Skip to content

Commit

Permalink
[SNAP-1067] Optimizations seen in perf analysis related to SnappyData…
Browse files Browse the repository at this point in the history
… PR#381 (#11)

 - added hashCode/equals to UnsafeMapData and optimized hashing/equals for Decimal
   (assuming scale is same for both as in the calls from Spark layer)
 - optimizations to UTF8String: cached "isAscii" and "hash"
 - more efficient ByteArrayMethods.arrayEquals (~3ns vs ~9ns for 15 byte array)
 - reverting aggregate attribute changes (nullability optimization) from Spark layer and instead take care of it on the SnappyData layer; also reverted other changes in HashAggregateExec made earlier for AQP and nullability
 - copy spark-version-info in generateSources target for IDEA
 - updating snappy-spark version after the merge

Conflicts:
	build.gradle
	sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala
  • Loading branch information
Sumedh Wale authored and ymahajan committed Mar 2, 2018
1 parent 1694567 commit 0c52ebd
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -323,7 +323,7 @@ case class HashAggregateExec(
private val bufferSchema = StructType.fromAttributes(aggregateBufferAttributesForGroup)

// The name for Fast HashMap
private var fastHashMapTerm: String = _
b private var fastHashMapTerm: String = _
private var isFastHashMapEnabled: Boolean = false

// whether a vectorized hashmap is used instead
Expand Down

0 comments on commit 0c52ebd

Please sign in to comment.