Code

Update#23

Code

Merged

YanTangZhai merged 49 commits intoYanTangZhai:SPARK-4692YanTangZhai/spark:SPARK-4692from apache:masterapache/spark:masterCopy head branch name to clipboardDec 31, 2014

+2,865-686

Commits

Commits on Dec 24, 2014

• [SPARK-4881][Minor] Use SparkConf#getBoolean instead of get().toBoolean

  Show description for 199e59a
  

  sarutak

  authored and

  JoshRosen

  committed
  199e59a

  Copy full SHA for 199e59a

• SPARK-4297 [BUILD] Build warning fixes omnibus

  Show description for 29fabb1
  

  srowen

  authored and

  JoshRosen

  committed
  29fabb1

  Copy full SHA for 29fabb1

Commits on Dec 25, 2014

• [SPARK-4873][Streaming] Use Future.zip instead of Future.flatMap(for-loop) in WriteAheadLogBasedBlockHandler

  Show description for b4d0db8
  

  zsxwing

  authored and

  tdas

  committed
  b4d0db8

  Copy full SHA for b4d0db8

• [SPARK-4953][Doc] Fix the description of building Spark with YARN

  Show description for 11dd993
  

  sarutak

  authored and

  pwendell

  committed
  11dd993

  Copy full SHA for 11dd993

• Fix "Building Spark With Maven" link in README.md

  Show description for 08b18c7
  

  dennyglee

  authored and

  JoshRosen

  committed
  08b18c7

  Copy full SHA for 08b18c7

• [EC2] Update default Spark version to 1.2.0

  Show description for b6b6393
  

  nchammas

  authored and

  JoshRosen

  committed
  b6b6393

  Copy full SHA for b6b6393

• [EC2] Update mesos/spark-ec2 branch to branch-1.3

  Show description for ac82785
  

  nchammas

  authored and

  JoshRosen

  committed
  ac82785

  Copy full SHA for ac82785

Commits on Dec 26, 2014

• [SPARK-4537][Streaming] Expand StreamingSource to add more metrics

  Show description for f205fe4
  

  jerryshao

  authored and

  tdas

  committed
  f205fe4

  Copy full SHA for f205fe4

• [SPARK-4608][Streaming] Reorganize StreamingContext implicit to improve API convenience

  Show description for f9ed2b6
  

  zsxwing

  authored and

  tdas

  committed
  f9ed2b6

  Copy full SHA for f9ed2b6

• SPARK-4971: Fix typo in BlockGenerator comment

  Show description for fda4331
  

  CodingCat

  authored and

  JoshRosen

  committed
  fda4331

  Copy full SHA for fda4331

Commits on Dec 27, 2014

• MAINTENANCE: Automated closing of pull requests.

  Show description for 534f24b
  pwendell

  committed
  534f24b

  Copy full SHA for 534f24b

• [SPARK-3787][BUILD] Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version

  Show description for de95c57
  

  sarutak

  authored and

  pwendell

  committed
  de95c57

  Copy full SHA for de95c57

• HOTFIX: Slight tweak on previous commit.

  Show description for 82bf4be
  pwendell

  committed
  82bf4be

  Copy full SHA for 82bf4be

• [SPARK-3955] Different versions between jackson-mapper-asl and jackson-c...

  Show description for 2483c1e
  

  jongyoul

  authored and

  pwendell

  committed
  2483c1e

  Copy full SHA for 2483c1e

• [SPARK-4954][Core] add spark version infomation in log for standalone mode

  Show description for 786808a
  

  liyezhang556520

  authored and

  pwendell

  committed
  786808a

  Copy full SHA for 786808a

• [SPARK-4952][Core]Handle ConcurrentModificationExceptions in SparkEnv.environmentDetails

  Show description for 080ceb7
  

  witgo

  authored and

  pwendell

  committed
  080ceb7

  Copy full SHA for 080ceb7

• [SPARK-4501][Core] - Create build/mvn to automatically download maven/zinc/scalac

  Show description for a3e51cc
  

  Brennon York

  authored and

  pwendell

  committed
  a3e51cc

  Copy full SHA for a3e51cc

Commits on Dec 29, 2014

• [SPARK-4966][YARN]The MemoryOverhead value is setted not correctly

  Show description for 14fa87b
  

  XuTingjun

  authored and

  tgravescs

  committed
  14fa87b

  Copy full SHA for 14fa87b

• [SPARK-4982][DOC] spark.ui.retainedJobs description is wrong in Spark UI configuration guide

  Show description for 6645e52
  

  wangxiaojing

  authored and

  JoshRosen

  committed
  6645e52

  Copy full SHA for 6645e52

• Adde LICENSE Header to build/mvn, build/sbt and sbt/sbt

  Show description for 4cef05e
  

  sarutak

  authored and

  JoshRosen

  committed
  4cef05e

  Copy full SHA for 4cef05e

• [SPARK-4946] [CORE] Using AkkaUtils.askWithReply in MapOutputTracker.askTracker to reduce the chance of the communicating problem

  Show description for 815de54
  

  YanTangZhai

  authored and

  JoshRosen

  committed
  815de54

  Copy full SHA for 815de54

• [Minor] Fix a typo of type parameter in JavaUtils.scala

  Show description for 8d72341
  

  sarutak

  authored and

  rxin

  committed
  8d72341

  Copy full SHA for 8d72341

• [SPARK-4409][MLlib] Additional Linear Algebra Utils

  Show description for 02b55de
  

  brkyvz

  authored and

  mengxr

  committed
  02b55de

  Copy full SHA for 02b55de

• SPARK-4968: takeOrdered to skip reduce step in case mappers return no partitions

  Show description for 9bc0df6
  

  Yash Datta

  authored and

  rxin

  committed
  9bc0df6

  Copy full SHA for 9bc0df6

• SPARK-4156 [MLLIB] EM algorithm for GMMs

  Show description for 6cf6fdf
  

  tgaloppo

  authored and

  mengxr

  committed
  6cf6fdf

  Copy full SHA for 6cf6fdf

• Added setMinCount to Word2Vec.scala

  Show description for 343db39
  

  ganonp

  authored and

  mengxr

  committed
  343db39

  Copy full SHA for 343db39

Commits on Dec 30, 2014

• [SPARK-4972][MLlib] Updated the scala doc for lasso and ridge regression for the change of LeastSquaresGradient

  Show description for 040d6f2
  

  DB Tsai

  authored and

  mengxr

  committed
  040d6f2

  Copy full SHA for 040d6f2

• [SPARK-4920][UI] add version on master and worker page for standalone mode

  Show description for 9077e72
  

  liyezhang556520

  authored and

  JoshRosen

  committed
  9077e72

  Copy full SHA for 9077e72

• [SPARK-4882] Register PythonBroadcast with Kryo so that PySpark works with KryoSerializer

  Show description for efa80a5
  JoshRosen

  committed
  efa80a5

  Copy full SHA for efa80a5

• [SPARK-4908][SQL] Prevent multiple concurrent hive native commands

  Show description for 480bd1d
  marmbrus

  committed
  480bd1d

  Copy full SHA for 480bd1d

• [SQL] enable view test

  Show description for 94d60b7
  

  adrian-wang

  authored and

  marmbrus

  committed
  94d60b7

  Copy full SHA for 94d60b7

• [SPARK-4975][SQL] Fix HiveInspectorSuite test failure

  Show description for 65357f1
  

  scwf

  authored and

  marmbrus

  committed
  65357f1

  Copy full SHA for 65357f1

• [SPARK-4959] [SQL] Attributes are case sensitive when using a select query from a projection

  Show description for 5595eaa
  

  chenghao-intel

  authored and

  marmbrus

  committed
  5595eaa

  Copy full SHA for 5595eaa

• [SPARK-4904] [SQL] Remove the unnecessary code change in Generic UDF

  Show description for 63b84b7
  

  chenghao-intel

  authored and

  marmbrus

  committed
  63b84b7

  Copy full SHA for 63b84b7

• [SPARK-5002][SQL] Using ascending by default when not specify order in order by

  Show description for daac221
  

  scwf

  authored and

  marmbrus

  committed
  daac221

  Copy full SHA for daac221

• [Spark-4512] [SQL] Unresolved Attribute Exception in Sort By

  Show description for 53f0a00
  

  chenghao-intel

  authored and

  marmbrus

  committed
  53f0a00

  Copy full SHA for 53f0a00

• [SPARK-4493][SQL] Tests for IsNull / IsNotNull in the ParquetFilterSuite

  Show description for 19a8802
  

  liancheng

  authored and

  marmbrus

  committed
  19a8802

  Copy full SHA for 19a8802

• [SPARK-4916][SQL][DOCS]Update SQL programming guide about cache section

  Show description for f7a41a0
  

  luogankun

  authored and

  marmbrus

  committed
  f7a41a0

  Copy full SHA for f7a41a0

• [SPARK-4930][SQL][DOCS]Update SQL programming guide, CACHE TABLE is eager

  Show description for 2deac74
  

  luogankun

  authored and

  marmbrus

  committed
  2deac74

  Copy full SHA for 2deac74

• [SPARK-4928][SQL] Fix: Operator '>,<,>=,<=' with decimal between different precision report error

  Show description for a75dd83
  

  guowei2

  authored and

  marmbrus

  committed
  a75dd83

  Copy full SHA for a75dd83

• [SPARK-4937][SQL] Normalizes conjunctions and disjunctions to eliminate common predicates

  Show description for 61a99f6
  

  liancheng

  authored and

  marmbrus

  committed
  61a99f6

  Copy full SHA for 61a99f6

• [SPARK-4386] Improve performance when writing Parquet files

  Show description for 7425bec
  

  MickDavies

  authored and

  marmbrus

  committed
  7425bec

  Copy full SHA for 7425bec

• [SPARK-4935][SQL] When hive.cli.print.header configured, spark-sql aborted if passed in a invalid sql

  Show description for 8f29b7c
  

  scwf

  authored and

  marmbrus

  committed
  8f29b7c

  Copy full SHA for 8f29b7c

• [SPARK-4570][SQL]add BroadcastLeftSemiJoinHash

  Show description for 07fa191
  

  wangxiaojing

  authored and

  marmbrus

  committed
  07fa191

  Copy full SHA for 07fa191

• SPARK-3955 part 2 [CORE] [HOTFIX] Different versions between jackson-mapper-asl and jackson-core-asl

  Show description for b239ea1
  

  srowen

  authored and

  pwendell

  committed
  b239ea1

  Copy full SHA for b239ea1

• [Spark-4995] Replace Vector.toBreeze.activeIterator with foreachActive

  Show description for 0f31992
  

  Jakub Dubovsky

  authored and

  mengxr

  committed
  0f31992

  Copy full SHA for 0f31992

• [SPARK-4813][Streaming] Fix the issue that ContextWaiter didn't handle 'spurious wakeup'

  Show description for 6a89782
  

  zsxwing

  authored and

  tdas

  committed
  6a89782

  Copy full SHA for 6a89782

• [SPARK-4998][MLlib]delete the "train" function

  Show description for 035bac8
  

  ljzzju

  authored and

  mengxr

  committed
  035bac8

  Copy full SHA for 035bac8

Commits on Dec 31, 2014

• [SPARK-1010] Clean up uses of System.setProperty in unit tests

  Show description for 352ed6b
  JoshRosen

  committed
  352ed6b

  Copy full SHA for 352ed6b