3c-spark.txt

Amazon (AWS) EMR 
Bootstrap Actions:

S3 location:  s3://support.elasticmapreduce/spark/install-spark
Optional arguments:  -x

-x: Prepares the default Spark config for dedicated Spark single application use [1 executor per node, 
num of executors equivalent to core nodes at creation of cluster, all memory/vcores allocated]



/home/hadoop/spark/bin/spark-sql --master yarn-client

use benchm;


select x, avg(y) as ym 
from d 
group by x
order by ym desc 
limit 5;

select count(*) as cnt 
from d
inner join dm on d.x = dm.x;



cache table dm;
cache table d;