Code

Stages nodes#39

Code

Open

mayurdb wants to merge 9 commits intoqubole:masterqubole/sparklens:masterfrom mayurdb:StagesNodesmayurdb/sparklens:StagesNodesCopy head branch name to clipboard

+361-26

Commits

Commits on Jun 28, 2019

• Added a separate listener for SQL events

  

  Mayur Bhosale

  committed
  dd3a69d

  Copy full SHA for dd3a69d

Commits on Jul 1, 2019

• Added a generic framework for adding new metrices

  

  Mayur Bhosale

  committed
  1a83945

  Copy full SHA for 1a83945

• Handling exception while handling parsing the old sparklens JSONs

  

  Mayur Bhosale

  committed
  d780597

  Copy full SHA for d780597

• Method names refactoring

  

  Mayur Bhosale

  committed
  3ab8730

  Copy full SHA for 3ab8730

Commits on Jul 2, 2019

• Moved the metrics collection code out of the listener

  

  Mayur Bhosale

  committed
  24c90f9

  Copy full SHA for 24c90f9

• SQLMetrics JSON serialization and de-serialization for offline reporting

  

  Mayur Bhosale

  committed
  86cf929

  Copy full SHA for 86cf929

Commits on Jul 3, 2019

• Collect RDD Ids only instead of collecting the entire RDDInfo objects

  

  Mayur Bhosale

  committed
  9e22da3

  Copy full SHA for 9e22da3

• Finalize serializing and deserializing the SQLMetrics to the sparklens json for offline reporting

  

  Mayur Bhosale

  committed
  bece515

  Copy full SHA for bece515

Commits on Jul 8, 2019

• Proper handling of the SparkListener and QueryExecutionListener

  

  Mayur Bhosale

  committed
  25afe44

  Copy full SHA for 25afe44