Code

JSON tree traversal#4

Code

Open

karthikeyann wants to merge 70 commits intofea-json-tree-gpukarthikeyann/cudf:fea-json-tree-gpufrom fea-json-tree-traversalkarthikeyann/cudf:fea-json-tree-traversalCopy head branch name to clipboard

+8,779-1,178

Commits

Commits on Aug 26, 2022

• col_id generation for record orient

  karthikeyann

  committed
  93719e4

  Copy full SHA for 93719e4

Commits on Sep 6, 2022

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  d124241

  Copy full SHA for d124241

Commits on Sep 7, 2022

• row offset cpu version reference implementation

  karthikeyann

  committed
  522052e

  Copy full SHA for 522052e

• comment out debug prints in level processing for col_id

  karthikeyann

  committed
  e88d08f

  Copy full SHA for e88d08f

Commits on Sep 8, 2022

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  6591fa5

  Copy full SHA for 6591fa5

• initial code for row_offsets generation

  karthikeyann

  committed
  b85c01d

  Copy full SHA for b85c01d

Commits on Sep 9, 2022

• cleanup debug print functions, some functions to stable for debugging

  Show description for 5693ba6
  karthikeyann

  committed
  5693ba6

  Copy full SHA for 5693ba6

• fix bug: carry over col_id from previous stage due to sort reorder.

  karthikeyann

  committed
  73c613b

  Copy full SHA for 73c613b

Commits on Sep 12, 2022

• debug print json string in token order

  karthikeyann

  committed
  bffd961

  Copy full SHA for bffd961

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  f452f8a

  Copy full SHA for f452f8a

Commits on Sep 13, 2022

• skip restore parent_node_ids order by making a copy

  karthikeyann

  committed
  af399b3

  Copy full SHA for af399b3

Commits on Sep 15, 2022

• use NodeIndexT for col_ids type

  karthikeyann

  committed
  03e6826

  Copy full SHA for 03e6826

• create column_order from struct field order

  karthikeyann

  committed
  439cfa0

  Copy full SHA for 439cfa0

Commits on Sep 17, 2022

• documentation and cleanup

  karthikeyann

  committed
  222cd60

  Copy full SHA for 222cd60

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  a158220

  Copy full SHA for a158220

Commits on Sep 18, 2022

• copied pytest change from PR rapidsai#11574 to pass

  karthikeyann

  committed
  07caae7

  Copy full SHA for 07caae7

Commits on Sep 19, 2022

• fix memory error off-by-one write out of bounds

  karthikeyann

  committed
  900bdc1

  Copy full SHA for 900bdc1

• fix bug: call missing get_token call for node_range_end

  karthikeyann

  committed
  3b75751

  Copy full SHA for 3b75751

• wrap debug prints within debug macro flag

  karthikeyann

  committed
  2c2f43f

  Copy full SHA for 2c2f43f

• cleanup PRINT_LEVEL_DATA

  karthikeyann

  committed
  efbff72

  Copy full SHA for efbff72

• rename is_field_name_node lambda

  karthikeyann

  committed
  202f7aa

  Copy full SHA for 202f7aa

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  9f39a0e

  Copy full SHA for 9f39a0e

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  0a318a1

  Copy full SHA for 0a318a1

• Merge branch 'fea-json-tree-gpu' of github.com:karthikeyann/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  7fff746

  Copy full SHA for 7fff746

• add json-lines support in json tree traversal

  karthikeyann

  committed
  ee080ea

  Copy full SHA for ee080ea

• address review comments (removed unused 0 condition)

  karthikeyann

  committed
  cffaece

  Copy full SHA for cffaece

• Remove isort exclusions (rapidsai#11680)

  Show description for 482d8ed
  bdice

  authored
  482d8ed

  Copy full SHA for 482d8ed

• Transfer correct dtype to exploded column (rapidsai#11687)

  Show description for b2ffea7
  wence-

  authored
  b2ffea7

  Copy full SHA for b2ffea7

• Update to Thrust 1.17.2 to fix cub ODR issues (rapidsai#11665)

  Show description for 87f56e8
  robertmaynard

  authored
  87f56e8

  Copy full SHA for 87f56e8

• Adds GPU implementation of JSON-token-stream to JSON-tree (rapidsai#11518)

  Show description for bf2c751
  karthikeyann

  authored
  bf2c751

  Copy full SHA for bf2c751

Commits on Sep 20, 2022

• Adds type inference and type conversion for leaf-columns to the nested JSON parser (rapidsai#11574)

  Show description for 0ba4675
  elstehle

  authored
  0ba4675

  Copy full SHA for 0ba4675

• Merge branch 'branch-22.10' of github.com:rapidsai/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  1bc51b6

  Copy full SHA for 1bc51b6

• Add regex capture-group parameter to auto convert to non-capture groups (rapidsai#11695)

  Show description for d10406f
  davidwendt

  authored
  d10406f

  Copy full SHA for d10406f

• Add read-only functions on string dtypes to DataFrame.apply and Series.apply (rapidsai#11319)

  Show description for 0528b38
  brandon-b-miller

  authored
  0528b38

  Copy full SHA for 0528b38

• address review comments, reduce level_boundaries memory usage

  karthikeyann

  committed
  a87f08d

  Copy full SHA for a87f08d

Commits on Sep 21, 2022

• Upgrade pandas to 1.5 (rapidsai#11617)

  Show description for 387c5ff
  galipremsagar

  authored
  387c5ff

  Copy full SHA for 387c5ff

• Don't assume stream is a compile-time constant expression (rapidsai#11725)

  Show description for 5c91739
  vyasr

  authored
  5c91739

  Copy full SHA for 5c91739

• cleanup, optimizations - use scatter, skip needless restore order by sort of vectors

  karthikeyann

  committed
  68f2968

  Copy full SHA for 68f2968

• use size_type for NodeIndexT, -1 as parent_node_sentinel

  Show description for 353dcc8
  karthikeyann

  committed
  353dcc8

  Copy full SHA for 353dcc8

• Merge branch 'branch-22.10' of github.com:rapidsai/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  a729729

  Copy full SHA for a729729

• move debug print to anonymous namespace, cleanup comments

  karthikeyann

  committed
  8ef4a4b

  Copy full SHA for 8ef4a4b

• cleanup compare_vector, debug print with env,

  Show description for d3e48c7
  karthikeyann

  committed
  d3e48c7

  Copy full SHA for d3e48c7

• Add a __dataframe__ method to the protocol dataframe object (rapidsai#11692)

  Show description for 02d5e83
  rgommers

  authored
  02d5e83

  Copy full SHA for 02d5e83

Commits on Sep 22, 2022

• Adds option to take explicit nested schema for nested JSON reader (rapidsai#11682)

  Show description for a91853d
  elstehle

  authored
  a91853d

  Copy full SHA for a91853d

• address review comments

  karthikeyann

  committed
  113ea64

  Copy full SHA for 113ea64

• replace merge sort stable with 2 radix stable sort

  karthikeyann

  committed
  173065d

  Copy full SHA for 173065d

• Refactor CSV reader benchmarks with nvbench (rapidsai#11678)

  Show description for d4f46fc
  PointKernel

  authored
  d4f46fc

  Copy full SHA for d4f46fc

• reorganise code into functions

  karthikeyann

  committed
  619bb72

  Copy full SHA for 619bb72

• Refactor parquet writer benchmarks with nvbench (rapidsai#11623)

  Show description for 46bd87a
  PointKernel

  authored
  46bd87a

  Copy full SHA for 46bd87a

• cleanup debug prints verbose typing

  karthikeyann

  committed
  898bd25

  Copy full SHA for 898bd25

• Fix ORC string sum statistics (rapidsai#11740)

  Show description for f227d7d
  vuule

  authored
  f227d7d

  Copy full SHA for f227d7d

• Update libcudf documentation build command in DOCUMENTATION.md (rapidsai#11735)

  Show description for 5430fbd
  davidwendt

  authored
  5430fbd

  Copy full SHA for 5430fbd

• Disable very large column gtest for contiguous-split (rapidsai#11706)

  Show description for 9363095
  davidwendt

  authored
  9363095

  Copy full SHA for 9363095

• move parent_indices translation to a function

  karthikeyann

  committed
  2791684

  Copy full SHA for 2791684

• Update cpp/tests/io/json_tree.cpp

  Show description for 24a65a9
  

  karthikeyann

  and

  elstehle

  authored
  24a65a9

  Copy full SHA for 24a65a9

• Add strings_udf package for python 3.9 (rapidsai#11730)

  Show description for 25e5e17
  brandon-b-miller

  authored
  25e5e17

  Copy full SHA for 25e5e17

• Reduces memory requirements in JSON parser and adds bytes/s and peak memory usage to benchmarks (rapidsai#11732)

  Show description for 204a09c
  elstehle

  authored
  204a09c

  Copy full SHA for 204a09c

• address review comments

  karthikeyann

  committed
  66e1c7f

  Copy full SHA for 66e1c7f

• Merge branch 'branch-22.10' of github.com:rapidsai/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  e11da8d

  Copy full SHA for e11da8d

Commits on Sep 23, 2022

• address review comments

  karthikeyann

  committed
  1239514

  Copy full SHA for 1239514

• remove NVTX (helps code review)

  karthikeyann

  committed
  ecb64be

  Copy full SHA for ecb64be

• Add ability to construct ListColumn when size is None (rapidsai#11745)

  Show description for 451c837
  galipremsagar

  authored
  451c837

  Copy full SHA for 451c837

• removed debug prints

  karthikeyann

  committed
  3eb8326

  Copy full SHA for 3eb8326

• performance changes, replace sort with scatter

  karthikeyann

  committed
  f9e2837

  Copy full SHA for f9e2837

• remove default arg to stream

  karthikeyann

  committed
  7126c07

  Copy full SHA for 7126c07

• address review comments (davidwendt)

  karthikeyann

  committed
  d898aba

  Copy full SHA for d898aba

• move sequence to scope of for-loop

  karthikeyann

  committed
  aafab03

  Copy full SHA for aafab03

• Resolve dask_cudf failures caused by upstream groupby changes (rapidsai#11755)

  Show description for d9f2c2b
  rjzamora

  authored
  d9f2c2b

  Copy full SHA for d9f2c2b

• Ensure that all tests launch kernels on cudf's default stream (rapidsai#11726)

  Show description for 9a5f39a
  vyasr

  authored
  9a5f39a

  Copy full SHA for 9a5f39a

Commits on Sep 24, 2022

• Merge branch 'branch-22.10' of github.com:rapidsai/cudf into fea-json-tree-traversal

  karthikeyann

  committed
  888a83f

  Copy full SHA for 888a83f