Code

Model updates with side inputs#25174

Code

Closed

AnandInguva wants to merge 26 commits intoapache:masterapache/beam:masterfrom AnandInguva:model_update_apiAnandInguva/beam:model_update_apiCopy head branch name to clipboard

+382-119

Commits

Commits on Jan 21, 2023

• Add model pcoll param to the RunInference Ptransform

  Show description for 74d72cf
  AnandInguva

  committed
  74d72cf

• Add sklearn side input example

  Show description for 36a7db4
  AnandInguva

  committed
  36a7db4

• Add WatchFilePattern PTransform

  AnandInguva

  committed
  40b3d19

• Add ModeMetadata and some refactoring

  Show description for 857766d
  AnandInguva

  committed
  857766d

• Add GetLatestFileByTimeStamp

  Show description for 9d59040
  AnandInguva

  committed
  9d59040

• refactor _convert_to_result and add it to the utils.py

  Show description for 3aa4c8c
  AnandInguva

  committed
  3aa4c8c

• Add tag to the RunInference DoFn

  AnandInguva

  committed
  f87ceb9

• Add enable_side_input_loading flag

  AnandInguva

  committed
  f82238b

• Add helper functions

  Show description for 485bfd1
  AnandInguva

  committed
  485bfd1

• Add doc string, refactor utils code

  AnandInguva

  committed
  02a2386

• Fix pytorch inference tests

  AnandInguva

  committed
  3f2bb77

Commits on Jan 23, 2023

• Fix up sklearn inference

  AnandInguva

  committed
  1e41460

Commits on Jan 24, 2023

• Remove logging

  AnandInguva

  committed
  6dc0a18

Commits on Jan 25, 2023

• Add thread Lock when there is an update to side input

  AnandInguva

  committed
  57fbd5c

• Check if side input is EmptySideInput

  AnandInguva

  committed
  9768aac

• Change interval on processing time

  AnandInguva

  committed
  ddb4663

• Add unit test for side input loading

  AnandInguva

  committed
  8fde482

• Remove examples

  AnandInguva

  committed
  3eeae3c

• Add log when side input path is updated

  AnandInguva

  committed
  193e561

Commits on Jan 26, 2023

• Add test to Dataflow

  AnandInguva

  committed
  f709338

• Fix snippets tests

  AnandInguva

  committed
  dfde454

• revert build settings

  AnandInguva

  committed
  d678794

• Fix lint

  AnandInguva

  committed
  20d8a4a

• Refactor side input loading code

  AnandInguva

  committed
  18b33a2

• Add model_id to PredictionResult

  AnandInguva

  committed
  99e14f8

Commits on Jan 27, 2023

• Add documentation, changelog

  AnandInguva

  committed
  5e7ca32