Code

Add implementation. Closes #1#2

Code

Merged

juliangruber merged 56 commits intomainfilecoin-station/spark:mainfrom add/implementationfilecoin-station/spark:add/implementationCopy head branch name to clipboardMay 31, 2023

+260

Commits

Commits on May 24, 2023

• docs

  juliangruber

  committed
  7d7f52f

  Copy full SHA for 7d7f52f

• add get job from orchestrator

  juliangruber

  committed
  efbe295

  Copy full SHA for efbe295

• style

  juliangruber

  committed
  9bdc77c

  Copy full SHA for 9bdc77c

• add fetch car via saturn gateway

  juliangruber

  committed
  6e91bb4

  Copy full SHA for 6e91bb4

• add submit success to ingestor

  juliangruber

  committed
  363c56d

  Copy full SHA for 363c56d

• fix submit retrieval

  juliangruber

  committed
  9069c91

  Copy full SHA for 9069c91

• log

  juliangruber

  committed
  83db140

  Copy full SHA for 83db140

• refactor

  juliangruber

  committed
  327ad17

  Copy full SHA for 327ad17

• add loop

  juliangruber

  committed
  2662dfa

  Copy full SHA for 2662dfa

• more stable loop

  juliangruber

  committed
  911f11d

  Copy full SHA for 911f11d

• call Zinnia.jobCompleted()

  juliangruber

  committed
  d95b315

  Copy full SHA for d95b315

• collect ttfb

  juliangruber

  committed
  1c5b98d

  Copy full SHA for 1c5b98d

• add response status

  juliangruber

  committed
  378d42d

  Copy full SHA for 378d42d

• abort early if res not ok

  juliangruber

  committed
  fdc6458

  Copy full SHA for fdc6458

• refactor

  juliangruber

  committed
  a577f9a

  Copy full SHA for a577f9a

• add read timeout

  juliangruber

  committed
  0cebf09

  Copy full SHA for 0cebf09

• report error activity

  juliangruber

  committed
  4310754

  Copy full SHA for 4310754

• clean up

  juliangruber

  committed
  2d5c611

  Copy full SHA for 2d5c611

• refactor

  juliangruber

  committed
  6206c73

  Copy full SHA for 6206c73

• refactor

  juliangruber

  committed
  cf6dfb3

  Copy full SHA for cf6dfb3

• start test suite

  juliangruber

  committed
  cabc58d

  Copy full SHA for cabc58d

• add ci

  juliangruber

  committed
  02ed3ee

  Copy full SHA for 02ed3ee

• refactor

  juliangruber

  committed
  79f9935

  Copy full SHA for 79f9935

Commits on May 29, 2023

• test

  juliangruber

  committed
  00885d0

  Copy full SHA for 00885d0

• add retries to integration test

  juliangruber

  committed
  71ffb22

  Copy full SHA for 71ffb22

• fix ci

  juliangruber

  committed
  08c5568

  Copy full SHA for 08c5568

• add unit test

  juliangruber

  committed
  2a4cd08

  Copy full SHA for 2a4cd08

• simplify, add unit test

  juliangruber

  committed
  6dc0cc9

  Copy full SHA for 6dc0cc9

• add unit test

  juliangruber

  committed
  826d648

  Copy full SHA for 826d648

• todo

  juliangruber

  committed
  2c41f31

  Copy full SHA for 2c41f31

• todo

  juliangruber

  committed
  9cf1e65

  Copy full SHA for 9cf1e65

• more tests

  juliangruber

  committed
  ab157fc

  Copy full SHA for ab157fc

• add submit more fields

  juliangruber

  committed
  da0fd27

  Copy full SHA for da0fd27

• fmt

  juliangruber

  committed
  353c835

  Copy full SHA for 353c835

Commits on May 30, 2023

• module.js -> main.js

  juliangruber

  committed
  a140c93

  Copy full SHA for a140c93

• ci: add lint

  juliangruber

  committed
  ee4ba4f

  Copy full SHA for ee4ba4f

• docs

  juliangruber

  committed
  800e5b7

  Copy full SHA for 800e5b7

• add receive headers timeout

  juliangruber

  committed
  acb147e

  Copy full SHA for acb147e

• add ActivityState

  juliangruber

  committed
  85d2135

  Copy full SHA for 85d2135

• move test/all.js to test.js

  juliangruber

  committed
  a9427e3

  Copy full SHA for a9427e3

• add missing throw in integration test

  juliangruber

  committed
  838e2a2

  Copy full SHA for 838e2a2

• refactor using async iterator syntax

  juliangruber

  committed
  ce7b5c6

  Copy full SHA for ce7b5c6

Commits on May 31, 2023

• fix lint

  juliangruber

  committed
  2dc0c03

  Copy full SHA for 2dc0c03

• allow more attempts for integration tests

  juliangruber

  committed
  62f8cce

  Copy full SHA for 62f8cce

• add test order, arguments and length of fetch calls

  juliangruber

  committed
  633798c

  Copy full SHA for 633798c

• fix submitRetrieval + test

  juliangruber

  committed
  dfc6707

  Copy full SHA for dfc6707

• fix lint

  juliangruber

  committed
  27e7832

  Copy full SHA for 27e7832

• fix tests and condition

  juliangruber

  committed
  7e0ca9f

  Copy full SHA for 7e0ca9f

• update spark-api schema

  juliangruber

  committed
  e97820e

  Copy full SHA for e97820e

• add check retrieval from api

  juliangruber

  committed
  c157dc0

  Copy full SHA for c157dc0

• include status code in error message

  juliangruber

  committed
  0cb2abe

  Copy full SHA for 0cb2abe

• startTimeout -> resetTimeout

  juliangruber

  committed
  5d514b1

  Copy full SHA for 5d514b1

• make stats also accessible if retrieval fails

  juliangruber

  committed
  b04e901

  Copy full SHA for b04e901

• use activity class

  juliangruber

  committed
  89e3d05

  Copy full SHA for 89e3d05

• add assert res.ok

  juliangruber

  committed
  33775e5

  Copy full SHA for 33775e5

• fix lint

  juliangruber

  committed
  5167c71

  Copy full SHA for 5167c71