Optimize failed key processing by indexing workitems by shardingkey + workid #38332
Triggered via pull request
January 24, 2025 16:40
arunpandianp
synchronize
#33755
Status
Success
Total duration
3m 9s
Artifacts
–
beam_PreCommit_RAT.yml
on: pull_request_target
Matrix: beam_PreCommit_RAT
Annotations
8 warnings and 21 notices
beam_PreCommit_RAT (Run RAT PreCommit)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-java@v3, gradle/gradle-build-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
testConsumedWorkItems_itemsSplitAcrossResponses (org.apache.beam.runners.dataflow.worker.windmill.client.grpc.GrpcDirectGetWorkStreamTest) failed:
org.apache.beam.runners.dataflow.worker.windmill.client.grpc.GrpcDirectGetWorkStreamTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.windmill.client.grpc.GrpcDirectGetWorkStreamTest.xml [took 10m 0s]
|
testRequestKeyedData_sendOnShutdownStreamThrowsWindmillStreamShutdownException (org.apache.beam.runners.dataflow.worker.windmill.client.grpc.GrpcGetDataStreamTest) failed:
org.apache.beam.runners.dataflow.worker.windmill.client.grpc.GrpcGetDataStreamTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.windmill.client.grpc.GrpcGetDataStreamTest.xml [took 10m 0s]
|
testIgnoreRetriedKeys[0: [streamingEngine=false]] (org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest) failed:
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.xml [took 10m 0s]
|
testNumberOfWorkerHarnessThreadsIsHonored[0: [streamingEngine=false]] (org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest) failed:
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.xml [took 10s]
|
testIgnoreRetriedKeys[1: [streamingEngine=true]] (org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest) failed:
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.xml [took 10m 0s]
|
testNumberOfWorkerHarnessThreadsIsHonored[1: [streamingEngine=true]] (org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest) failed:
org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.xml [took 10s]
|
testOnNewWorkerMetadata_redistributesBudget (org.apache.beam.runners.dataflow.worker.streaming.harness.FanOutStreamingEngineWorkerHarnessTest) failed:
org.apache.beam.runners.dataflow.worker.streaming.harness.FanOutStreamingEngineWorkerHarnessTest#L0
runners/google-cloud-dataflow-java/worker/build/test-results/test/TEST-org.apache.beam.runners.dataflow.worker.streaming.harness.FanOutStreamingEngineWorkerHarnessTest.xml [took 1m 0s]
|
7 tests found
There are 7 tests, see "Raw output" for the full list of tests.
|
4 tests found
There are 4 tests, see "Raw output" for the full list of tests.
|
48 skipped tests found
There are 48 skipped tests, see "Raw output" for the full list of skipped tests.
|
9869 tests found (test 1 to 689)
There are 9869 tests, see "Raw output" for the list of tests 1 to 689.
|
9869 tests found (test 690 to 1263)
There are 9869 tests, see "Raw output" for the list of tests 690 to 1263.
|
9869 tests found (test 1264 to 1869)
There are 9869 tests, see "Raw output" for the list of tests 1264 to 1869.
|
9869 tests found (test 1870 to 2414)
There are 9869 tests, see "Raw output" for the list of tests 1870 to 2414.
|
9869 tests found (test 2415 to 2970)
There are 9869 tests, see "Raw output" for the list of tests 2415 to 2970.
|
9869 tests found (test 2971 to 3221)
There are 9869 tests, see "Raw output" for the list of tests 2971 to 3221.
|
9869 tests found (test 3222 to 3472)
There are 9869 tests, see "Raw output" for the list of tests 3222 to 3472.
|
9869 tests found (test 3473 to 4130)
There are 9869 tests, see "Raw output" for the list of tests 3473 to 4130.
|
9869 tests found (test 4131 to 4805)
There are 9869 tests, see "Raw output" for the list of tests 4131 to 4805.
|
9869 tests found (test 4806 to 5501)
There are 9869 tests, see "Raw output" for the list of tests 4806 to 5501.
|
9869 tests found (test 5502 to 6032)
There are 9869 tests, see "Raw output" for the list of tests 5502 to 6032.
|
9869 tests found (test 6033 to 6554)
There are 9869 tests, see "Raw output" for the list of tests 6033 to 6554.
|
9869 tests found (test 6555 to 7109)
There are 9869 tests, see "Raw output" for the list of tests 6555 to 7109.
|
9869 tests found (test 7110 to 7776)
There are 9869 tests, see "Raw output" for the list of tests 7110 to 7776.
|
9869 tests found (test 7777 to 8544)
There are 9869 tests, see "Raw output" for the list of tests 7777 to 8544.
|
9869 tests found (test 8545 to 9259)
There are 9869 tests, see "Raw output" for the list of tests 8545 to 9259.
|
9869 tests found (test 9260 to 9632)
There are 9869 tests, see "Raw output" for the list of tests 9260 to 9632.
|
9869 tests found (test 9633 to 9869)
There are 9869 tests, see "Raw output" for the list of tests 9633 to 9869.
|