Locust issue in multinode mocknet/ft-bench: no txs send when num-passive-users is high

[mooori]

Following this guide to set up a multinode statelessnet ft benchmark, I can successfully run the first two locust workloads (touching no and little state). The third workload touching all of the state does not send any transactions. The only difference to the little state workload is the value of num-passive-users.

Side note: I think the IP in the third workload is wrong, instead of -H 34.79.130.22:3030 it should be -H 127.0.0.1:3030 as in the workloads above.

Executing the command just creates users and then exits without sending requests and without printing an error. This is what the end of the logs look like:

[2024-08-28 13:24:47,782] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 490/500, created 4900000 users
[2024-08-28 13:24:47,933] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 491/500, created 4910000 users
[2024-08-28 13:24:48,083] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 492/500, created 4920000 users
[2024-08-28 13:24:48,234] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 493/500, created 4930000 users
[2024-08-28 13:24:48,384] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 494/500, created 4940000 users
[2024-08-28 13:24:48,535] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 495/500, created 4950000 users
[2024-08-28 13:24:48,685] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 496/500, created 4960000 users
[2024-08-28 13:24:48,834] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 497/500, created 4970000 users
[2024-08-28 13:24:48,984] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 498/500, created 4980000 users
[2024-08-28 13:24:49,135] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 499/500, created 4990000 users
[2024-08-28 13:24:49,285] mocknet-crt-benchmark-traffic/INFO/root: node0: Processed batch 500/500, created 5000000 users
[2024-08-28 13:24:49,285] mocknet-crt-benchmark-traffic/INFO/root: Finished setup for account 0 on worker node0
[2024-08-28 13:24:49,286] mocknet-crt-benchmark-traffic/INFO/locust.main: No run time limit set, use CTRL+C to interrupt
[2024-08-28 13:24:49,286] mocknet-crt-benchmark-traffic/INFO/locust.main: Starting Locust 2.31.4
Type     Name                                                                          # reqs      # fails |    Avg     Min     Max    Med |   req/s  failures/s
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
         Aggregated                                                                         0     0(0.00%) |      0       0       0      0 |    0.00        0.00

[2024-08-28 13:24:49,286] mocknet-crt-benchmark-traffic/INFO/locust.runners: Sending spawn jobs of 2000 users at 100.00 spawn rate to 8 ready workers
[2024-08-28 13:24:49,289] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_d21ce36549074d3cbf973b67c35ded28' (index 7) quit. 7 workers ready.
[2024-08-28 13:24:49,290] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_499956c343b948e79b655d714af75d52' (index 4) quit. 6 workers ready.
[2024-08-28 13:24:49,290] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_18aaaf4fcdf04e44b0d5da960a9b2f93' (index 1) quit. 5 workers ready.
[2024-08-28 13:24:49,290] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_211e51ec93b04688853bb883ba3e64b9' (index 3) quit. 4 workers ready.
[2024-08-28 13:24:49,290] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_173ed5b756ba4741bb232befa9503ad9' (index 2) quit. 3 workers ready.
[2024-08-28 13:24:49,290] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_306371a793cc4113bdca814464b503df' (index 6) quit. 2 workers ready.
[2024-08-28 13:24:49,290] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_f097d0d8ae9a4c83b26dc85045008eb4' (index 0) quit. 1 workers ready.
[2024-08-28 13:24:49,291] mocknet-crt-benchmark-traffic/INFO/locust.runners: Worker 'mocknet-crt-benchmark-traffic_ff0c3f9a024346019ab62277cd8c4477' (index 5) quit. 0 workers ready.
[2024-08-28 13:24:49,291] mocknet-crt-benchmark-traffic/INFO/locust.runners: The last worker quit, stopping test.
[2024-08-28 13:24:50,292] mocknet-crt-benchmark-traffic/INFO/locust.main: Shutting down (exit code 0)
Type     Name                                                                          # reqs      # fails |    Avg     Min     Max    Med |   req/s  failures/s
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
--------|----------------------------------------------------------------------------|-------|-------------|-------|-------|-------|-------|--------|-----------
         Aggregated                                                                         0     0(0.00%) |      0       0       0      0 |    0.00        0.00

Response time percentiles (approximated)
Type     Name                                                                                  50%    66%    75%    80%    90%    95%    98%    99%  99.9% 99.99%   100% # reqs
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------
--------|--------------------------------------------------------------------------------|--------|------|------|------|------|------|------|------|------|------|------|------