Skip to content

Benchmark Asterinas #238

Benchmark Asterinas

Benchmark Asterinas #238

Triggered via schedule January 29, 2025 20:01
Status Failure
Total duration 5h 32m 52s
Artifacts 73
Matrix: Benchmarks
Matrix: Results
Fit to window
Zoom out
Zoom in

Annotations

7 errors and 8 warnings
Benchmarks (lmbench/tcp_loopback_http_bw)
No files were found with the provided path: result_*.json. No artifacts will be uploaded.
Benchmarks (lmbench/tcp_virtio_lat)
unable to access 'https://github.com/asterinas/asterinas/': gnutls_handshake() failed: Error in the pull function.
Results (fio-ext2_seq_read_bw_no_iommu)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'ext2_seq_read_bw_no_iommu'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.25`. | Benchmark suite | Current: 56b85cb132e54cc51522e6444bc17f9e00eb2ee3 | Previous: c4229e3c2f10108ba964de8be8087cc103ede216 | Ratio | |-|-|-|-| | `Average file read bandwidth on Asterinas` | `2822` MB/s | `3764` MB/s | `1.33` | This comment was automatically generated by [workflow](https://github.com/asterinas/asterinas/actions?query=workflow%3ABenchmark%20Asterinas) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). Comment was generated at https://github.com/asterinas/asterinas/commit/56b85cb132e54cc51522e6444bc17f9e00eb2ee3#commitcomment-151929710
Results (lmbench-tcp_loopback_bw_64k)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'tcp_loopback_bw_64k'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.25`. | Benchmark suite | Current: 56b85cb132e54cc51522e6444bc17f9e00eb2ee3 | Previous: c4229e3c2f10108ba964de8be8087cc103ede216 | Ratio | |-|-|-|-| | `Average TCP bandwidth on Asterinas` | `6259.66` MB/s | `8639.09` MB/s | `1.38` | This comment was automatically generated by [workflow](https://github.com/asterinas/asterinas/actions?query=workflow%3ABenchmark%20Asterinas) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). Comment was generated at https://github.com/asterinas/asterinas/commit/56b85cb132e54cc51522e6444bc17f9e00eb2ee3#commitcomment-151930813
Results (lmbench-tcp_virtio_bw_128)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'tcp_virtio_bw_128'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.25`. | Benchmark suite | Current: 56b85cb132e54cc51522e6444bc17f9e00eb2ee3 | Previous: c4229e3c2f10108ba964de8be8087cc103ede216 | Ratio | |-|-|-|-| | `Average TCP bandwidth on Asterinas` | `279.97` MB/sec | `375.12` MB/sec | `1.34` | This comment was automatically generated by [workflow](https://github.com/asterinas/asterinas/actions?query=workflow%3ABenchmark%20Asterinas) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). Comment was generated at https://github.com/asterinas/asterinas/commit/56b85cb132e54cc51522e6444bc17f9e00eb2ee3#commitcomment-151930890
Results (lmbench-tcp_virtio_bw_64k)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'tcp_virtio_bw_64k'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.25`. | Benchmark suite | Current: 56b85cb132e54cc51522e6444bc17f9e00eb2ee3 | Previous: c4229e3c2f10108ba964de8be8087cc103ede216 | Ratio | |-|-|-|-| | `Average TCP bandwidth on Linux` | `514.56` MB/sec | `722.26` MB/sec | `1.40` | | `Average TCP bandwidth on Asterinas` | `486.24` MB/sec | `628.40` MB/sec | `1.29` | This comment was automatically generated by [workflow](https://github.com/asterinas/asterinas/actions?query=workflow%3ABenchmark%20Asterinas) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). Comment was generated at https://github.com/asterinas/asterinas/commit/56b85cb132e54cc51522e6444bc17f9e00eb2ee3#commitcomment-151930911
Results (lmbench-tcp_virtio_connect_lat)
# :warning: **Performance Alert** :warning: Possible performance regression was detected for benchmark **'tcp_virtio_connect_lat'**. Benchmark result of this commit is worse than the previous benchmark result exceeding threshold `1.25`. | Benchmark suite | Current: 56b85cb132e54cc51522e6444bc17f9e00eb2ee3 | Previous: c4229e3c2f10108ba964de8be8087cc103ede216 | Ratio | |-|-|-|-| | `Average TCP connection latency on Asterinas` | `44.9675` µs | `34.2733` µs | `1.31` | This comment was automatically generated by [workflow](https://github.com/asterinas/asterinas/actions?query=workflow%3ABenchmark%20Asterinas) using [github-action-benchmark](https://github.com/marketplace/actions/continuous-benchmark). Comment was generated at https://github.com/asterinas/asterinas/commit/56b85cb132e54cc51522e6444bc17f9e00eb2ee3#commitcomment-151930929
Benchmarks (nginx/http_file8KB_bw)
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/11bd71901bbe5b1630ceea73d27597364c9af683'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
Benchmarks (nginx/http_file8KB_bw)
Back off 11.312 seconds before retry.
Results (fio-ext2_seq_read_bw_no_iommu)
Performance alert! Previous value was 3764 and current value is 2822. It is 1.333805811481219x worse than previous exceeding a ratio threshold 1.25
Results (lmbench-tcp_loopback_bw_64k)
Performance alert! Previous value was 8639.09 and current value is 6259.66. It is 1.380121284542611x worse than previous exceeding a ratio threshold 1.25
Results (lmbench-tcp_virtio_bw_128)
Performance alert! Previous value was 375.12 and current value is 279.97. It is 1.3398578419116334x worse than previous exceeding a ratio threshold 1.25
Results (lmbench-tcp_virtio_bw_64k)
Performance alert! Previous value was 722.26 and current value is 514.56. It is 1.4036458333333335x worse than previous exceeding a ratio threshold 1.25
Results (lmbench-tcp_virtio_bw_64k)
Performance alert! Previous value was 628.40 and current value is 486.24. It is 1.2923659098387628x worse than previous exceeding a ratio threshold 1.25
Results (lmbench-tcp_virtio_connect_lat)
Performance alert! Previous value was 34.2733 and current value is 44.9675. It is 1.3120271464959605x worse than previous exceeding a ratio threshold 1.25

Artifacts

Produced during runtime
Name Size
results_fio-ext2_seq_read_bw
310 Bytes
results_fio-ext2_seq_read_bw_no_iommu
327 Bytes
results_fio-ext2_seq_write_bw
311 Bytes
results_fio-ext2_seq_write_bw_no_iommu
329 Bytes
results_hackbench-group8_smp1
311 Bytes
results_iperf3-tcp_virtio_bw
338 Bytes
results_lmbench-ext2_copy_files_bw
332 Bytes
results_lmbench-ext2_create_delete_files_0k_ops
346 Bytes
results_lmbench-ext2_create_delete_files_10k_ops
349 Bytes
results_lmbench-fifo_lat
298 Bytes
results_lmbench-mem_copy_bw
316 Bytes
results_lmbench-mem_mmap_bw
313 Bytes
results_lmbench-mem_mmap_lat
302 Bytes
results_lmbench-mem_pagefault_lat
322 Bytes
results_lmbench-mem_read_bw
316 Bytes
results_lmbench-mem_write_bw
317 Bytes
results_lmbench-pipe_bw
303 Bytes
results_lmbench-pipe_lat
300 Bytes
results_lmbench-process_ctx_lat
317 Bytes
results_lmbench-process_exec_lat
322 Bytes
results_lmbench-process_fork_lat
320 Bytes
results_lmbench-process_getppid_lat
323 Bytes
results_lmbench-process_shell_lat
324 Bytes
results_lmbench-ramfs_copy_files_bw
332 Bytes
results_lmbench-ramfs_create_delete_files_0k_ops
352 Bytes
results_lmbench-ramfs_create_delete_files_10k_ops
351 Bytes
results_lmbench-semaphore_lat
314 Bytes
results_lmbench-signal_catch_lat
324 Bytes
results_lmbench-signal_install_lat
331 Bytes
results_lmbench-signal_prot_lat
322 Bytes
results_lmbench-tcp_loopback_bw_128
326 Bytes
results_lmbench-tcp_loopback_bw_4k
325 Bytes
results_lmbench-tcp_loopback_bw_64k
329 Bytes
results_lmbench-tcp_loopback_connect_lat
347 Bytes
results_lmbench-tcp_loopback_lat
317 Bytes
results_lmbench-tcp_loopback_select_lat
337 Bytes
results_lmbench-tcp_virtio_bw_128
325 Bytes
results_lmbench-tcp_virtio_bw_64k
324 Bytes
results_lmbench-tcp_virtio_connect_lat
341 Bytes
results_lmbench-tcp_virtio_lat
328 Bytes
results_lmbench-udp_loopback_lat
317 Bytes
results_lmbench-udp_virtio_lat
327 Bytes
results_lmbench-unix_bw
303 Bytes
results_lmbench-unix_connect_lat
323 Bytes
results_lmbench-unix_lat
299 Bytes
results_lmbench-vfs_fcntl_lat
317 Bytes
results_lmbench-vfs_fstat_lat
310 Bytes
results_lmbench-vfs_open_lat
308 Bytes
results_lmbench-vfs_read_lat
308 Bytes
results_lmbench-vfs_read_pagecache_bw
334 Bytes
results_lmbench-vfs_select_lat
318 Bytes
results_lmbench-vfs_stat_lat
307 Bytes
results_lmbench-vfs_write_lat
311 Bytes
results_memcached-t16_conc64_window10k
372 Bytes
results_memcached-t8_conc32_window10k
367 Bytes
results_memcached-t8_conc32_window20k
369 Bytes
results_nginx-http_file16KB_bw
353 Bytes
results_nginx-http_file32KB_bw
352 Bytes
results_nginx-http_file4KB_bw
351 Bytes
results_nginx-http_file64KB_bw
353 Bytes
results_nginx-http_file8KB_bw
351 Bytes
results_nginx-http_req10k_conc1_bw
357 Bytes
results_nginx-http_req10k_conc20_bw
360 Bytes
results_redis-get_100k_conc20_rps
358 Bytes
results_redis-ping_inline_100k_conc20_rps
381 Bytes
results_redis-ping_mbulk_100k_conc20_rps
379 Bytes
results_redis-set_100k_conc20_rps
357 Bytes
results_schbench-smp1
1.03 KB
results_schbench-smp8
1.04 KB
results_sqlite-ext2_benchmarks
3.6 KB
results_sqlite-ramfs_benchmarks
3.63 KB
results_sysbench-cpu_lat
297 Bytes
results_sysbench-thread_lat
312 Bytes