Display stderr output upon e2e spec failure

[ffakenz]

🛡️ Improved e2e debugging by displaying stderr output upon spec failure, as exceptions are being thrown to this channel.

---

• CHANGELOG updated or not needed
• Documentation updated or not needed
• Haddocks updated or not needed
• No new TODOs introduced or explained herafter

[github-actions]

Transactions Costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at	2024-01-03 11:24:57.784143612 UTC
Max. memory units	14000000
Max. CPU units	10000000000
Max. tx size (kB)	16384

Script summary

Name	Hash	Size (Bytes)
νInitial	985245919fcc6c0c5cd116023cd2c947c43e80dcbb5075fe12433fbb	4072
νCommit	7cb20fa71eb4c563ca283566ebe0aa65859d96c3f8cba35c52c181fd	2043
νHead	7a36661f5c15e9f1783aeaab890812c59b7286cbbc6de762d3110772	8816
μHead	8b111ac12274e46314769295a1c5dcab1d260096fc469fd698065463*	3851

• The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per Head.

Cost of Init Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4372	10.35	3.99	0.46
2	4576	12.47	4.79	0.49
3	4776	14.68	5.63	0.52
5	5179	19.12	7.31	0.59
10	6185	30.29	11.55	0.75
41	12415	98.92	37.55	1.77

Cost of Commit Transaction

This is using ada-only outputs for better comparability.

UTxO	Tx size	% max Mem	% max CPU	Min fee ₳
1	534	11.37	4.44	0.30
2	723	15.04	6.07	0.35
3	906	18.85	7.75	0.40
5	1282	26.90	11.27	0.51
10	2227	49.55	20.97	0.80
19	3907	99.43	41.75	1.43

Cost of CollectCom Transaction

Parties	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
1	57	484	21.78	8.51	0.41
2	114	590	33.21	13.10	0.54
3	171	700	47.52	18.88	0.70
4	228	810	59.15	23.75	0.84
5	284	920	79.30	31.87	1.06
6	340	1031	96.94	39.18	1.26

Cost of Close Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	486	15.16	6.43	0.34
2	735	18.45	9.31	0.40
3	846	19.82	10.59	0.42
5	1246	23.28	13.84	0.49
10	2202	32.32	22.10	0.67
50	5514	80.35	41.77	1.34

Cost of Contest Transaction

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	582	20.27	8.98	0.40
2	699	21.81	10.32	0.43
3	961	24.32	12.44	0.48
5	1268	27.83	15.55	0.54
10	2143	37.30	23.74	0.72
42	7294	95.60	74.17	1.78

Cost of Abort Transaction

Some variation because of random mixture of still initial and already committed outputs.

Parties	Tx size	% max Mem	% max CPU	Min fee ₳
1	4329	19.03	8.19	0.55
2	4384	27.20	11.62	0.65
3	4667	47.43	20.83	0.89
4	4847	66.43	29.23	1.11
5	5047	87.59	38.66	1.36

Cost of FanOut Transaction

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties	UTxO	UTxO (bytes)	Tx size	% max Mem	% max CPU	Min fee ₳
5	0	0	4206	8.26	3.46	0.43
5	1	57	4239	9.49	4.22	0.44
5	5	285	4375	14.28	7.22	0.51
5	10	570	4546	20.34	10.99	0.59
5	20	1139	4884	32.85	18.71	0.77
5	30	1709	5226	45.15	26.34	0.93
5	40	2275	5563	57.04	33.79	1.10
5	50	2844	5902	69.77	41.61	1.27
5	74	4217	6722	99.34	59.96	1.68

End-To-End Benchmark Results

This page is intended to collect the latest end-to-end benchmarks results produced by Hydra's Continuous Integration system from the latest master code.

Please take those results with a grain of salt as they are currently produced from very limited cloud VMs and not controlled hardware. Instead of focusing on the absolute results, the emphasis should be on relative results, eg. how the timings for a scenario evolve as the code changes.

Generated at 2024-01-03 11:29:00.932637923 UTC

Baseline Scenario

Number of nodes	3
Number of txs	9000
Avg. Confirmation Time (ms)	22.845999600
P99	110.12446203000017ms
P95	31.28900544999998ms
P50	20.292427ms
Number of Invalid txs	0

Baseline Scenario

Number of nodes	1
Number of txs	3000
Avg. Confirmation Time (ms)	4.418723260
P99	7.220097499999999ms
P95	5.894807849999995ms
P50	4.2202245000000005ms
Number of Invalid txs	0

[github-actions]

Test Results

388 tests  ±0   383 ✅ ±0   21m 39s ⏱️ -18s
132 suites ±0     5 💤 ±0 
  5 files   ±0     0 ❌ ±0 

Results for commit 23c8dcf. ± Comparison against base commit c5d58ba.

♻️ This comment has been updated with latest results.