NetworkSpeed10Gb

🚚 Old article

This is old - for updates see PerformanceLab instead.

Testing

Testing MTU 9000 on LAN cards; Using setup TestNetwork10gNet1 (pair of 10 Gbit direct fiber, times ×2 sockets in each computer).

Results

NetModel (with fixes) can use entire 9700 Mbit/s (asio async trivial 9700 Mbit/s, asio bocking trivial 9850 Mbit/s) with few fixes and options.

See Results in NetworkSpeed.

Data

9000m UDP = 8972 UDP datagram

Using git rev b718c98fcac242b52eddb07c302b1fef7006f74f... but fixed to be50ba7d1d209d42bf9f18768587eefcfe27e912

AsioRBlock = our src-tools/netutils/asio_send_block - asio, blocking, single-thread minimal program

AsioRAsync = our src-tools/netutils/asio_receive_async - asio, async, multi-thread (multi IO) minimal program

NetModel = our netmodel in src-tools/netmodel/netmodel.cpp , run as tunserver.elf --mode-bench ... (or use ./menu to pick some template, or see this wiki below tests examples)

Possible command: THR=1 WF=512 CRY=0; ./tunserver.elf --mode-bench 192.168.1.107 2125 crypto=$CRY wire_buf=$WF wire_sock=1 wire_ios=1 wire_ios_thr=$THR tuntap_weld=1 tuntap_sock=1 tuntap_ios=1 tuntap_ios_thr=1 tuntap_weld_sleep=1 tuntap_block mt_mutex mport

Now in file:

https://github.com/yedinocommunity/pictures/blob/master/data/yedino_speed_10g1.ods

** OUTDATED TABLE (was from sending "just" 10 Gbps, not ~13). **

Test	Send	Recv	Recv Mb/s
test1	CompWolf 1 × 9000m-UDP AsioRBlock	CompDragon NetMod 1×🎲	5,900
	CompWolf 1 × 9000m-UDP AsioRBlock	CompDragon NetMod 6×🎲	5,900
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon NetMod 1×🎲	9,600
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon AsioRAsync 1×🎲	9,600
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon AsioRAsync 2×🎲	9,600
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon AsioRAsync 5×🎲	9,600
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon NetMod 2×🎲	8,200 (why slower when MT?!)
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon AsioRAsync 5×🎲 buf/wf=64 ⛳	9,600 ^fix
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon NetMod 3×🎲	6,990 (why slower when MT?!)
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon NetMod 4×🎲	6,400 (why slower when MT?!)
	CompWolf 2 × 9000m-UDP AsioRBlock	CompDragon NetMod 6×🎲	6,400 (why slower when MT?!)

{{test1}}

Dragon:

galaxy42/build(asiotest)
$ make ; C=0 ; nice -n -18 ./tunserver.elf --mode-bench 192.168.1.107 2121 crypto=$C wire_buf=8 wire_sock=1 wire_ios=1 wire_ios_thr=1 tuntap_weld=1 tuntap_sock=1 tuntap_ios=1 tuntap_ios_thr=1 tuntap_weld_sleep=1 tuntap_block mt_strand mport

...

Loop. Wire: RECV={avg=5796.32 (now=5804) bestAvg=   0 Mb/s 0.0808627 Mp/s}; Tuntap: start=0  fullBuf=0 ; Welds: [18000 RESE]
Loop. Wire: RECV={avg=5797.66 (now=5801.93) bestAvg=   0 Mb/s 0.0808338 Mp/s}; Tuntap: start=0  fullBuf=0 ; Welds: [18000 RESE]

Wolf:

sudo nice -n -18 taskset -c 1 ./asio_send_block 192.168.113.16 9000  999000    foo   8972       -1