test(db): add check for gdu vs du

[matthewkeil]

Motivation

I reinstalled my osX and a new error popped up. The du command does not have the -b flag in the osx version of du. Required me to install du from the GNU coreutils. brew install du prefixes the commands with g so the command name is gdu.

I did not have this aliased nor on my path before reinstalling. Never ran into the error before updating/reinstalling the os so it may be something new but am not 100% certain. Installed version Ventura 13.4.1 (22F82).

I found a stack overflow page that explained how to alias all the commands but a few other pages I found said there could be system instability from fully aliasing because existing scripts can potentially fail if expecting the osx versions.

OSX man page for du
GNU man page for du
SO page for issues with aliasing commands

Description

Checks for existence of gdu command on darwin platform and defaults back to du if gdu is not found.

Steps to test or reproduce

On mac with coreutils installed via homebrew:

cd packages/db
yarn test:unit

[github-actions]

Performance Report

✔️ no performance regression detected

Full benchmark results

Benchmark suite	Current: a21b0f6	Previous: 3257345	Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc	652.11 us/op	847.56 us/op	0.77
getPubkeys - validatorsArr - req 1000 vs - 250000 vc	73.645 us/op	92.416 us/op	0.80
BLS verify - blst-native	1.1551 ms/op	1.4285 ms/op	0.81
BLS verifyMultipleSignatures 3 - blst-native	2.3590 ms/op	2.8654 ms/op	0.82
BLS verifyMultipleSignatures 8 - blst-native	5.0540 ms/op	6.1024 ms/op	0.83
BLS verifyMultipleSignatures 32 - blst-native	18.205 ms/op	22.164 ms/op	0.82
BLS aggregatePubkeys 32 - blst-native	24.232 us/op	29.186 us/op	0.83
BLS aggregatePubkeys 128 - blst-native	94.690 us/op	114.69 us/op	0.83
getAttestationsForBlock	49.366 ms/op	64.646 ms/op	0.76
isKnown best case - 1 super set check	268.00 ns/op	347.00 ns/op	0.77
isKnown normal case - 2 super set checks	270.00 ns/op	342.00 ns/op	0.79
isKnown worse case - 16 super set checks	266.00 ns/op	331.00 ns/op	0.80
CheckpointStateCache - add get delete	4.8860 us/op	5.8660 us/op	0.83
validate api signedAggregateAndProof - struct	2.7747 ms/op	3.2226 ms/op	0.86
validate gossip signedAggregateAndProof - struct	2.7786 ms/op	3.3276 ms/op	0.84
validate api attestation - struct	1.3414 ms/op	1.5934 ms/op	0.84
validate gossip attestation - struct	1.3461 ms/op	1.6007 ms/op	0.84
pickEth1Vote - no votes	1.2217 ms/op	1.3795 ms/op	0.89
pickEth1Vote - max votes	8.7861 ms/op	12.275 ms/op	0.72
pickEth1Vote - Eth1Data hashTreeRoot value x2048	8.1057 ms/op	10.166 ms/op	0.80
pickEth1Vote - Eth1Data hashTreeRoot tree x2048	13.664 ms/op	19.748 ms/op	0.69
pickEth1Vote - Eth1Data fastSerialize value x2048	570.69 us/op	777.65 us/op	0.73
pickEth1Vote - Eth1Data fastSerialize tree x2048	6.0791 ms/op	6.6088 ms/op	0.92
bytes32 toHexString	508.00 ns/op	620.00 ns/op	0.82
bytes32 Buffer.toString(hex)	295.00 ns/op	359.00 ns/op	0.82
bytes32 Buffer.toString(hex) from Uint8Array	428.00 ns/op	575.00 ns/op	0.74
bytes32 Buffer.toString(hex) + 0x	295.00 ns/op	359.00 ns/op	0.82
Object access 1 prop	0.15800 ns/op	0.20200 ns/op	0.78
Map access 1 prop	0.15100 ns/op	0.17700 ns/op	0.85
Object get x1000	6.7390 ns/op	9.5550 ns/op	0.71
Map get x1000	0.59500 ns/op	0.78900 ns/op	0.75
Object set x1000	46.424 ns/op	64.433 ns/op	0.72
Map set x1000	36.527 ns/op	47.571 ns/op	0.77
Return object 10000 times	0.22450 ns/op	0.26970 ns/op	0.83
Throw Error 10000 times	3.8888 us/op	4.6095 us/op	0.84
fastMsgIdFn sha256 / 200 bytes	3.3050 us/op	3.9850 us/op	0.83
fastMsgIdFn h32 xxhash / 200 bytes	280.00 ns/op	362.00 ns/op	0.77
fastMsgIdFn h64 xxhash / 200 bytes	351.00 ns/op	419.00 ns/op	0.84
fastMsgIdFn sha256 / 1000 bytes	11.345 us/op	13.546 us/op	0.84
fastMsgIdFn h32 xxhash / 1000 bytes	413.00 ns/op	503.00 ns/op	0.82
fastMsgIdFn h64 xxhash / 1000 bytes	416.00 ns/op	489.00 ns/op	0.85
fastMsgIdFn sha256 / 10000 bytes	103.85 us/op	121.68 us/op	0.85
fastMsgIdFn h32 xxhash / 10000 bytes	1.9470 us/op	2.2080 us/op	0.88
fastMsgIdFn h64 xxhash / 10000 bytes	1.3440 us/op	1.5380 us/op	0.87
enrSubnets - fastDeserialize 64 bits	1.2640 us/op	1.4820 us/op	0.85
enrSubnets - ssz BitVector 64 bits	433.00 ns/op	489.00 ns/op	0.89
enrSubnets - fastDeserialize 4 bits	172.00 ns/op	196.00 ns/op	0.88
enrSubnets - ssz BitVector 4 bits	442.00 ns/op	495.00 ns/op	0.89
prioritizePeers score -10:0 att 32-0.1 sync 2-0	99.919 us/op	126.29 us/op	0.79
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25	124.83 us/op	158.94 us/op	0.79
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5	162.02 us/op	169.50 us/op	0.96
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75	289.61 us/op	336.05 us/op	0.86
prioritizePeers score 0:0 att 64-1 sync 4-1	337.39 us/op	396.68 us/op	0.85
array of 16000 items push then shift	1.6200 us/op	1.8360 us/op	0.88
LinkedList of 16000 items push then shift	8.9670 ns/op	10.748 ns/op	0.83
array of 16000 items push then pop	47.460 ns/op	69.349 ns/op	0.68
LinkedList of 16000 items push then pop	8.5290 ns/op	10.358 ns/op	0.82
array of 24000 items push then shift	2.3870 us/op	2.6413 us/op	0.90
LinkedList of 24000 items push then shift	8.8630 ns/op	10.288 ns/op	0.86
array of 24000 items push then pop	102.57 ns/op	131.50 ns/op	0.78
LinkedList of 24000 items push then pop	8.7020 ns/op	10.215 ns/op	0.85
intersect bitArray bitLen 8	6.8290 ns/op	7.9810 ns/op	0.86
intersect array and set length 8	56.536 ns/op	63.580 ns/op	0.89
intersect bitArray bitLen 128	31.948 ns/op	39.068 ns/op	0.82
intersect array and set length 128	766.65 ns/op	897.60 ns/op	0.85
bitArray.getTrueBitIndexes() bitLen 128	1.4560 us/op	1.6560 us/op	0.88
bitArray.getTrueBitIndexes() bitLen 248	2.5030 us/op	2.6970 us/op	0.93
bitArray.getTrueBitIndexes() bitLen 512	4.7370 us/op	5.1970 us/op	0.91
Buffer.concat 32 items	1.0490 us/op	1.1030 us/op	0.95
Uint8Array.set 32 items	1.8870 us/op	2.5640 us/op	0.74
transfer serialized Status (84 B)	1.9460 us/op	2.0520 us/op	0.95
copy serialized Status (84 B)	1.6760 us/op	1.6870 us/op	0.99
transfer serialized SignedVoluntaryExit (112 B)	2.1690 us/op	2.0920 us/op	1.04
copy serialized SignedVoluntaryExit (112 B)	1.6560 us/op	2.0250 us/op	0.82
transfer serialized ProposerSlashing (416 B)	2.6750 us/op	2.8810 us/op	0.93
copy serialized ProposerSlashing (416 B)	2.0170 us/op	2.9400 us/op	0.69
transfer serialized Attestation (485 B)	2.1830 us/op	3.2290 us/op	0.68
copy serialized Attestation (485 B)	1.9730 us/op	2.6990 us/op	0.73
transfer serialized AttesterSlashing (33232 B)	2.3080 us/op	2.7220 us/op	0.85
copy serialized AttesterSlashing (33232 B)	4.7960 us/op	6.7110 us/op	0.71
transfer serialized Small SignedBeaconBlock (128000 B)	2.5010 us/op	3.1780 us/op	0.79
copy serialized Small SignedBeaconBlock (128000 B)	11.341 us/op	18.895 us/op	0.60
transfer serialized Avg SignedBeaconBlock (200000 B)	2.8670 us/op	3.2890 us/op	0.87
copy serialized Avg SignedBeaconBlock (200000 B)	16.716 us/op	24.412 us/op	0.68
transfer serialized BlobsSidecar (524380 B)	2.6440 us/op	3.3920 us/op	0.78
copy serialized BlobsSidecar (524380 B)	76.352 us/op	87.581 us/op	0.87
transfer serialized Big SignedBeaconBlock (1000000 B)	2.8800 us/op	3.6580 us/op	0.79
copy serialized Big SignedBeaconBlock (1000000 B)	147.24 us/op	185.05 us/op	0.80
pass gossip attestations to forkchoice per slot	2.0297 ms/op	2.4131 ms/op	0.84
forkChoice updateHead vc 100000 bc 64 eq 0	1.9810 ms/op	2.7444 ms/op	0.72
forkChoice updateHead vc 600000 bc 64 eq 0	13.538 ms/op	15.487 ms/op	0.87
forkChoice updateHead vc 1000000 bc 64 eq 0	22.318 ms/op	26.981 ms/op	0.83
forkChoice updateHead vc 600000 bc 320 eq 0	17.169 ms/op	19.423 ms/op	0.88
forkChoice updateHead vc 600000 bc 1200 eq 0	80.630 ms/op	99.561 ms/op	0.81
forkChoice updateHead vc 600000 bc 64 eq 1000	21.711 ms/op	26.530 ms/op	0.82
forkChoice updateHead vc 600000 bc 64 eq 10000	23.647 ms/op	28.793 ms/op	0.82
forkChoice updateHead vc 600000 bc 64 eq 300000	29.118 ms/op	37.220 ms/op	0.78
computeDeltas	3.8494 ms/op	3.3833 ms/op	1.14
computeProposerBoostScoreFromBalances	377.58 us/op	461.34 us/op	0.82
altair processAttestation - 250000 vs - 7PWei normalcase	2.0544 ms/op	3.0526 ms/op	0.67
altair processAttestation - 250000 vs - 7PWei worstcase	3.1045 ms/op	3.8043 ms/op	0.82
altair processAttestation - setStatus - 1/6 committees join	169.34 us/op	173.76 us/op	0.97
altair processAttestation - setStatus - 1/3 committees join	335.81 us/op	322.47 us/op	1.04
altair processAttestation - setStatus - 1/2 committees join	468.78 us/op	441.22 us/op	1.06
altair processAttestation - setStatus - 2/3 committees join	591.20 us/op	581.78 us/op	1.02
altair processAttestation - setStatus - 4/5 committees join	789.76 us/op	748.55 us/op	1.06
altair processAttestation - setStatus - 100% committees join	938.20 us/op	903.00 us/op	1.04
altair processBlock - 250000 vs - 7PWei normalcase	9.9225 ms/op	10.256 ms/op	0.97
altair processBlock - 250000 vs - 7PWei normalcase hashState	17.666 ms/op	17.803 ms/op	0.99
altair processBlock - 250000 vs - 7PWei worstcase	37.083 ms/op	41.451 ms/op	0.89
altair processBlock - 250000 vs - 7PWei worstcase hashState	58.050 ms/op	68.929 ms/op	0.84
phase0 processBlock - 250000 vs - 7PWei normalcase	2.5900 ms/op	3.0779 ms/op	0.84
phase0 processBlock - 250000 vs - 7PWei worstcase	29.485 ms/op	37.156 ms/op	0.79
altair processEth1Data - 250000 vs - 7PWei normalcase	462.42 us/op	631.10 us/op	0.73
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15	8.8950 us/op	14.662 us/op	0.61
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219	83.085 us/op	83.848 us/op	0.99
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42	17.253 us/op	28.522 us/op	0.60
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18	7.1200 us/op	15.691 us/op	0.45
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020	119.89 us/op	160.02 us/op	0.75
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777	1.3250 ms/op	1.5842 ms/op	0.84
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384	1.4696 ms/op	1.6811 ms/op	0.87
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384	1.4016 ms/op	2.1995 ms/op	0.64
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384	3.3788 ms/op	4.2154 ms/op	0.80
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384	2.2457 ms/op	3.0623 ms/op	0.73
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384	4.9762 ms/op	6.6233 ms/op	0.75
Tree 40 250000 create	323.98 ms/op	402.11 ms/op	0.81
Tree 40 250000 get(125000)	197.63 ns/op	248.98 ns/op	0.79
Tree 40 250000 set(125000)	933.31 ns/op	1.2224 us/op	0.76
Tree 40 250000 toArray()	17.289 ms/op	23.239 ms/op	0.74
Tree 40 250000 iterate all - toArray() + loop	17.414 ms/op	23.381 ms/op	0.74
Tree 40 250000 iterate all - get(i)	67.439 ms/op	87.545 ms/op	0.77
MutableVector 250000 create	11.957 ms/op	13.395 ms/op	0.89
MutableVector 250000 get(125000)	6.2180 ns/op	8.8110 ns/op	0.71
MutableVector 250000 set(125000)	240.36 ns/op	352.24 ns/op	0.68
MutableVector 250000 toArray()	2.9454 ms/op	4.7566 ms/op	0.62
MutableVector 250000 iterate all - toArray() + loop	3.0035 ms/op	4.8400 ms/op	0.62
MutableVector 250000 iterate all - get(i)	1.4626 ms/op	2.0256 ms/op	0.72
Array 250000 create	2.6292 ms/op	3.5404 ms/op	0.74
Array 250000 clone - spread	1.1734 ms/op	1.0557 ms/op	1.11
Array 250000 get(125000)	0.56200 ns/op	0.58200 ns/op	0.97
Array 250000 set(125000)	0.63300 ns/op	0.69900 ns/op	0.91
Array 250000 iterate all - loop	78.407 us/op	119.56 us/op	0.66
effectiveBalanceIncrements clone Uint8Array 300000	23.769 us/op	26.896 us/op	0.88
effectiveBalanceIncrements clone MutableVector 300000	345.00 ns/op	309.00 ns/op	1.12
effectiveBalanceIncrements rw all Uint8Array 300000	169.11 us/op	219.32 us/op	0.77
effectiveBalanceIncrements rw all MutableVector 300000	78.605 ms/op	92.943 ms/op	0.85
phase0 afterProcessEpoch - 250000 vs - 7PWei	118.36 ms/op	127.78 ms/op	0.93
phase0 beforeProcessEpoch - 250000 vs - 7PWei	31.080 ms/op	43.716 ms/op	0.71
altair processEpoch - mainnet_e81889	311.57 ms/op	370.73 ms/op	0.84
mainnet_e81889 - altair beforeProcessEpoch	58.412 ms/op	72.648 ms/op	0.80
mainnet_e81889 - altair processJustificationAndFinalization	13.506 us/op	19.300 us/op	0.70
mainnet_e81889 - altair processInactivityUpdates	5.2081 ms/op	6.3206 ms/op	0.82
mainnet_e81889 - altair processRewardsAndPenalties	49.898 ms/op	78.806 ms/op	0.63
mainnet_e81889 - altair processRegistryUpdates	2.5800 us/op	3.1150 us/op	0.83
mainnet_e81889 - altair processSlashings	439.00 ns/op	875.00 ns/op	0.50
mainnet_e81889 - altair processEth1DataReset	483.00 ns/op	665.00 ns/op	0.73
mainnet_e81889 - altair processEffectiveBalanceUpdates	1.2488 ms/op	1.7294 ms/op	0.72
mainnet_e81889 - altair processSlashingsReset	2.4920 us/op	3.5210 us/op	0.71
mainnet_e81889 - altair processRandaoMixesReset	3.8150 us/op	6.1700 us/op	0.62
mainnet_e81889 - altair processHistoricalRootsUpdate	788.00 ns/op	737.00 ns/op	1.07
mainnet_e81889 - altair processParticipationFlagUpdates	2.3720 us/op	3.8180 us/op	0.62
mainnet_e81889 - altair processSyncCommitteeUpdates	510.00 ns/op	1.0430 us/op	0.49
mainnet_e81889 - altair afterProcessEpoch	124.94 ms/op	154.49 ms/op	0.81
phase0 processEpoch - mainnet_e58758	354.59 ms/op	407.33 ms/op	0.87
mainnet_e58758 - phase0 beforeProcessEpoch	136.52 ms/op	156.65 ms/op	0.87
mainnet_e58758 - phase0 processJustificationAndFinalization	14.353 us/op	18.891 us/op	0.76
mainnet_e58758 - phase0 processRewardsAndPenalties	68.016 ms/op	58.110 ms/op	1.17
mainnet_e58758 - phase0 processRegistryUpdates	9.8060 us/op	13.438 us/op	0.73
mainnet_e58758 - phase0 processSlashings	487.00 ns/op	887.00 ns/op	0.55
mainnet_e58758 - phase0 processEth1DataReset	477.00 ns/op	940.00 ns/op	0.51
mainnet_e58758 - phase0 processEffectiveBalanceUpdates	1.3432 ms/op	1.4013 ms/op	0.96
mainnet_e58758 - phase0 processSlashingsReset	1.9660 us/op	2.9490 us/op	0.67
mainnet_e58758 - phase0 processRandaoMixesReset	4.4430 us/op	9.7990 us/op	0.45
mainnet_e58758 - phase0 processHistoricalRootsUpdate	617.00 ns/op	1.0850 us/op	0.57
mainnet_e58758 - phase0 processParticipationRecordUpdates	3.6540 us/op	5.5890 us/op	0.65
mainnet_e58758 - phase0 afterProcessEpoch	97.292 ms/op	125.40 ms/op	0.78
phase0 processEffectiveBalanceUpdates - 250000 normalcase	1.1885 ms/op	2.6190 ms/op	0.45
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5	1.3859 ms/op	1.9697 ms/op	0.70
altair processInactivityUpdates - 250000 normalcase	24.485 ms/op	30.724 ms/op	0.80
altair processInactivityUpdates - 250000 worstcase	23.731 ms/op	30.561 ms/op	0.78
phase0 processRegistryUpdates - 250000 normalcase	7.5880 us/op	9.8080 us/op	0.77
phase0 processRegistryUpdates - 250000 badcase_full_deposits	303.28 us/op	463.50 us/op	0.65
phase0 processRegistryUpdates - 250000 worstcase 0.5	124.53 ms/op	178.54 ms/op	0.70
altair processRewardsAndPenalties - 250000 normalcase	69.353 ms/op	92.004 ms/op	0.75
altair processRewardsAndPenalties - 250000 worstcase	72.758 ms/op	93.638 ms/op	0.78
phase0 getAttestationDeltas - 250000 normalcase	7.5575 ms/op	10.625 ms/op	0.71
phase0 getAttestationDeltas - 250000 worstcase	7.6808 ms/op	9.7165 ms/op	0.79
phase0 processSlashings - 250000 worstcase	2.2586 ms/op	2.6816 ms/op	0.84
altair processSyncCommitteeUpdates - 250000	148.36 ms/op	186.33 ms/op	0.80
BeaconState.hashTreeRoot - No change	271.00 ns/op	309.00 ns/op	0.88
BeaconState.hashTreeRoot - 1 full validator	50.719 us/op	59.958 us/op	0.85
BeaconState.hashTreeRoot - 32 full validator	507.53 us/op	615.70 us/op	0.82
BeaconState.hashTreeRoot - 512 full validator	5.5662 ms/op	6.9734 ms/op	0.80
BeaconState.hashTreeRoot - 1 validator.effectiveBalance	63.931 us/op	83.981 us/op	0.76
BeaconState.hashTreeRoot - 32 validator.effectiveBalance	896.74 us/op	1.0753 ms/op	0.83
BeaconState.hashTreeRoot - 512 validator.effectiveBalance	11.522 ms/op	13.736 ms/op	0.84
BeaconState.hashTreeRoot - 1 balances	48.927 us/op	65.119 us/op	0.75
BeaconState.hashTreeRoot - 32 balances	443.36 us/op	517.60 us/op	0.86
BeaconState.hashTreeRoot - 512 balances	4.3336 ms/op	5.5757 ms/op	0.78
BeaconState.hashTreeRoot - 250000 balances	77.847 ms/op	92.814 ms/op	0.84
aggregationBits - 2048 els - zipIndexesInBitList	13.502 us/op	17.621 us/op	0.77
regular array get 100000 times	31.238 us/op	40.218 us/op	0.78
wrappedArray get 100000 times	31.303 us/op	39.511 us/op	0.79
arrayWithProxy get 100000 times	15.342 ms/op	17.255 ms/op	0.89
ssz.Root.equals	208.00 ns/op	273.00 ns/op	0.76
byteArrayEquals	205.00 ns/op	277.00 ns/op	0.74
shuffle list - 16384 els	6.6785 ms/op	8.6675 ms/op	0.77
shuffle list - 250000 els	97.705 ms/op	121.36 ms/op	0.81
processSlot - 1 slots	8.1660 us/op	9.4550 us/op	0.86
processSlot - 32 slots	1.2813 ms/op	1.4943 ms/op	0.86
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei	56.462 ms/op	59.458 ms/op	0.95
getCommitteeAssignments - req 1 vs - 250000 vc	2.5030 ms/op	3.2875 ms/op	0.76
getCommitteeAssignments - req 100 vs - 250000 vc	3.6966 ms/op	4.7590 ms/op	0.78
getCommitteeAssignments - req 1000 vs - 250000 vc	3.8589 ms/op	5.1554 ms/op	0.75
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei	4.4900 ns/op	5.4900 ns/op	0.82
state getBlockRootAtSlot - 250000 vs - 7PWei	688.97 ns/op	708.43 ns/op	0.97
computeProposers - vc 250000	8.9803 ms/op	10.002 ms/op	0.90
computeEpochShuffling - vc 250000	109.10 ms/op	121.21 ms/op	0.90
getNextSyncCommittee - vc 250000	143.36 ms/op	164.83 ms/op	0.87
computeSigningRoot for AttestationData	12.728 us/op	14.004 us/op	0.91
hash AttestationData serialized data then Buffer.toString(base64)	2.2307 us/op	2.6087 us/op	0.86
toHexString serialized data	1.0012 us/op	1.2046 us/op	0.83
Buffer.toString(base64)	206.65 ns/op	250.66 ns/op	0.82

by benchmarkbot/action

[wemeetagain]

🎉 This PR is included in v1.10.0 🎉