Test build machines

[uazo]

Objectives:

• To verify the performance related to the build of different machines
• Prepare setup script for self-configuration
• Verification of costs

Current machine:

• Webtropia: Intel i5-9600K (6 x 3,7 GHz)
  32 GB DDR4
  2x 256 GB NVMe
  current builder: https://github.com/uazo/cromite/actions/runs/7260536880
  € 54.89 /month (will increase by 10% from 2024)

Test on:

• Aruba: PRO O32A64
  32 Virtual CPU
  64 GB of RAM
  480 GB of Hard Disk
  Additional 20Gb disk
  € 0.4240 Euro /hour
  current builder: https://github.com/uazo/cromite/actions/runs/7261420934

• OVH: B3-64
  16 vCores (2.3 GHz)
  64 GB RAM
  400 GB NVMe + Additional 20Gb Disk
  € 0.4538 /hour
  current builder: https://github.com/uazo/cromite/actions/runs/7262352281

[uazo]

Current script (WIP):

git clone https://github.com/uazo/cromite

# install docker
sudo apt-get update
sudo apt-get install -y ca-certificates curl gnupg
sudo install -m 0755 -d /etc/apt/keyrings
curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /etc/apt/keyrings/docker.gpg
sudo chmod a+r /etc/apt/keyrings/docker.gpg

# Add the repository to Apt sources:
echo \
  "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.gpg] https://download.docker.com/linux/ubuntu \
  $(. /etc/os-release && echo "$VERSION_CODENAME") stable" | \
  sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
sudo apt-get update

sudo apt-get install -y docker-ce docker-ce-cli containerd.io docker-buildx-plugin docker-compose-plugin
sudo usermod -aG docker $USER

# install sysbox
wget https://downloads.nestybox.com/sysbox/releases/v0.6.2/sysbox-ce_0.6.2-0.linux_amd64.deb
docker rm $(docker ps -a -q) -f
sudo apt-get install -y jq
sudo apt-get install -y ./sysbox-ce_0.6.2-0.linux_amd64.deb
sudo systemctl status sysbox -n20
sudo docker info | grep -i runtime

# install my sysbox version
apt install -y unzip
unzip ~/cromite/tools/images/sysbox/sysbox.zip
cp build/ubuntu_22.04/x64/sysbox-runc /usr/bin/
docker run --runtime=sysbox-runc -it hello-world

# set casefold disk (/dev/sdb1)
cat /sys/fs/ext4/features/casefold # got supported
sudo umount -fl /dev/sdb1
sudo mkfs -F -t ext4 -O casefold /dev/sdb1
sudo dumpe2fs -h /dev/sdb1 | grep 'Filesystem features'
sudo mkdir -p /casefold
sudo mount /dev/sdb1 /casefold

# install win sdk
sudo mkdir -p /casefold/win
sudo chattr +F /casefold/win
echo test >/casefold/win/test && cat /casefold/win/Test

cd /casefold/win/
mkdir 10.0.22621.0 && cd 10.0.22621.0
!! make eb2fe448b4.zip generable
unzip eb2fe448b4.zip

# make storage folder
cd ~
sudo mkdir -p /storage

cd cromite/tools/images/github-runner/
!! make .env file
sudo GHRUNNERHOME=$HOME/runner bash ./start-runner.sh

[uazo]

results:

	12 vcore - Webtropia	16 vcore - OVH	32 vcore - Aruba
A x64	3h 32m	1h 55m	1h 6m
Win x64	4h 47m	2h 24m	1h 19m
A arm64	3h 37m	1h 57m	1h 7m
A arm	3h 36m	n/a	1h 7m
L x64	3h 43m	n/a	1h 5m
Total	19h 22m	10h 23m (estimated)	5h 50m
Cost/Month (always on)	54,89 €	315,46 €	337,63 €
Cost/Hour	0.073 (estimated)	0.4240	0.4538
Total Cost (estimated)	1,53 €	5,09 €	3,18 €
Incidence Total/Core	96,83	38,94	10,94
--> Hour:Min	1:36	0:38	0:10

note: n/a because I forgot to use my version of sysbox

considerations:

• the current server (the first one) is really slow
• ovh is not worth it
• absurd time for the windows build, what's the point?
• I have to try another server with 16 cores, but I have to look for it at half the price.

[uazo]

Test with

• Aruba PRO O8A16
  8 Virtual CPU
  16 GB of RAM
  0.0840 Euro / hr (61.32 month)
  https://github.com/uazo/cromite/actions/runs/7273069478

there was no way to test that server, problems all the time with docker. who knows.