proxmox-template

dependencies

• qemu-guest-agent
• proxmoxer
• ansible
• python3
• pip3
• jmespath
• jq

resources

• engonzal/ansible_role_proxmox Public
• community.general.proxmox – Proxmox inventory source
• ansible.builtin.pip – Manages Python library dependencies
• community.general.proxmox_template – management of OS templates in Proxmox VE cluster
• community.general.proxmox_tasks_info – Retrieve information about one or more Proxmox VE tasks
• https://docs.ansible.com/ansible/latest/collections/community/general/proxmox_kvm_module.html#ansible-collections-community-general-proxmox-kvm-module
• kalenarndt/packer-vsphere-cloud-init - Public
• chef/bento - Public
• samgabrail/packer-terraform-vmware - Public
• ruzickap/packer-templates - Public
• dbond007/Packer - Public
• joefitzgerald/packer-windowsPublic archive
• CptOfEvilMinions/BlogProjects - Public
• clayshek/ans-pve-win-provision - Public
• clayshek/ans-pve-win-templ - Public
• hashicorp/learn-packer-getting-started - Public
• kalenarndt/packer-vsphere-cloud-init - Public

get images

• linux

  • openstack - Get images

• windows

  • Windows Appendix A: KMS Client Setup Keys
  • get own product key

  wmic path SoftwareLicensingService get OA3xOriginalProductKey

  • realoriginal/windows10activation
  • Key Management Services (KMS) client activation and product keys

Push Images

• ubuntu

# ubuntu
ssh proxmox 'wget "http://cdimage.debian.org/cdimage/openstack/current-10/debian-10-openstack-amd64.qcow2" -P /var/lib/vz/template/iso/'
ssh proxmox 'wget "https://releases.ubuntu.com/20.04/ubuntu-20.04.3-live-server-amd64.iso" -P /var/lib/vz/template/iso/'
ssh proxmox 'wget "https://cdimage.debian.org/cdimage/release/current/amd64/iso-cd/debian-11.2.0-amd64-netinst.iso" -P /var/lib/vz/template/iso/'
ssh proxmox 'wget "http://cdimage.ubuntu.com/releases/20.04/release/ubuntu-20.04.3-live-server-arm64.iso" -P /var/lib/vz/template/iso/'
# or
scp "C:/Users/shortpoet/Downloads/ubuntu-20.04.3-live-server-arm64.iso" proxmox:/var/lib/vz/template/iso/
scp .\hirsute-server-cloudimg-amd64.img proxmox:/var/lib/vz/template/iso/

• windows

# windows
# proxmox
ssh proxmox 'wget "https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.208-1/virtio-win-0.1.208.iso" -P /var/lib/vz/template/iso/'
scp "C:\Users\shortpoet\Documents\disk-images\win10\Win10_21H2_English_x64.iso" proxmox:/var/lib/vz/template/iso/Win10_21H2_English_x64.iso
# xml -> iso
# mkisofs -J -l -R -V 'Label CD' -iso-level 4 -o '/mnt/h/source/iso/win10/Autounattend.iso' '/mnt/h/source/orgs/shortpoet-ansible/proxmox-template/packer/win10/floppy/'
mkisofs -J -l -R -V 'Label CD' -iso-level 4 -o '/mnt/h/source/orgs/shortpoet-ansible/proxmox-template/packer/win10/floppy/Autounattend.iso' '/mnt/h/source/orgs/shortpoet-ansible/proxmox-template/packer/win10/floppy/'
scp /mnt/h/source/orgs/shortpoet-ansible/proxmox-template/packer/win10/floppy/Autounattend.iso proxmox:/var/lib/vz/template/iso/
rm /mnt/h/source/orgs/shortpoet-ansible/proxmox-template/packer/win10/floppy/Autounattend.iso
# local
wget "https://fedorapeople.org/groups/virt/virtio-win/direct-downloads/archive-virtio/virtio-win-0.1.208-1/virtio-win-0.1.208.iso" -P /mnt/h/source/iso/win10

Ubuntu

• get most recent release url

release_codename='Focal Fossa'
sstream-query --json --max=1 --keyring=/usr/share/keyrings/ubuntu-cloudimage-keyring.gpg http://cloud-images.ubuntu.com/releases/streams/v1/com.ubuntu.cloud:released:download.sjson arch=amd64 release_codename=$release_codename ftype='disk1.img' | jq -r '.[].item_url'

• query all releases

release_codename='Focal Fossa'
sstream-query --json --keyring=/usr/share/keyrings/ubuntu-cloudimage-keyring.gpg http://cloud-images.ubuntu.com/releases/streams/v1/com.ubuntu.cloud:released:download.sjson arch=amd64 release_codename=$release_codename ftype='disk1.img' | jq -r '.[].version_name'

• Index of /releases/streams/v1
• Ubuntu 20.04.3 LTS (Focal Fossa)
• Ubuntu 20.04 LTS (Focal Fossa) Daily Build [20211216]
  • img dl
• Ubuntu 20.04 LTS (Focal Fossa) [20211129]
  • img dl

test ansible

• test with no ansible.cfg

ansible all --key-file ~/.ssh/id_ed25519_proxmox -i inventory -m ping

• restrict working directory permissions in order to use ansible.cfg

sudo chmod -R 770 proxmox-template

• add basic config to ansible.cfg

cat > ansible.cfg <<EOT
[defaults]
inventory = inventory
private_key_file =  ~/.ssh/id_ed25519_proxmox
EOT

• test with ansible.cfg

ansible all -m ping

Proxmox cli commands

pveum role list --output-format=json | jq -r "any(.[].roleid; . == \"Automation\")"
pveam available
pveam list local
pveam list vmstore
qm list
pvesh ls /nodes/proxmox/qemu
pvesh ls /nodes/proxmox/qemu/9002/config
ls /dev/mapper # VMs-vm--{vmId}--disk--{diskIdx|cloudinit}

• force kill vm

VMID='9004'
ps aux | grep "/usr/bin/kvm -id $VMID" # get PID
kill -9 PID

• cycle clone with new user data

# local
rsync /mnt/h/source/orgs/shortpoet-ansible/proxmox-template/ansible/roles/310_proxmox_vms_create/configs/ubuntu-2004-user_data.yml proxmox:/var/lib/vz/snippets
# host
VM_ID='9999'
VM_CLONE_ID='999'
qm stop $VM_CLONE_ID && qm destroy $VM_CLONE_ID
qm clone $VM_ID $VM_CLONE_ID --name ubuntu2004-cloud-template-ansible-clone --full >/dev/null 2>&1
qm start $VM_CLONE_ID
#[How to ping in linux until host is known?](https://serverfault.com/questions/42021/how-to-ping-in-linux-until-host-is-known)
VM_IP='192.168.1.42'
GREEN='\033[0;32m'
MAGENTA='\033[0;35m'
NC='\033[0m' # No Color
# waits for sshd
until nc -vzw 2 $VM_IP  22 >/dev/null 2>&1; do sleep 2; echo -e "..${MAGENTA}PING${NC}"; done; echo -e "--> ${GREEN}DONE${NC}"
# up for a few before sshd is ready
until ping -c1 $VM_IP >/dev/null 2>&1; do :; done; echo -e "--> ${GREEN}DONE${NC}"
# local & ssh command
rsync /mnt/h/source/orgs/shortpoet-ansible/proxmox-template/ansible/roles/310_proxmox_vms_create/configs/ubuntu-2004-user_data.yml proxmox:/var/lib/vz/snippets && ssh proxmox 'cycle_vm 9999 999'

• ip / mac

# - get the mac address of the vm
$vmid=''
$mac=$(/usr/sbin/qm config $vmid | awk '/net0/ { print tolower($2) }' | sed -r 's/[^=]*=([0-9a-f:]*),.*/\1/g')
# - get the ip address of the vm
arp -an -i eth1 | grep $mac | cut -d' ' -f2 | sed -r 's/\((.*)\)/\1/g'
qm guest cmd 999 network-get-interfaces | jq -r '.[] | select(.name == "eth0")."ip-addresses"[] | select(."ip-address-type" == "ipv4")."ip-address"'

Environment

$env:TF_VAR_proxmox_password=$(Get-Secret -Name ProxmoxAutomation -AsPlainText)
$env:PKR_VAR_proxmox_password=$(Get-Secret -Name ProxmoxAutomation -AsPlainText)
$env:PKR_VAR_WIN_IP_LOCAL=$((Get-NetIPConfiguration | Select-Object IPv4Address -First 1).IPv4Address.IPAddress)
$env:PACKER_LOG=1

export PKR_VAR_WIN_IP_LOCAL=$(/usr/sbin/ip -4 -o -json addr list eth0 | jq -r '.[].addr_info[].local')
export PROXMOX_AUTOMATION_PASSWORD=$(pass Homelab/proxmox/users/automation@pve)
export PKR_VAR_proxmox_password=$(pass Homelab/proxmox/users/automation@pve)
export PACKER_LOG=1
# or
export PACKER_LOG='TRACE'
export PACKER_LOG_PATH='log/win10.log'
mkpasswd -m sha-512 --rounds=4096 $(pass Homelab/proxmox/users/automation@pve)
mkpasswd -m sha-512 $(pass Homelab/proxmox/users/automation@pve)

git (image files 😅)

• git rm - fatal: pathspec did not match any files

git filter-branch --force --index-filter 'git rm -r --cached --ignore-unmatch terraform/iso_base/hirsute-server-cloudimg-amd64.img' --prune-empty -- --all

comparing instances

• sftp
  • How to use SFTP on a system that requires sudo for root access & ssh key based authentication?

sftp -o stricthostkeychecking=no -o identityfile=~/.ssh/id_ed25519_proxmox [email protected]
# with sudo
sftp -s "sudo /usr/lib/openssh/sftp-server" -o stricthostkeychecking=no -o identityfile=~/.ssh/id_ed25519_proxmox [email protected]
# sftp> get /run/cloud-init/instance-data.json /run/cloud-init/instance-data-sensitive.json /etc/cloud/cloud.cfg

ssh

ssh-keygen -f "/home/shortpoet/.ssh/known_hosts" -R "192.168.1.42" && ssh -o stricthostkeychecking=no -o identityfile=~/.ssh/id_ed25519_proxmox [email protected]

dotfiles

pass Github/hamflavor-windows-pat
mkdir repos; cd repos; git clone https://github.com/shortpoet-dots/linux.git/
cd ~; chmod +x ./repos/linux/.bin/install.sh; ./repos/linux/.bin/install.sh

Packer

Windows

• GitLab
• How to Extract Specific Files from Windows 10 ISO (Install.wim)

Mount-DiskImage -ImagePath H:\source\iso\win10\Autounattend.iso
Mount-DiskImage -ImagePath H:\source\iso\win10\Win10_21H2_English_x64.iso
Mount-DiskImage -ImagePath H:\source\iso\win10\virtio-win-0.1.208.iso
# elevated
Get-WindowsImage -ImagePath e:\sources\install.wim