Stateless (Warewulf-style) provisioning: profiles, node pools, overlays, dnsmasq export, compute image
CI / agent (push) Successful in 3s
CI / site (push) Successful in 3s
CI / go (push) Failing after 36s

Profiles bind a RAM-booted root image to overlay templates; assigning a
machine allocates a node name and management IP, writes the per-MAC PXE
entry with a per-node token and exports static leases for dnsmasq. Nodes
pull rendered overlays (hosts, slurm.conf from inventory, gres.conf, SSH
host key, munge key) through rollcall-overlay.service; the runtime refresh
timer is the heartbeat. Adds the compute-debian13 image definition and a
generic live-build root image script, CLI and web UI for profiles/assign.

Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
Ilker ManapandClaude Fable 5.1 committed 2026-10-27 02:00:14 +01:00
1 parent 1430421a3f
commit 7fe7c26e22
38 files changed
+1543 -16

No files matched your search

+31
View File
@@ -126,6 +126,37 @@ for a hint (`bmc_hints`) and verifies it out-of-band.
Vendor quirks (iDRAC/iLO password policies, missing empty slots) are reported in
`bmc.errors` and visible in the UI.
## Stateless nodes (Warewulf-style)
For HPC compute nodes Rollcall can boot a root image straight into RAM and
dress it with per-node files, instead of installing an OS on disk.
* **Images** live in `images_dir/<name>/{vmlinuz,initrd.img,filesystem.squashfs}`
and are built with `images/build-rootfs.sh <name>` from
`images/<name>/{packages.list,hook.chroot,includes/}` (live-build, same
toolchain as the commissioning image). `images/compute-debian13` is a
Debian 13 compute node: slurmd, munge, rdma-core, NFS client, firmware.
* **Profiles** bind an image to overlays, extra kernel parameters, a node name
format (`node%03d`) and variables: `rollcall profile add compute -image compute-debian13 -overlays compute`.
* **Assigning** a commissioned machine to a profile allocates a node name and
IPs from `node_pools`, writes a per-MAC PXE entry that boots the image with
`hostname=`, `rollcall.server=` and a per-node token, and exports static
DHCP leases plus host names for dnsmasq (`dnsmasq_dir`, re-read on HUP via
`rollcall-dnsmasq.path`). `rollcall assign <id> compute -boot` also
power-cycles the machine through its BMC.
* **Overlays** are directory trees under `overlays_dir/<overlay>/{system,runtime}`;
files ending in `.tmpl` are Go templates rendered with the node, all nodes of
the cluster, the profile and `cluster_vars`. The `compute` overlay generates
`/etc/hosts`, `slurm.conf` (node lines from the commissioning inventory:
sockets, cores, threads, memory, GPUs), `gres.conf`, a persistent SSH host
key per node (sealed in the database), root `authorized_keys` and the munge
key. Inside the image `rollcall-overlay.service` applies the system overlay
before munge/slurmd/ssh start; a timer refreshes the runtime overlay every
five minutes, which doubles as the node heartbeat (`booted` state, last seen).
* The controller renders the same files: `rollcall render compute etc/slurm/slurm.conf > /etc/slurm/slurm.conf`.
States: `ready → stateless → booted`; `rollcall unassign` releases name and IPs.
## Lab
`lab/` documents a Proxmox SDN test setup: an isolated vnet, a PXE server VM