Stateless (Warewulf-style) provisioning: profiles, node pools, overlays, dnsmasq export, compute image
Profiles bind a RAM-booted root image to overlay templates; assigning a machine allocates a node name and management IP, writes the per-MAC PXE entry with a per-node token and exports static leases for dnsmasq. Nodes pull rendered overlays (hosts, slurm.conf from inventory, gres.conf, SSH host key, munge key) through rollcall-overlay.service; the runtime refresh timer is the heartbeat. Adds the compute-debian13 image definition and a generic live-build root image script, CLI and web UI for profiles/assign. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
This commit is contained in:
1 parent
1430421a3f
commit
7fe7c26e22
38 files changed
+1543
-16
No files matched your search
@@ -126,6 +126,37 @@ for a hint (`bmc_hints`) and verifies it out-of-band.
|
||||
Vendor quirks (iDRAC/iLO password policies, missing empty slots) are reported in
|
||||
`bmc.errors` and visible in the UI.
|
||||
|
||||
## Stateless nodes (Warewulf-style)
|
||||
|
||||
For HPC compute nodes Rollcall can boot a root image straight into RAM and
|
||||
dress it with per-node files, instead of installing an OS on disk.
|
||||
|
||||
* **Images** live in `images_dir/<name>/{vmlinuz,initrd.img,filesystem.squashfs}`
|
||||
and are built with `images/build-rootfs.sh <name>` from
|
||||
`images/<name>/{packages.list,hook.chroot,includes/}` (live-build, same
|
||||
toolchain as the commissioning image). `images/compute-debian13` is a
|
||||
Debian 13 compute node: slurmd, munge, rdma-core, NFS client, firmware.
|
||||
* **Profiles** bind an image to overlays, extra kernel parameters, a node name
|
||||
format (`node%03d`) and variables: `rollcall profile add compute -image compute-debian13 -overlays compute`.
|
||||
* **Assigning** a commissioned machine to a profile allocates a node name and
|
||||
IPs from `node_pools`, writes a per-MAC PXE entry that boots the image with
|
||||
`hostname=`, `rollcall.server=` and a per-node token, and exports static
|
||||
DHCP leases plus host names for dnsmasq (`dnsmasq_dir`, re-read on HUP via
|
||||
`rollcall-dnsmasq.path`). `rollcall assign <id> compute -boot` also
|
||||
power-cycles the machine through its BMC.
|
||||
* **Overlays** are directory trees under `overlays_dir/<overlay>/{system,runtime}`;
|
||||
files ending in `.tmpl` are Go templates rendered with the node, all nodes of
|
||||
the cluster, the profile and `cluster_vars`. The `compute` overlay generates
|
||||
`/etc/hosts`, `slurm.conf` (node lines from the commissioning inventory:
|
||||
sockets, cores, threads, memory, GPUs), `gres.conf`, a persistent SSH host
|
||||
key per node (sealed in the database), root `authorized_keys` and the munge
|
||||
key. Inside the image `rollcall-overlay.service` applies the system overlay
|
||||
before munge/slurmd/ssh start; a timer refreshes the runtime overlay every
|
||||
five minutes, which doubles as the node heartbeat (`booted` state, last seen).
|
||||
* The controller renders the same files: `rollcall render compute etc/slurm/slurm.conf > /etc/slurm/slurm.conf`.
|
||||
|
||||
States: `ready → stateless → booted`; `rollcall unassign` releases name and IPs.
|
||||
|
||||
## Lab
|
||||
|
||||
`lab/` documents a Proxmox SDN test setup: an isolated vnet, a PXE server VM
|
||||
|
||||
Reference in new issue
Block a user