mpi-ring finishes in about two seconds, so there is nothing to observe in
squeue, no meaningful sacct record and no load on the nodes.
heat_mpi solves 2D steady-state heat diffusion by Jacobi iteration over a
grid split into horizontal strips, one per rank. Every iteration performs a
five-point stencil, a halo exchange with the neighbouring ranks via
MPI_Sendrecv, and an MPI_Allreduce for the global residual - so it exercises
compute and both point-to-point and collective communication rather than just
starting up and exiting.
It runs to a wall-clock budget (-m minutes) instead of a fixed iteration
count, which is what makes it useful for watching the scheduler. Stopping is
collective: rank 0 decides and broadcasts, so every rank leaves on the same
iteration. The residual falls monotonically, which doubles as a check that the
halo exchange is correct.
Measured on this cluster: 6144 grid, 8 ranks over 4 nodes, ~12 GFLOP/s with
all nodes at ~95% CPU and ~72 MiB per rank.
heat-long.sbatch defaults to 20 minutes and takes GRID, MINUTES and REPORT
through --export.