Slurm: why priority/basic, said rightly
CI / test (push) Failing after 8m3s

priority/basic did not end InvalidAccount: 23.11 dropped
accounting_storage/none, and without slurmdbd the main scheduler passes
jobs by whatever the priority plugin. Basic stays, fair share needing
slurmdbd anyway.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Ilker ManapandClaude Opus 5.5 committed 2026-11-11 23:21:24 +01:00
1 parent bab0766ee1
commit 02774769a7
2 files changed
+8 -6

No files matched your search

+4 -3
View File
@@ -2039,9 +2039,10 @@ lent, partition`); the leader tells each named node's agent (root) what to be, t
InvalidAccount and backfill starts them, one a pass (bf_interval=10: 6-10 s each). So many small jobs
want slurmdbd. — Wrong cause, found 2026-11-11: a job asking no memory got the whole node's (ReqTRES
mem=all), so a node ran one job at a time and each next one waited for backfill's pass. Fixed: the
partition's DefMemPerCPU is the leanest node's share; slurmdbd is not needed for this. And InvalidAccount is
real: 23.11 defaults to priority/multifactor, whose main scheduler passes every job by without
accounting storage; PriorityType=priority/basic starts a job on submission. Also found: slurm.conf
partition's DefMemPerCPU is the leanest node's share; slurmdbd is not needed for this. InvalidAccount is real too:
23.11 dropped accounting_storage/none, and without slurmdbd the main scheduler passes every job by;
backfill starts it within bf_interval (10 s). priority/basic did not change that (fair share needs
slurmdbd anyway). Starting on submission needs slurmdbd, on MySQL/MariaDB. Also found: slurm.conf
wrote every node State=DRAIN, so each slurmctld start (on any change of the files) drained a lent node
until its agent resumed it, up to a minute; a lent node is now written without it. Not tried yet: a GPU node (gres).
- Failover while lent, tried 2026-11-11 (v0.16.3-23): the first try killed the job (NODE_FAIL). A new
+4 -3
View File
@@ -218,9 +218,10 @@ JobAcctGatherType=jobacct_gather/none
SelectType=select/cons_tres
SelectTypeParameters=CR_Core_Memory
SchedulerType=sched/backfill
# Without accounting storage, 23.11's default (multifactor) has the main
# scheduler pass every job by as InvalidAccount, for backfill to start a
# pass later; basic is first come, first served, started on submission.
# First come, first served: multifactor's fair share needs accounting
# storage (slurmdbd), which there is none of yet. Without it, 23.11's main
# scheduler passes every job by as InvalidAccount, and backfill starts it
# on its next pass (bf_interval above).
PriorityType=priority/basic
GresTypes=gpu
MpiDefault=none