Demo mode — sample data only. Sign up to connect real training runs.

failedLightningrecoverable

slurm-protein-exp7

Step 400 · loss 0.1800 · 10/1/2026, 2:11:03 AM

Recovery

resume_from_checkpoint

python -m faultline.cli resume demo-run-failed

Metrics

Checkpoints

Latest checkpoint: step 40011.5m ago agocommitted
100
200
300
400

Events

  • infofaultline.run.resume_completed10/1/2026, 2:12:03 AM

    recovery succeeded from checkpoint step 400

    Recovery successful

  • errorfaultline.run.failed10/1/2026, 2:11:03 AM

    Slurm node eviction (demo)

  • infofaultline.checkpoint.saved10/1/2026, 2:10:03 AM

    checkpoint step 400