Training mode
This changes both memory and throughput assumptions.
Precision
4bit is intended for QLoRA-style adapter training. Use fp16 or bf16 for fuller training flows.
Enabled checkpointing lowers memory at the cost of some extra compute.
Recommended when you already ran a short pilot fine-tuning job.