accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). I

by ihatesea69· Repository·other
Also installable via skills CLI
npx skills add ihatesea69/HieuNghi-AI-Skills/airesearch_skills/08-distributed-training/accelerate

Source

Path:airesearch_skills/08-distributed-training/accelerate/SKILL.md(main)

Related in other

accelerate | AgentArea Skills