torch-tensor-parallelism

Guidance for implementing tensor parallelism in PyTorch, including ColumnParallelLinear and RowParallelLinear layers. This skill should be used when implementing distributed tensor parallel operations

by letta-ai· Repository·design
Also installable via skills CLI
npx skills add letta-ai/skills/design/torch-tensor-parallelism

Source

Path:design/torch-tensor-parallelism(main)

Related in design