torch-tensor-parallelism

Guidance for implementing tensor parallelism in PyTorch, including ColumnParallelLinear and RowParallelLinear layers. This skill should be used when implementing distributed tensor parallel operations

by letta-ai· Repository·design
Also installable via skills CLI
npx skills add letta-ai/skills/letta/benchmarks/trajectory-only/torch-tensor-parallelism

Source

Path:letta/benchmarks/trajectory-only/torch-tensor-parallelism(main)

Related in design