torchserve

Model serving engine for PyTorch. Focuses on MAR packaging, custom handlers for preprocessing/inference, and management of multi-GPU worker scaling. (torchserve, mar-file, handler, basehandler, model-

by cuba6112· Repository·other
Also installable via skills CLI
npx skills add cuba6112/skillfactory/skills/torchserve

Source

Path:skills/torchserve/SKILL.md(main)

Related in other

torchserve | AgentArea Skills