torchserve
Model serving engine for PyTorch. Focuses on MAR packaging, custom handlers for preprocessing/inference, and management of multi-GPU worker scaling. (torchserve, mar-file, handler, basehandler, model-
Also installable via skills CLI
npx skills add cuba6112/skillfactory/skills/torchserve