awq

Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference

by majiayu000· Repository·other
Also installable via skills CLI
npx skills add majiayu000/claude-skill-registry/skills/devops/awq-quantization

Source

Path:skills/devops/awq-quantization(main)

Related in other

awq | AgentArea Skills