awq
Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference
Also installable via skills CLI
npx skills add ihatesea69/HieuNghi-AI-Skills/airesearch_skills/10-optimization/awq
Source
Path:
airesearch_skills/10-optimization/awq/SKILL.md(main)