Operational patterns for LLM inference: latency budgeting, tail-latency control, caching, batching/scheduling, quantization/compression, parallelism, and reliable serving at scale. Emphasizes producti
frameworks/shared-skills/skills/ai-llm-inference(main)