vLLM: high-throughput LLM serving, OpenAI API, quantization.
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞