quantization

Model quantization for efficient inference and training. Covers precisiontypes (FP32, FP16, BF16, INT8, INT4), BitsAndBytes configuration, memoryestimation, and performance tradeoffs.