Llm-Compressor on Sana Fayyaz

Llm-Compressor on Sana Fayyazhttps://sanafayyaz315.github.io/tags/llm-compressor/Recent content in Llm-Compressor on Sana FayyazHugoen-usThu, 03 Sep 2026 00:00:00 +0000Half the Size, Better Performance, Same Accuracy: Understanding W8A8 INT8 LLM Quantizationhttps://sanafayyaz315.github.io/posts/understanding-w8a8-int8-llm-quantization/Thu, 03 Sep 2026 00:00:00 +0000https://sanafayyaz315.github.io/posts/understanding-w8a8-int8-llm-quantization/Compressing Llama 3.1 8B with SmoothQuant + GPTQ (W8A8 INT8): what changes under the hood, and what it costs and buys you in accuracy and serving performance.