🪔 Happy Diwali! Wishing you and your family a festival full of light, joy and good health. 🪔

HubDatAICloud · Data · AI Ops

- Azure
- AWS
- OCI
- All AI & GenAI
- Vector Databases
Learning
Videos
Tags
About

Home / Tags / #quantization

#quantization

3 posts tagged quantization.

GPU basics for LLM inference: VRAM, model size math, precision and which GPU you actually needAI & GenAI · 29 Oct 2026
Optimization: shrinking vector indexes - fewer dimensions, int8 and binary quantization, and rescoringAI & GenAI · 25 Oct 2026
Transformation: moving self-hosted LLM inference from FP16 to FP8 or INT4 quantized modelsAI & GenAI · 25 Oct 2026

Search

Search all 1585 posts by error text, command, service or tag.

Azure
AWS
OCI
Data Platform
Databricks on Azure
Databases
AI & GenAI
Tags
About
RSS
LinkedIn

visitors visited

© 2026 HubDatAI by Deepak Bhardwaj. A personal, non-commercial knowledge-sharing blog for IT support professionals. Views are my own and not those of any employer. Commands are provided as-is; test them outside production first.