http://blog.caveduck.io/tags/quantization/Recent content in Quantization on Warpspace BlogHugo -- 0.154.5en-USMon, 20 Apr 2026 00:00:00 +0000http://blog.caveduck.io/posts/neural-net-quantization/Mon, 20 Apr 2026 00:00:00 +0000http://blog.caveduck.io/posts/neural-net-quantization/We take the trained 32-bit weights of a neural net and shrink them down to 2–8 bits using two approaches: K-Means (non-uniform) and Linear (uniform, integer arithmetic). From the affine mapping r=S(q−Z) all the way to the compression-ratio vs. accuracy trade-off, with plots measured by actually running the code on an MNIST MLP.http://blog.caveduck.io/posts/deep-learning-data-types/Mon, 13 Apr 2026 00:00:00 +0000http://blog.caveduck.io/posts/deep-learning-data-types/INT8, FP16, BF16, FP8 (E4M3/E5M2), FP4 — what do all these data types flooding deep learning model cards actually mean, and how do bits get interpreted as numbers? We take them apart one by one, with a widget where clicking bits updates the formula and value in real time.