4-bit

IF4: Smarter 4-Bit Quantization That Adapts to Your Data

MIT researchers propose a hybrid data format that switches between floating-point and integer representations, improving accuracy in 4-bit neural network quantization.