Latest posts tagged with #quantizing on Bluesky
LO-BCQ: Locally Optimal Block Clustered Quantization for 4-bit (W4A4) LLM Inference
Reena Elangovan, Charbel Sakr, Anand Raghunathan, Brucek Khailany
Action editor: Yunhe Wang
https://openreview.net/forum?id=loWISTqGwW
#quantization #quantizing #blocks
Accumulator-Aware Post-Training Quantization for Large Language Models
Ian Colbert, Giuseppe Franco, Fabian Grob, Jinjie Zhang, Rayan Saab
Action editor: Jundong Li
https://openreview.net/forum?id=p6l0579yj7
#quantization #quantizing #multiplications
New #Featured Certification, #J2C Certification:
LO-BCQ: Locally Optimal Block Clustered Quantization for 4-bit (W4A4) LLM Inference
Reena Elangovan, Charbel Sakr, Anand Raghunathan, Brucek Khailany
https://openreview.net/forum?id=loWISTqGwW
#quantization #quantizing #blocks
