Vector Post-Training Quantization (VPTQ) is a novel Post-Training Quantization method that leverages Vector Quantization to high accuracy on LLMs at an extremely low bit-width (<2-bit). VPTQ can ...

Abstract: Conventional soft clustering algorithms perform well on linearly distributed features, but their performance degrades on nonlinearly distributed features in high-dimensional space. In this ...

Abstract: In this article, we present an efficient unified algorithm for the minimum Euclidean distance between two collections of compact convex sets, each of which can be a collection of convex ...