Neural Speed: Fast Inference on CPU for 4-bit Large Language Models
Neural Speed: Fast Inference on CPU for 4-bit Large Language Models
Thu Apr 18, 9:33pm UTC
https://towardsdatascience.com/neural-speed-fast-inference-on-cpu-for-4-bit-large-language-models-0d611978f399