Google's new TurboQuant algorithm speeds up AI memory 8x, cutting costs by 50% or more

TL;DR

Reports differ across sources; according to arstechnica.com, even if you don’t know much about the inner workings of generative AI models, you probably know they need a lot of memory.