Today, we can think of large language models (LLMs) as the “JPEG of knowledge.” An LLM isn’t a database filled with precise, factual data—it’s a lossy, compressed version of knowledge.

While running tests, Bühlmann found that a novel image compressed with Stable Diffusion looked subjectively better at higher compression ratios (smaller file size) than JPEG or WebP.