Can gzip be a language model?
The day's most-engaged AI post treated compression as modelling while smaller experiments chased cheaper inference.
TL;DR
- The most-engaged AI item on Hacker News was a post asking whether gzip can be a language model.
- Two more Hacker News write-ups argued about optimization: a summer of AI optimization and a claim that a log router does not need a large LLM.
- On r/MachineLearning, a framework-free prototype learner claimed 1.6x-4x faster fact correction than backprop, and ProgramAsWeights proposed compiling English function descriptions into locally-run neural programs.
The most-engaged AI item on Hacker News was a post asking whether gzip can be a language model, reviving the compression-as-modelling connection. [1]
Two more Hacker News write-ups pushed the same cost theme: a review of a summer of AI optimization and an argument that a log router does not need a large LLM behind it. [2] [3]
On r/MachineLearning, a framework-free prototype learner claimed it lets local LLMs learn and correct facts instantly, reported as 1.6x-4x faster than backprop; a separate project, ProgramAsWeights, proposed compiling English function descriptions into neural programs that run locally. [4] [5]
Why it matters
If compression and tiny task-specific programs carry more of the load, the economics of inference move away from ever-larger general models — the same pressure that keeps local-inference work relevant.
Editor's note
Performance figures are self-reported by the projects and posts and were not benchmarked here.