The path to ubiquitous AI | Taalas

This looks like something fun to keep track of. Having near-instant responses from small models enables so many interesting things.

If things go this route for established, stable models then a lot of the general criticism over resource demands for GPU-heavy datacenters will ... shift. I say shift because it won't eliminate the angst some feel for what people have done with LLMs ("AI slop") and they'll latch on to something else. Treating silicon as a disposable product (and the attached board and supporting chips) would be a fair first target.