Adam Knight

Software & Stories

Bookmark

taalas.com/the-path-to-ubiquitous-ai/

This looks like something fun to keep track of. Having near-instant responses from small models enables so many interesting things.

If things go this route for established, stable models then a lot of the general criticism over resource demands for GPU-heavy datacenters will ... shift. I say shift because it won't eliminate the angst some feel for what people have done with LLMs ("AI slop") and they'll latch on to something else. Treating silicon as a disposable product (and the attached board and supporting chips) would be a fair first target.