AI models clearly "think" differently to humans. We know this to be true because you have to pre-train models extensively on huge amounts of text to get them to even predict simple English language completions. The model that first started the boom, GPT-3, was 175 billion parameters of 16-bit float, and required at least 500GB of data to train on. But that's because they
aren't human brains. We've just solved the problem of pair programming in a different way to billions of years of evolution.
I was one of those people a year-ish ago, never thought AI models would help with coding, decided to do a free trial (back then) of Github Copilot and ... yeah, I changed my mind pretty quickly. These models are genuinely game changing.
I don't think that there's a multi-trillion-dollar industry worth of AI to come, but I could easily see hundred billion dollars kind of scale just from what it does for software engineering.
These models still make... strange and quite "dumb" mistakes... but also school me from day to day, and I'm learning more than I ever did with Google and StackOverflow.
Of course things change quickly and I will change my opinion accordingly.
I do think AI is great and that it is genuinely helpful, but I can also see its limitations.
At the moment it isn't something I can use in my current role due to security concerns.
You can run local models on modern computer hardware. Models like Qwen-3.8-27B for instance are almost as good as older, formerly SOTA models like Claude Sonnet 4.5. They require a PC with 16-32GB of RAM, and a CPU with many threads, or a GPU that supports addressing larger memory pools.
They obviously cannot create security concerns since the model is just a gigantic mathematical vector describing how to transform tokens, and it runs only in your personally controlled environment (llama.cpp, or other environments), so it won't be uploading data to some datacenter somewhere or spying on you - it literally couldn't even if the model designers wanted it to do so.
Many of these models have been trained on distilled outputs of SOTA models. Frontier AI companies love to argue that this is illegal and IP infringement, but the outputs of AI models aren't copyrightable (because no human authorship was involved), and... well, they didn't pay for their training data either, so I think it's rather hypocritical frankly. What is interesting is how capable open models are despite being much smaller than the models they were trained off. There's obvious knowledge limitations, and they can be more prone to hallucination, but in mainstream work (Python, C/C++, that kind of thing) they're easily just as capable as the frontier models, but around 1/50th the size.