

The current architectures fundamentally aren’t capable of such complexity, no matter how big they get or what prompt wrappers they have.
There are some interesting, deeper innovations in papers, but the AI hyperscalers seem to have little awareness of them, and I’ve seen so many cool experiments just drift by with no further testing these past few years. Which, again, suggests whatever approach the purse holders are taking is not a “innovate our way to better complexity” one.






Well Musk’s quote there isn’t wrong.
Musk isn’t an engineer, but neither are those consultants. They should all be deferring to deeper within the company for technical decisions instead of conflating some sci fi literacy with practical decision making, and leave musk to making much coarser ones at most.