I think we've seen pretty much the limit of what LLMs can pretend to do. They can sort of spit out code snippets in a stack overflow kind of way, but are not capable of starting with a set of requirements and producing a complex program. Programming has never been about remembering all the syntax and having all the design patterns memorized, that's what documentation and search engines are for. Programming is engineering a complete, maintainable solution given a set of requirements.
I do think LLMs will eat Stack Overflow's lunch as a source of quick code snippets for programmers to copy/paste.