It is difficult to get a man to understand something, when his
salary depends on his not understanding it!—Upton Sinclair,
I, Candidate for Governor: And How I Got
Licked
What will happen long term is more specialized models for specific applications. MS already has coder facing resources through GitHub Co-Pilot, and they were the key funders for most of OpenAI’s work with GPT so they have also deployed GPT4 inline for Bing, which I find actually pretty useful even though it’s been neutered to all hell.
The problem with GPT is the G. Generalized. We’ve been building more specific models though. Co-Pilot is already trained on the entire codebase and discussion boards on GitHub. Eventually that’s going to be the tool you want to use over GPT because it’s specifically designed for code above all else.
What will happen long term is more specialized models for specific applications. MS already has coder facing resources through GitHub Co-Pilot, and they were the key funders for most of OpenAI’s work with GPT so they have also deployed GPT4 inline for Bing, which I find actually pretty useful even though it’s been neutered to all hell.
The problem with GPT is the G. Generalized. We’ve been building more specific models though. Co-Pilot is already trained on the entire codebase and discussion boards on GitHub. Eventually that’s going to be the tool you want to use over GPT because it’s specifically designed for code above all else.