This is an automated archive.
The original was posted on /r/singularity by /u/DragonForg on 2024-01-13 06:31:11+00:00.
I fundamentally believe we were under-appreciating the GPT store. I think its potential comes with its ability to mass produce GPTs in all niches.
Let's suggest a GPT I wanted to look up. I am interested in making tea and understanding all the nuance in it. If I simply asked chatGPT to give me an output about tea, it simply would blurt out its best guess or answer.
But say a tea company or expert in tea includes data that helps the GPT by giving real-world material that can improve its performance. This is objectively easy to do, and it's this speed of development that makes it objectively better than saying, making a news article on tea.
All one has to do is take 10 minutes to collect data (article, wikipedia, etc), and ask GPT to make the prompt and all the rest it already does. Boom, you have a TeaGPT. Which allows you to have a better GPT maker.
Toss on top of that what CharacterAI has learned, with utilizing Loras to further improve their characters (giving them unique personalities), while in this case, it makes it more of an expert in the field.
Thus, the idea isn't like an appstore where we develop games that take a long time, but to spam the hell out of it, making countless upon countless GPTs of all specialties. With a decent algorithm that sorts them by usefulness, then you have not just "ChatGPT" but many different types or specialties of GPTs.
Hence, it isn't a fixed mixture of experts it is an infinite mixture of experts all based upon how good the Loras are and the data submitted.
In summary, it is basically a mixture of experts, but we create a mixture of experts. All niches created by our uses. If they suck well, they get thrown to 0 views (like all algorithms). If good, they get to the top. With such a mass supply and hopefully a massive user base, the best will move on the top.
Anyways, too ambitious, or do you think the same?
Is this what Sam means by AGI with GPT 5?