Four weeks ago, GPT-4 remained the undisputed champion: consistently at the top of every key benchmark, but more importantly the clear winner in terms of “vibes”. Almost everyone investing serious time exploring LLMs agreed that it was the most capable default model for the majority of tasks—and had been for more than a year.
Today that barrier has finally been smashed. We have four new models, all released to the public in the last four weeks, that are benchmarking near or even above GPT-4. And the all-important vibes are good, too!
Those models come from four different vendors.
Until there is open sourced community AI, none of it matters. We as working class are going to be fucked.
There are many free LLM models and platforms to access them. You can download and permanently posses the actual model files and weights.
There are open source frameworks to run and interact with these models that run fully locally
The problem is open models are nowhere close to stuff like GPT-4. It is going to be a problem for us non-elites.
The problem is open models are nowhere close to stuff like GPT-4
Of course not, you’d need the same class of hardware running 24/7 to get similar results, and ain’t nobody paying for that.
Agreed but it’s still a good tool thats available. You can use it to summarize large documents. Yes prolly never as capable if you have elite monies. But still worth playing and learning how to use. Imho.
I’ll acknowledge that right now to get model conclusions on par with gpt 4 you are going to need a custom pipeline with multiple adversarial models, RAG and more. But it all could be built by an eager hobbyist with a strong gaming pc
To be clear this approach will not benchmark the same as gpt 4 but can indeed generate useful content.
it all could be built by an eager hobbyist with a strong gaming pc
That’s a no, chief. These Big Tech CIA corpos buy 100000s of Nvidia Tegra A100 GPUs.
Lol mmk
Mistral has a lot of open source models that are quite good. Their largest ones are closed; for what reason I don’t know.
Then that also does not matter. It is the simple consequence of “open” advocates not donating or being financially involved with AI LLM model building computer hardware or datasets. Money capital happens to be the most important factor in society as of now.
None of the models that rival gpt4 are open AFAIK
Yup
Firstly, none of those models are openly licensed or weights available. I imagine the resources they need to run would make them impractical for most people, but at after a year that has seen enormous leaps forward in the openly licensed model category it’s sad to see the very best models remain strictly proprietary.
Hmm has the leaderboard not been updated? It’s still showing gpt4 at the top: https://huggingface.co/spaces/lmsys/chatbot-arena-leaderboard
deleted by creator
Note to self — read the thread first.
