this post was submitted on 09 Oct 2023
36 points (100.0% liked)

Futurology

1765 readers
308 users here now

founded 1 year ago
MODERATORS
voidx@futurology.today
Lugh@futurology.today
Espiritdescali@futurology.today
AwesomeLowlander@futurology.today
36
Researchers say their open-source AI model LLaVA, is as powerful as GPT-4 Vision, which was released only weeks ago. (llava-vl.github.io)
submitted 1 year ago by RewindAgain@futurology.today to c/futurology@futurology.today
15 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] BetaDoggo_@lemmy.world 1 points 1 year ago

It's not even close, less than half of 3.5's 85.5% in ARC. Some larger Open models are competitive in Hellaswag, TruthfulQA and MMLU but ARC is still a major struggle for small models.

3Bs are kind of pointless right now because the machines with processors capable of running them at a usable speed probably have enough memory to run a 7B anyway.