Firefox

17941 readers

76 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 4 years ago

MODERATORS

k_o_t@lemmy.ml

Orbit by Mozilla (orbitbymozilla.com)

submitted 2 months ago by neme@lemm.ee to c/firefox@lemmy.ml

83 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] thingsiplay@beehaw.org 17 points 2 months ago (1 children)

Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

So it connects to Google Cloud for this? What does that mean "locally", if its a Cloud Platform? And what does that mean "Mozilla's", if its Google? I'm a bit confused with this sentence.

Does it download and execute it locally offline or does it send the data to Google Cloud Platform?? The page is not clear about this and I searched for an answer. I have the same Mistral 7B model that I downloaded from HuggingFace website and can use offline with a specific GUI application. It would be nice if I could Firefox point to that file instead.

Otherwise, this does not look very promising and I wouldn't trust it at the moment.

[–] Bitrot@lemmy.sdf.org 19 points 2 months ago* (last edited 2 months ago) (1 children)

Google Distributed Cloud allows you to run Google Cloud Platform locally in your own datacenter. They can deploy apps to that infrastructure and use the cloud console for management, or even use normal kubernetes tools for it.

Couldn’t say if that’s what they’re actually doing, but running Google Cloud locally is a thing.

[–] thingsiplay@beehaw.org 2 points 2 months ago (1 children)

Thanks for the clarification. That's interesting indeed. Unfortunately Mozilla is so dependent on Google.

[–] Bitrot@lemmy.sdf.org 4 points 2 months ago

I agree. I’d prefer they just run their own Kubernetes and manage it themselves. Maybe throw some business at Red Hat if they need help with it.