this post was submitted on 25 Dec 2024
25 points (79.1% liked)
Linux
5505 readers
185 users here now
A community for everything relating to the linux operating system
Also check out !linux_memes@programming.dev
Original icon base courtesy of lewing@isc.tamu.edu and The GIMP
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Hopefully the distros integrate ollama or similar so users don't have to think about it. And it all runs locally.
Anything like that should absolutely be left up to the user. The distro should not decide that for you. If you want it, install it and set it up yourself.
I dont see any harm in including support for running models built into the distro and then providing easy access to a pre-selected list of models to use with that if the user wants.
Sure, I agree with that. But that should, at the very least, not be included in a general purpose distro aimed at beginners unless they offer it as a seperate download or something. I feel like this kind of thing should be a seperate edition of the distro or something for people who actually want it.
How about no. Users can install apps like Alpaca if they want AI. Right now there are zero Foss models anyway and there are many copyright issues.
It's already in the AUR. And someone could just set up a PPA for DEB-based distros.