this post was submitted on 06 Jul 2023
58 points (100.0% liked)
Linux
48136 readers
628 users here now
From Wikipedia, the free encyclopedia
Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).
Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.
Rules
- Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
- No misinformation
- No NSFW content
- No hate speech, bigotry, etc
Related Communities
Community icon by Alpár-Etele Méder, licensed under CC BY 3.0
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
IDK 🤷♂️ But it also looks like the laptop GPU you propose has a maximum of 12gb ram, which is already quite low for the older image models and definitely not enough for most language models.
This guy is windows centric but has a list of ram minimum requirements: https://www.youtube.com/watch?v=H-6DXU967bU&t=314
or just the cropped screenshot:
I'm mostly concerned with what potential proprietary garbage is locked in the firmware of a laptop. Current PC motherboards are even worse for this, like even System76's firmware for their desktops is proprietary. The work on HIPS to bridge CUDA and ROCm is active and open source. I'll deal with some limitations to avoid nvidia treating me like garbage as a customer. There is a good bit of banter about how AMD is currently operating at around half its potential and that this is about to change. With OpenSIL and the effort AMD is putting into open source it seems like the better option. I want to do some more kernel hacking experiments with the CPU scheduler and process isolation. This is far easier when I don't have to deal with asymmetrical cores and complicated management.
Regardless, the linked data telemetry shows plenty of people are running AMD GPUs just fine. I was expecting to see custom kernels used with the Radeon stuff and mostly people running mainline, but that is not the case. There are a few on the bleeding edge, but most are on old generic LTS kernels. It looks like it just works. The dataset includes the parameters and iteration time for each user running SD. It is a little slower than nvidia, but it still works fine. There are a lot of people running 8GB and smaller GPUs on SD.
This is for very low resolution only and AI up-scaling then takes another long time. Yes SD can work with 8gb vRAM and 12 is nicer, but the upcoming SDXL will probably require 16gb to work good enough.
I agree that Nvidia is crap and would love to recommend AMD, but their software for AI stuff is just bad right now and their business decisions to only support the newest data-center GPUs with it is even worse.
I have an all AMD Linux system, and it works great for gaming and VR, but I have given up on trying to get SD to work on it despite spending a lot of time on that already. Maybe with a newer card it would be better, but I think the risk is just too high to spend a lot of money on an officially unsupported card that AMD can break any minute and has done so in the past.
This is the talking-sense that got to me. Thanks. It is why I made the post before pulling the trigger.
I really hate shopping and now I'm back to zero. I probably need to focus on an external graphics card solution, but that looks like a messy space to navigate too. There seems to be a good bit of negative feedback from the ASUS ROC external GPU laptop setup. I have no idea what is or is not possible. I think I saw a headline in passing about USB4 just getting merged into the kernel, so that doesn't bode well for support of existing hardware. I'm not sure what kind of bandwidth is really needed for SD to the CPU.
Thanks again for the minor disappointment to avoid a major one later.