Your GPU is an AI accelerator already. Running trained AI models is not as resource demanding as training one. Unless local training becomes universal, AI acclerators for consumers make very few sense.
this post was submitted on 27 Jun 2023
15 points (100.0% liked)
Gaming
30429 readers
207 users here now
From video gaming to card games and stuff in between, if it's gaming you can probably discuss it here!
Please Note: Gaming memes are permitted to be posted on Meme Mondays, but will otherwise be removed in an effort to allow other discussions to take place.
See also Gaming's sister community Tabletop Gaming.
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
The newest gen GPUs have sections dedicated to AI already, so we effectively already have dedicated AI accelerators.
Yes there are but the op is talking about discrete AI accelerators....
Unless the AI processing is much more specialized than graphics, I think manufacturers would put that effort into making more powerful GPUs that can also be used for AI tasks.
They would try to alleviate the cost on running GPU by making an AI accelerator chip like Tensor Core, but it'll get bottleneck by limited VRAM when Neural Net models require steep amount of memory. it's more productive to have something like NPU that runs either on RAM or by it's own memory chips offering higher amount of capacity to run such neural net and avoid the roundtrip data copying between GPU and CPU.
We saw this happen a long time ago with PPUs. Physics Processing Units. They came around for a couple of years, then the graphics cards manufacturers integrated the PPU into the GPU and destroyed any market for PPUs.
Look into what Mystic AI was doing. It's effectively what you were talking about but based in reality :)
What is the significance of semiconductors in chatbot technology?How do semiconductors enhance chatbot capabilities?Can chatbots powered by semiconductors understand and respond to human emotions?What role do semiconductors play in voice-based interactions with chatbots?
Tips: the datasheet (https://www.icdrex.com/the-future-of-communication-chatbots-powered-by-semiconductors/) may help you a little.
Absolutely, I would suggest looking into two separate devices that focuses solely on AI acceleration:
and
Two very interesting articles. Thank you for that!
Especially the analog processor is a game changer with having the computation directly in memory. Generally, analog computers are a very interesting subject!
Good question, but I'd say that the same train of thought went through dedicated physics cards. I'd guess that an AI card should have a great value proposition to be worth buying.
For compatibility, they could e.g. offer a cloud based subscription system.
I'm not sure where you're going with this, but it feels wrong. I'm not buying a hardware part that cannot function without a constant internet connection or regular payment.