Technology

1009 readers

71 users here now

A tech news sub for communists

founded 2 years ago

MODERATORS

ByteDance just dopped Doubao-1.5-pro tht uses sparse MoE architecture, it matches GPT 4o benchmarks while being 50x cheaper to run, and it's 5x cheaper than DeepSeek (www.aibase.com)

submitted 3 days ago by yogthos@lemmygrad.ml to c/technology@lemmygrad.ml

23 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] juchenecromancer@lemmygrad.ml 1 points 1 day ago (1 children)

What kind of specs do you need to run DeepSeek locally? A few months back, I tried using ollama to run some small llama models on my home laptop (Ubuntu with 16GB RAM and a weak Nvidia integrated GPU w/ nouveau drivers) at it was borderline unusable.

[–] yogthos@lemmygrad.ml 1 points 21 hours ago

I got the deepseek-r1:14b-qwen-distill-fp16 version running with 32gb ram and a GPU here.