omegastick

joined 1 year ago
[–] omegastick@lemmy.ml 14 points 1 year ago (1 children)

I asked for advice on how to express something in UML once:

"No one cares whether you follow the UML standard, just make something up"

"But my company uses waterfall and requires UML diagrams to move onto the next phase of development!"

"That's an issue with your company then. Ask your boss how to do it. Question closed."

[–] omegastick@lemmy.ml 3 points 1 year ago

I was considering this. The hosting provider we use for model training runs doesn't charge for ingress/egress. Their storage costs would eat us alive though haha. OVH looks much more promising.

[–] omegastick@lemmy.ml 2 points 1 year ago (1 children)

Interesting, I'll have to have a look at doing something like that. If I remember correctly, the CivitAI devs are active on Discord, so maybe I could just ask them directly.

 

I'm looking at starting a service that involves hosting a lot of LLM models, which are often going to be 16GB+ (compressed). I did a bit of searching for cloud storage providers with cheap egress, and the cheapest I could find is $0.01 per GB, which would still be $0.16+ per download.

How do sites like Huggingface or CivitAI do it? Lots of VC funding?