this post was submitted on 06 Aug 2023
1461 points (99.0% liked)
Announcements
23319 readers
1 users here now
Official announcements from the Lemmy project. Subscribe to this community or add it to your RSS reader in order to be notified about new releases and important updates.
You can also find major news on join-lemmy.org
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Is there any limitations with the database (postgres)?. I know postgres is one of the best (maybe even best) monolith database (running on one node) at the moment, but will the space be enough? With this in mind, has there been any consideration of migrating to a distributed database like ScyllaDB or CassanraDB to alleviate potential space constraints? On the other hand, if Lemmy doesn't intend to store data for long periods, maybe the capacity of Postgres would suffice. Any thoughts or plans on this? I appreciate your insights on this matter.
Disk space is definitely not an issue for us w/ postgres, or any text data really. The entire wikipedia english text data, is ~20GB. Images are the main disk-space concern for servers.
A backup of lemmy.ml's DB is only ~1.8 GB currently, and that's 3+ years of data.
We have no plans to move away from postgres, and lose all of its features and performance.
Distributed columnar databases are a different breed, migrating to that would not be trivial as it comes with a reduction of features compared to a traditional SQL databases, such as partial SQL support, bad join performances and lack of secondary indexes.