this post was submitted on 02 Sep 2024
11 points (100.0% liked)

Reddthat Announcements

694 readers
1 users here now

Main Announcements related to Reddthat.

founded 2 years ago
MODERATORS
ticoombs@reddthat.com
reddthat@reddthat.com
example@reddthat.com
11
Outage: 2/Sept ~29 minutes (reddthat.com)
submitted 2 months ago by ticoombs@reddthat.com to c/reddthat@reddthat.com
1 comments fedilink hide all child comments
 

We had a brief outage today due to the server running out of space.

I have been tracking our usage but associated it with extra logging and the extra build caches/etc that we've being doing.

Turns out the problem was the frontend Next-UI which has been caching every image since the container was created! All 75GB of cached data!

Once diagnosed it was a simple solution to fix. I'm yet to notify the project of this error/oversight and I'll edit this once Issues/PRs are created.
I also haven't looked at turning the caching off yet as my priority was recovering the main Reddthat service.

Thanks all for being here!

Tiff

you are viewing a single comment's thread
view the rest of the comments
[–] Telorand@reddthat.com 2 points 2 months ago (1 children)

I just went and did the proverbial "touch grass" in the interim.