Can the fediverse really scale?
I'm thinking about kbin/lemmy here, but my understanding is that every instance has to maintain a copy not just of the magazines/communities it hosts but also every other one its users subscribe to? So in a worst case scenario, the storage requirements would grow in sort of an N-squared fashion, would they not? If all of reddit wound up here, that's a lot of storage.
I guess the idea is that a smaller instance would only have to manage some subset of magazines of interest to its membership. But all it would take would be some bots sneaking in there and subscribing to everything, sort of like the kid who hits every button on the elevator.
I'm not sure what the solution is? I think it's good to have more than one copy of any given magazine/community kicking around in case its host instance goes dark/defederates/whatever. But maybe there is some sort of middle ground? Like perhaps a somewhat torrent-like scheme for backup where instances can contribute as much storage/bandwidth as is realistic for them? I'm not sure how that would work, but you would somehow want to ensure that there are a few redundant copies of every community distributed across all instances. And of course an instance could still go on caching the more active communities for practical reasons.
#RedditMigration