I run a full media server, as well do a few friends. Now we had the idea to share our media libraries. In a first quick attempt we, mounted each other’s library folder via an smb share and imported those in jellyfin (all servers connected by VPN) Works quite well, but is kind of cumbersome the more people get in. I had the following idea: distributed storage, not as in redundancy, but more like mergerfs. Each “node” allocates a certain amount of storage, say node A, B and C provide 1TB each, these get fused into a singe mount that shows up as 3TB volume. If one node goes offline, the volume will only be 2TB and all files on the offline node will of course be unavailable.
Did a bit of research and found stuff like ceph,.glusterfs or seeweedfs, all of which I guess have a lot more functionality and thus are quite complicated and a little over my head. Do you do something like that or have any good ideas how to do that easily?
I use Plex instead of jellyfin, but there’s the ability to just add a friends library and it pulls in without mounting anything. I thought Jellydin had that as well?
I run Plex too, and indeed library sharing is built right in and ridiculously easy to set up.
I think OP is already doing things the best way possible in Jellyfin by mounting others’ servers remotely over VPN
Another one to have a search for is IPFS.
Ceph, GlusterFS, and I suspect SeaweedFS (but I haven’t used it) expect high speed, low latency connections to their peers. So they won’t work well over the internet.
There’s some info floating around about using IPFS as the backend for Jellyfin, which in theory should allow you to share media between friends, but I haven’t tried it.
I think you can keep doing the SMB shares and use an overlay filesystem on top of those to basically stack them on top of each other, so that
server1/dir1/file1.txt
andserver2/dir1/file2.txt
andserver3/dir1/file3.txt
all show up in the same folder. I’m not sure how happy that is when one of the servers just isn’t there though.Other than that you probably need some kind of fancy FUSE application to fake a filesystem that works the way you want. Maybe some kind of FUES-over-Git-Annex system exists that could do it already?
I wouldn’t really recommend IPFS for this. It’s tough to get it to actually fetch the blocks promptly for files unless you manually convince it to connect to the machine that has them. It doesn’t really solve the shared-drive problem as far as I know (you’d have like several IPNS paths to juggle for the different libraries, and you’d have to have a way to update them when new files were added). Also it won’t do any encryption or privacy: anyone who has seen the same file that you have, and has the IPFS hash of it, will be able to convince you to distribute the file to them (whether you have a license to do so or not).
Could you use symlinks? Not sure what the “gotchas” or downside to this approach is though.
Downside: it’s entirety manual and not scalable whatsoever.
Could you explain further? Wouldn’t this just need to be setup once per server that OP wants to connect?