Home / server / Questions / 130826
In Process
sud03r
Asked: 2010-04-09 22:57:55 +0800 CST

Distributed file systems

  • 772

I need to implement a distributed storage system for a set of nodes(devices) connected in a mesh network.

So what basically my design goals are:

  1. The storage system should be capable of handling dynamic entry and exit of nodes.
  2. Replication (for fault tolerance).

For this i am thinking of using a Distributed file system. Every node could access data in the other nodes in a transparent manner.

Are there some simple, easily pluggable opensource implementations?

Thanks for your thoughts!

distributed-filesystems

4 Answers

  1. OpenAFS is a well supported, cross platform distributed file system solution used widely, which can do all of what you said.

    • 3

  2. Ceph, when it reaches production quality, might be a good choice.

    • 3

  3. OpenAFS is quite good. It also allows for a service pool so that a disconnected node still has a copy of their data. i.e. you work on your laptop which is an AFS node, but, files that are in your distributed storage modified recently still have a local copy. When you reconnect, those modified files are then resynced.

    GlusterFS/Lustre is another decent one. I had some performance problems with GlusterFS on write-heavy content, but, it worked very well.

    http://www.cleversafe.org/dispersed-storage/ is another possible solution.

    http://danga.com/mogilefs/ if you don't require a posix compliant filesystem

    • 2

  4. If you need open source and fault-tolerant distributed file system then you can use MooseFS. You can install it easily for example on Ubuntu.

    • 1