I've played around with GlusterFS a few times now. First it was the distribution which they eventually stopped making. Then it was the RedHat RPM packages (also available for debian/ubuntu) which worked out pretty well. In the near future, I'll be testing Openstack which can use GlusterFS for storage of virtual machine nodes.
I always had some minor issues compiling it for Opensuse or SLES. Recently, I realized that GlusterFS has been added to Opensuse's official distribution (on the DVD and in the defualt repository). Well, needless to say that I jumped on the opportunity. As of a couple days ago, this site runs on Opensuse 12.1, Nginx, and GlusterFS. GlusterFS is only used for website data for the time being but I'm looking into testing it out for other purposes such as Email server.
Everything went as expected without any issues. To get it going with a basic network mirror (assuming DNS or hosts file configured and /data is where the data partition is mounted):
gluster1# zypper in glusterfs
gluster1# chkconfig glusterd on
gluster2# zypper in glusterfs
gluster2# chkconfig glusterd on
gluster> peer probe gluster2
gluster> volume create replica 2 gluster1:/data gluster2:/data
Now to mount the gluster volume on the client servers. Install glusterfs there with zypper too. Add the following to /etc/fstab file.
gluster1:/data /data glusterfs defaults,_netdev 0 0
Notice the option "_netdev". This will ensure the network is up and running before mounting the volume. To mount it before system is rebooted:
Notice also that we are mounting using gluster1 DNS entry (this can be IP address). If gluster1 is offline, this will fail. However, you can quickly change it to gluster2 and mount. During a failure of one of the gluster nodes, this no longer affects the client as glusterfs client connects to all nodes available during mount and will ensure availability during failures.
What is GlusterFS? Clustered file system?
I was playing around with OCFS2 on 2 Ubuntu servers few years ago.
Never reached more than 60MB/s filecopy.
Had some bugs, example: one server goes down, other reboots with kernel panic since OCFS node was unavailable.
But anyway - it worked as designed to be (clustered).
So I’m going to take a look into GlusterFS :)
Comment from: phoeniXfury [Member]
GlusterFS has seen multi-gigabyte/s speeds. It’s like RAID storage network. It unfortunately is not really great for iSCSI but great for shared file storage.
Found something maybe interesting here: