FreeNAS seems like a great product with a full checklist of features, even iSCSI. But how reliable is it? There are a few scary stories about lost data, for example here. Here is another example.
If you have used freeNAS for a longer period of time or even in a production setting, please share your experiences, good or bad. It would be great if you could also describe the setup, ie which hardware and features (software raid, zfs, iscsi etc) you are using.
I have been using freenas on a spare machine with 4x 1TB hard drives (2 raid 1's, so 2TB usable). It has been up 24/7 for 6 months.
I find it brilliant!
I tested many NAS's devices and only got a maximum of 10Mb/s on a gigabit port, and that was rare, typically it was around 3-4. My main reason for a device was to save energy, however 2x 2 drive nas's = more than a 80+% psu on a celeron system.
On freenas, I have a celeron based machine that cost me under £70, and on the internal 100Mb card, I can easily push 70Mb/s on samba.
The most expensive part was I bought a 4 drive enclosure to add/remove hard drives easily! Was a bit of a waste of money, but looks cool!
I can not complain at all about it and love the system. I did look at openfiler, but it seemed a bit OTT and freenas did what I needed...
To the others who recommended it, not saying Openfiler is bad, but freenas suited my needs perfectly, I boot the machine off of a USB stick and works well... The question was "is FreeNAS reliable" and my answer has to be yes.
The system is using software raid and even though the celeron is a single core 64 bit one, even during a raid rebuild + watching a HDTV episode across the network, it never goes above 60% cpu
To get it working, I downloaded the full iso, put a 1GB usb stick in my laptop, used usb pass through on Vmware Workstation and booted from the iso. I then used the install option and chose the USB stick. (You can do this on the actual machine and I have since however this was my first time using it and I couldn't find a blank cd!)
I put the usb stick in to the machine and booted. It worked fine first time!
Steps to actually get it usable as a nas were the following:
Then it was accessible over windows by \\ip and using the username and password I chose.
I will be looking at openfiler again soon as AD support is lacking a bit, however for a SOHO / domainless environment, you can not go wrong with freenas.
edit - Via request - Was to big to fit in comments
Reliability has different components to it. One is how reliable it is to go all the way with recommended hardware in mainstream configuration, set it up once, then NOT touch it, and watch how reliable things are. I'd rate FreeNAS pretty high on that.
Another is reliability taking into account various human error factors (non-standard configuration, experimenting, non-standard sequencse of changes in configuration, etc). I'd rate FreeNAS really low on that. It's so easy to shoot yourself in a foot and lose your data. You can read the forums to get the idea, but if you try it yourself, you'll have it too :)
As it was already mentioned above, FreeNAS seems to be really geared towards enterprise consumers and ignorant of home users and their problems. Speaking of expensive server grade hardware with have multiple vdevs tens of drives in each, FreeNAS server that manages it, and an operational engineer who manages the server.
If you are a home user or small business user willing to have simple file sharing over 3-9T array perhaps with all the nice ZFS redundancy and checksumming features, but you also want to save money and you're used to the idea that a fileserver can run on cheap hardware, don't even try FreeNAS, it's not cost-effective, unless you (a) want to make it a serious hobby project and it's fun for you to spend time on this, (b) you're ready to invest much more money on upgrading (or completely replacing) your setup as you figure out your hardware won't work.
I am one of such users, I've been trying FreeNAS for 2.5 months already. I've spent the entire Christmas and New Year's holidays on initial setup, plus a bunch of evenings and weekends. It's somewhat fun, but feels really dangerous. Due to bugs or too non-standard configuration, I've experienced loss of 1 drive in 4-drive Raid-Z some 5 times already, and during 2 of them I've hit unrecoverable read errors during resilvering. Most of that happened when I was detaching and re-importing volumes or reapplying encryption. I am somewhat worried that if 1 drive loss is possible due to noob-ish handling of server setup even without real hardware disk failure, you need Raid-Z2 or Raid-Z3 just to mitigate that. I've been very paranoid with continuous snapshotting to an external drive for backups, and it saved me multiple times. Though I did have a couple of unrecoverable read errors on external drive that I had to deal with, and I am guessing this is due to the fact I used USB 3.0 which is NOT recommended (read: it's not supported and there are possible bugs). I also had problems with an SSD drive I used for L2ARC reporting errors, which disappear after I remove and re-attach it, however, it was impossible to wipe it: I had to disable checks, wipe it with dd, and reboot so that OS would refresh its knowledge about disk metadata, only then it allowed me to re-partition the drive and re-add it. There are more things of this kind that I had to go through.
Common gotchas for new users:
I dont have direct direct experience with FreeNas, but I would suggest that you try OpenFiler instead. Like FreeNas, it is is Free and Unix based. OpenFiler is a more commercialized product with many commercial production implementations.
If you are about to commit data that you care about to this product please consider the following points:
I also suggest that you host your OpenFiler on ESXi, and you will be able to share the machine with other VMs if the system is powerful enough and will not be heavily loaded by other VM's.
You can also load OpenFiler successfully onto Hyper-V - just setup the ethernet adapter as legacy adapter.
Good luck - if this helps please give me credits.
I've been running Freenas for a couple of years now. First i ran 3 disks in a RAID 5 with a few extras for temporary storage.
I really like the reliability of it, it's rock solid, and once it's set up, it's fantastic.
The basic setup is very easy, especially if you install to a hard drive or CF card (i chose the latter). However, i tried for a while to get it to boot from a USB thumbdrive, and gave up. There are now new instructions on how to get this to work, but my CF setup works fine, so i haven't tried again.
Adding drives, creating RAID arrays, etc is very simple. Setting up Samba/CIFS is also very easy. This means you can quickly set up a server that plays very well with a mixed Mac and PC network.
When you start to customise a bit more, you can run into trouble however. I recently tried to upgrade my Samba transfer speed by tweaking settings, and ended up having to reset to factory defaults and restoring the config from a backup (this is actually easy to do, but i don't think that it should have been a necessary step).
Freenas is a bit fussy about hardware, it doesn't seem to like the onboard Nvidia NIC that comes with my ASUS motherboard, as i said before, it doesn't make using a USB thumbdrive easy.
Recently i've upgraded the disks and changed to 1TB drives backing up from disk to disk using the included Rsync, as the whole RAID 5 thing scared me (i worried that if it went wrong, the risk of making a mistake and losing all my data was too great). BTW, Rsync is ridiculously easy, in contrast to my experiences with trying to use it with Windows.
Support is through the forum on Sourceforge, and if you don't ask questions in the right way, you will be ignored. People are very helpful if you make the effort.
Finally, is it worth the hassle? Absolutely, i have a reliable server that once set up runs and runs. I use it for backing up various machines, as well as holding my photo, music, and video libraries, which stream to various machines. I touch the config about once a year, to upgrade to a newer version, or add disks, etc, and between those times i never need to worry about it.
I'm running FreeNAS 7 in a pair of office file servers. I use the built-in rsync to periodically back up the primary to an identical machine in the next rack over. And I have scripts that run remote backups to the rsync target on the FreeNAS box. It's pretty solid for iSCSI, NFS, and CIFS as well.
I went with FreeNAS primarily for hardware support... the OpenFiler release that was available didn't support the NIC or the storage adapter on my servers, nor did it support ZFS. I'm probably going to be upgrading to FreeNAS 8 soon (upgrading the backup, letting it sync, then making it the master, and upgrading the former-master).
I now see that this is an ancient thread, but if you're still in the SF Bay Area, one of the FreeNAS 8 team will be demonstrating the brand new release at BayLISA this Thursday (6/16/11) ... check out www.baylisa.org or www.meetup.com/baylisa for details (disclaimer: I'm the secretary of BayLISA so I like seeing lots of people show up).
For a while I ran OpenFiler against ESXi. I measured the IOPS I could produce locally (on the machine itself, against a raid volume) and remotely from an ESXi server over a software iScsi initiator and the results were within 95% of local performance -- and it scaled to 4 drives in a raid5 array.
YMMV -- but for me -- it provided near local performance over iSCSI, even with multiple servers attached (* only tested with 3 servers).
I chose FreeNAS instead of OpenFiler because of hardware requirements. FreeNAS basically needs less of everything. I was able to run a 1.28TB RAID1 configuration with just 256Mb of RAM on a 400MHz VIA board with a 128Mb CF card. It's just some really old hardware I had lying around. So far, it has been working well enough. No real complaints yet.
I have run FreeNAS boxes for nearly a year with good success. I generally use them as backup devices to local storage so performance isn't of the utmost important. The current systems I have are HPaq 2 GHz P4 with a single 1.5 TB drive. As I remember when we benchmarked about 6 months ago we could get something like 40 MB sustained over a GB connection using NFS. I have used iSCSI as well but not at this point.
I have recently configured a unit connected via NFS to 2 VMware hosts and so far my daily management guy can't see any performance issues.
We have experimented with more cutting-edge hardware using RAID and more drives. Getting newer hardware running has been difficult, so we may end up using Ubuntu for its excellent hardware support and OpenFiler on top.
FREENAS is sublime!
I've been using FreeNAS 8 for about six months with pure joy. Still I haven't finished testing all functions yet, but till now all is working perfectly as described in the manuals.
Every single function can be configured by my grandmother without my help. The GUI is great and a VERY BIG + is the independence of hardware platforms.
I use CIFS, NFS, ISCSI and FTP. To get started I used the instruction videos on YouTube, succeeded on the first try and have managed to recreate the setup many times after for testing and demo purposes.
I recommend FREENAS to everyone and I do! Technology should be FREE for the world to make it a better place (and not make the few richer thus making many others poorer.)
REMARK: I very strongly feel that the product FREENAS should remain a shared storage solution. So please do not combine other functions like for instance QNAP does. It is elegantly the best storage solution I have encountered when searching for it for over 6 months.
My congrats with your achievements!!
I tried to use freenas under VMWare Fusion on my Mac Mini because I want to continue using ZFS and Apple dropped the ball on that one. However, the disk I'm using is a 1TB USB external disk and the FreeNas kernel can't talk to it, the kernel says the USB port times out. A small flash USB disk worked fine.
This was on the unstable v7 release (for zfs), but I can't shake the feeling that the FreeBSD kernel isn't as comfortable with various sorts of hardware as Linux.
I tried an OpenSolaris VM and it could see the disk just fine. I'm thinking about using that since knowing that ZFS keeps my data checksummed gives me peace of mind.
UPDATE: This post got me wondering, so I got around the USB problem by attaching the USB disk as a raw disk. I couldn't get that to work on VMWare Fusion, but I could make it work on Virtualbox 3.0.4.
To make a long story short: With FreeNAS 7RC1 I was able to mount the zpool and I was transferring files to my host systems over NFS at 7MB/s. I then used the same raw disk setup with OpenSolaris 11/08 and I was only able to get 4MB/s.
It's not a very professional test, I know :) The Solaris VM seems to be halting every so often, I'm not sure why.
So in conclusion: FreeNAS on a VirtualBox VM outperforms OpenSolaris by almost 100%. Works as an endorsement for me even though it was only the one test...