I am looking at building a high reliability, fault tolerant file server to store 300 plus GB worth of files. Reliability is needed b/c a sysadmin will not always be around/on-site to ensure full backups are made regularly. I am assuming RAID 5 array, for data and seperate drive(s) for OS (RH 7.x), redundant power supplies. Any suggestions (voice of experience) on: - Motherboard/CPU combo's - Server Cases - RAID host cards (3ware-IDE, Mylex-SCSI) - High(er) MTBF IDE, SCSI Hard drives (I don't want another 60/75GXP fiasco) <g>. - Tape drives (DLT, DAT, etc)
Thanks in advance for any words of wisdom.
Brock
I have about 3.5TB of fileservers running on 3Ware IDE RAID cards. I am pretty happy with them. They are very well supported under Linux (in the kernel since 2.2.15). They have a separate controller for each drive, so you avoid many of the limitations of IDE. The 8 port card can give you 1280GB of drives (1120GB at RAID5) if needed.
Cases to build your own fileserver with 8 drives are hard to come by. We have an Antec SX1440 and it sucks (IMHO). I wouldn't buy it again. For the last server we built, I used a 'Small Cube Server' case from California PC (www.calpc.com) ~$400. It is pretty decent, I have a couple of complaints, but it works. It's the best I have found so far. I would recommend the redundant power supply.
Don't buy a desktop or workstation motherboard. We have used the following boards and I haven't been 100% satisfied with any of them....
Tyan Tiger MPX (Dual Athlon board with 64bit/66MHz PCI, AMD MPX chipset) Asus P2B-DS (Dual PIII board, BX chipset) Tyan Thunder (Dual PIII board with onboard everything, GX chipset)
I would recommend looking at a motherboard with a ServerWorks chipset, they are designed to be servers. Their (onboard) IDE and Video performance are terrible, but they can really pump out the data. I plan on going with a ServerWorks chipset for our next server.
I will never buy another IBM drive! Out of 50 drives, I sent back 10. Out of 60 Maxtor drives, I have sent back 1. I buy Maxtor or Seagate now. I have about 30 80GB drives and a dozen 160GB drives and I have had no problems.
Since you said a sysadmin will not always be around, I would recommend a DLT changer or LTO drive for backup. If a user has to change multiple tapes, it is going to be a hassle and they are going to forget. So I would recommend a drive (or library) that can back up all the data in one go. That means a DLT8000 library (40-80GB/tape) or an LTO drive (100-200GB/tape). I have heard good things about LTO, but I haven't used one. Personally I don't really like DLT, but it is VERY popular.
If you have any questions, or would like to see some of what we have done at Frantic, email me privately.
shawn
-----Original Message----- From: roundtable-admin@muug.mb.ca [mailto:roundtable-admin@muug.mb.ca]On Behalf Of Brock Wolfe Sent: Tuesday, April 30, 2002 7:07 PM To: roundtable@muug.mb.ca Subject: [RndTbl] Server config
I am looking at building a high reliability, fault tolerant file server to store 300 plus GB worth of files. Reliability is needed b/c a sysadmin will not always be around/on-site to ensure full backups are made regularly. I am assuming RAID 5 array, for data and seperate drive(s) for OS (RH 7.x), redundant power supplies. Any suggestions (voice of experience) on: - Motherboard/CPU combo's - Server Cases - RAID host cards (3ware-IDE, Mylex-SCSI) - High(er) MTBF IDE, SCSI Hard drives (I don't want another 60/75GXP fiasco) <g>. - Tape drives (DLT, DAT, etc)
Thanks in advance for any words of wisdom.
Brock
_______________________________________________ Roundtable mailing list Roundtable@muug.mb.ca http://www.muug.mb.ca/mailman/listinfo/roundtable
Brock Wolfe wrote:
I am looking at building a high reliability, fault tolerant file server to store 300 plus GB worth of files. Reliability is needed b/c a sysadmin will not always be around/on-site to ensure full backups are made regularly. I am assuming RAID 5 array, for data and seperate drive(s) for OS (RH 7.x), redundant power supplies. Any suggestions (voice of experience) on:
- Motherboard/CPU combo's
- Server Cases
- RAID host cards (3ware-IDE, Mylex-SCSI)
- High(er) MTBF IDE, SCSI Hard drives (I don't want another 60/75GXP fiasco) <g>.
- Tape drives (DLT, DAT, etc)
When I worked in Calgary, we had clients that we visited very rarely and had very low remote sys admin duty requirements. Everything was automated and the users did perform the regular tape changes etc as required. The onus can be placed into a group of competent individuals to perform what is really a mundane task. Shawn commented earlier that if you are going to span multiple tapes, that you will most likely want to have a tape library solution ... more expensive, but your options open up much more as well. I've also seen solutions that a "snapshot" of the data is copied to another set of drives and those drives are backed up to tape ... multiple or not, doesn't matter, the original data is free to carry on it's merry way and the users are able to change the tapes while they're at the site.
You haven't really given any indication as to what kind of data will be on the drives, how often it is updated etc ... could you use incremental backups vs using full backups continually? What is the purpose of the file storage? Are they just huge files (such as what Shawn has to deal with) or are they relational databases? If it's relational, how many transactions are you talking about -- user load etc ... if it's high, or you're performing a fair amount of random write activity stay away from raid5 if you care about performance in the long term ... and don't get tricked into using some kind of write-back caching to compensate for the abysmal raid5 write performance for those types of files ... if the cache fails, your array goes down and your data is hosed -- yes, I've seen it happen and it's not nice. If it's a *file* server, is it's primary duty to serve files to PC's on the network? if so, raid5 is more useful for this type of deployment, also, what about the possibilities of a nas or san ... The muug page describes the october 2001 meeting which discusses the topics of nas/san.
We run about 288GB hot-pluggable, hot spared, across two identical systems in a raid 0+1 configuration, multi-channel scsi controllers on multi pci channels networked with a fiber connection ... everything is redundant right down to the power supply .. UPS's on everything including the network. Not cheap, but works well. Also have (relatively) cheap PC's running linux in various branches across the country which are easily re-creatable from a hardware and software configuration perspective... there's not much redundancy in this except for the easy replaceability.
Dan.