Gadgetory


All Cool Mind-blowing Gadgets You Love in One Place

100TB of High Speed Storage - The AMAZING Storinator Mass Storage Server

2015-05-05
all right so I gave you guys an update on some of the ball and new server gear that we've had arriving for the new office including a powerful Xeon based storage server the plans for which I've actually already kind of revised and our new 2,000 dollar 12 port 10 game at network switch but today we're going to kick things up a notch with a custom-built story nadir mass storage server from 45 drives comm that features over 100 terabytes of high-speed storage so strap in guys cuz this couldn't be good Intel's new 750 series SSDs utilizing the nvme standard provides speeds never before seen on consumer storage drives click my hair to learn more so the problem we're trying to overcome here seem straightforward on the surface how to store all our data but when you go out in the real world and see entire video production houses running off of USB and thunderbolt external drives or coming up with long term archival solutions like write the dates on the sides of the drives and put them on a shelf in the bathroom completely exposed to dust moisture and accidents as if this was the VHS home video dark ages it suggests that we've been asking maybe the wrong questions all this time because it's not about storage it's about accessibility the number of times that we've gone to do our review of some exciting new next-gen products and gone hey maybe I'll grab some full quality footage of its predecessor from our old video for comparison which oh it's on the archive shelve isn't it guess I'll do what we always do and download the old video from YouTube then slice it up in crappy quality that happens more than I'd like to say and obviously that's not a solution that makes sense as Linus media group continues to scale the amount and quality of footage that we're storing as well as the number of people who need to access it as our company grows so let's talk store inator s45 the middle-of-the-road model that we chose that sits in between the more quiet SMB optimized 30 drive version and the monster XL 60 drive version in the front you'll find three 120-millimeter cooling fans to push air through our drives with a custom linus media group logo painted onto the graphite powder coated chassis on top then behind that three rows of 15 slots that give us the 45 drive capacity for this sucker further toward the back we find another two 120 millimeter fans that will pull air through the drives and then the system hardware chamber that exists only to power the other two-thirds of the case overall it strikes an unusual balance between being objectively professional-grade with all the core components and Intel 2.1 gigahertz six core Xeon CPU 128 gigs of kingston ECC ddr3 ram a Super Micro motherboard a two plus one fully redundant 700 watt power supply 316 port SAS controller cards from LSI and an Intel X 540 10 gigabit network card are from brands with reliability reputations ranging from excellent to legendary and yet it has a small custom system builder or DIY feel to it but comes from things like the blue LED lit vandal switch at the back that's used to power the unit on the flat cable managed but obviously off the shelf molex splitters that provide power to up to 45 drives at a time the fairly rudimentary PC builder tool on their site and the general simplicity of the enclosure design that other than the fixed backplane something that I really prefer compared to just loose cables as a smaller operator who's going to tinker with these machines versus chucking one of the hundreds of them in my data center out if there's some kind of an issue it looks like something that could be made in a pretty normal fabrication shop what a cool machine but of course that's not what you guys are here to see the store inator isn't the star of the show today it's more of an enabler so after installing FreeNAS a freebsd based storage operating system with native ZFS support that you can learn more about here it was finally time to break out the hard drives now while Seagate sounded like I punched them in the gut when I told them that I needed 27 drives for this project they also understood that if you're actually serious about having fast reliable network access to your 4k footage for a number of operators at a time you need a lot of drives and they have to be high performance so many drives in fact that they won't even fit in one master carton shipping box so once we'd figured out how many 27 the next step was to determine which model of drive we would be using honestly for most people and small businesses for that matter nothing more hardcore than ainaz hard drive would be required they're rated for 24/7 operation they offer reasonable if not earth shattering performance certainly more than a gigabit network connection would require they go up to four terabytes that gives you 24 terabytes of storage with a couple of disks redundancy and they can be obtained for under $40 u.s. per terabyte they're kind of like the city boss of hard drives but this is lie this tech tip suckas so i'ma ride around in a 747 instead sorry anyway because we have more than just hand cam vlog footage to deal with these days sometimes even sponsored projects for customers where data loss is not an option we opted for Seagate's enterprise capacity drives unlike their Nass or even enterprise nas drives which are rated for the adverse conditions and the vibration associated with up to eight or sixteen bay drive enclosures respectively the enterprise capacity drives feature exotic interfaces up to twelve gigabit per second SAS big capacities up to six terabytes per drive top of the line performance 10 times the workload rating of their desktop drive counterparts at five hundred and fifty terabytes per year and they do all of this while managing external vibrations so you can pack them in as tight as you can pack them pretty much which I guess means it's time to start talking about how that went so to start things off I went with nine drives in a ZFS two configuration this gives me just shy of 80% storage efficiency with two of my drives dedicated to redundancy I used one of my two SSD raid array clients here that are both on the same 10 gigabit network and achieved read and write speeds in the 300 plus megabyte per second range not too shabby but I mean I wasn't really sure what to expect at this point expanding as the FS storage server is both simple and kind of complicated as long as you have the same number of the same capacity of drives it's extremely fast and basically a few button presses to get her up and running but don't get your hopes up about simply adding a tenth drive to an existing nine drive array like you can do with a hardware RAID card it just doesn't work that way unfortunately the good news is that adding another set of drives should yield a significant improvement in performance since it's effectively striping data across the two sets unfortunately that wasn't my experience I saw the same numbers as before so after soldiering on and adding my third set of nine drives for a total of twenty seven and over 100 terabytes of storage and then realizing that the performance needle still hadn't budged I figured it was time to throw another client at the problem so with two clients to SSD based gigabit clients excuse me ten gigabit clients copying 20 gigabytes of data concurrently speeds were effectively doubled I got perfect scaling indicating that both drive speed and the speed of the network card in our store inator are not bottlenecks but unfortunately I don't have anymore 10 gigabit clients at the moment so this victory and discovery also means that we're done for the time being until we move into the new office where I can give it to aggregated network connections for 20 gigabit per second total for your reticle speeds and then hammer this thing with half a dozen clients at the same time to find out exactly where her limits are so stay tuned for that speaking of staying tuned audible.com keeps you tuned in to the books that you want to sit down to read but simply don't have the time for by letting you take your library with you on the go you can listen in the car at work on the bus in bed or anywhere that you can wear a pair of headphones really with over 150,000 audiobooks to choose from so there's definitely going to be something for you especially if you're into having your favorite celebrities read to you Dustin Hoffman's performance of being there by Jerzy Kosinski is getting rave reviews for his performance so you might want to check it out and join the book club now to get an audiobook every month at audible.com slash Linus and if you're on the fence about audible.com anyway the first one is actually free all right guys that's pretty much it like this video if you liked it dislike it if you thought it sucks check out the link to the forum to discuss it if you want to discuss the video we also have links for our merchandise cool t-shirts like this one giving us a contribution and changing your Amazon bookmarks one with our affiliate code so we get a small kickback whenever you buy hard drives or whatever else the case may be thanks again for watching it as always don't forget to subscribe and follow and all of that good stuff
We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites.