Building our 10 Gigabit 192TB Storage Server! FINALLY!!
Building our 10 Gigabit 192TB Storage Server! FINALLY!!
2018-05-14
show off your Riggins style with the
view 37 from thermal take a large curved
window offers the generous view of your
components with included addressable RGB
fans for a fully custom interior enjoy
the freedom of full-sized hardware
high-end water cooling support and dust
filtered ventilation for a system that
performs as good as it looks
click the link below to learn more
what's going on guys welcome back to the
channel so today's project is actually
gonna revolve around tackling a huge
issue or a need that we've been faced
with for the last couple of months here
on the channel you might notice that our
image quality for our videos has gone up
a notch and that's because one of the
reasons apart from Chris who's holding
the camera right now is the camera
itself which is the sony fs7 beautiful
camera but it creates some seriously
huge file sizes one project now that we
create here in the studio can can take
anywhere from three to six hundred gigs
which is immense so the other issue is
that we have a couple different editors
besides me now me Chris and wifey sauce
and occasionally a project will have to
trade hands and when that happens we
either have to do some musical chairs
magic where we all swap computers or we
have to spend a lot of time taking the
files putting them on an external drive
and moving them to a different computer
it's uh it's been a huge burden lately
if you guys will come this way for a
moment you'll notice that we have our
three workstations set up here let's
take a look at one of them this is the
one that Chris usually works on you can
see that we've got a two terabyte hard
drive that's just kind of for backup and
then we have two one terabyte SSDs that
are already pretty much filled to the
brim and there's only maybe two to five
projects in each of these drives guys so
it's it's clearly an issue and even
worse is that we don't currently have
any good system worked out for
redundancy so if one of these drives
goes right now we're kind of screwed and
that data is completely lost it's a
freaking everyone out
wifey sauce has been under a lot of
stress lately and she doesn't even do
that much editing compared to Chris and
I I mean I should give her the benefit
that she's one of the most hard-working
people I've ever met personally and I
can't even imagine what I would do with
yeah yeah he does we take 10 minute
breaks every few hours it's like a
illegal thing so that is but anyway we
have a serious need that needs serious
tending to and I have the perfect
solution today I will be putting
together a 10 gigabit storage server
which is a project unlike any other that
I've ever taken on before and full
disclaimer I am a networking newbie
there's very little that I know about
hard core networking there's still much
for me to learn in this regard and also
a lot of the information that I share
with you guys today will be heavily
regurgitated from Wendell of level one
techs who was instrumental at helping me
get this project up off the ground so
huge thanks to him he taught me so much
in so little time and also helped me
source a lot of the hardware that you're
about to see so you guys haven't checked
out level one text yet I highly
recommend it there's some really great
content on there so with that in mind
let's take a look at some of this
hardware we're working with for starters
we have 24 8 terabyte and 302 C ba
enterprise level hard drives these
things are good for 24/7 operation and
it gives us a total of a hundred and
ninety two terabytes to work with now of
course we will be putting this in RAID
10 which is raid 1+0 so we kind of get
the best of both worlds in terms of
redundancy and performance so the
redundancy side of things that means
we'll actually be having the amount of
usable data here or usable storage I
should say so that's really only only 96
terabytes of workable storage but at
least we'll be safe in case of a drive
failure or multiple drive failures it
also gets us some speed performance by
striping the drives together meaning
that we'll actually be able to saturate
hopefully at least with the read speeds
a 110 gigabit per second connection
which is very exciting these drives will
be living inside of this disk shelf this
is an LSI SAS 6 gigabit per second disk
shelf we've got a redundant power supply
this is just going to be so much easier
especially because we'll be connecting
this to a host PC using just these two
cables which allows for just a very sexy
configuration
I mean imagine how many SATA cables you
would actually have to wire up if you
had them going to each individual drive
it would just be a madhouse so this is a
very clean solution that I'm very
excited to to take advantage of today
but let's talk about the host PC because
this is just a disc shelf after all
there's no onboard processing here so we
need an actual computer in order to do
all the heavy lifting will actually be
using the ZFS file system which is known
for being a very advanced and reliable
file system in that case we're gonna be
using FreeNAS loading it up onto an SSD
and booting up off of that that's not in
here yet but we'll get around to that
this is the trooper SC first off from
Coolermaster a very nice case tons of an
airflow I'll probably be adding some
more fans especially to certain areas in
the build that get extra hot under these
types of server storage storage server
workloads we wanted to go the economical
route so we went with Rison because it's
got you know high core and thread count
but also it supports things like ECC
memory and so we've got the risin 7 1700
in here we haven't done any overclocking
yet or anything like that not even sure
if we're going to yet the CPU is being
cooled by an Arctic freeze cooler with a
120 millimeter fan I kind of took a
chance on this cooler not sure if it's
going to work out we can always replace
it later down the line if not we've got
64 gigs of tritons er GB RAM before you
freak out this is just temporary to get
things up and running
we actually have a 128 gigabyte kit of G
snow kingston unbuffered ECC memory on
the way so yeah and then we also have
our X 370 motherboard the Tai Chi from
asrock beautiful board and has a lot of
connectivity all the bells and whistles
we could possibly need for this project
right here let's talk about what's
populating our PCI Express slots
starting with the EVGA geforce gtx 1050
Ti we're pretty much just gonna be using
this to connect a monitor so that we can
sort of visualize and monitor our system
real time and then we also have a 10
gigabit ethernet card here this is the
Intel X 540 t2 with dual rj45 ports
we'll be connecting this to our 10
gigabit 12 port switch and finally down
here we have our LSI SAS 6 gigabit per
second controller which is a got eight
channels to it so there's two ports on
the back four channels on each port and
if you do the math six gigabit per
second that gives us 48 gigabits of
bandwidth coming out of this thing which
is absolutely crazy one thing i aughtta
meant
that these SAS controllers are known to
get extremely hot under load but they
won't actually notify you or warn you at
least this one doesn't when it gets too
hot so it'll just end up dying if you
don't take care of it which is why I'm
probably gonna have to MacGyver at some
point a case fan that's aimed straight
at this card for dedicated airflow so we
don't run into any failures additionally
we have an Intel obtain 900 P SSD this
thing's an absolute animal 480 gigs this
is gonna be our cache drive it's known
for its incredibly high endurance I mean
you can literally write dozens of
petabytes to this thing before it
becomes unreliable and the read and
write speeds are just through the roof
some of the best write speeds on the
market right now and apart from that
we've got an 80 plus 650 watt g-series
power supply from C sonic but that's
pretty much our rig guys this is our
host PC that I cannot wait to get
connected to this dish disk shelf once
we've populated it with all of these
drives so let's go ahead and do that now
and hopefully by the end of this little
montage I'll be able to show you guys
this 10 gigabit storage server in action
q epic music
all right the NASS is finally up and
running
thank God it's been such a long process
I should mention that this today is like
about three or four days after the rest
of the video that you've already seen
because we had a weekend in between it
messed everything up but anyway we're up
and running it's functional there's
still a lot of optimizing that we have
to do to make sure everything's running
the best it can
but we're operational so that's good
right now all the drives are alive and
well knock on wood that they stay that
way for a long time but Wendell did
suggest that we hit the NASS hard with
tons of file transfers just to make sure
that none of these drives are defective
and peter out in the first couple of
weeks so maybe after about a week or two
if everything looks good then we'll
start using it for real I should mention
it's a little noisy in here because we
do have a large blower fan not the GPU
kind aimed straight at our Nick our ten
gigabit Nick and the the RAID controller
I thought this was an HPA I actually
ordered an HPA they sent me a rate
controller instead didn't even realize
it because I've never really worked with
either of those things
and I said Wendell the picture I was
like is this right he's like that's a
raid cart that's actually like a $300
brand new raid cart and I was like well
I paid 80 bucks for it and it was
supposed to be an HPA so we might we
might actually do a little trade because
I can still get everything up and
running with this raid cart in here but
an HPA just makes a lot more sense for
my needs and I think Wendell just really
really wants my rate card now everything
else is looking good there was a bit of
a swap aru inside of the system I don't
know if you can tell from there but the
m-dot 2 adapter that was connected to
our octane drive that was initially in
the bottom m2 slot of our system had to
move that up to the top slot because I
completely forgot that it's sharing
bandwidth with the bottom PCIe slot
which is where our NIC is currently so
the NIC wasn't working initially so I
had to pop that MDOT to card up a few
notches and everything's working fine
now the blower fan might be a little
overkill it's kind of just what we had
at the time but I do have like a little
USB fan that probably makes a lot more
sense we can actually put the side panel
on and stuff getting back to the matter
at hand though I think it'd be really
cool to show you guys a quick demo of
this thing in action so why don't we
transfer over to the other room and I'll
give you a guys a gig
a bit of taste let's go alrighty here we
are
it declined PC and in the left window we
have our local storage we're actually on
a one terabyte nvme SSD right now I
believe this is our Rd 400 from OCZ and
you can see we've got a couple projects
in here this is the test file we'll be
using it is 50 2.8 gigabytes and and
over here on the right the window to the
right we actually have our our gnash
this is our Nass storage you can see
Network Nass and I create a little data
set or a folder if you will called test2
there's already a file in here I'm
actually it's the same one I just
renamed it but let's go ahead and
transfer this over and see what kind of
speeds were getting boom you right off
the bat oh we hit one gigabyte right
right from the get-go and then we kind
of dip down a little bit but we're still
getting anywhere from eight to nine
hundred megabytes a second whoo do that
so we're transferring about 50 almost 55
gigs here 53 gigs in under a minute guys
and we'll be able to achieve these same
types of transfer speeds when we're you
know transferring files between client
systems as well because they'll all be
connected to the ten gigabit switch 900
megabytes a second is pretty much right
in between what you would get out of a
SATA based SSD and an nvme SSD so I can
I can definitely live with that and
there we go sweet and if you guys want
to see a little bit more action here you
can open up premiere let me readjust the
camera really quick so this clip right
here is actually the file I just
transferred over to the nest so
technically we're editing on our client
PC but the footage is stored on our
servers so we're gonna go ahead just
test this out see how smooth it is this
is a 4k file
I'm haven't done any like sort of color
effects or anything like that but we're
we're at full resolution full 100%
scaling and I'm just gonna go ahead and
play it
see if it's move
books prefer it to good is clearly a
shot of Chris and wifey sauce populating
the disk shelf they're being very
helpful that day all right you can go to
2x here 4x
and I was choppy just for a split second
then it smoothed out pretty quickly 8x
and bear in mind guys I have not even
setup the obtained caching yet obtain
SSD caching something that I'm gonna set
up momentarily but this is pretty
promising so far considering I haven't
even messed around with that was this 8x
or 16x at any rate I don't think I
really edit at this speed very often so
this is more than enough performance and
it definitely feels like I'm editing off
of local storage which is exactly what
we want so altogether I'm going to call
this one a big win I'm gonna cut this
video off now because I've been working
on this for way too long
this was a super challenging yet equally
if not more so fulfilling project I I
have no regrets I'm so glad that we're
at the point we are now and and we're
not even done we actually have like I
said a lot more optimizing to do to get
our workflow exactly the way we want it
follow me on social media at bit wit
Kyle both on Twitter and Instagram I'll
be posting stuff about the server and
just sort of the progress we're making
behind the scenes that doesn't really
warrant a full video or a part two but
if you want to catch all the BTS stuff
go ahead and follow me there but that's
all that's all for now guys toss a like
on this video go ahead and ask me any
questions down below I'll try to get
around to them and get subscribe so you
don't miss any more stuff coming to the
channel very soon you can also check us
out on floatplane if you want to watch
our videos a week early without ads for
3 bucks a month I'll put a link in the
description below till next time guys
thank you so much for tuning in to this
one have a good one and I'll see y'all
in the next video
We are a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites.