{"id":1236,"date":"2011-08-22T23:54:18","date_gmt":"2011-08-22T20:54:18","guid":{"rendered":"http:\/\/www.japhoto.fi\/blog\/?p=1236"},"modified":"2011-08-24T00:31:19","modified_gmt":"2011-08-23T21:31:19","slug":"serve-me-up-part-i","status":"publish","type":"post","link":"http:\/\/www.japhoto.fi\/blog\/computers\/serve-me-up-part-i\/","title":{"rendered":"Serve me up &#8211; Part I&#8230;"},"content":{"rendered":"<p><a href=\"http:\/\/www.japhoto.fi\/blog\/uncategorized\/serve-me-up-part-i\/\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1237\" title=\"Server-3\" src=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Server-3.jpg\" alt=\"\" width=\"800\" height=\"533\" \/><\/a><\/p>\n<p>I&#8217;m going to dive into the &#8220;geek zone&#8221; for a while, but hopefully it will be beneficial to photographers as well.<\/p>\n<p><!--more-->I&#8217;ve been writing my thesis these past months and since it is about backup systems and generally how you can keep your data safe, it got me improving my own data safety as well.<\/p>\n<p>The amount of data isn&#8217;t getting any smaller either, since shooting with the Canon 7D produces approximately 20-25MB raw files. At that rate it doesn&#8217;t take long when your photo folder starts getting quite large.<\/p>\n<p>At the moment my Lightroom &#8220;master&#8221; collection is about 500GB, which actually isn&#8217;t that much and isn&#8217;t a problem on my main computer, but since you should have multiple generations of backups, it starts to add up.<\/p>\n<p>So storage space is the issue or actually lack thereof. The solution&#8230;a file server (or two).<\/p>\n<p>I&#8217;ve always had multiple computers around and some of them have been acting as my &#8220;servers&#8221;, but in reality they have been only other Windows machines with simple network shares.<\/p>\n<p>Before I started this project I had one machine with two RAID-1 (allows one of the drives to fail, still maintaining the data) arrays consisting of two 500GB hard drives and two 1TB hard drives giving me about 1.5TB of quite well secured storage space.<\/p>\n<p>The problem with RAID-1 is the loss of 50% of your hard drive space since it mirrors the data on both disks. I&#8217;ve also been a bit hesitant about all &#8220;fake RAID&#8221; solutions, but the actual RAID controllers aren&#8217;t cheap and at this point I can&#8217;t afford one.<\/p>\n<p>After an extensive research I found out that using Linux to create a purely software-based RAID-solution comes actually quite close to having an actual RAID controller. This meant going out of my comfort zone (Windows) and dipping my feet in the Linux pool.<\/p>\n<p>But before that I needed to assemble the server itself. I decided to spend about 0\u20ac in it, so I had to utilize older parts I had laying around (which I do have plenty of).<\/p>\n<p><a href=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Kublai.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1242\" title=\"Kublai\" src=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Kublai.jpg\" alt=\"\" width=\"533\" height=\"800\" \/><\/a><\/p>\n<p>This Silverstone Kublai KL02 was my case of choice for this project. Unfortunately it has a window on the side, so I&#8217;ll have to deal with that somehow. I really don&#8217;t need or want a window on my fileserver.<\/p>\n<p>The case actually has a bit of a background story to it as well&#8230;<\/p>\n<p><a href=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/SST-CFP52B.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1243\" title=\"SST-CFP52B\" src=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/SST-CFP52B.jpg\" alt=\"\" width=\"800\" height=\"533\" \/><\/a><\/p>\n<p>This was my initial purchase a few years ago. I wanted to turn my Antec P182B into a server and wanted more hard drive space for it.<\/p>\n<p>I should have known that it was not a wise decision since this unit is made by Silverstone (SST-CFP52B) and the case I wanted to put it is was made by Antec.<\/p>\n<p>Not a problem if the rack would be universal, but it&#8217;s actually suitable for only three cases (all made by Silverstone of course). So the options were to mod the rack to fit the P182B or get a Silverstone case for the project.<\/p>\n<p>Modding the front bezel wouldn&#8217;t have been a huge deal, but I spotted a Silverstone Kublai KL02 case which had been on display in our shop, so I got it for a reasonable price.<\/p>\n<p>So now I had a suitable case and since one of these racks were included, I now had two of them. All good and well, but the problem is that these racks are pretty much garbage.<\/p>\n<p>The idea behind them is good, but I&#8217;d give 1 out of 5 stars to the execution. In other words, don&#8217;t buy one or you&#8217;ll probably regret it.<\/p>\n<p>Well what&#8217;s wrong with them you might ask? I&#8217;ll tell you:<\/p>\n<ul>\n<li>The front fan is noisy (it is user replaceable if you own a soldering iron)<\/li>\n<li>The fan gets power via a &#8220;touch&#8221; interface, which doesn&#8217;t always work, so the fan may or may not spin<\/li>\n<li>The fan power assembly is so wide that it makes it hard to slide in and out the two center hard drive racks<\/li>\n<li>The hard drive racks won&#8217;t lock properly, so the rack can slide against the fan when plugging in the drives<\/li>\n<\/ul>\n<p>There&#8217;s probably more, but since I just want to forget the battle I had with them, I can&#8217;t remember them.<\/p>\n<p>You can also make the rack hot-swappable with four of these&#8230;<\/p>\n<p><a href=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/SST-CP05.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1246\" title=\"SST-CP05\" src=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/SST-CP05.jpg\" alt=\"\" width=\"800\" height=\"533\" \/><\/a><\/p>\n<p>Again the idea is good, but just imagine the amount of wiring in the computer when you attach four (or eight in my case) of these to the back of the racks. You also have to buy these separately.<\/p>\n<p>I can&#8217;t understand why a simple backplane didn&#8217;t enter their minds, why go with these four plastic things that make the wiring utterly impossible in the case. Oh well, I don&#8217;t need hot-swap anyway.<\/p>\n<p><a href=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Server-1.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1248\" title=\"Server-1\" src=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Server-1.jpg\" alt=\"\" width=\"533\" height=\"800\" \/><\/a><\/p>\n<p>To address the problems with the rack itself, I removed the fan power assemblies and replaced the fans with Noctua fans instead. I ran the wiring from under the rack and plugged them in to the motherboard itself.<\/p>\n<p>The rest of the assembly went quite smoothly and before long I had a computer suitable for being a Linux server.<\/p>\n<p>The specs of the computer are:<\/p>\n<ul>\n<li>Case: Silverstone Kublai KL02<\/li>\n<li>Processor: AMD Athlon 64 3500+<\/li>\n<li>Motherboard: DFI Lanparty UT CFX3200 DR<\/li>\n<li>RAM: Adata 4GB (4x1GB) DDR1 400MHz<\/li>\n<li>PSU: Antec Neo 480W modular<\/li>\n<li>GFX: nVidia GeForce GT220<\/li>\n<li>Hard drives: 1x160GB Western Digital (OS) + 5x500GB Samsung HD501LJ (RAID5)<\/li>\n<li>CPU cooler: Cooler Master Hyper 6 + Noctua NF-R8<\/li>\n<li>Case fans: 2x Noctua NF-S12-1200 + 1x Noctua NF-S12B FLX<\/li>\n<li>OS: Ubuntu Desktop 10.04 LTS<\/li>\n<\/ul>\n<p><a href=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Server-2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1247\" title=\"Server-2\" src=\"http:\/\/www.japhoto.fi\/blog\/wp-content\/uploads\/2011\/08\/Server-2.jpg\" alt=\"\" width=\"533\" height=\"800\" \/><\/a><\/p>\n<p>The case itself isn&#8217;t all that good either, it&#8217;s a tight fit in any case, but imagine slapping on the hot-swap add-ons on there. They would render the four SATA-ports unusable and cause way more problems than they solve.<\/p>\n<p>In the photo you can also see my custom SATA-power cable which is made to exact measurements.<\/p>\n<p>After that, installing Ubuntu was smooth sailing and even though I am pretty much a Linux noob, I managed to create an RAID-5 array with three 500GB hard drives.<\/p>\n<p>The two other drives were added after the initial creation of the array by adding them one at a time, letting the computer reshape the array and expanding the filesystem to fill the new drive. Reshaping the array takes ages, but so far the system has been working without any glitches. The reason behind adding the two drives afterwards was that they were still in use in my Windows machine and they were also full of data, so I had to migrate the data away from them first.<\/p>\n<p>This setup with five drives in RAID-5 gives me a little under 2TB of usable space and it is protected against one drive failure. This is ok with such small drives, but for more important data I&#8217;ve decided to build another server as well. It will feature 1TB disks and RAID-6, which protects me against two drives failing simultaneously and gives me about 4TB of usable space. That should be enough for a moment :)<\/p>\n<p>Part II will be about the new project and I&#8217;ll go into more detail about configuring the server itself. I&#8217;ll also be using a true server distribution of Ubuntu instead of the desktop edition I have installed in this machine. Having no GUI (graphical user interface) will be a challenge, so hopefully I&#8217;ll be able to pull it off.<\/p>\n<p>I&#8217;ll also explain how my redefined backup system works and what else can be done to preserve your precious data.<\/p>\n<p>Stay tuned for part II and other things I have in the back burner&#8230;<\/p>\n<p>Janne<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;m going to dive into the &#8220;geek zone&#8221; for a while, but hopefully it will be beneficial to photographers as well.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[58],"tags":[47,60,48,59],"class_list":["post-1236","post","type-post","status-publish","format-standard","hentry","category-computers","tag-backup-2","tag-linux","tag-raid","tag-server"],"_links":{"self":[{"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/posts\/1236","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/comments?post=1236"}],"version-history":[{"count":17,"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/posts\/1236\/revisions"}],"predecessor-version":[{"id":1252,"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/posts\/1236\/revisions\/1252"}],"wp:attachment":[{"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/media?parent=1236"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/categories?post=1236"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.japhoto.fi\/blog\/wp-json\/wp\/v2\/tags?post=1236"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}