Random Curiosity

Saki – 22 »« SCANDAL – Don’t say “lazy” (K-ON! ED Cover)

Server Failures Suck

Worker Kirby   Small

As some of you might know, many of the images on Random Curiosity are graciously hosted by my friends at Maximum7. Unfortunately, a bout of bad luck struck last week when two of the hard drives on that image server suddenly died. As it was explained to me, a RAID 5 is an array of three drives, and when one drive dies, you can swap it out for a new one without interruption of service. However, in the rare case that two die, which is what happened here, the array becomes irrecoverable. The good thing is that the guys at Max7 were able to provide me with another image server, and divine and I spent several hours uploading images to get it back up to serving most everything that points to it.

The bad thing is that a lot of those archived images are still gone, mainly the ones in Jaalin and Trillian’s old posts (like K-ON! and Saki), because we didn’t maintain second or third copies of those like we do for everything else. I’m honestly not quite sure what to do about it at this point since it doesn’t make sense to have them re-screencap entire series. If by chance anyone out there happens to have those images saved somewhere, please email me, but I suspect that the images in those archives are gone forever.

September 22, 2009 at 10:41 pm
33 comments »
  • September 22, 2009 at 10:46 pmGame8910

    ouch…that really sucks…losing data is always a pain in the ass

  • September 22, 2009 at 11:03 pmfristian

    RAID5 is useless at the drive capacity these days. Even if you only have one drive failure, you’ll often get rebuild errors.

  • September 22, 2009 at 11:14 pmstarss

    Thanks for explaining that to me. And of course it had to happen to those posts with all the captions! :(

  • September 22, 2009 at 11:16 pmAdam

    I’ve noticed some load errors on the page. Sometimes it fails to load the main content area of the blog.

    Normally I just refresh to fix this issues, I haven’t had any other problems with the images.

  • September 22, 2009 at 11:17 pmlinnah-chan

    why not try google cache?

  • September 22, 2009 at 11:18 pmlinnah-chan

    why not try google chrome?

  • September 23, 2009 at 12:03 amOmni

    fristian: I wasn’t the one who got to choose :/

    linnah-chan: I don’t understand how that would help.

  • September 23, 2009 at 12:18 amMichael Flux

    Omni: Not sure what linnah-chan means about Chrome – seems completely irrelevant – but in reference to the cache – maybe Google cache managed to grab some of those images that went missing – not a really high chance of that, but maybe, worth checking

  • September 23, 2009 at 12:28 amChen^2

    Why not use Internet Archive? Its really slow sometimes but it has your site (and most every website out there) saved for the last few years listed by date. It saves a copy of the whole site (most of the time) whenever there is a change to it. From the looks of it, its archived old pages since the day you switched over from Blogger, it takes awhile to get used to though, as some of the links to page 2 would redirect to a different time and you’d have to change the address manually in the address bar.

    http://web.archive.org/web/*/http://randomc.net/

  • September 23, 2009 at 12:29 amChen^2

    Why not use Internet Archive? Its really slow sometimes but it has your site (and most every website out there) saved for the last few years listed by date. It saves a copy of the whole site (most of the time) whenever there is a change to it. From the looks of it, its archived old pages since the day you switched over from Blogger, it takes awhile to get used to though, as some of the links to page 2 would redirect to a different time and you’d have to change the address manually in the address bar. Hope this helps.

    http://web.archive.org/web/*/http://randomc.net/

  • September 23, 2009 at 12:30 amChen^2

    Sorry about the double post, I thought the first one didnt go through.

  • September 23, 2009 at 1:30 amMearex

    a pain in the ass or butt, they are the same. how the hell can both burn out at the same time? maybe it’s a power short? or maybe the room is too humate? forgive my poor spelling but you know what i mean.

  • September 23, 2009 at 2:02 amOmni

    Chen^2: Not a bad idea, but unfortunately it doesn’t archive recently enough (K-ON and Saki were this year).

  • September 23, 2009 at 2:04 ammutio

    And what did we learn? Never rely on harddrives compeltely, even not in a RAID5 or RAID6, always make backups.

    That wise spamming won’t help you and I’m very sorry for what happened. Hope you’ll have some additional backups in the future to prevent this from happening again.

  • September 23, 2009 at 2:07 ampwkim21

    Wow sucks, wish I could help but I don’t have even temporary files of it left. Hope you keep providing the great coverage.

  • September 23, 2009 at 3:37 amtwsl

    just discovered that you can at least recover most of the thumbnails, it’s not much but perhaps better than nothing?

  • September 23, 2009 at 5:54 amahelo

    awww. i’ll miss jailin’s funny screencaps of saki and k-on

  • September 23, 2009 at 7:11 amOmni

    mutio: I learned that lesson long ago and triple back-up everything I post. The other writers, however….

    twsl: How?

  • September 23, 2009 at 8:15 amshirosaki

    omni, just how much bandwith consuming this site in a month ? (for images),

    maybe i can give u hosting mirror. pls contact me via mail.

  • September 23, 2009 at 8:33 amNeo_NMO

    shirosaki: since the bandwidth logs were wiped along with everything else, i can’t remember how much it uses on average. however, since setting up the new server, randomc’s used about 200GB of bandwidth in about 10 days.

    i’ve setup a secondary mirror that updates every 6 hours automatically at http://randomc2.maximum7.net/images/ and may setup a tertiary mirror at some point… we’ll see.

  • September 23, 2009 at 8:34 amNeo_NMO

  • September 23, 2009 at 8:53 amshirosaki

    600gb for month ,maybe even more… i see. this kind of traffic exeeding my limits. sorry to not bein useful. i hope u can avoid this kind of disasters in future. and thx for technical info :)

    btw Neo_NMO, whats your fs ?

  • September 23, 2009 at 9:48 amNeo_NMO

    fs?

  • September 23, 2009 at 11:53 amGuppy

    I think shirosaki means FS as in filesystem.

  • September 23, 2009 at 12:34 pmdivine

    I’d just like to add that I did have a backup copy of all my images (which have been re-uploaded), so you shouldn’t see any broken image links on my older posts. Let me know if you do though.

    For people who still aren’t aware of my presence here, that means for posts with “BY DIVINE” on them. :P

  • September 23, 2009 at 12:47 pmshirosaki

    yup i mean fs=file system. im askin this cause some raid configurations has known bugs, with certain file systems.

  • September 23, 2009 at 1:11 pmearly219@yahoo.com

    I feel bad for those who wants to review animes that doesn’t have the images.. and RAID5 is really a great back-up feature.. it’s really rare that 2 drives fail at once.. they most likely overheated next to each other.

  • September 23, 2009 at 1:21 pmearly219@yahoo.com

    btw, you mentioned 3 drives.. RAID5 usually have 4 drives.. anyway, it sucks.. i liked those funny and perverted screen caps from jaalin

  • September 23, 2009 at 1:46 pmdivine

    A RAID-5 array has a 3 drive minimum, but usually incorporates a lot more drives than that.

  • September 23, 2009 at 2:17 pmNeo_NMO

    it’s a linux box, so it’s probably ext3 or something

  • September 23, 2009 at 9:05 pmMajjin

  • September 23, 2009 at 9:06 pmMajjin

    ^^ says they were from Random C ^^

  • September 24, 2009 at 1:14 pmearly219@yahoo.com

    oh so your running at 3 drives minimum.. because the settings i usually see are array of drives from [0]-[3] which is 4 drives ^^