(Topic ID: 282744)

Magnetic Disk and Tape Club

By Crash

3 years ago


Topic Heartbeat

Topic Stats

  • 41 posts
  • 12 Pinsiders participating
  • Latest reply 9 months ago by Crash
  • Topic is favorited by 3 Pinsiders

You

Linked Games

No games have been linked to this topic.

    Topic Gallery

    View topic image gallery

    6f2j3a (resized).jpg
    its-a-unix-system-i-know-this (resized).jpg
    DSC_2737 (resized).JPG
    fujifilm (resized).JPG
    DSC_1702 (resized).JPG
    #1 3 years ago

    I saw this video a while back, surprised tape backup was still a thing for medium sized businesses and enterprises:

    So I started thinking about the best way to store things like captures of childhood videos and other precious data. I have a few external hard drives, but one died and I can't format it anymore across multiple PCs or operating systems. Plus hard drives have an official shelf life of about 5 years.

    I put that on the back burner for a while and came across some home videos a friend wanted captured. I played those back and was amazed at how some of those VHS tapes that were recorded in 1986 through the 1990s had held up. That's 34 years!! I then looked at another home video from a family member recorded in 1990, with the same amazing result. Picture is great and sound is crystal clear.

    Coming up on a possible 8mm film transfer project from my grandmother's side of the family, I again revisited tape backups in hopes of preserving the memories for another 30 years. I was lucky to find a good eBay deal that includes a drive and some gently used 3TB LTO5 tapes to get me started. I'm installing this puppy in my gaming PC, complete with HBA card.

    Is anyone else buying these tape systems on the secondhand market for home use?

    #2 3 years ago

    Hard drives are getting cheaper, but are they really that reliable for long term archiving (20+ years)?

    #3 3 years ago

    Also found this:

    #4 3 years ago

    My stuff came in. Now I need to read up on how to connect it all up. Anyone else do this type of work? How long do these LTO tapes really last?

    DSC_1702 (resized).JPGDSC_1702 (resized).JPG
    #5 3 years ago
    Quoted from Crash:

    Hard drives are getting cheaper, but are they really that reliable for long term archiving (20+ years)?

    Well solid states should have any failing issues like disk hard drives right?

    I'm sure you read this but...
    " However, LTO tapes are extremely sensitive to storage conditions, so this 30-year life expectancy assumes you are using ideal storage conditions - a constant temperature of about 70 degrees Fahrenheit and 40% relative humidity."

    Edit: wow looking the up SSDs say only 10 years...ibwonder if that counts if you pile everything in and then disconnect it .

    Interesting topic I never though of until I saw this thread!

    #6 3 years ago

    They will last a long time, most likely the tape drive will go before the tapes. Make sure you pick up some cleaning tapes as well, and run regular maintenance. I don't miss the days of taking my most recent tapes over to the local bank's safety deposit box every Friday for safekeeping.

    The cloud is where it's at. I run a local hybrid setup now that I have retired my tape backups. Two local synology rackstations with 44tb of storage each, and then I backup about 7tb a week to backblaze, and the grand total per month is right around $30.

    #7 3 years ago
    Quoted from TheLaw:

    Well solid states should have any failing issues like disk hard drives right?

    Not mechanical issues, but they do wear out as you write to them. But so do tapes and hard drives, they just wear mechanically. SSDs wear electrically, if that makes sense.

    Quoted from TheLaw:

    " However, LTO tapes are extremely sensitive to storage conditions, so this 30-year life expectancy assumes you are using ideal storage conditions - a constant temperature of about 70 degrees Fahrenheit and 40% relative humidity."

    I'm storing my tapes indoors (my house).

    Quoted from TheLaw:

    Edit: wow looking the up SSDs say only 10 years...ibwonder if that counts if you pile everything in and then disconnect it .

    I would think you would still need to power the SSD from time to time to prevent the electrons in the cells from leaking out, losing the data.

    Quoted from TheLaw:

    Interesting topic I never though of until I saw this thread!

    I work in IT and we see old tape backup stuff come in from time to time. I considered getting one from a client's recycle pile, but it was SCSI only and probably LTO3 or LTO4. I was able to find my equipment due to a company closing from coronavirus and selling off the stuff at liquidation prices. In addition to getting a good deal, I'm also glad I was able to help their cause financially.

    #8 3 years ago
    Quoted from ralphwiggum:

    The cloud is where it's at. I run a local hybrid setup now that I have retired my tape backups. Two local synology rackstations with 44tb of storage each, and then I backup about 7tb a week to backblaze, and the grand total per month is right around $30.

    Although a lot more convenient, cloud storage is actually backed by tape:

    #9 3 years ago

    Backblaze is all HDs... each quarter they publish their failure statistics, and it’s always an interesting read....

    https://www.backblaze.com/blog/category/cloud-storage/hard-drive-stats/

    #10 3 years ago

    The Seagate drives don't seem to be as reliable as they were 15 years ago. I've seen issues with them personally too vs. other brands.

    #11 3 years ago
    Quoted from Crash:

    The Seagate drives don't seem to be as reliable as they were 15 years ago. I've seen issues with them personally too vs. other brands.

    I have as well... I used to buy Seagate exclusively and about 10 years ago, started seeing higher failure rates in them. For the most part, we stick with WD now. So far, I have swapped out about 75 desktops to SATA3 SSD WD Blues and they have been rock solid.

    I haven't looked at Backblaze's published stats this year, but what I found interesting in previous published stats were that the consumer drives they use were holding up nearly as well as the enterprise drives they use. I thought there would be a larger percentage of failure than what was published.

    #12 3 years ago

    Welp, I don't have a free PCI-E slot. I'll need to try this in another PC I have.

    #13 3 years ago

    Indeed cloud storage backups will be on tape. Still the cheapest form for storing large amounts of data.

    2 weeks later
    #14 3 years ago

    Why not encrypt your data and store in the cloud? I live in fire and earthquake area in Northern California so for me it feels like the only option. After the 2017 fire is almost burned our town I went all cloud storage.

    #15 3 years ago

    Unless you have a specialized facility to store your tape, in a special climate controlled area that you'll be keeping for the next 30+ years, you're going down a rabbit hole that someone else already has figured out IMO. I do video work for a living and I'm a digital hoarder, so my setup is just a shit ton of hard drives plus cloud storage. I have two local 2tb SSD drives that are my main active drives for projects I'm working on. Then 5x 4TB drives that live in an array that I plug into for archiving and retrieving old projects. I back those 5x 4tb drives once every couple of months or so and store those drives at my parents house. All of that data is then backed up in an unlimited google drive account that I still have from my college for some reason.

    Almost all of the audio recording I do is analog, and I usually don't reuse tapes all that often. When I do, I back everything up digitally in 96/24 and erase the tape. What I can say is that even though I don't have perfect tape storage conditions and I am using tape that is old and who knows how it's been stored in the past 30 years of its life, I've lost plenty of pieces of multitrack recordings due to tape shedding and fallout and what not. I can't scientifically measure how much information without letting it shred itself to bits Basinski style, but I can say that I would trust hard drives over tape for a home situation any day of the week. Cloud storage all gets backed up on tape obviously, but hell, if they want to worry about the storage and stability, I guess that's why I'm paying them for it (well, through my tuition I guess hah)

    #16 3 years ago

    Not interested in cloud storage, plus don't have the upload speed for that anyway.

    2 months later
    #17 3 years ago

    I have a few boxes of these that I have no use for. They have been in storage in my Florida garage for a number of years. I wouldn't feel comfortable selling them knowing this. If you are willing to pay shipping and want them (to try to use, not resell), shoot me a PM.

    fujifilm (resized).JPGfujifilm (resized).JPG

    7 months later
    #18 2 years ago

    I'm considering storing audio on VHS long term. The format's track record for longevity and Hi-Fi's capability of reproducing audio are both fantastic. I can't see an SSD or hard drive lasting this long for archival audio storage. A 2 hour long FLAC file can be pretty big, and tapes and VCRs are still cheap. You don't even need blank tapes, just buy used ones off eBay and erase them. They don't even have to be high grade tapes. I'm also looking for some software that will save a FLAC file as a video stream simultaneously.

    #19 2 years ago

    For the most part, I back up to large external HDDs and Verbatim BD-R 25GB discs (I always go with better quality discs). I make sure there is at least two copies of the data, each on different media.

    I haven't messed with backup tapes in years.

    #20 2 years ago

    I used to think CDs and DVDs had good longevity until after about 10 years so or I started having issues with some discs becoming unreadable due to rot. I do have some BD-Rs though and I haven't been able to test those for longevity yet.

    I think my strategy will end up being DVDs or Blu-rays and VHS/LTO tapes as a second level backup. I don't trust hard drives as much as I used to. I see drives with 5 years of age or less develop bad sectors on the surface of the platters.

    #21 2 years ago

    I have terabytes of back up on hard drives duplicated in three physical locations, hard drive failure is rare once you get past the 6 month mark.

    I backed up on tape at one time, the tape drives are a failure point as some else suggested.

    #22 2 years ago

    I've kind of had my eye on a Synology DS1621+ RAID NAS storage device. It's a little spendy even before adding the drives, though.

    https://www.synology.com/en-us/products/DS1621+

    #23 2 years ago

    I would recommend LTO tapes for long term backups. Store encrypted tape copies at a friends or relatives house. SSD drives might only be good for 5-10 years before bit errors, especially on consumer drives. Magnetic disk drives are good for 10+ years but have their own issues. LTO tapes are what we use for offsite/offline backups for data retention and are designed for security, portability, and reliability for backup purposes. Personally I have a small storage array at home then offload a backup to tape a few times a year. For reference I am a storage engineer for a large IT company. Do not risk losing all your data with a substandard or hobbyist method. Our lives are mostly digital now and methods for protecting these assets have changed over the last 20 years. Cloud is and will be more relevant as time goes on but LTO tapes are still very useful.

    #24 2 years ago

    Here's what I figure. If 30 year old consumer formats like VHS, compact casette, and 8-track are still retaining information, imagine what enterprise grade LTO tapes can do.

    #25 2 years ago
    Quoted from Crash:

    Here's what I figure. If 30 year old consumer formats like VHS, compact casette, and 8-track are still retaining information, imagine what enterprise grade LTO tapes can do.

    Analog sound can afford to lose some data, drop a few bits and bytes and your digital data is unreadable.

    #26 2 years ago
    Quoted from gdonovan:

    Analog sound can afford to lose some data, drop a few bits and bytes and your data is unreadable.

    That's pretty much the same problem with every media storage format. At some point the physical material (magnetic tape, plastic disc, metal surface coating) will eventually degrade.

    Good quality paper can last hundreds of years. Now's the time to go back to punch cards as a storage medium

    #27 2 years ago

    True, it happens with any media. Just seems in my experience that the reliability of any tape format has outperformed other methods I have tried over the years.

    #28 2 years ago
    Quoted from Crash:

    True, it happens with any media. Just seems in my experience that the reliability of any tape format has outperformed other methods I have tried over the years.

    I actually have hard drives dating back to the mid 80s I use for work on arcade machines!

    #29 2 years ago
    Quoted from Crash:

    True, it happens with any media. Just seems in my experience that the reliability of any tape format has outperformed other methods I have tried over the years.

    Here's an interesting read, and they mention m-disc. I'm no expert, so maybe there's nothing new here: https://briantomasik.com/archiving-data-on-blu-ray-discs/

    At least if you can find a stable Blu-ray, you can stash it in a fireproof safe or maybe a safety deposit box - or both.

    I guess the best option is to have multiple backup locations/material.

    5 months later
    #30 2 years ago

    Finally got the tape drive installed. Installed Windows 7, just need the drivers for the HBA card and drive itself, followed by the HP StoreOpen software.

    DSC_2737 (resized).JPGDSC_2737 (resized).JPG
    1 week later
    #31 2 years ago

    For the initiated, I would advise against using Windows. I spent probably a good 2 hours trying to get this to work under Windows. I started with Windows 7 because it doesn't suck and some of the OEM tools and drivers were more likely to work with Windows 7 (being that LTO-5 came out as a standard in 2010). First of all I had to install my HBA card driver from LSI. No problems there. Then I had to install an older version of .NET Framework and Visual C++ Redistributable 2010 for the Quantum LTFS driver and tools. But alas, this did not start and cited the LTFS Management Service wasn't running. Tried to start the service, this failed. I checked the event log and found out the NT kernel was blocking the driver from being loaded due to driver signature enforcement.

    So I turned off driver signature enforcement, and the service and LTFS tools are now running. Great, but my tape drive was not listed in the Quantum LTFS manager. I found out it's listed as a tape drive in Device Manager, but the driver was listed as "unavailable." So I found and installed the only driver for HP LTO-5 drives I could find on their site. Rebooted and... blue screen crashes every time. To boot up, I had to turn driver signature enforcement back on so no drivers would load. And now I'm stuck.

    So I considered trying this with Windows 10, which I despise. However, I first decided to try Linux Mint. Much to my surprise my HBA card and tape drive all work out of the box and the expected st0, nst0, etc. device files showed up under /dev/. I then messed around with the mt ("magnetic tape") utility and used dd to read and write some files sequentially. Everything worked flawless and I'm getting 100MB/s+ reads in Linux and about 70MB/s writes. I only used test files of a few hundred MBs, so those numbers aren't truly accurate.

    Now, I'm aware of LTFS on Linux. But from what I can tell I would have to compile it myself, do some even more involved stuff with the terminal, make sure block size and UTF-8 formatting are correct, etc. Whatever "filesystem" is used by the Linux tape driver by default is very crude, as expected, but reliable and effective. Just like back in the 90s with Unix machines, I prefer to bundle up all my small files as tarball archives or just write large files sequentially to tape using the terminal as-is.

    I also printed some basic instructions on how to do this so if future me ever needs to do a recovery, the information is all there.
    its-a-unix-system-i-know-this (resized).jpgits-a-unix-system-i-know-this (resized).jpg

    #32 2 years ago
    Quoted from Crash:

    For the initiated, I would advise against using Windows...

    I've thought about this often the past year. But my Ubuntu skills are seriously lacking (i.e. almost none). Any reason you didn't use Ubuntu (looks like Mint is partly based on Ubuntu)? I'd do this on a Raspberry Pi4.

    Edit: Looks like a Mint build isn't directly available for the Pi?

    #33 2 years ago
    Quoted from mbwalker:

    I've thought about this often the past year. But my Ubuntu skills are seriously lacking (i.e. almost none). Any reason you didn't use Ubuntu (looks like Mint is partly based on Ubuntu)? I'd do this on a Raspberry Pi4.
    Edit: Looks like a Mint build isn't directly available for the Pi?

    I already had Linux Mint installed on this machine for a VHS decode project, and the files I want to archive are already there. I just changed hard drives when testing Windows. I've used Ubuntu, and Mint is based on it. I really dont like Ubuntu nowadays due to Gnome, Amazon being preinstalled, and extra telemetry that Linux Mint doesn't have.

    4 weeks later
    #34 1 year ago

    I did my first tape backup. A 23GB tar file with no LTFS. Just me, the terminal, the tape tools, and syntax from the 1970s. Probably only took about 5 minutes. My drive stayed cool but the HBA card got warmer than I liked so I put a small fan next to the case during the write.

    6f2j3a (resized).jpg6f2j3a (resized).jpg

    1 week later
    #35 1 year ago
    #36 1 year ago

    I've had a library in my basement for a year that I've still not hooked up. I should really get on that.

    1 week later
    #37 1 year ago

    So this is very interesting. This version of the software isn't publicly available yet. I have a bunch of old compact casettes lying around I have no other use for.

    1 year later
    #38 10 months ago

    Wow, didn't see this one coming:

    #39 10 months ago

    Also not really tape, but I decided to try ZIP100 disks for long term photo archiving. I have 14 of those on order along with a USB external drive. I was lucky to snag all of that for less than $50 shipped before taxes. If I can avoid the "click of death" I think being magnetic, ZIP discs will be a good third media option tor long term JPG photo archival.

    I also learned I can convert them to JXL files to save 30% on file sizes using lossless compression. JPEG XL is also an open standard and gaining adoption, and is fully backward compatible with the legacy JPEG format my hundreds of family photos are in.

    What give some hope about ZIP is there are examples on YouTube of disks and drives being stored in a covered box in a garage, plus a move, over about 20 years and most of the disks still read fine. That's impressive. Better than hard drives or optical media. And if the drive ever does die I can buy parts drives for well under $20.

    1 week later
    #40 10 months ago

    So I also found out my dad has 2 SuperDisk LS-120 drives. One was pulled from a PC between 15 and 20 years ago, and the other is in a USB enclosure designed for use with Macs. I disassembled the enclosure and found they are both the same IDE/ATAPI drive made in Japan by the same manufacturer (I don't believe the drives themselves were made by Imation or 3M). I slapped the other internal drive in an IDE USB hard drive caddy. Both drives work, one works flawlessly and the other struggles a bit when reading, but it does successfully read. I'm going to clean the laser mirror and lenses and see if that improves. Oh, and the one disk I tested with works 100% as well. I took multiple images with both of these drives and they were both identical with no missing sectors that I could see.

    So again, magnetic media continues to impress me. I guess my ultimate redundant multi-format hydra approach will be:

    1. M-Disc Blu-ray (for large files such as videos and small files such as photos and documents)
    2. ZIP Disk (small files such as photos and documents)
    3. SuperDisk (small files such as photos and documents)
    4. Floppy disk (mainly documents, may be possible to store JPEG-XL files, which have 20% smaller lossless file sizes than JPEG)
    5. LTO-5 tape (for large files such as videos)

    #41 9 months ago
    Quoted from Crash:

    Also not really tape, but I decided to try ZIP100 disks for long term photo archiving. I have 14 of those on order along with a USB external drive. I was lucky to snag all of that for less than $50 shipped before taxes. If I can avoid the "click of death" I think being magnetic, ZIP discs will be a good third media option tor long term JPG photo archival.
    I also learned I can convert them to JXL files to save 30% on file sizes using lossless compression. JPEG XL is also an open standard and gaining adoption, and is fully backward compatible with the legacy JPEG format my hundreds of family photos are in.
    What give some hope about ZIP is there are examples on YouTube of disks and drives being stored in a covered box in a garage, plus a move, over about 20 years and most of the disks still read fine. That's impressive. Better than hard drives or optical media. And if the drive ever does die I can buy parts drives for well under $20.

    I tried all 14 of a random collection of ZIP disks I found on eBay. It was altogether about $2 per disk. About 10 of these are brand new, with the "50 Ways to Use Your ZIP Disk" demo EXE file and nothing else on the new disks. Verified no "deleted" data was on them, confirming they were new.

    One disk had some legal documents from 1998 (can't believe the previous owner didn't format that one). Another has a set of ZIP utilities for Windows 3.1, 95, 98, and Windows NT. The third disk has some HP printer drivers from the year 2000. The fourth one has a partial Norton ZIP Rescue backup of his computer from 2001 with no personal files but it has a bunch of kids games. Maybe it was for kid's computer. I took a full image of a few disks and skipped that for the blank ones. I did scrub through the blank ones a bit with a hex editor with no issues.

    This was all recovered with zero unreadable sectors on an internal IDE ZIP drive from 1999 and ZIP disks from 1997, with data that is 25 years old. From an archival standpoint that is VERY impressive.

    If you still have ZIP disks and no drive to read them, I may consider data recovery. PM me if you want.

    Reply

    Wanna join the discussion? Please sign in to reply to this topic.

    Hey there! Welcome to Pinside!

    Donate to Pinside

    Great to see you're enjoying Pinside! Did you know Pinside is able to run without any 3rd-party banners or ads, thanks to the support from our visitors? Please consider a donation to Pinside and get anext to your username to show for it! Or better yet, subscribe to Pinside+!


    This page was printed from https://pinside.com/pinball/forum/topic/tape-data-backup-club and we tried optimising it for printing. Some page elements may have been deliberately hidden.

    Scan the QR code on the left to jump to the URL this document was printed from.