Digitising My Life in 2018

Life is digital. We’ve known that for a long time. Digital offers lots of convenience, but it brings with it complications. In particular, safe storage.

In 2018 I need to try to fix three or four problems/issues I have coming up.

1. Cloud Storage

As longtime readers might know, I have a couple of Synology NAS drives at home, each with a RAID 0 arrangement with pairs of matched hard drives storing my data. In total they store just over 4TB of data, with a further 1TB of headroom between the two NAS drives.

While I have local copies of music and other documents, space is really taken up by photos (in RAW format) and videos. As more devices move from HD to 4K, those video file sizes aren’t going to be coming down much any time soon.

All of this NAS drive storage is backed up to Amazon Cloud – more of which later.

Beyond this storage, I have a further 4TB drive of older files sitting on a new standalone 4TB external HD. This data is not backed up in the cloud, but is duplicated on a series of older “passport” sized portable HDs.

Amazon introduced its unlimited cloud storage system last year, and I jumped at spending £59.99 for a year’s worth of unlimited storage. I could use an app on my NAS drive to upload files in the background and keep the two in sync. My older NAS drive didn’t really work with this method, but I managed to create a virtual link between the two NAS drives from the drive that did work, and I safely backed up all my files.

But the writing was on the wall for the Amazon deal almost from the start. In the US, where they’d had the initiative for a longer time, Amazon had cancelled it because some users were storing vast quantities of data. It would only be a matter of time before Amazon UK followed suit, and sure enough, I got an email announcing the end of the scheme towards the end of last year.

Because Amazon will continue to store photos free of charge, I would only require 3TB of data for video and other files. Amazon prices that at £237 a year.

But that excludes my other 4TB of data. Even if some of that is also photos, I’m probably looking at 5TB at £400 a year to be fully backed up with Amazon.

So my first job is to find a robust backup provider that can help, ideally coming in at well below £400.

One alternative is to buy an 8TB external hard drive, sync my drives to it (I would estimate that will take at least a week), and then store that drive at work, returning it home fortnightly or monthly to do intermediate syncs.

Another suggestion via Twitter was:

I do kind of like the idea of this. In reality, I’m probably not going to find a friend with unlimited data willing to put my Raspberry Pi/USB HD combo under their stairs or wherever, but it’s definitely an idea. Nextcloud in particular seems interesting application to enable this.

I will continue to explore paid for options and see what I come up with.

2. Scanning Photos

Yes – just about every photo I take these days is digital, and even those shot on film get scans at the time, so I have digital copies of them. But I still have a few thousand (I think) printed photos.

Included amongst this is a historical archive of old Virgin Radio pictures – mostly press photos – saved from the bin around the time that Virgin Radio was rebranded as Absolute Radio.

I’ve been meaning to scan this trove for years. But I’ve always been stuck since although I have a reasonable scanner, it’s only USB 2.0 and doing a decent scan of a photo takes quite some time. Even if you place half a dozen or more photos on the flatbed at the time, it’s a painful process. Invariably I choose to scan at high quality – probably higher than I’ll ever need.

The other option would be to scan negatives – as I usually still have them. But that involves dust removal and other slow to process issues.

One popular alternative is to pay a third party company to do the scanning for me. That involves boxing the photos off, sending them off, and getting a digital download or USB stick back with the results. It’d safely cost me several hundred pounds.

My 2018 solution is to not be quite as fussy about the quality of my scans. Anything really worthwhile I may spend more time with. But in the main, we’re talking about photos that have barely seen the light of day since I took them (I’ve never really had physical photo albums).

I own a Fujitsu Scan Snap iX500 which I bought to scan a large number of documents. It’s really good at this, and I also save things like cycling or walking routes from magazines, or other things that might be useful to hang on to.

Importantly, it has a sheet feeder that means you can scan things pretty quickly. For documents I make searchable PDFs using optical character recognition at the time of the scan.

But I’d not used it for photos because – well – I was concerned about quality issues. But it will scan to 600 dpi, and while that might not be enough to print billboard sized photos from, it should be fine for regular use.

I will report back and let you know the findings.

[Update: Well I did a bit of a test run through with 800 Virgin Radio photos that I, er, acquired when the station rebranded as Absolute Radio, and it was fairly painless. The quality is decent and it didn’t take an inordinate amount of time to do. This should be very achievable.]

3. Digitising Video

I also have something approaching 100 MiniDV video tapes with various footage on them. While I’ve already captured and digitsed all my oldest Hi8 video footage, this MiniDV footage needs capturing. I have a working camera to play the tapes back from, but the only way to capture is in real time. In reality that means a dedicated PC (fortunately I have such a beast), and regularly running tapes through the camera to capture the material.

There are no short cuts for this one that I can see.

4. Supplemental

I found a load of 3.5″ floppy discs the other day. I suspect that there’s little to nothing I really need to keep from them, but I’ll probably pick up a cheap USB drive and run through them anyway. I’ll keep a handful for posterity, but probably ditch the others – especially the numerous covermount discs!

The other job I have is to properly digitise the family’s Super 8 films. Many years ago, I pointed a digital video camera at a projection screen and captured them that way. I have that now converted to mp4. But it’s dreadful quality. Again, third parties can do this, but the costs are high. I’ve been quoted £600-£1000. So at some point, getting a machine like this Reflecta Super 8 scanner might be a good idea. It looks like it’ll create HD video from footage, although a bit of post-production will be required to correct the frame rate.

5. Summary

One thing I’m aware of is that all the scanning and capturing from 2 and 3 will create a bigger haul to store in 1. Such is the way of these things.

I should also note that I still have unripped CDs to capture, old cassettes I might digitise, and never mind my ongoing DVD/BluRay collection just about none of which is in a pure digital format.

I can see format conversion and digitisation being a theme for the rest of my life somehow…

Note: Just because I’ve digitised something, it doesn’t mean I’ll be throwing the originals out. They don’t take an enormous amount of space, and it would be foolish to do so.