Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
IT Technology

Delete Never: The Digital Hoarders Who Collect Tumblrs, Medieval Manuscripts, and Terabytes of Text Files (gizmodo.com) 150

An anonymous reader shares a report: Online, you'll find people who use hashtags like "#digitalhoarder" and hang out in the 120,000-subscriber Reddit forum called /r/datahoarder, where they trade tips on building home data servers, share collections of rare files from video game manuals to ambient audio records, and discuss the best cloud services for backing up files. The often stereotyped hoarders letting heaps of physical items of questionable utility dominate their homes and lives often suffer social stigma and anxiety as a result. By contrast, many self-proclaimed digital hoarders say they enjoy their collections, can keep them contained in a relatively small amount of physical space, and often take pleasure in sharing them with other hobbyists or anyone who wants access to the same public data.

[...] Many people active in the data hoarding community take pride in tracking down esoteric files of the kind that often quietly disappear from the internet -- manuals for older technologies that get taken down when manufacturers redesign their websites, obscure punk show flyers whose only physical copies have long since been pulled from telephone poles and thrown in the trash, or episodes of old TV shows too obscure for streaming services to bid on -- and making them available to those who want them.

This discussion has been archived. No new comments can be posted.

Delete Never: The Digital Hoarders Who Collect Tumblrs, Medieval Manuscripts, and Terabytes of Text Files

Comments Filter:
  • I have too many PDF scans of Byte Magazine [archive.org] on my iPad. #digitalhoarder
  • by 140Mandak262Jamuna ( 970587 ) on Tuesday March 05, 2019 @11:54AM (#58219574) Journal
    I dont think I have seriously deleted any file since 2000 at work. Log files from unit testing suites, sure, and the scratch folders for temp work, sure. But any file created by me, be it a text file, or a script or bmp file or a partial edit of an email, or a several dozens prior drafts of the presentations, nothing has been deleted. The email archive goes all the way to 1997. Some early emails are in large flat text files, which I am going to reorganize and extract all the meta data and make them clean anytime now...

    I count about 8 Tb spread across several machines as my current disk usage. Wondering if this is high, low or medium in technology sectors. None of it are videos or animations. Not much of bmp files, or binaries. Images are, at best, jpgs.

    • by Jason Levine ( 196982 ) on Tuesday March 05, 2019 @01:17PM (#58220068) Homepage

      Every time I get a new laptop, I take the files on the desktop of the old laptop and put them in a dated folder on the desktop of the new one. So on my current laptop, I have "Old Laptop - 2018-01-18". Inside that is another old laptop folder and inside that is another one. There are files that are a decade old in there which I haven't looked at in nine years, but I don't get rid of them because "maybe I'll need this one day and it only takes up a couple of MB."

      • by Shaitan ( 22585 )

        I do this too

      • I do the same thing. Since each of my new computers has had, typically, an order of magnitude more storage than the previous one, the entire recursive archive costs me less than 10% of the capacity of the new one. (I say typically because there was a discontinuity at the transition from spinning rust to SSD.)

        Obligatory xkcd:
        https://xkcd.com/1360/ [xkcd.com]
      • by jon3k ( 691256 )
        I do something very similar. When I upgrade an OS or get a new machine, I just make a copy of my old home directory and put it on my nas in a backups/ directory with year + machine name (2019-03-10_pc_name). I'm usually very good about storing anything I'm actually creating either on the nas directly or in a github repo, but there's an off chance some random config file might be handy or something. I don't remember every needing to get something, but the folders are really small and it gives me peace of
  • “Cloud backup” (Score:3, Insightful)

    by ruddk ( 5153113 ) on Tuesday March 05, 2019 @12:08PM (#58219640)

    I was just looking for another way to backup my NAS. I had been using CrashPlan on Linux but as I have approached 7TB I’d data, mostly unedited video, and lost my baseline, it has become way to slow.
    It is interesting that if I want to backup 10TB, the cheapest solution I have found is to place a small QNAP (1 or 2 drive) at a friends house and run run sync backup between them. It has a break even at 1 1/2 year, power bill included. Since we are on 100 megabit internet it is fast enough.
    Was looking at backblaze b2 as alternate solution.
    I am not aware of any other backup provider than CrashPlan that offers unlimited space using a Linux client. The speed issue seems to be a single threaded java program that does client side deduplication. It will take me 7 months to reestablish baseline. 2 months when I exported the VM with the backup client and ran it on a cpu with faster single core performance. :)

    • by AmiMoJo ( 196126 )

      I use Spideroak, but the client has similar performance issues. It's at least not Java but it uses an Sqlite database and a hell of a lot of disk/RAM thrashing.

      I don't think any of them have a decent client app.

      • by ruddk ( 5153113 )

        I think it is like most cloud solutions(backup, mail, office solution etc). It is fine for "regular" PC backup $5 a month and you have a backup of your computer without having to muck about with it. But special use cases require a bit more.

    • I was able to backup a bit more than 8TB with Backblaze Personal ($5/mo. for unlimited storage) in about a week. That said, I'm backing up from a Windows box with a direct-attached RAID enclosure, just because I wanted to avoid issues like limitations on backing up network drives or client platforms. I know it's possible to backup a NAS on Backblaze Personal via iSCSI (since it appears to be a local drive to Backblaze), but the people I've heard who use iSCSI for that purpose don't seem to recommend it. Eve

      • I backed up with BackBlaze as well. In my case, it was about 4TB, but it took me over a month to complete the first full backup thanks to poor upload speeds. (Not BackBlaze's fault. My local ISP.)

    • by GuB-42 ( 2483988 )

      Deduplication is a problem with CrashPlan on large datasets. You can disable it here.

      https://support.code42.com/Cra... [code42.com]

      It says "don't do it" every two lines but it sped up my backup speed by more than 10 times after a few TB.

      • by ruddk ( 5153113 )

        Thanks, I'll give it a whirl since I am about to cancel it anyway. Better do a restore test though. :D
        There isn't any huge gain anyway since it is video anyway.

    • It is interesting that if I want to backup 10TB, the cheapest solution I have found is to place a small QNAP (1 or 2 drive) at a friends house and run run sync backup between them.

      Is that a cheaper solution than unplugging the drive and walking over to your friend's house with it?

      • by ruddk ( 5153113 )

        No you are right, I guess the cheapest solution is the Adidas net with a 12TB USB drive.
        But I still want to geek out a bit I suppose. :D

    • Re: (Score:2, Interesting)

      by Anonymous Coward

      Dual qnap boxes, one at a remote location with an openvpn tunnel from the remote qnap to my home router is the route I went too. So much cheaper and the data stays under your own control so long as you trust where ever you have chosen to keep your remote qnap. Use the full disk encryption with an unstored key and if the remote qnap were ever stolen it's data is inaccessable. You can get cheap older qnap nas units off ebay, They don't need to be exceedingly fast newer units. I just rsync my local qnap to the

    • by jon3k ( 691256 )
      I am in the same boat, tons of raw video from iphones and various devices that I want to keep. What I recommend is just taking an external USB HDD, encrypt it with LUKS and stick it in your desk drawer at work. Then for me, once or twice a year, bring it home, mount it, rsync it, take it back to the office. This is "good enough" for me. My house is a few miles from the office so the likelihood of some event destroying both, for me, is very unlikely (nowhere near a hurricane or a fault line, tornado hitt
  • by WankerWeasel ( 875277 ) on Tuesday March 05, 2019 @12:15PM (#58219686)
    CrashPlan closed their consumer-facing unlimited storage cloud backup option because of people like this. It wasn't the 98% of the people using the service but the small minority of folks that backed up terabytes of data in collections like those here that made it unprofitable for them to continue operating. The digital hoarders really killed that service, ratter than the regular users.
    • Then what did they mean by unlimited?

      • It was always unlimited as promised, until it hit the point of being financially unprofitable for the company and they closed the service for all consumers. At the end of the day, that cloud storage costs CrashPlan money to buy from Amazon, Microsoft, etc. They never went back on the unlimited claim, but as very frequently happens, a small group of users really taking advantage of things, ruined it for everyone.
      • by lgw ( 121541 )

        Then what did they mean by unlimited?

        They meant "but don't be a dick". Now it means "this is why we can't have nice things".

        • so using their service of "unlimited" means that I'm abusing it? clearly there needs to be some clarification in their business model. It's like the old Flip Wilson story about the Lemonade stand:

          As a kid, I used to have a lemonade stand. The sign said, "All you can
          drink for a dime." So some kid would come up, plunk down the dime, drink a
          glass, and then say, "Refill it." I'd say, "That'll be another dime." "How
          come? Your sign says--" "Well, you had a glass, didn't you?" "Yeah." "And
          that's all you can drink for a dime."
          -- Flip Wilson

          • by lgw ( 121541 )

            Yes. It's like any resource that's obviously shared with other people. Even if you can technically take all you want, you probably shouldn't. Life is not a game to be exploited for maximum personal gain without regard to others. Not to say that it would violate any TOS, just to say "don't be a dick".

            • it's a virtual resource, I can't tangibly hold it therefore I don't care how much I use; end of story.

              • by lgw ( 121541 )

                Do you feel the same way about electricity?

                Backend storage is a tangible resource. Bandwidth (well, routers) is a tangible resource.

                • your examples are still not fully opaque. Electricity is traded as a commodity, routers and networks could be but aren't. If you don't charge me for my usage but charge me bulk pricing that disregards patterns of usage then what do you care how much of it that I use? I think we've now transcended into a net neutrality debate. I'll use my unlimited bandwidth on my unlimited storage in an unlimited way, after all that's what I pay for.

                  I have no pity for business that promises and prices "unlimited" services a

                  • by lgw ( 121541 )

                    The flip side is there's no justification for outrage when the "unlimited" plan is suddenly cancelled. Tragedy of the commons, really.

                    • 1) Build Services that allow for "unlimited"
                      2) ???
                      3) Profit!

                      the essential business model for E business and why they fail.

            • "Being a dick" should mean things like storing others peoples files, giving out the password so others can download/upload to the account, etc. Or using it as your file server to store data you don't retain a local copy of. If it's really your files, you should be able to use it in a manner that backs up all your files, without limit if offered as such. It's like an all-you-can-eat buffet. It's a dick move to get food for someone else, or take a bunch of food home... but you have to reasonably expect a fat
        • They meant "but don't be a dick". Now it means "this is why we can't have nice things".

          At what number does "unlimited" turn into "being a dick". Is someone's 500GB collection of dickbutt drawings more or less dickish than someone else's 2TB photo library they have amased over the years?

          You want me to not be a dick, stop being arbitrary and tell me at where you draw the dick in the sand.

    • It sounds to me like an engineering problem, not a gross profitability problem. They probably engineered their storage environment for any one customer blob to not exceed some size, and when it does it deducts from the efficiency of the whole system incurring dramatically higher costs.

      You would think generally one guy with 10 TB is offset by dozens of people buying plans who have mere gigabytes of storage consumed if you're just thinking in terms of their cost per TB of storage.

      • They offered unlimited storage, and these hoarders took advantage of it.
    • CrashPlan closed their consumer-facing unlimited storage cloud backup option because of people like this. It wasn't the 98% of the people using the service but the small minority of folks that backed up terabytes of data in collections like those here that made it unprofitable for them to continue operating. The digital hoarders really killed that service, ratter than the regular users.

      STOP making bullshit excuses for a company already. Anyone who is wiling to offer an "unlimited" plan should be prepared for exactly that. And if you can't manage to be profitable off "the 98%", then you didn't stand a chance anyway. Your business plan was fucked from Day 1.

      • And they did offer just that. They never limited things. It was when a small group of users pushed things to the point it was unprofitable for the company that they closed their consumer business. AT&T, Verizon, Sprint, Comcast, and others never would have put in caps on their own service if it weren't for those that go far and away above the general user. It's those users that cost all of us.
        • And they did offer just that. They never limited things. It was when a small group of users pushed things to the point it was unprofitable for the company that they closed their consumer business. AT&T, Verizon, Sprint, Comcast, and others never would have put in caps on their own service if it weren't for those that go far and away above the general user. It's those users that cost all of us.

          The end result of offering "unlimited" plans should come as no surprise to anyone in any business at this point. And if you can't manage to be profitable off the other 95%+ who don't abuse your service, then your business model was doomed anyway. Stupidity deserves to be rewarded with bankruptcy in that case, and I'm not about to make excuses for the fucking morons who refuse to account for human behavior or learn from history.

          • Take that stance all you like. The point is to stop crying that companies are putting caps in place. If some didn't choose to be abusive of them, we'd all still be enjoying things without any caps, should there be times when our usage is more than normal.
            • Take that stance all you like. The point is to stop crying that companies are putting caps in place. If some didn't choose to be abusive of them, we'd all still be enjoying things without any caps, should there be times when our usage is more than normal.

              There you go again, making pathetic excuses for companies who fail to understand human behavior. Stop doing that stupid shit already. The actual point here is understanding and accepting human behavior. If you don't like it when even 1% of your user base takes FULL advantage of your "unlimited" offering, then STOP being that idiot who offers unlimited plans.

              And no, I'm not one of those 500TB hoarders who abuses the shit out of these offerings. I barely have a couple hundred GB stored in the cloud in tot

              • You seem to have a total inability to understand why companies offer "unlimited" options. It's all about marketing, but that point seems to be so far over your head that you can't even begin to comprehend. But keep crying about it, it's pretty funny.
                • You seem to have a total inability to understand why companies offer "unlimited" options. It's all about marketing, but that point seems to be so far over your head that you can't even begin to comprehend. But keep crying about it, it's pretty funny.

                  I don't care if it's defined as mere marketing or not; stand behind your product and offering, or shut the hell up.

                  1 - 10% of your user base "abusing" an unlimited plan should never be enough to destroy your product. If it is, then you were stupid enough to allow it in the first place. Don't bitch about gambling if you can't afford to lose.

        • If most of us come in under the caps, how is having the caps costly to anyone other than the few who exceed the caps? Crashplan could have just decided to institute a cap, and most of their customers would have never noticed.
        • Oh bullshit. Those caps are to enhance profitability only. If it was a congestion issue, *current bandwidth* would be throttled *when congested*. Total bytes per month is unrelated to their cost structure; it's not how bandwidth is priced. They're incurring no extra cost from someone saturating their connection from 2-6AM every night when they're at a tiny fraction of peak capacity.
    • It wasn't the 98% of the people using the service but the small minority of folks that backed up terabytes of data

      It sure seems like 1-3% of customers storing many terabytes of data would come off as a rounding error in how much storage you would actually need to store hundreds of thousands of customers worth of data anyway...

      They would also be doing you a bit of a service by stress-testing everything for extreme cases.

      If that much more data is seriously a problem, then why not offer tiers like 0-2 TB (nor

      • Clearly it was more than as simple as a rounding error, as they shut down the consumer service due to the abuses. If you have a small group that cost your company a disproportionately large chunk of the total cost, that's an issue. They're certainly not stress testing as they provide such services to huge businesses on their commercial size which are doing that for them already. Nothing is truly unlimited and those that can't recognize that and see it for the marketing move it is are only kidding themselves
        • Clearly it was more than as simple as a rounding error, as they shut down the consumer service due to the abuses.

          Or maybe they only wanted larger customers and not have to deal with so many smaller customers that could each generate support requests.

          As I said, if cost was an issue they could have just implemented tiered pricing.

          In a way they did - they just have only the upper level tier now, and provided free migration to the small business plan. As it is, that plan is still only $10 / device / month, not

    • by Anonymous Coward

      So, really, they were offering 1 TB (or 2 TB etc) service but they got the benefit of lying and saying their service was unlimited, which attracted more customers. Cry me a river that they'll have to accurately market what they are offering.

      It's one thing to say "unlimited" when there is an inherent cap on the cost you could incur per customer (e.g., if you offer "unlimited long distance calling" there are a finite number of minutes in a month) and you can decide that it actually makes sense to offer an "un

    • The digital hoarders really killed that service, ratter than the regular users.

      No, the unsustainable terms of service ("unlimited") were the problem and that was always strictly under the control of the service provider, in fact that offer predates any of the clients using the service for what it was said to be. Microsoft made the same bad choice with its storage system which was once offered on an "unlimited" tier. Nobody has unlimited quantities of anything so offering such is unrealistic. It's not a clie

    • This is absolute FUD. If it was a problem of a few people backing up massive amounts of data, then they could have instituted a data cap. If these terrible "digital hoarders" were the only people backing up TB of files, then it shouldn't have impacted any of their other users, correct?
  • by foxalopex ( 522681 ) on Tuesday March 05, 2019 @12:15PM (#58219688)

    People pretty much will collect anything and everything if possible. So it shouldn't be a surprise that there would be folks who collect data. The interesting part is going to be what happens to that data when they pass away?

    • People pretty much will collect anything and everything if possible.

      Thus confirming the conspiracy theory that were seeded on Earth as a mining solution to gather up a bunch of shit by some really low-effort aliens.

    • People pretty much will collect anything and everything if possible. So it shouldn't be a surprise that there would be folks who collect data. The interesting part is going to be what happens to that data when they pass away?

      Same thing that happens to the book collection(s) of folks who pass away - someone else might pick it up (books with any actual value at a yard/estate sale, data by way of "...oh, a pile of disk drives for a buck? Sure, what the hell? I can make a cheap NAS out of it or something..." at the same estate sale.)

      Similarly, the kids/heirs might scrounge through that data if they see value in it (hypothetical: "oh shit - DeadGrandpa mentioned that he had mined quite a bit of $RandoCoin back in the day, and it's w

  • There used to be the notion of data retention, it was embedded in mainframes and OS stacks dating back to the 70s to prevent this kind of thing. Data owners had to take proactive steps to ensure retention. I myself have found that a few DROBOs filled up act nicely to preserve all that ancient knowledge, like my old MSDN CDs that had all the C++ documentation before they purged it in favor of C# and my Leisure Suit Larry collection. So don't call us hoarders, call us digital monks of the digital monastery s

  • What these people are doing is preserving or archiving information to share with people. As other's have posted, also known as data retention.

    Someone who hoards, hides away what they accumulate.

    The two are not the same. But since the term "hoarder" is en-vogue people want to use it for notoriety's sake. Morons.
  • ...to invite them to dinner [wikipedia.org], isn't it ?!?
  • Hoard random data in the terabytes.

    I remember Paul "Pee Wee" Herman got hit for having Child Pornography he'd bought in a massive lot of vintage photos. He was wealthy enough to fight it off and win, but he also won because it was physically in sealed boxes so when they raided him he could legally say he's never set eyes on the stuff. With digital you can't really do that, so unless you're so rich folks look the other way (like Epstein) your life is over.
  • So this is what Vint Cerf meant by 'digital velum'...sort of.
  • the wayback machine anyone?
    Maybe they should talk about that too.

  • Or we need to have an intervention for all those museum curators who accept donated collections only to store them away in their sub-basement for decades at a time. Oh wait, that's more about being a disproportionate tax deduction for the donor, rather than hoarding. Never mind!
  • by epine ( 68316 ) on Tuesday March 05, 2019 @07:33PM (#58222188)

    Look what I just found in my extensive digital records:

    Digital Hoarding Can Make Us Feel Just as Stressed and Overwhelmed as Physical Clutter, Research Suggests [slashdot.org] — 8 January 2019

    And, no, I don't feel stressed in the least.

  • collect all those rare files and put them on a cloud, because, you know, then they will be saved forever!

If all the world's economists were laid end to end, we wouldn't reach a conclusion. -- William Baumol

Working...