• paris@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      5
      ·
      2 hours ago

      The Internet Archive is, and I really want to emphasize this, Fucking Huge. If you want to help archive it, every upload has an associated torrent you can download and help seed. Torrenting itself isn’t illegal, only torrenting illegal stuff like copyrighted movies. You can buy a relatively cheap refurbished HDD of whatever size you want, set up qBittorrent, and torrent the uploads that you want to make sure are available even if the Internet Archive has to take them down or has a critical data loss failure.

      • LaunchesKayaks@lemmy.world
        link
        fedilink
        arrow-up
        3
        ·
        edit-2
        22 minutes ago

        Thank you so much for the advice! I want to preserve important documents like the bill of rights and the constitution, as well as sexual education material, especially stuff pertaining to women and reproductive health. Also banned books. Things the facists are trying to purge and things that are important to me.

    • spujb@lemmy.cafeOP
      link
      fedilink
      arrow-up
      1
      ·
      4 hours ago

      i’m not smart enough for this but maybe look to communities like r/DataHoarder to get started

  • jherazob@beehaw.org
    link
    fedilink
    English
    arrow-up
    21
    ·
    12 hours ago

    Okay, given how things are going, do we know if the Internet Archive has a backup plan for when these fucks attack it in earnest?

  • brucethemoose@lemmy.world
    link
    fedilink
    arrow-up
    98
    ·
    edit-2
    18 hours ago

    We are screwed if the Internet Archive goes down, right?

    Seems like a huge point of failure for one entity.

    • kautau@lemmy.world
      link
      fedilink
      arrow-up
      47
      ·
      16 hours ago

      Agreed, I think the biggest issue though is just scale. It’s over 100 petabytes of data. Not outside the realm of big cloud providers to mirror, but they don’t really give a shit. It would require some sort of significant distributed software solution for the community to work with. Not impossible, but as far as I know, nobody’s taken up the mantle yet as I think it would need custom software just to begin the solution of how to distribute it as a sharded set of community mirrors, different people just mirroring individual pieces.

        • Swedneck@discuss.tchncs.de
          link
          fedilink
          arrow-up
          9
          ·
          8 hours ago

          IPFS is the way to go IMO, it’s so perfect for archival that it pains me that it’s still pretty unknown

          the fact that you don’t need any sort of central organization for everyone to help seed data is amazing, no more duplicate torrents splitting seeders, so long as you have identical data the network just figures it out.
          If you have the hash for a piece of data you can just set a computer to watch for someone to start seeding it, even if the last time anyone saw the data was decades ago and a dude just found a CD in their recently passed dad’s basement, if that dude seeds it overnight and then their computer explodes, you’ve now downloaded it and it’ll remain available. It’s so fucking good.

      • Enceladus
        link
        fedilink
        arrow-up
        15
        arrow-down
        1
        ·
        15 hours ago

        HexOS has a plan for shared encrypted data. With the simplicity of installation and management it could take off mainstream as personal NAS are gaining popularity, but its still in early development.

    • grue@lemmy.world
      link
      fedilink
      English
      arrow-up
      52
      ·
      18 hours ago

      It it long past overdue for the Internet Archive to move to the EU or Switzerland or something.

      • ⛓️‍💥@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        6 hours ago

        Would be best if there were several mirrors in several countries. It’s unfortunately too large to realistically host via crowd sourcing. The best you could do is something ala Storj where fragments are redundantly distributed across various hosts.

    • spujb@lemmy.cafeOP
      link
      fedilink
      arrow-up
      47
      ·
      edit-2
      18 hours ago

      from the linked page

      Excludes corrupt datasets and data not publicly accessible.

    • shikitohno@lemm.ee
      link
      fedilink
      arrow-up
      3
      ·
      12 hours ago

      Same, especially before the inevitable attacks on the Internet Archive to come. Who knows what nonsense will be in the works to try and get this removed, or the whole project shut down in the coming years.

  • Cyborganism
    link
    fedilink
    English
    arrow-up
    1
    ·
    21 hours ago

    I wonder if the recent attacks on the internet archive wasn’t to prevent this kind of thing? Maybe it was an American job.