• IronCraftMan@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    Czkawka, dupeGuru, and VisiPics are my go-to for non-exact photo duplicates. I typically run all three, since they don’t all find the same duplicates. VisiPics runs fine under wine.

    But Czkawka’s real strength is non-exact video duplicates. The only other tool I’ve found that does that is videoduplicatefinder.

  • ComprehensiveBoss815@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    10 months ago

    I’ve removed at least 100GB of duplicates using this tool. Running every few months is a good way to cleanup things when my download queues get unruly.

    • iamcts@alien.topB
      link
      fedilink
      English
      arrow-up
      0
      ·
      10 months ago

      The latest WiFi standards provide faster theoretical throughput than what most motherboards have onboard for ethernet.

        • iamcts@alien.topB
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 months ago

          Completely different scenario.

          Most motherboards only come with a single 1Gbps port, maybe 2.5Gbps if you’re lucky. The latest WiFi standards far exceed 1Gbps, so I’m not sure why people are up in arms about my comment when it’s factual.

  • Bob_Spud@alien.topB
    link
    fedilink
    English
    arrow-up
    0
    ·
    10 months ago

    There seem to be a few of these in Github, found this one recently it seems to do a reasonable job. The real problem is its bash script you need WSL2 to run it on windows.

    What I like is the output is CSV files that are spreadsheet friendly and can be used to analyze and remove files in bulk.

    https://github.com/Jim-JMCD/Duplicate-File-Finder

    Czkaaka (CLI version) output file can be used to delete stuff in bulk but doesn’t list directories separately you have to through files individually.

    • ssl-3@alien.topB
      link
      fedilink
      English
      arrow-up
      0
      ·
      10 months ago

      The real problem is its bash script you need WSL2 to run it on windows.

      Eh?

      WSL2 is one way to run a Linux kernel (and thus native Linux executable binaries) in Windows.

      And while bash is definitely very common on Linux, it has never by any means been a strictly Linux program.

      It can be used on all kinds of operating systems – mostly unix-like operating systems, but also including Windows using a POSIX compatibility shim like Cygwin.

      People were using bash in 1989, years before Linux became the beginning of a thing. And folks have been using it on Windows since at least 1995, or maybe even earlier – decades before WSL.

  • RNG_BackTrack@alien.topB
    link
    fedilink
    English
    arrow-up
    0
    ·
    10 months ago

    I need similar tool but for music. Name of the files might be different. Size might be slightly different as well but im not sure that its count as duplicates

    • eriksrx@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 months ago

      This tool works for audio, too! I haven’t tried it for audio but the options are there.

    • eriksrx@alien.topOPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 months ago

      Just tried this! It’s either so efficient my CPU isn’t working too hard or it focuses most of its work onto one CPU core. That said, I appreciate being able to identify the highest res version of a file, that helps a lot!