I know about Clonezilla and copy pasting partitions with gparted, but can I just use dd to copy a partition with batocera to a USB stick and will it then boot from the stick? Do I have to set the boot flag or take any other steps?

Thank you for any tips.

  • ricecake@sh.itjust.works
    172·
    9 months ago

    It might work, but probably not without a little tweaking.

    A lot of things will reference drive identifiers or drive path to know where to mount them. These things don’t get copied by dd.

    • Deckweiss@lemmy.world
      10·
      9 months ago

      huh?

      Isn’t it the other way around?

      I once cloned an nvme with dd and had to physically remove one of the two, because they had the same id and the bios couldn’t differentiate between them and would randomly boot into either the first or the second one, inconsistently.

      And removing either one would boot into an identical system with everything mounted and working. Which caused some confusion until I realized that the id was copied over.

      So unless you didn’t use the id in fstab, you should be fine. Sure the device path may differ, but that can happen anyway to usually devices should be referenced by id.

      • ricecake@sh.itjust.works
        6·
        9 months ago

        There are different schemes that different distros use. Some user partition id, some use fire system id, and some use device serial number and partition index.

      • ricecake@sh.itjust.works
        4·
        9 months ago

        Probably all you need to do is check to make sure things look right, and actually test it.

        I can’t think of anything else that would be common that you’d want to check. If you’re running weird virtualization setups on your laptop you might have to do more. :P

    • stewi@sh.itjust.works
      1·
      9 months ago

      dd’ing /dev/sdx will copy all IDs

      dd’ing /dev/sdx1 will keep UUID but PARTUUID will remain the same on the destination

  • Krafty Kactus@sopuli.xyzEnglish
    111·
    9 months ago

    If you dd your entire laptop drive to the entire flash drive it should be able to boot. It might not work the same with just one partition though. Also, how big is your USB stick!?!?

    • bartolomeo@suppo.fiOP
      4·
      9 months ago

      Lmao they are huge these days! But I’m talking about a 40gb partition, cloning it to a 64gb stick.

      You can’t even buy 2gb sticks anymore :/

      • cmnybo@discuss.tchncs.deEnglish
        5·
        9 months ago

        Small USB flash drives are still available, you just won’t find them in the local stores. There are expensive, industrial grade drives from places like digikey and dirt cheap, no name drives from Chinese sellers where they will print your logo on them for free if you buy a hundred of them.

      • bizdelnick@lemmy.ml
        3·
        9 months ago

        One partition is not enough. You also need to copy a EFI boot partition and create a correct partition table manually. And note that you cannot get a correct result when partitions you are copying are mounted. You need to boot some live system to do this.

        • caseyweederman
          1·
          9 months ago

          I’ve heard that systemd-boot can do it with just one partition but I don’t know howww also somebody please eli5 BTRFS to me, my brain’s doing the full-sponge thing.

          • bizdelnick@lemmy.ml
            2·
            9 months ago

            It is possible to boot from a single partition, USB live images work this way. But regular installation that OP wants to clone likely has a separate partition.

  • MonkderZweite@feddit.ch
    7·
    9 months ago

    You can just use `# cat /dev/your-disk > /dev/your-stick, no need for a (dd) scalpel there.

    If your system uses UUID’s in /etc/fstab, you have to change them to match the current partitions to have it bootable. lsblk -o+UUID is nice for that.

    • bartolomeo@suppo.fiOP
      2·
      9 months ago

      Ok, thanks. That sounds pretty good.

      If i want to compress it and save it as a backup can I do

      cat /dev/sda3 | gzip -9 > drive.img.gz

      ?

      • kuneho@lemmy.world
        4·
        9 months ago

        fill up the remaining space on the drive completely with 0s with a dummy file you delete then, before gzipping

      • MonkderZweite@feddit.ch
        2·
        9 months ago

        Yes, but like @kuneho said, since “deleted” stuff only is marked as deleted (not wiped), there’s always a bunch of random on the “empty” space part of a disk, which compresses badly.

        Do cat /dev/zero > /path/to/mounted/partition/zeroes and delete it after cat errored out because no space, to fill the “empty” space with zeroes.

        • bartolomeo@suppo.fiOP
          2·
          9 months ago

          That worked really well! I got a 50gb partition with about 30gb free space into a 10gb zipped image. Is there any way to show progress during the operation like with dd’s status=progress?

          • MonkderZweite@feddit.ch
            1·
            9 months ago

            I often use pv instead of cat for this. And there’s some ‘hack’ where some tool looks at some kernel feature to guess progress of cp & co. But i forgot it’s name.

  • z00s@lemmy.world
    83·
    9 months ago

    #Big tip: use chatGPT to help you with commands.

    You can say something like “I want to backup my entire file system using [this program]. I want to create a tar file, and then copy that to an external drive. I want the program to display progress while it’s copying, then verify the files have been copied correctly once it has finished. I am using [whatever distro]. Please give me the commands I need to achieve this.”

    Then it will spit out the commands you need to input with the correct syntax.

    The best part is that you can then ask it to clarify any parts of its answer so you can learn how it all works and make sure the commands are doing what you asked. And if your computer spits out an error, just paste that back into chatgpt and it will help you resolve it.

    Seriously, chatgpt is like a 24 hour on call Linux guru friend. It’s saved me so much time and effort over the last few months doing things like this.

    • Secret300@sh.itjust.works
      1·
      9 months ago

      Swear to God. I hope someone develops something so I can just say what I want to do in the terminal and an AI will create the command then prompt “run this command? Y/N/E” E to explain it

  • Possibly linux@lemmy.zipEnglish
    4·
    9 months ago

    First tar up your filesystem. You can use gzip to save space. Once that’s done copy it over. Make sure you use a good filesystem on the USB device that isn’t going to cause data loss. (ie not fat)

    Keep in mind that you can’t do this live and that copying the archive over will take time and the drive may lie to you. Its always best practice to run sync or eject before unplugging.

    • Squizzy@lemmy.world
      2·
      9 months ago

      I just moved to Linux two days ago and omg there is so much to learn but something I never heard of until 20.minutes ago and again right now is tarring…what is it?

          • Possibly linux@lemmy.zipEnglish
            4·
            9 months ago

            Its not necessary better as tar by itself doesn’t have compression. You need gzip, bzip2 or something else. On modern systems with gnu tar can handle tar with compression.

            If your still curious I would look up how to use it.

      • clever_banana@lemmy.today
        2·
        9 months ago

        Tape ARchiver. It just takes a tree of inodes and puts it in one long format that can be written out to tape or stored as a single file.

      • yianiris@kafeneio.social
        01·
        9 months ago

        You mean tearing?
        As in video screen tearing?

        There is also tar which is a very common archiving system, so tarring=archiving

        Stay away from debian/ubuntu if you really want to learn linux. They dictate how you do things so much you will never learn how to do it.

        @Squizzy @possiblylinux127

        • Squizzy@lemmy.world
          1·
          9 months ago

          I’m on mind, which I think is Ubuntu but tbh while I’d love to learn I think it is all just too much for me with my workload. I’m enjoying tinkering but I’m getting nowhere.

      • Possibly linux@lemmy.zipEnglish
        3·
        9 months ago

        Because it is in use. You technically can hot swap a file system by switching run levels and temporarily switching to a tmpfs but I’ve never succeeded.

  • smb@lemmy.mlEnglish
    4·
    9 months ago

    you can copy your system live, but that would involve other tools than dd too.

    with dd when copying the whole device (instead of just partitions) everything gets cloned. This includes uuids, labes, lvm devices with the names of their lv and vg names and raid devices in case you have any. all of these (c|w)ould collide unless the original disk was taken out or either the new or old disks labrls uuids etc are previously to the boot changed to prevent collusions or accidently mounting/booting the original partitions. also if (!) you use device names i.e. in fstab, crypttab, scripts or such, like with the uuids things could break. also you might have to take action for your bios to actually boot from the stick. most people disable usb boot on notebooks for security reasons.

    using dd, cloning the full disk to the full stick, then removing the original disk + set bios boot setting might work out of the box, i’ld try that first as it takes only the effort to boot from another os to do the dd-copy offline (preventing filesystem damage while copying).

    a live copy could be done by cloning only the partition layout and bootloader, then setting up new filesystems (with new uuids) and new lvm group/volumes etc if any, copying original disk using rsync then (maybe “bind” mounting to separate partitions if needed), then adjusting boot config to match new uuids/labels. This could be done while running the system to be copied, but of course even running rsync twice might lack some updates of currently open files by sth like desktop programs or logfiles.

    Without knowing the exact setup, only limited answers can be given, but you have to make sure the boot process will work, so at least the boot loader (grub?) and its files will be needed, which -at least in the past and for old lilo/grub- could not reside at some position on the disk after some “high value” like some number GBs. if that limitation is still there, your new exact partition layout on the usb stick might be relevant for success, but try/error should give you the hints you need.

    you might use “language models” for getting hints, but they are language models, not friends, their “solution” might break your system and delete your data, and they are trained to say they are sorry afterwards, but the are’nt sorry, its just a sequenze of probabilities and words to them not more.

    So always only work on data that has been backed up and prooven to be suitable for you to recover everything you need from scratch, no matter if friends, language models or lemmy users assist you ;-)

    UPDATE: just learned that batocera is “designed” to be just copied to usb stick and run from there, so it will most likely already include everything you need. best is to follow their instructions how to create the usb stick to boot from. if you already have it running from partition, you most likely can copy your current data using rsync. but beware, if you have two copies with the same uuids (partition +usb) that might not work as expected.