• doctordevice
      link
      fedilink
      arrow-up
      2
      ·
      8 months ago

      This sub finally inspired me to go figure out how to install image gen stuff, so it’s helpful to me too. If you have any tips or tricks I’d love to hear it!

      Are you adding much to the prompts beyond the direct lyrics to guide it?

      • Anissem@lemmy.mlOP
        link
        fedilink
        arrow-up
        2
        ·
        8 months ago

        My rule for myself has been absolutely no modifications of lyrics or any additions prompt wise. What you see is a direct result of the full lyrics interpreted by Midjourney. I give up a lot on songs and some take dozens of variations before I find something that works.

        • doctordevice
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          8 months ago

          Okay, that’s been my experience as well. Some songs just really don’t seem to work. I’m using Stable Diffusion installed locally and trying out different models and negative prompts.

          I was even messing around with adding weights to certain words to try to push the generation one way or another. No matter what I tried, I couldn’t get Come Sail Away to do anything but just sailboats or weird smashed together conglomerations of sailboats.