If you’re wondering why it has been looking quiet here, we stumbled upon an issue that caused lemdro.id to stop federating out its community content.

It should now be resolved but please let us know if there are any issues!

  • OtterA
    link
    fedilink
    English
    arrow-up
    21
    ·
    6 months ago

    What happened to be the problem?

    • cole@lemdro.id
      link
      fedilink
      English
      arrow-up
      41
      ·
      edit-2
      6 months ago

      Basically, the lemmy backend service for some reason marked every instance we federated with as inactive, which caused it to stop outbound federation with basically everyone. I have a few working theories on why, but not fully sure yet.

      TL;DR lemmy bug, required manual database intervention to fix

      This was a stressful start to a vacation!

      For a more detailed working theory…

      I’ve been doing a lot of infrastructure upgrades lately. Lemdro.id runs on a ton of containerized services that scale horizontally for each part of the stack globally and according to load. It’s pretty cool. But my theory is that since the backend schedules inactive checking for 24 hours from when it starts that it simply was being restarted (upgraded) before it had a chance to check activity until it was too late.

      theory:

      • scheduled task checks instances every 24 hours

      • I updated (restarted it) more than every 24 hours

      • it never had a chance to run the check

      • ???

      • failure

      This isn’t really a great design for inactivity checking and I’ll be submitting a pull request to fix it.

  • limerod@reddthat.com
    link
    fedilink
    English
    arrow-up
    9
    ·
    6 months ago

    I see. I was concerned about the reduced activity levels overall down to single vote posts.

  • DacoTaco@lemmy.world
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    6 months ago

    A welcome back from lemmy.world is in order (Found this via filtering by all instances, not just .wotld and subscribed instances )

    • sabreW4K3@lemmy.tf
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 months ago

      BTW @[email protected] can we get the ability to edit our posts please? Way too often I’ll submit and then go back and edit to provide more information if the preview falls short, but lemdro.id doesn’t allow this.

          • cole@lemdro.id
            link
            fedilink
            English
            arrow-up
            3
            ·
            edit-2
            6 months ago

            have you tried in the default lemmy ui? it might be a sync bug

            • sabreW4K3@lemmy.tf
              link
              fedilink
              English
              arrow-up
              2
              ·
              6 months ago

              Ah, it is indeed an app bug as both Sync and Jerboa can’t edit. The Web UI does indeed allow it though. Weird.

          • ijeff@lemdro.idOPM
            link
            fedilink
            English
            arrow-up
            1
            ·
            edit-2
            6 months ago

            If you’re using Sync, it doesn’t currently support post editing! I usually use Photon or the default UI to edit my submissions.