It has been a while that I tried Star Citizen. With the new Neuralnet Tracker plugin (AI haha) for OpenTrack we get head tracking without annoying IR LEDs or reflecting stripes just by reading the webcam video feed. This is apparently fast enough to try head tracking without a dedicated head tracker nowadays. And all that on a Linux PC. Took some fiddling but the concept still works. What a time to be alive.

Demo: https://makertube.net/w/groS1wpAhP8XYE75vJwX32

HowTo: https://simpit.dev/systems/opentrack/

  • Skia@lemm.ee
    link
    fedilink
    arrow-up
    3
    ·
    4 months ago

    Hey, lots of great pointers to nice tools in here! Thanks, and well done for making this work in SC :-)

  • krimson@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    4 months ago

    Nice. How’s the input lag compared to IR? Can’t really tell from your video if there is a lot of delay between head movement and camera movement in SC.

    • Beko Pharm@discuss.tchncs.deOP
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      4 months ago

      Can’t tell for sure either. It Lag feels slightly higher but perfectly fine for trying some head tracking without investing in additional hardware. This depends a lot on the processing power, of course. Cam doesn’t matter that much. It seems to read with only ~540 px width or something and any webcam of the last decade should manage ~50 fps with that 🤔

      I’m also uncertain what the current penalty is for running this on Wayland via gamescope, which is really bringing my rig to it’s limits.

  • Fenrisulfir
    link
    fedilink
    arrow-up
    2
    ·
    4 months ago

    This sounds a lot like FaceTrackNoIR but I haven’t messed with that since I got a VR headset. Good to see stuff like this still getting development

    • Beko Pharm@discuss.tchncs.deOP
      link
      fedilink
      arrow-up
      1
      ·
      4 months ago

      It does have some protocol overlaps especially for UDP. Not that it’s very complicated but it helped me when I implemented this in FreeSpace Open to get head tracking working on Linux PC too 🤓

      • Fenrisulfir
        link
        fedilink
        arrow-up
        1
        ·
        24 days ago

        Not sure. I only check back in on SC every year or two. I’ve got into it at the start but me and my titan are waiting for release to really dive in. PC’s also in pieces waiting for the 9800x3d and 5090

  • Mactan@lemmy.ml
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    4 months ago

    what needs to be done to get around error protocol dylib load failure ?

    edit, ah i guess i should set an output like UDP huh