Write-once ROMs tend to be pretty reliable for a long time as long as there’s no physical damage. Leaking save state batteries can do that.

There are some old rewritable ROMs that work by shining UV light on them to erase them, and then you can write to them again. Those can go bad, especially if the sticker falls off and they’re exposed to light. They aren’t common in cartridges, but you’ll see them in arcade motherboards.

Magnetic media will lose its magnetic domains over time. A lot depends on the quality of the disk and the environment it’s stored in. Commercially released floppy disks tend to be pretty reliable, but retail blank disks were increasingly cost-optimized into hot garbage as time went on. The new-old-stock disks we get these days are terrible. That said, quality stuff properly stored can last a long, long time.

Optical discs will inevitably get scratched when you use them. Commercial pressed discs can last a long time in storage, though. Burned discs, not so much.

Modern flash memory may lose its cell charge with time without any read/write cycles being involved. AFAIK, there’s not much out there about using flash for long term archiving. Most people who are interested in archiving, especially for large corporations, use quality magnetic tape stored in a controlled environment. They aren’t interested in flash, so there’s not much info out there.