On a community server.

Dungeons spawn below the map whenever you enter one. This is also the case with boss arenas.

If you climb out like this, you can sometimes watch players from a distance. Eventually it disappeared and I continued onward. Creepy~