Caves there are. After I ran that staircase to bedrock without hitting one, I found that zombie dungeon on the other side of some gravel. The dungeon itself is useless (unless you have a use for the stacks of feathers it now produces), but the far side back corner has a hole in it that opens on a cave. More cave found above the stairs, might connect. Next time maybe.