Gah. I thought something looked off about the floor. I hadn't flipped the normals, so the displacement map was opposite. Here's the corrected comparison with a slightly changed camera position.