I ended up splitting the wall in three pieces and deleting the middle one. Then I pulled the two ends to where they should be.

Stupid that a hack like that is necessary. There is also no Join Walls command but that seems to have been a requested feature for 15 years or so