Add a surface at that place to hide the hole, or put the pole at ground level. Who will really care if the pole is the ground in the reality, but starts at ground level in Sweet Home 3D!