I tried to adjust the scroll wheel settings of my mouse. It was already very low, but I adjusted it down to the lowest value, but unfortunately that didn't make any difference with the minimum distance that it pans.