Spot View Problem

Sorry if this had been asked before but I did a search in the forum and did not see this specific question if its in here. I had a problem with my aircraft pulling to the left while on the ground during taxi or takeoff. I have a ground handling gauge on my aircraft panel that controls the taxi speed (Ultimate boeing Panel), so the throttles to both engines were getting the same power so that wasn't the problem. I finally resorted to recallibrating my joystick (Saitek X45) and that seemed to solve the problem. However, after starting a flight, I switched to spot view during taxi to the runway and the problem surfaced again. I determined that switching to spot view somehow was throwing off the calibration on my joystick. Is there a fix for this or is it just a case of not using the spot view during taxi or takeoff? Thanks in advance for any help offered. Bill