This has been driving me crazy and seemed to get worse recently! I think I've fixed it, though. I hope this works for someone else!
In the General Options -> Accessibility menu I changed the COCKPIT INTERACTION SYSTEM to 'LOCK' from 'LEGACY' and, it seems to have solved the problem.