One thing to test this - disengage the AP when it's fully trimmed out and not commanding any trim (ie, it's happy). Is it in trim? Know that the auto-trim endeavors to fly the airplane in trim, but that is necessarily a range where the residual force on the servo is "low enough". So one thing...