Johan,
It may very well be inside the AP controller, but one thing to try first. Are you sure the trim motor works both ways? The limit switches in the Ray Allen servos can fail in such a way that the servo will only move one way. You can use a 9V battery to move the servo and test very easily...