The craft should not 'fight you' when making a return, ever, with a stable GPS lock on. This is indicative that the different sensors (GPS, compass, orientation) are giving conflicting information. It's always a good idea after takeoff to let go of the sticks and watch for holding of position...