Are you in GPS mode? This looks like exactly what I'd expect for a drone trying to hold its position on GPS... you may get better results in ATTI and manually holding it in the wind using a fixed visual reference point. Results tend to be far smoother.
The shots you've shown are very close to...