No this is not bearing play, the inner swash can slide in and out of the bearing by 0.3-0.4mm at a guess which doesn't sound alot but it was enough to make the pitch feel jumpy and less precise.
I seem to have fixed it by pressing a socket of the correct diameter on the inside of the swash to squeeze the sides against the bearing.