Just have to shim them out a touch. I have seen guys using CF servo washers from other kits placed between the servo and the servo mount.
You could also use small washers. Don't shim them out too much, just enough they don't touch. And for geometry sake, I would shim all three the same amount so they are in the same relative position to the swash. I might be over thinking it, but geometry is important.