Is there some way to fix this?
Don't right click on the planet, it queues an "use ability" order to the ship if it has an ability that targets a planet (like all the colony capitals 
). Zoom in a bit until you can see the target planet's grav well, and right click in it. That'll make the fleet jump right.
Both issues are known 
