I have a suggestion. Would it not be a good idea to give fleets missions?
This way you can do let the fleets be run by the AI if you want to while your attention is elsewhere.
Say for Example give a fleet a "raid" mission against a planet. Now the fleet will go in and attack the planets structures but if it starts meeting heavy resistance it will retreat.