In my experience, even with those settings, you need to go into the Fleet Overview for the fleet (once the ship has joined), go to the Ship Design Display for the supply ship, and select Auto Resupply Own Fleet. Without that setting (and it defaults to No Auto Resupply), nothing will actually move. This applies to tankers in a fleet, as well.