[Matt G.]

How on earth do you get an arbor press in there?

I'd support the driveshaft from below, get a brass rod and hammer, and use that to get it flush, then drive it out with a roll pin punch, as has been suggested.