Grizzly mini mill

Just got the mini mill and have been playing with it a
little.
I installed the drill chuck and taper shank per
instructions.
But when I attempted to remove it per instructions
I can't get the taper to budge.
I don't want to damage anything by beating too hard on the
fixing pin with the mallet.
Any ideas appreciated.
The only other experience I've had with a morse taper was on
a Clausing drill press and yu just tapped a wedge in a slot
above the taper and it fell out.