It sounds like he is 'defending' his territory, that being the cage. How are you trying to take him out?
If you are going in to grab him, it's not the best way and can in fact re-inforce his defenses.
The best thing to do is use your finger. Open the cage door and put your finger right on the outside of it and call him to come out. You can gradually put your finger in farther but don't make any 'sudden' moves (including taking your finger/hand away really fast). If he's about to bite, just retreat, slowly or stay still.
I've always let my birds come out on their own.
I'm at the point now, where I can take Skittles out by putting my finger in and he'll actually go to the perch nearest my finger and jump on. The only issue I've ever had with that is when he wants 'scratchies' first. They are easier to give when he's out of his cage but sometimes he doesn't want to wait. I've posted this video as an idea for how I do it now, when he DOESN'T come out on his own but I know he wants to come out.
I don't force him.
[ame="https://youtu.be/mlUYswrIWc8"]Skittles wants scratchies! - YouTube[/ame]