Look at it from his point of view.
Without having any say in it, you're moved to a strange house, with people you don't know, not just once, but twice. And these strangers keep getting in your space, trying to make you do things you clearly don't want to do. How would you feel?
Parrots are smart. They'll control what they can, when they can. Give him time to adjust and adapt to the routines of your house, and to the people there. Give him space so he can start to trust you.