Very good advice above...Unfortunately, when you buy or adopt a parrot, regardless of it's age, and you are not the only person living in the household, you have absolutely no control over who they choose to be "their person". And there is no rhyme or reason as to why they choose who they choose, often times the person that is solely responsible for feeding them, giving them treats, cleaning their cage, and who is home the most with them is not their person. They know why they have chosen their person, but a lot of the time they are the only one's who understand their choice.
You can't force him to choose you over your wife, it does sound like he has chosen her to be his person, at least for right now. This does change sometimes, for no reason at all. But the fact that he's not attacking you and he's allowing you to pet him at all, even if your wife has to be there is a good sign. Often the other spouse or other people in the household can't even get close to the bird. So that's a good sign. If you are the one that is going to be home with him the most, then that should help over time to strengthen your bond with him. Right now, for whatever reason, he has chosen your wife, she has earned his trust, and he's tolerating you. So that gives you an "in", and the more time you spend with him, the more treats you give him, the more attention you give him, the more time you spend just talking to him gently and softly, etc., the closer he'll most-likely become to you. Don't ever try to push him or force him though, as that will most-likely result in him totally distrusting you and may start an aggression towards you. This will be a marathon for you, not a sprint.
He may always choose your wife as "his person", that's just the way it is when you bring home a bird. There's no way you can really change that. Sometimes they change their minds on their own, sometimes they don't. Most of the time though you can reach a mutual agreement where over time you both bond with each other and it will get to the point where you also can handle him, pet him, get him to step-up for you, etc. It's just going to take time...but please don't take this personally. I know that's difficult, but it's nothing you did, it's just how it goes...
Also, keep in-mind that they absolutely can sense your frustration, any anger, any resentment, etc. towards him, and if you let him know you feel that way, then it's only going to make him feel uncomfortable around you too. So just try to keep an open-mind, and try to accept the fact that right now he is your wife's bird, at least as far as he is concerned. The more accepting you are of him, the more accepting he will be of you.