Do not force handling! But do encourage him to be near you. One way to shape behavior is to use food treats, for conures safflower seeds seem to be like crack. So set up a small treat dish, and every time you pass the cage ( I make up excuses to pass every ten minutes in a session) put a single safflower seeds ( or high value treat iteam) in the dish and say hello and walk on. After you've determined that he will come and eat the seed right away after you move off, you move to the next step. You come and say hello but only put the seed in the dish if he doesn't move away. You do that for a while, then you only put a seed in the dish if he moves towards you and the dish, even a single lean in or a single step towards the dish he gets a treat. What you are doing is shaping his response and behavior towards you. Sometimes you will back slide and have to go back to earlier steps. You are working towards him sitting right next to the dish waiting for you to say hi and out the seed in. After he is comfortable with that you can give the seed by hand, and then hopefully he steps up to get the seed and you are on the way!!! This whole process can take place advancing in a single day(rare) or several days, or weeks or months.. I've used this with two abused /neglected/ fearful/ parrots one my Penny the Quaker, and one a severely traumatized starved abused Nanday Conure. Penny just took a day to see progress and a few days to have her bring with me, but we had some big backsliding too. The Nanday took a couple of weeks to see progress, and month or so before I could hold him.
But in addition to that , I also spent time sitting close to the cage but turned sideways not confronting them head on, just reading out loud from my book.
For Penny I put the treat dish on top of her cage, near a rope perch , for the Nanday it was inside his cage. Why it works is they are moving towards you, changes there thinking, and they associated you with good stuff!!! There's other advise too, but this is a start. With a scared bird , abd all this new stuff don't give up!!! Way to soon, much more patience is needed