Yup, as Julie said get the orange guard since it's just concentrated citrus. I wouldn't spray it directly on toys, dishes or anything he'll have his beak on all the time, but it's totally safe to use around birds unlike other pesticides.
Personally, though, I'd replace the cage ASAP. Ants will make a new home in your home and multiply by the bajillions (which will drive you nuts). When we lived in Arizona, our apartment complex was just infested (despite the landlords best efforts) with sugar ants and they were EVERYWHERE by the billions. Didn't matter how clean you were (and I am a tad on the OCD side with cleaning), if you stored every single food item in airtight containers, sprayed and put the diamotaceous earth around ext... they just swarmed all the time. It was AWFUL to deal with. I shudder thinking about them. I would do anything to stop an ant infestation from ever happening. Not worth a cage IMO.