If you are truly chasing a Humidity problem, which is very likely this year. You're target needs to be between 45 - 55 depending on a target home temperature of 70 degrees. At this moment, my house is at 70 degrees with a Humidity reading of 47 and slowly climbing. My personal target is between 48 and 50 with a temperature of 70 degrees.
This Winter has gone dry, very early. Commonly, in the Great White North, we are not dealing with such low Humidity readings until mid-January. Much can be blamed, but it all comes down to an early start of Winter and a larger number of Cold Fronts swinging down from the far North. These 'very cold' Fronts are 'much dryer' than the fronts that move in from the far Southwest and are fed with moisture from the Gulf of Mexico.
Long Story Short: This Winter will require far more moisture added to our homes than past Winters. Also, dry skin will be far more common for the same reasons.
Coconut oil can be 'very' lightly applied to the beak, but it is not recommended for application more than once a day unless directed by your Avian Vet. You can increase the amount of misting /bathes, that will also help both the Parrot and the house in general.
I believe that your Parrot has any Oil Gland. If you can examine it, please do so. It is 'possible' that your Parrot's gland is not providing enough oil. Its a bit of a long short but worth checking. The area and feathers around the gland, should appear slightly more moist and the feathers' slightly darker. It this area is on the drier side, its off to the Avian Vet's for an expert's evaluation.