Don't feel alone with CPAP. Have been put one for only 1 1/2 weeks and have been dealing with the same nose issues as you. The doctor gave me a full face mask (Quattro) which really tore up the bridge of my nose. To alleviate some of the pain, I used to 3M waterproof hospital tape which you can get from Walmart. After a week, I finally decided to get rid of the full face mainly due to the frustration of getting a lot of leaks. One night it started blowing me some raspberries which was funny despite it waking me up. The doctor has now given me the Mirage Liberty. This has a mouth piece and nasal pillows with nothing on the top of the nose or forehead. For nasal problems you might want to buy a Neti pot. This will allow you to flush your sinuses with saline every night. That is what I do each night and so far have not had any dried out nose. I do turn down my humidifier to 1 1/5 due it causing my nose to start dripping, yuk!!!!.
Best of luck. This is a great forum to get good advice from.