just curious, is your marriage OK otherwise? or are there troubles in other places and this is the perfect excuse you can use to get out of a bad thing?

I would think that you would find a way to deal with this issue. It sounds like you are looking for an excuse for a "way out". You did marry him for better or worse, this is what it means...