Would it be considered rude?

I don't see how it is rude. 99% of our guest list is also from out of state or abroad and we aren't paying for anyone's ticket OR accommodations. It's up to them to decide whether they want to come and whether they can afford it. I have been to other weddings with out of town guests and have never heard of anyone paying for their guests to be there.