You may lose the ability
As your reputation raises and you gain various reputation levels you will be able to access various areas, gain discounts, and unlock quests and items. As your reputation lowers you may lose the ability to interact with NPC of that faction or might just be outright attacked on sight. Some factions, such as the Megaten Gold, control neutral cities and gaining their bad side will make the cities near inaccessible.