Rightly or wrongly most employers want people who are 'team' players, who will join in & can be treated all the same.
Any-one who takes an individual path, even if it seems to be for a 'good' reason, is, potentially a problem in such a system.
What you seem to be wanting to do is be 'different', and not a member of the team.
You have that right and you seem to understand the financial implications of doing so - but do you understand how that appears to the other members of staff, your colleagues?
If work actually means that much to you I urge that you consider the wider implication of being part of the team & try to see how taking your holiday is actually something you can do to 'fit in' - and even let your hair down & have fun