I'm not sure if your boss isn't right (sorry).
A broken finger isn't
usually incapacitating enough to keep you off work.......depending on the work

The pain should be controlled with medication. And a few days off to "get the healing started" is neither here nor there.....
I work with my hands and carried on working even though I had a broken 5th metacarpal (barroom fracture) on my dominant hand.......but maby I'm odd that way