Feel Wrong for Doing Right?

I know a man who discovered internal theft at his workplace, and he was afraid
if he told someone, his job would be in jeopardy. I asked why he felt that way,
and he thought that somehow someone would pin the fault on him.

You should never feel wrong when you know you're doing the right thing.

Feel wrong for doing right?