If you aren't making decisions about ad serving, obviously it wouldn't effect you. If you are choosing ads to serve, and don't care about their reputation, that's a problem regardless of how much it bothers you.
This is far more important then a few lazy web admins that want to profit from scamming their users.
Well yeah buddy, that's why you used fraud to increase profits.