If you aren't making decisions about ad serving, obviously it wouldn't effect you. If you are choosing ads to serve, and don't care about their reputation, that's a problem regardless of how much it bothers you.

This is far more important then a few lazy web admins that want to profit from scamming their users.