What is a penetration tester and do we need one?

Ethical hackers probe systems to find vulnerabilities. But how, exactly, do they do what they do?