What is a password manager and why is it useful?

A password manager can make your digital life both simpler and more secure. Are there any downsides to relying on software to create and store your passwords?