What is a WordPress Child Theme?

After reading a few forums that answer some of my questions about WordPress, I keep coming across the term "Child Theme" would someone be able to tell me what that it? How it differs from the "Regular Themes" that I've been using and how I change to a Child Theme?
Thank you!