Prevent robots from scraping directory

Hi, any suggestions on the best methods for preventing robots from scraping my directory content?