robots.txt Root-level text file that tells crawlers which paths they may or may not index.
Full definition coming soon. The one-liner above is the short answer; we are filling in the long-form explanation, examples, and related tools.