Case-Based Critical Thinking Question
Tyler does not want parts of his website indexed, so he is creating a robots.txt file.
-Tyler uses the code Disallow: /testto instruct bots to not index the test____.
A) directory
B) image
C) site
D) file

Question

Quizplus · Accepted Answer

The "Disallow: /test" code in a robots.txt file instructs bots to not index the directory named "test". It cannot be used for individual files or images. It can also not be used to instruct bots to not index an entire site, as the robots.txt file only applies to the directory it is placed in.