Q. Which directive in robotstxt would allow all user-agents to crawl the entire site?

A
Makefile User-agent: * Disallow: /
B
Makefile User-agent: Googlebot Disallow: *
C
Makefile User-agent: * Disallow:
D
Makefile User-agent: *Allow: /admin
Solution:

Leaving Disallow.

Entri Contact Image

Get Expert Advice for Free: Register for Your Free Consultation Now!