Howdy, Stranger!

It looks like you're new here. If you want to get involved, click one of these buttons!

Badges

anishasood

best online clothing shopping sites

About

Username
anishasood
Location
DELHI
Joined
Visits
42
Last Active
Roles
Registered Users
Points
42
Location
DELHI
Badges
4
  • Re: What is robots.txt?

    In a nutshell. Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. ... The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.