Hi,
I need you help, how do I block a directory which is inside another directory from getting crawled and indexed?
Just say, I have a directory named "news" inside the directory "events"
If I don't want that directory "news" and all the pages beneath it not to be indexed how do I do that?
example.com/events/news
Should I use
User Agent: *
Disallow: \news\
or
Disallow: events\news\ ?
Thank you so much.
0 • •
Posts
But meta tagging will definetly work.
use:
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"></head>
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •User-agent: googlebot
Disallow: /news/
If you want to give all search engine spiders the same rights, use the following robots.txt content:
User-agent: *
Disallow: /news/
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •User Agent: *
Disallow: \events\news\
you wont block any other sub-directories under events
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •I think this would make the site all nofollow link attribute.
I think macmachi only wants to have nofollow links to the category event/news and all other categories underneath the category event. But not totally the whole directory to be nofollow. It would be an un-useful site if ever it will be presented like that.
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •But meta tagging will definetly work.
use:
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"></head>
OR
If you want to block from visiter and also from google spider then you better to do one thing delet your page from that server .
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •