Recent Threads
Howdy, Stranger!
It looks like you're new here. If you want to get involved, click one of these buttons!
Forums
- All Categories 21.7K
- Search Engine Optimization 14.7K
- Google 3.5K
- Bing 200
- Linkbuilding 1.9K
- On Site Optimization 1.3K
- SEO Q & A 6K
- India 576
- UK (United Kingdom) 162
- Adwords Forum 164
- Random 174
- Marketplace 3.3K
- Buy Links 477
- Sell Links 1.1K
- Seo Services 1.5K
- SEO Content 246
- seoforums.org cafe 3.8K
- Off Topic 1.4K
- Feedback/Suggestions 128
- Introductions 2.1K
- GOLD Plugin Support 147
- Wordpress Price Comparison wpP 7
- Fuzzy SEO for Wordpress 27
- Fuzzy SEO for vBulletin 53
- Auto Link for vBulletin 20
Gold Sponsor
Silver Sponsors
Please help me to block a directory?
Hi,
I need you help, how do I block a directory which is inside another directory from getting crawled and indexed?
Just say, I have a directory named "news" inside the directory "events"
If I don't want that directory "news" and all the pages beneath it not to be indexed how do I do that?
example.com/events/news
Should I use
User Agent: *
Disallow: \news\
or
Disallow: events\news\ ?
Thank you so much.
I need you help, how do I block a directory which is inside another directory from getting crawled and indexed?
Just say, I have a directory named "news" inside the directory "events"
If I don't want that directory "news" and all the pages beneath it not to be indexed how do I do that?
example.com/events/news
Should I use
User Agent: *
Disallow: \news\
or
Disallow: events\news\ ?
Thank you so much.
Posts
But meta tagging will definetly work.
use:
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"></head>
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •User-agent: googlebot
Disallow: /news/
If you want to give all search engine spiders the same rights, use the following robots.txt content:
User-agent: *
Disallow: /news/
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •User Agent: *
Disallow: \events\news\
you wont block any other sub-directories under events
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •I think this would make the site all nofollow link attribute.
I think macmachi only wants to have nofollow links to the category event/news and all other categories underneath the category event. But not totally the whole directory to be nofollow. It would be an un-useful site if ever it will be presented like that.
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •But meta tagging will definetly work.
use:
<html>
<head>
<title>...</title>
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"></head>
OR
If you want to block from visiter and also from google spider then you better to do one thing delet your page from that server .
- Spam
- Abuse
- Troll
0 • Off Topic Disagree Agree Like •