Google Accepts The "noindex" Directive In The robots.txt, Temporary or Permanent?
November 22nd, 2007 | 8,998 Views RSS Feed
In a post called 'Validate your robots.txt - Googlebot becomes smarter' Sebastian writes that "forgotten –and, until recently, ignored– statements in your robots.txt might change the crawler’s behavior all of a sudden, without notice".
In this regard, John MĂĽller from Google ZĂĽrich answers:
"At the moment we will usually accept the "noindex" directive in the robots.txt, but we are not yet at a point where we are willing to set it into stone and announce full support. … I just want to remind everyone again that this is something that may still change over time. Be careful when playing with things like this."
Like all things important, it's not of it's happening, it's when it'll happen that matters.
Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!
Spread the word
del.icio.us Digg Furl Reddit Google Rojo StumbleUpon Technorati Yahoo!
Comments
Leave a Reply
FEATURED CATEGORIES
- adCenter (56)
- AdSense (70)
- AdWords (177)
- Analytics (23)
- AOL (3)
- Ask (83)
- Blogging (17)
- Directory (6)
- Google (1273)
- Industry News (584)
- Keyword Research & Targeting (8)
- Link Popularity (37)
- Live (32)
- Microsoft (98)
- Mobile Search (13)
- MSN (169)
- PageTraffic Happenings (4)
- Panama (21)
- Pay Per Click (30)
- Search Engine Conferences (127)
- Search Engines (62)
- SEO (155)
- SEO Tools (31)
- Social Media (17)
- Tips & Tricks (11)
- Web Marketing (2)
- Yahoo! (444)
- Yahoo! Search Marketing (43)
advertisment
The Blog
The Associates




