Yahoo!'s New Robots.txt Tag To Block Unnecessary Content
May 4th, 2007 | 970 Views RSS Feed
Yahoo! has been making quite a few helpful improvements lately. The latest is robots-nocontent tag which will help webmasters differentiate main content and unrelated content for the Yahoo! crawler. Content in these restricted sections will not be used by Yahoo! for indexing the page or as excerpts in the SERPs.
Priyank Garg, project manager of Yahoo! Search informs, "This tag is really about our crawler focusing on the main content of your page and targeting the right pages on your site for specific search queries. Since a particular source is limited to the number of times it appears in the top ten, it's important that the proper matching and targeting occur in order to increase both the traffic as well as the conversion on your site. It also improves the abstracts for your pages in results by omitting unrelated text from search result summaries."
This is much like the Google’s no-follow tag and Yahoo! assures that it won’t be confused with cloaking. According to the Yahoo! Search Blog:
Note: Using a "nocontent" tag to mark explicit sections of content is not considered "cloaking" because all of the content on the page is available to protect the relevance of the results (unlike "cloaking" where we may be served content that is different from what visitors see).
The tag proves helpful to filter out navigation bars, advertising, boilerplate text and other content which is repeated across the site. The robots-nocontent does not affect the way links are treated.
Click here to subscribe to our RSS feed to get a daily digest of news around search engine industry. PageTraffic SEO Blog is updated four times a day and is ranked as one of the best search engine resources blog by Pandia!
- del.icio.us
- Digg
- Furl
- Rojo
- StumbleUpon
- Technorati
- Yahoo!
Did you like this article?
Related Posts
Comments
Leave a Reply
SEO Tools
FEATURED CATEGORIES
- adCenter (67)
- AdSense (83)
- AdWords (228)
- Analytics (32)
- AOL (3)
- Ask (91)
- Blogging (19)
- Directory (6)
- Google (1535)
- Industry News (679)
- Keyword Research & Targeting (13)
- Link Popularity (52)
- Live (51)
- Microsoft (115)
- Mobile Search (13)
- MSN (169)
- PageTraffic Happenings (4)
- Panama (21)
- Pay Per Click (32)
- Search Engine Conferences (151)
- Search Engines (85)
- SEO (196)
- SEO Tools (35)
- Social Media (18)
- Tips & Tricks (11)
- Web Marketing (3)
- Yahoo! (508)
- Yahoo! Search Marketing (59)
The Blog
The Associates


