"I was thinking about you all day today and what a great person you are."

"I wanted to be #1...After 2 months I reached the top position for my most popular keywords."

Read More...

The SEO Book

PPC Information

Need Links?

Need Traffic?

Use these Free PPC Coupons

SEO Tools

WordTracker - keyword suggeston

Robots Meta Tags

Each search engine spider wants to index all good content on the web. With that being said, you do not need to tell the search spiders when to revisit or to index or follow. The meta robots tag is standard protocol for robot exclusion. You may have certain pages on your web site that are not fully developed yet, or that you do not want seen for some reason. This is when you would use a robots meta tag.

Meta Robots tag format:

The meta robots tag is the area between the head tags using this context

• <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> (note: you can use any of the following also. their mission is self explanatory)
• <META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
• <META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW">
• <META NAME="ROBOTS" CONTENT="INDEX, FOLLOW"> (this tag serves no purpose as it is what the search spiders want to do anyway)

Robots .TXT File

also robots will look for a file called robots.txt in your root directory. if that file exists then they will open it up and look for something along the lines of

this disallows robots to your server	this allows complete access
User-agent: * Disallow: /	User-agent: * Disallow:

the * indicates all search spiders, and the disallow:/ indicates they should not visit any of your site. rather than using the * you can specify specific robots that you do not want to allow if you only have one that is offending your site. you can also disallow file types or certain directories.

If you have dynamic content that you want a robot to index you should not issue a session ID to the spider.

exclude all robots from parts of site	exclude a single robot	allow a single robot	disallow specific pages
User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /private/	User-agent: BadBot Disallow: /	User-agent: WebCrawler Disallow: User-agent: * Disallow: /	User-agent: * Disallow: /~joe/private.html Disallow: /~joe/foo.html Disallow: /~joe/bar.html

See Also:

• the official Web Robots Page
• a meta tag generator
• robots.txt generator & testing tools

meta refresh tag <--

--> other meta tags