I never paid much attention to my Robot text in my WordPress blog before but since my domains did not move one bit in the latest PageRank last week I thought it was time to do something about it.

I found this nice already finished Robot.txt on the WordPress instruction home page and I learned a whole deal.

I did not know before that Robot.txt could play such an big impact on my Page Ranking before.

If you have the blog on the domain index then you should put this Robot.txt on your WordPress blog as because Google told you so.

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: /comments
Disallow: /category/*/*
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /

# digg mirror
User-agent: duggmirror
Disallow: /

Sitemap: http://www.yourdomain.com/sitemap.xml

If you feel that this helped you link back to this blog 🙂

803 total views, 1 today

Tags: blog, Google, pagerank, PR, Robot.txt, wordpress