Comments on: Use Robots.txt to Protect your WordPress Blog from Duplicate Content Issue

By: Hemanth

Hemanth — Thu, 19 May 2011 00:57:30 +0000

Thanks for great post. I am exactly searching for “how to edit robot.txt file”

By: Prashant

Prashant — Wed, 13 Apr 2011 14:37:20 +0000

i disallowed the tags in my robots file…….
But today when i chked my webmaster account… There were around 150 tags “Restricted by robots.txt” in crawl error….

will it effect my blog????

By: Harsh Agrawal

Harsh Agrawal — Thu, 07 Apr 2011 19:27:19 +0000

It will be at the root of your WordPress installation. You can also check your robots.txt fiile from WordPress dashboard using Robots meta plugin.

By: Prashant

Prashant — Thu, 07 Apr 2011 17:33:04 +0000

how to edit the robot.txt file…
where it is in the FTP???

By: Harsh Agrawal

Harsh Agrawal — Thu, 03 Feb 2011 15:45:48 +0000

Jimmy
You can add rules in robots.txt
or if you wish to keep it very simple you can use Robote meta WordPress plugin.

By: Jimmy

Jimmy — Thu, 03 Feb 2011 14:19:40 +0000

Hi Harsh,

can u tell me how to make wordpress tags noindex ?

By: enterdel

enterdel — Wed, 19 Jan 2011 08:17:32 +0000

Thanks Harsh, i’ll modify my robot.txt like yours

By: Harsh Agrawal

Harsh Agrawal — Tue, 18 Jan 2011 19:29:03 +0000

Thanks Himanshu.