Robots.txt vs Meta NoIndex Tag – SEOForLunch Issue #37

Robots.txt vs Meta NoIndex Tag – SEOForLunch Issue #37

Issue #37
June 13th, 2017

Hey, lunch buddies.  Welcome to issue #37 of the #SEOForLunch newsletter.  A big thank you for all those who recently signed up and for those who have been a part of this ride since the beginning.  If you continue to enjoy this newsletter I would really appreciate it if you would forward to your co-workers and networks so they can sign up themselves (sign up here at

Last week I asked you guys what you thought of the ‘question of the week’.  I had some immediate positive responses but not as many as I thought I might.  I’m going to hold off in the near-term in favor of an idea I’ll share with you guys in the future.  Hold tight!

What You Must Know

nothing super important this week guys — sorry!

SEO Tips & Advice

Yoast wrote a quick write up about how to properly block pages from the search engines results.  Most think the robots.txt “disallow” directive is enough when in reality you shouldn’t be using the robots.txt file at all. In this case, you’ll want to use the meta robots noindex/nofollow tag.

If you have any questions whether or not your blocking pages appropriately make sure you read Yoasts bigger guide to robots meta tags. 

Interesting Reads in Your Spare Time

That’s everything for this week folks.  As always, feel free to connect with me, tweet me or hit reply to email me directly. I respond to all emails personally.


About Nick LeRoy

I'm a husband, father to three and obsessed Vikings fan and SEO Manager at Ovative/group. I also write a weekly SEO newsletter that you can sign up for over here to stay up to date with SEO best practices and industry news.

Entries by Nick LeRoy