Google: “Remove NOINDEX From Your Robots.txt File”

Share on facebook
Share on twitter

issue #138
July 30th, 2019

Hey, lunch buddies. Over the weekend, Kyle Faber and I wrapped up a blog post outlining how we achieved a perfect 100 Google Page Speed Insights score using WordPress. I published it Sunday night and woke up to Google’s own John Mueller sharing it on Twitter. Since then, the post has taken off. I hope you all enjoy it too!

Once you’re done reading this post if you still have questions about speeding up your WordPress site, Kyle also wrote up an even more detailed post about WordPress optimization that you can read over here.

Let’s get into this newsletter!

– Nick


What you need to know

Article: Google: Remove “NO INDEX” From Your Robots.txt Files

What’s Important:
In early July, Google announced that it was stopping support for several rules within the robots.txt file. This includes the use of “no index”. As a result, many sites that included the command within their robots.txt file received a message in Google Search Console this week.

Nick’s Take:
Google’s John Mueller confirmed that having NO INDEX in your robots.txt won’t break anything but that it will simply add tech maintenance on your end. With all that said, I still think it’s important to have the cleanest robots.txt file as possible. So if you have been pushing off making some optimizations to this file then this might be a good excuse to move this higher up in your priority list.


Interesting Reads in Your Spare Time

The best XML Sitemap tools, tips, and tricks – SEMRush
With so much recent conversation about the robots.txt file it makes sense to brush up on its sister file, the XML sitemap. Kevin recently updated this blog post on the SEMRush blog to keep us all up to date on XML sitemap best practices. If your site has navigation or architecture issues, I highly recommend you make sure your XML sitemap(s) are 100%.

Do keywords in reviews help with local rankings? – JurisDigital
If someone asked me this question my gut would be to say no. Lucky me, I haven’t received this question before. Casey walks us through the potential benefits of having keywords within user-generated reviews.

9 Ways to easily use Google spreadsheets for SEO tasks – AleydaSolis
As a PC user myself, I’m pretty stubborn in using my excel documents vs GDocs. However, this resource by Aleyda makes me think twice. Fortunately for me, most if not all of these functions can be carried over to Excel. For the more open-minded folks, this post is a must-read. I can almost guarantee it will save you time in executing some of the more mundane data-driven SEO tasks.

Dear HomeDepot, you killed your website overnight  – LukeCarthy
Ever worried that you might wake up one morning and see all your sites organic traffic disappear? This cruel reality is that it happened for Hope Depot (Canada). The team behind the site recently started blocking individuals (and bots) that are outside of Canada. Luke walks the Home Depot through several recommendations that are easily worth thousands of dollars in SEO consulting fees.

Nick LeRoy
Nick LeRoy
Nick has 10+ years of SEO consulting experience building and executing strategies for clients ranging from multi-billion dollar consumer packaged goods to fashion entities with hundreds of physical store locations. He also writes the weekly SEO newsletter #SEOForLunch that allows you to stay up to date with industry updates in the amount of time it takes you to eat your lunch.

Make SEO Business Decisions?

The #SEOForLunch newsletter keeps you up to date with SEO industry updates over your lunch break once a week.

Recent Publications