Google’s pushing for robots.txt to become a web standard

Share on facebook
Share on twitter

Issue #134
July 2nd, 2019

Hey, lunch buddies. Last week went by insanely fast. I hope all of you are in a better spot for wrapping up projects then I am prior to the July 4th weekend. While I’m making up for time now, I don’t regret my choices at all. Yesterday was my birthday and I took the entire weekend off to celebrate with my family and friends.

As summed up by a co-worker, I received the best combination of “Dad” gifts this year.  I received 5 tickets to an upcoming pre-season Vikings game. I’m pumped to bring the entire family to a game. In addition, I needed a new propane grill bad. My wife swooped in for the rescue and upgraded me to a nice 4 burner that compliments the smoker she bought me last year. I know, I’m spoiled!

I hope everyone reading this weeks #SEOForLunch has a great week. If you’re in the US enjoy your 4th of July. Please note, I’m on vacation next week. There will still be an #SEOForLunch issue next week but if I’m slow to respond to emails It’s due to me being on the lake enjoying a beer or three with the family.

Let’s get to this week’s updates!

What You Need To Know

Article: Google’s pushing for robots.txt protocol to become an internet standard

What’s important?
The robots.txt protocol directs Google (and other web spiders) on how to crawl an individual website. When configured properly, the robots.txt can help increase the efficiency in which Google (and others) crawl and potentially index the content on your site.

Nick’s take:
If you aren’t 100% familiar with the robots.txt file then this is your homework for the week. Last year, I was proven wrong in assuming that the “allow” command was invalid. It simply shows that folks that work with robots.txt files every day can gain value in reviewing all specifications.  Google did a great job in explaining what is and isn’t possible within the link above.

Get the #SEOForLunch Sent Directly To Your Inbox

Never miss a Google algorithm update again.

Interesting Reads in Your Spare Time

Tracking 60 Online Business (and their impact by Google algorithm updates) – Gaps
With all the recent Google algorithm/core updates you’ve likely spent some level of time analyzing both your own web properties and your competitors. Glen analyzed 60 online businesses and fleshes out how they are holding up after key Google updates took place within the last few months.

20 new graphics to display “link value” – Moz
Cyrus is awesome. I (like most of you I’m guessing) have fumbled through dozens of presentations with various solutions to explain the value of links and how it transfers from one URL to another. Cyrus and the Moz team put together 20 graphics to explain many of the common scenarios in which link value can be impacted. Best part? Moz encourages we use these images – just make sure you appropriately credit them.

Google no longer uses social signals social profile markup – Search Engine Journal
Ever marked up your social profiles to get them to display in the knowledge panel in Google’s SERP? Good news, you no longer have to do this. Google states that they have a way to get this data themselves. Of course, don’t necessarily take their word for it. Test and validate your listings aren’t at risk before removing (or adding) your social markup.

Is Google targeting Giphy with its new Gif feature? – Google
Google recently launched ‘sharable Gifs’. Directly from the horse’s mouth: “Google Images now has a “Share GIFs” section that lets you share GIFs directly into different apps, including Gmail, Hangouts, Android Messages and Whatsapp.” 

Ultimate guide to TF-IDF & content optimization – IPullRank
Mike King recently gave a presentation at MNSearch all about TF-IDF and content optimization that was off the charts. My friends at Uproer covered this and the rest of the sessions at MNSearch over here. This blog post from Fajr outlines a lot of what Mike covered in his presentation and even more. Definitely a great post to read (a few times) if you’re tasked with content optimization.

Nick LeRoy
Nick LeRoy
Nick has 10+ years of SEO consulting experience building and executing strategies for clients ranging from multi-billion dollar consumer packaged goods to fashion entities with hundreds of physical store locations. He also writes the weekly SEO newsletter #SEOForLunch that allows you to stay up to date with industry updates in the amount of time it takes you to eat your lunch.

Make SEO Business Decisions?

The #SEOForLunch newsletter keeps you up to date with SEO industry updates over your lunch break once a week.

Recent Publications