For the short term, it appears that Google has had the last laugh.
On January 21st (3 days after the post was published), the Cape Cod SEO home page was removed from Google search engine index. It would seem that this has only affected the home page (for now), as all other pages are still indexed that I can tell.
Check it out:
Here’s the Background:
- I wrote the post, “Would Someone From Google PR Notice Me PLEASE!!!”, which include a great picture of my daughter (proudly sporting a Google onesie), as a personal announcement to friends, colleagues and people who read Cape Cod SEO on a regular basis.
- I created a somewhat sarcastic URL for the post slug: “please-notice-me-great-google-gods“
- I BLOCKED ALL search engines from indexing the post and photos (call it old fashioned, but I still have some concerns about privacy on the Internet) via the robots.txt file.
- 3 days later, the home page was killed from Google search results (it doesn’t even show up for my name!)
Apparently someone at Google DID notice. But if it was the PR department, they had their speed dial right to the Google indexing team.
Digging Deeper Into The Issue
Of course it would seem really strange for a web page to be removed for this type of circumstance, so I had to look a bit further into the issue. What was I doing that could possibly have triggered such an action? I highly doubted my quick post on browser toolbars had anything to do with this, so I focused my efforts on the robots file and the baby announcement.
What I did realize was that I gave a friend a nice shot out but in a reasonably discrete (yet alert-able) manner. While I have website reporting evidence that no human visitor ever clicked the link, I am most certain that a search engine would crawl and have find it.
It could make sense that a questionable linking process (not practice), regardless of intent, would flag an alert that could lead to the removal of a web page; would you agree? Should you distrust Google?
Cleaning Up After The Fact
So as of yesterday, I removed the link (sorry, no potential link juice for those who could have benefited) and removed the block via the robots.txt file. Only time will tell as it pertains to an update in the Google search index and the reinclusion of the Cape Cod SEO home page. I’ll bet they still let me use their Google Analytics tool though.
There’s certainly “things” that I could be doing from an on-page search engine optimization standpoint that I am not doing now, but given the pattern of events, the 2 issues identified seem to be the only things that really were different and/or of potential impact. I always welcome additional opinions or thoughts on this however.
As a parting shot, check out the irony (edited out opinion) of this search result, astutely noticed by an esteemed colleague:
Notice the indented result as well – the post I was blocking!
Update – 1/25/2008
I was really appreciative of g1smd’s comments and analysis over at Sphinn. It sounds like the interaction between the Robots.txt file, timing of Google’s crawl and subsequent indexing updates may all have had more to do with this then initially realized.
Only time will tell with this issue (as it relates to an indexing update and adjustment), based on a few adjustments made, but the information was (and still is) well received and appreciated.
Thanks for reading my blog, you may want to subscribe to the RSS feed, or follow on Twitter for future updates and information as well!