SEO Whisperer: How Can I Get The Search Engines to Recognize ME?
LOOK at me when I’m talking to you!
I want some attention too!
These are the things we think… without actually saying them when it comes to Google and the other search engines.
You spend the time and write these great blog posts on your website but then you search Google a week later and still cannot find your post.
Google, why? Why don’t you look at me? My post is so much better than the one you are showing on the same topic.
So, let’s look at how to get Google to look at your website. How to get Google to see your new content on your website? How to be recognized?
In the techy world, this is called- “getting your page indexed”.
There are many ways to get your website indexed. Here is what the man himself says about getting indexed- straight from Google’s mouth.
We use software known as “web crawlers” to discover publicly available webpages. The most well-known crawler is called “Googlebot.” Crawlers look at webpages and follow links on those pages, much like you would if you were browsing content on the web. They go from link to link and bring data about those webpages back to Google’s servers.
The crawl process begins with a list of web addresses from past crawls and sitemaps provided by website owners. As our crawlers visit these websites, they look for links for other pages to visit. The software pays special attention to new sites, changes to existing sites and dead links.
Computer programs determine which sites to crawl, how often, and how many pages to fetch from each site. Google doesn’t accept payment to crawl a site more frequently for our web search results. We care more about having the best possible results because in the long run that’s what’s best for users and, therefore, our business.
Choice for website owners
Most websites don’t need to set up restrictions for crawling, indexing or serving, so their pages are eligible to appear in search results without having to do any extra work. That said, site owners have many choices about how Google crawls and indexes their sites through Webmaster Tools and a file called “robots.txt”. With the robots.txt file, site owners can choose not to be crawled by Googlebot, or they can provide more specific instructions about how to process pages on their sites.
Site owners have granular choices and can choose how content is indexed on a page-by-page basis. For example, they can opt to have their pages appear without a snippet (the summary of the page shown below the title in search results) or a cached version (an alternate version stored on Google’s servers in case the live page is unavailable). Webmasters can also choose to integrate search into their own pages with Custom Search.
Organizing information by indexing
The web is like an ever-growing public library with billions of books and no central filing system. Google essentially gathers the pages during the crawl process and then creates an index, so we know exactly how to look things up. Much like the index in the back of a book, the Google index includes information about words and their locations. When you search, at the most basic level, our algorithms look up your search terms in the index to find the appropriate pages.
I know. A mouthful. So, let’s break it down and let me give you a few pointers and one of my favorite methods:
- Make sure you have a robots.txt file attached to your site. This a file which tells Google and other search engines… “I want your spider to run through my website and check out my new links.” Here is a link that will give you more about this subject-
Check out the Google Search Guide to Robots
- Create a sitemap for your website- Here is a link to more of that subject: sitemap format
If you are using a wordpress site, there are many plugins that will create this for you for free. Once you have it created, copy the url of that link. This page will overall show all the pages and posts of your website. NOW… go over and do my favorite method to get indexed. Ready? This is powerful. DO NOT abuse it or you will lose the privilege of using it. (Ask me how I know : )
- Submit your url to Google
Here is the link. You have to have a Google account, gmail or webmaster account… which takes minutes to set up. Then you go to this url – Submit URL
And 9 out of 10 times… within minutes, your page is indexed. I would personally use this link rarely. If you are using #1 and #2, then there are rare occasions to use #3.
The main reason I use #3 is when we have created a new website and get impatient and want Google to find our site. Kind of like… LOOK at me, Google! Look at this great website. I know your customers will LOVE it! OK, we don’t say that out loud but we’re thinking it. : )
Then we grab the link to our sitemap page and submit it, and watch the spider crawler run through our site… Ahhhhh, it worked.
Hope that gave you a much better understanding of how to be recognized. NOW… go work on not being so needy. : ) You are a good person and have a good website – even if they don’t look your way. But it does help it if they do, doesn’t it.
Until next time,
SEO Whisperer signing off.