Archive for July, 2008

July
30

Useful Information of the Search Engine Bots

Finding all the right details on the search engine bots can be difficult, especially if you don’t know where to look. There are three major search engines that are highly known all across the world which we’ve talked about constantly, so why not give you the actual details on their spiders, crawlers, bots, whatever you like to call those handy little navigators.

Google

Lets begin with the most popular spider there is; Google Bot. Google Bot is of course associated with Google. This bot is commonly known as Googlebot/2.1, but Google actually has two different bots. There is the one I just listed and also an image spider known as Googlebot-Image/1.0.

When you want to block Googlebot from your site you simply put ‘googlebot’ into your User-agent section of the robots.txt file. Now to actually get crawled by the Googlebot frequently you will have to actually take the time to update your content by at least 1k. If you do this you will discover that your site is being crawled frequently with the chance of even more then once a day depending on how often the page is updated.

This spider/robot can support the navigation of the following types of web media:
HTML SHTML PDF ASP JSP PHP XML CFM
XLS PPT RTF WKS LWP WRI SWF DOC

Currently Google has been said to ignore Meta tags, but occasionally you will see Meta tag’s provided with descriptions of sites in the search results.

You will generally see search results on the following list of sites when you get crawled by the Googlebot:

• Google
• Netscape
• Earthlink
• AOL
• iWon
• Alexa
• Disney
• Go.com

Yahoo!

The next spider that you will want crawling your site happens to be Yahoo!’s. Their bot is known as Mozilla/5.0 with the user agent being ‘Slurp’ when listed in the robots.txt file.

With Yahoo!’s spider it seems to have a bit more difficulty crawling sites with frames making it that you may have a disadvantage when it comes to ranking, but they are slowly but surely getting better.

It can take at least thirty days for your site to be submitted onto the Yahoo! search results after being found by ‘Slurp’ if you do not submit the site on your own. This process could be lengthy, but if you have good quality inbound links then you will be discovered in no time.

MSN

Recently MSN search engine has become known as Windows Live. They tend to be one of the most active spiders out of all the search engines so you will discover they are crawling your site more frequently.

MSN bot has become known as MSNBOT/0.1 with it having the ability to crawl through sites that utilize frames. One way to get listed by MSN is to simply submit your site for free, which could take approximately 30 days after that to be listed.

As you can see with all this information that I just provided you Google seems to make more of their information available compared to Yahoo! and MSN. This truly does make it easier for you to configure your site around what the Googlebot can navigate through getting you listed much faster on one of the largest search engines that is available.

July
27

Paying the Ransom Demand of a Hacker

Wired Magazine had a snippet regarding hackers making demands of unsuspecting Webmasters. How it often times works is the hacker will notify the Webmaster that a vulnerability has been discovered on their site and for a “consulting fee” of something nominal … around $1,500.00 usually, is requested or the vulnerability will be posted.

What should you do?

If you pay the “ransom” what is to keep the hacker of posting the vulnerability anyway? Or since you paid once, you’ll probably pay again and they’ll get their buddies in on the scam and hit you for more money. When will it end? Probably when you stop paying.

What is the risk of just ignoring the demand? Not much. According to the FBI, most of these demands are merely bluffs, and the vulnerabilities they may have discovered can cause little harm to your site. According to a survey conducted in 2004, only 18% of these types of ransom demands were real.

But since that is still a 1-in-5 chance of getting your site nailed, you can begin “negotiations” with the hacker as you alert your web host to check and validate the vulnerability. This extra time can help you “lock down” your site so the vulnerability can be corrected and the ransom doesn’t have to be paid.

Many ask me about HackerSafe. It used to be a good service, but since McAfee bought them, they are suspect at best and based on my testing, nearly all vulnerabilities found are false.

July
26

Google Announces PageRank Update

Whether you like it or not, the online market is abuzz with Google giving a Heads-Up for an upcoming PageRank Update! That’s good news for SEOs and Webmasters.

The news is Google’s Matt Cutts announcing through his blog:

“I’m expecting that also in the next few days that we’ll be expiring some older penalties on websites”.

Matt Cutts leads in making waves with its latest announcements every now and then. Through this initiative, he proudly makes it known to the Webmasters about this latest development becoming visible in the next few days. It leaves everyone making wild guesses about the details of this latest development, with different stories being spun by all and sundry, especially those from the competitive side. However, some believe that Google has simply followed in the footsteps of Yahoo.

Speculations apart, let’s divulge a little deep into the details, (just for the sake of some newbies on the scene) as to what actually is meant by PageRank. PageRank is a system which counts various link votes of a website and also helps to find which pages are more important.

Thus, simply put, it states how a particular website ranks in terms of search engine rankings. PageRank are opinions of the importance of particular websites and does have a significant role in many web search tools. PageRank are opinions, opinions of the significance of particular Web sites as they correspond to a search query.

A page that is linked to by many pages, themselves enjoying high PageRank, gets a higher ranking in the scale. Google has its own unique way of assigning numeric value from 0-10 depending upon the website’s popularity, which in itself is based on number of inbound links together with the PageRank of the pages providing the links.

Let’s start with how PageRank is used by Google for searchers. It is one of many factors used for ranking pages. Focus on your content. If your website has good content which is regularly updated, you are likely to gain a high PageRank, with regular revisits and also a name (recognition) for your website.

Google proudly and periodically announces PageRank updates, whenever there is a strong need felt for it, be it every 2, 3, or 4 months and reiterates that Toolbar PageRank values are historical and not by any means real-time values.

So, one needs to gear up by keeping up with a website which has fresh content, is technically sound, and is bent on building a rich stock of links to put you a step ahead of your competitors. If you aim for a sufficiently higher PR for your website (we all do that, don’t we!), you need to have a flair for writing inviting (and different as well as interesting, so to say) headlines. A good heading does half of the business for your website.

You must have also meaningful permalinks that convey a true message about relevant details of your post to a prospective visitor (on your website, of course!). How can we dare to ignore the role of having a proper link building campaign for our web business? It’s an important strategy for the successful online marketing of your website with the dual advantage of giving your competitors a tough time.

Take time to ensure that links do exist on different sites with which you are doing business. Put in simple words, you should look for building links with sites that already have a ‘know, faith and liking’ with your business. These include websites of your customers, suppliers, your business friends, different trade associations and The Chamber of Commerce. Having done this, you are more likely to follow towards getting your website listed in at least some, if not all, of the prominent directories including Yahoo, DMOZ, GoGuides and Business including those which are free of charge.

Since there are many different ways to build links, you are likely to find a best answer from different alternatives by doing a little research to make your web presence felt (or read, phew!). Remember! It’s the quality of links, (and not the quantity of links) which matters.

This brings us to towards the last but not the least step for booking a high PR, be at any search engine including your favourite Google. Try to include as many posts under your topic as possible. Don’t worry; it’s not that calculative or brain cracking, as it seems to be. The golden rule is to keep your eyes and ears open (to possible changes and available alternatives) and just remain observant rather than overreacting in a fit of panic.

To go strictly by the guidelines of Matt Cutts, PageRank is not simply just a numerical figure in the scale of 1-10. It is much more than that. It is a floating-point number that is arrived at by considering various degrees of resolution than those indicated in the Google Toolbar. That does not by any means imply that we become obsessed with the PageRank of our websites in any way.

No wonder, for a blog in its infancy, a higher PageRank can and does spell more monetary gains. However, what really matters is the number of visitors that flock our website which are instrumental in keeping our cash registers ringing (oh, that gives us a sense of wow, and it really should). Give all the web page elements, the required importance and see your website sailing through!

July
25

Google AdWords Pulls from Content Networks

You always hear about businesses that get their site known by pay-per-clicks (PPC), but have you ever heard what it actually does? Over the years Google has put together a program known as Google AdWords, software that helps generate online advertising.

Recently you’ve probably heard about a large number of people that use Google AdWords choosing to discontinue being apart of the content network. This decision was made upon the large decrease in conversion rates for ads that have been placed in areas that are content networks.

Why are the content networks being punished?

Was this a good decision on the people using Google AdWords? Will it affect a lot of businesses by doing this? What is going to happen to all the current advertisements in the content networks?

Honestly, if people see that their advertisements they have are having a rapid decrease in the number of conversions they are receiving placed amongst the content networks then what good would it do keeping them there. The only thing that we could hope for is that this has a quick turnaround, but quick just doesn’t seem to happen all the time. One of the biggest focuses on your own site is to get a high conversion ratio for what you have and if it weren’t working out wouldn’t you normally make a change to flip it around? Yes, so why continue placing advertisements in an area that isn’t receiving any acknowledgement.

Now what affect could this have on business? This is one area that could both ways, either you see a turnaround in the conversion rate for other areas of your site, or you see a drop completely in all areas of your site. This isn’t one of those win-win situations, it’s a 50/50 chance, and so are you willing to take the risk?

Businesses At Risk for Turning Away

You could greatly affect your business by just removing one little advertisement that has been located amongst your content, but not even be aware that this was the zone getting you the most clicks. So why remove them in the first place? Well, of course the first thing is advertisements cost money and if you aren’t earning money how you going to pay for them. Another reason you may choose to remove them is to see if the amount of visitors to your sites increases. People may see all of these advertisements located on your site and turn away. When someone is looking for details and content on a specific topic and see tons of advertisements located right where they want to read then they may go somewhere else that doesn’t include it.

Over the past few weeks many Webmasters have been taking the risk of removing the content network advertisements to see what might actually happen. They are quickly learning that there is several versions of advertisements to be considered in the content network that could be worked around to best fit your site. Many use to actually blame Google for the reason behind why content network advertisements didn’t work, but guess what people, Google fixed this! So now who can you blame? I know, you could probably think of someone, but in the end it will turn back to you.

If you do not take the time to learn about the advertisement options that you have for your content network then how will you ever know exactly how it works? You won’t. Why not try? What are you going to loose, or even gain? You want to be able to compete in your market of business, why not be the risk taker and try out advertisements in the content network since so many sites are starting to pull away from it. If it doesn’t work out for good, then you have at least tried and not going to sit each night pondering about what if. You could open many new doors for your business, so stop building up concrete walls in front of those unopened doors. Open it up and see what’s on the other side, you might not be disappointed, and if you are it is at least an astounding learning experience that may help you out in the future.

July
24

Google AdWords – An Informative Approach

With the amount that we see Google AdWords popping up all over the forums and Internet SEO news we thought it was time we’d give you some well-needed information on Google AdWords. Now you’re probably wondering, why would we need to know about Google AdWords? Wouldn’t it be great to know what you are dealing with before you jump in and start paddling your way towards something that may drown you deep into the sea? Of course, so lets begin.

What is Google AdWords?

Google AdWords is a program designed by Google itself that allows businesses that have online-based sites to place advertisements in the search engines at a price, also known as the pay per click (PPC) option. Currently Google AdWords seems to be controlling a large amount of all the advertising that seems to occur in the search engines with a quickly expanding market share to go along with it.

What kinds of offers are available?

There is of course their standard PPC program available through Google, but currently they are offering two other services to assist new advertisers into their market of advertising. The first one is the cheapest route someone could take to begin his or her online advertising experience. For only $5.00 to start the customer can receive AdWords Starter Edition. Let’s take a look at this further.

AdWords Starter Edition

With this option you will be given the opportunity to run one advertisement by filling out a one-page form that will assist in determining your budget, the keywords, and the text of your ad. Simple enough don’t you think? You then can easily just activate the advertisement and it will begin running.

This option is a perfect way to familiarize you with the world of online advertising. You no longer need to be worried if it is the right option for you because you can easily make it the perfect option, especially for only $5.00 to begin. What’s wrong with that? You probably pay more just to start up your vehicle every single day.

Now after you’ve tried out the AdWords Starter Edition and felt that this may be the right path for your advertising experience you may want to consider upgrading to the AdWords main program through Google. It won’t actually cost you a thing to upgrade, so what wrong could honestly happen?

AdWords Jumpstart

This option tends to be for those people who love getting a lot of help then you may want to consider paying the extra bit of $299.00 for AdWords Jumpstart. With the use of this program you will not only have direct contact with one of the Google ad reps, but they will assist in writing your ads, selecting the keywords, and determining your bid amounts. Now that just makes life so much easier. Best part is, in the long run you will end up getting the money back because it will go towards the clicks you receive on your advertisement, so you are just investing in your own future.

With the help from your AdWords Jumpstart rep they will develop a campaign that will give you a daily budget of $50.00+. Once your budget begins to increase you will see that you advertisement will begin to show on more relevant search results. If you do need to all of a sudden raise or lower your budget those you can with the option to make changes to your daily budget any time you need after you start your campaign.

Now that we’ve gone through two of the best options for new Google AdWords users you are probably wondering how difficult it will be to actually get your advertisements seen. Well it isn’t too difficult especially since advertisements in Google are usually placed at the top of the page and down the right hand side.

When people do a search that is relevant to your category it is likely that your advertisement will be seen, especially if the market you are in isn’t a huge market. Google AdWords is a great option when you want to get known, but don’t want to go around posting in forums and blogs to get several clicks in a week. It is not the quantity that matters it is the quality. If you can’t provide quality approaches on getting your business known, like advertising, then you may as well just start digging that hole in your backyard now.

Going around posting your advertisement on thousands of forums and blogs will help, but not everyone uses them. So why not post advertisements in an area that everyone has used at least once in their life. Search engines are very popular so pay the extra few bucks to get your advertisements advertised with Google, Yahoo!, and MSN.

There are also four different formats you can utilize for your advertisements format. These consist of:
• Video ads
• Image ads
• Mobile ads
• Local business ads on Google Maps

All four of these options are great ways to get your business known, especially if you are a local business wanting to get known by your public.

Lastly, why not choose who can actually see your advertisement? Google AdWords has given its clients the ability to choose who and when your advertisements can be seen. You can turn the ads off entirely for the time being if you notice there is no conversion rate, you can have the ads targeted for a certain language or location, site targeting which allows you to determine what sites can have your advertisement listed, ad scheduling allows you to select what days and timeframes you want your ad to appear, and position preference is where you can choose where you’d like the ad to appear in the Google search results.

With Google AdWords there is many options available that allow you to make your advertising experience a personalized experience. If you are not comfortable with how things go simply turn off your advertisements and continue on your way. Google AdWords is a great way to get yourself known especially if you are willing to put the extra few dollars in for some extra effort.

July
19

Yahoo! Introduces Sitelinks

Yahoo! looks to keep following in Google’s footsteps as they are now showing “Googlish” Sitemaps. Here is a screenshot of a search for “microsoft”.

Yahoo! Sitelinks - Microsoft search

Many main keyword phrases don’t have them, but “software” and “travel” do. For my affiliate sites which have Sitelinks in Google, they do not have Sitelinks in Yahoo! – at least not yet.

July
13

SEO Interview Questions – What I Ask

There have been a lot of talk over the last year about “Interview Questions” in the SEO space and I even reviewed a HUGE list of SEO Interview Questions, but let’s face it, you don’t have a lot of time to ask those, let alone review the answers. So, here is what I do because I have adopted the Howie Schwartz method: hire fast and fire faster.

I want to know their knowledge and ability to learn and grow. I also want to uncover their ability to bullshit too. I always give a test project, one that should be completed in about 5-10 minutes to gauge their ability to analyze, process and recommend a solution.

And if they cry because I was too mean, that’s a bonus. :-)

Here are a list of questions I ask in either a live interview, over the phone, or post on a job board. This is especially helpful when outsourcing overseas as it will give you an understanding how well they can communicate and write in English.

SEO Interview Questions

What SEO tools do you use on a weekly basis? (I want to know how well versed they are in the market and an SEO’s toolset say a lot about them, the same way a carpenter’s toolbox does).

What kind of strategies have you implemented to achieve at least a PR5 for a current client and what is the domain? (Run a backlink check on the site with SEO Elite or another link analysis product. Are there shady links? Paid links? Link Farms? If it looks solid, ask them to put your name as the author (temporarily) in the meta author tag, or place your name somewhere on the home page to verify they have control over the site).

What’s the difference between PageRank and ToolBar PageRank? (I love this question. If you get “Aren’t they the same?” end the interview immediately).

How do you evaluate whether an SEO campaign is working? (Hopefully the answer here is “conversions” and not “traffic” or worse, “ranking”)

Why does Google rank Wikipedia for so many topics? (Great question which should produce insightful answers)

Do a Google search on this candidates name (If you cannot find them, that’s a red flag. And if you can’t find them ask why not).

Of the well-known SEOs, who do you pay attention to and who are you not likely to pay attention to? (I love this one.)

What industry sites, blogs, and forums do you regularly read? (This is a great question and they better rattle off less than a dozen or it is a warning that they spend too much time reading and not enough time working)

Tell me your biggest failure in an SEO project (good question – watch them “shift” in their seat)

In what areas of SEO are you strongest? (test these areas heavily to make sure they are really strong in those areas)

In what areas of SEO are you weakest? (make sure they actually admit to a weakness. Those who state “I’m too organized” or “I have too much attention to detail” are red flags. Everyone has weaknesses.)

There you go. That should give you plenty of information to really get their worth, and not bury them with too many unneeded questions.

July
9

Google Continues to Kick Microsoft’s Ass … Again and Again

Google’s update to their Keyword Tool will SIGNIFICANTLY improve your keyword research ability. Review how in just four minutes with the screen shots, commentary and test results below:

Google has always stated they would never follow Yahoo!’s footsteps and release actual numbers from their keyword data, as Yahoo! took so much heat for their numbers being off. Well, they have obviously had a change of heart. Here is a summary of what they have added and what the numbers mean.

Step One: Go to Google’s External Keyword Tool.

Step Two: Enter your keyword phrase or a website URL.

Google Keyword Tool

In the above example, the radio button defaults to "Descriptive words or phrases", I enter my keyword, and while I can enter multiples, I am going to leave it on a generic term "mortgages" to see how Google’s synonyms feature works as it is also checked by default.

Google Keyword Tool

If you choose the URL route, you will need to click the radio button "Website content" and the screen will change to allow for a URL to be spidered. I did not check to also spider pages linked from this URL. I want to see how Google sees this page’s "theme" which is very important in my SEO efforts.

Why?

If Google comes back with unrelated terms as my theme, I know I screwed up my Title Tag, Headline, Content, etc. and I need to fix it ASAP. Because if Google can’t properly read my theme, I’m probably not going to rank well for the terms I’m targeting.

Step Three: Click "Get keyword ideas".

Step Four: Analyze Results.

Google Keyword Tool

Keywords: Are sorted by relevance based on Google’s algorithm.
Advertiser Competition: This is based on AdWords. The fuller the bar, the more competition. As you see from the image above, the bars are completely full indicating heavy competition. Heavy competition in the AdWords space almost always translates into heavy competition in the SEO space for that keyword phrase. However, competition is good, as where there is competition, there is money being made.
Approx. Search Volume: June: Based on data collected from June (last month), this is the total number of search volume for the month.
Approx. Avg. Search Volume: Based on historical data of the last 12 months, this is the average per month search volume.

As you can see from the data above, the volume is pretty heavy for the top mortgage keyword phrases. Later in this article I will be comparing real data with Google’s data to show how accurate it is.

How did the web page option result turn out?

Google Keyword Tool

As you can see from the data Google spit out, the page is very well themed and "search engine optimization" and "search engine marketing" are the two biggest themes. Perfect. Google then breaks down each and gives additional keyword suggestions for each grouping. This is very powerful and very much worth your time to learn. This just made keyword research for your individual pages so much easier. What about the MSN Excel Tool which I thought was so cool? It’s just been replaced in my book with Google’s tool.

Why?

Accuracy. You don’t have hundreds or thousands of non-related keywords for a URL in Google’s tool as you do in Microsoft’s. It is clear Google wins yet again by giving relevant, meaningful data instead of a big glob of stuff for you to wade through.

Data Accuracy
So, how accurate is this data? Let’s see. I constrained a keyword report to only include "meta" keywords, as they are "niche" keywords in my view and best to use to test data accuracy.

Google Keyword Tool

The above numbers are constrained to only show the click-through traffic from Google for the entire month of June. This is an actual screen shot from Google Analytics. Now, let’s compare these numbers with the keyword tool.

Google Keyword Tool

Google only had data for three of the five keywords entered. As you can see, I did an "exact match" so the search volumes would be accurate. As you see from the results, we are getting "Insufficient Data" for June and it seems through the queries I have put through that the "magic number" is 600. Meaning that unless your click through traffic is at least 600 on your end, there won’t be any data from the previous month. Even though Google is showing an "average" of 1,600 search queries a month for the term "meta content" and there are no advertisers, even though Google says there are (Advertiser Competition bar half full), I had a mere 318 clicks despite holding the #1 position. Taking 46% of the search volume, which is what I should expect for the #1 result, I should have had 736 clicks, more than 400 than I received.

"But wait," you say, "the data for June was insufficient. You are basing your numbers on data which doesn’t exist."

Fine.

Taking twelve months of data (July 1, 2007 – June 30, 2008), I received 3,612 click throughs, or and average of 301, which is LOWER than the current month’s data. I could go on for days with similar results.

Looking at data on my affiliate sites, the trend is similar. Google’s search volume numbers are at least 2x of what they should be, which is similar to what Overture did. Be mindful of this as you make your determination based on "search volume" as the numbers are inflated. In one instance, I own the top seven results for a keyword phrase (different domains, of course) and my traffic volume is just over half of Google’s search volume number. It should be A LOT higher than that. More proof that the numbers are off.

Remember to test the keyword first through PPC to make sure the keyword phrase converts before doing SEO. No use doing SEO on a phrase that doesn’t convert – no matter how much search volume it gets.

I will have more examples this month as I continue my testing with this tool.

July
4

Google Independence

Independence Day
It’s a holiday here in the US, but I like to remember this day 8 years ago when everything changed in the search engine industry. Back on July 4, 2000, Yahoo! announced they were replacing their secondary search provider Inktomi with a young up-start search engine called Google. Ha. This came as a shock as the best search engine the previous two years was Inktomi-based HotBot. Industry “insiders” wondered what in the world was Yahoo! thinking moving from the best search database in the world to a virtual “unknown”. Google would gain control of the search market and never look back.