Performancing Metrics

Browsing Category: "SEO"

What went Wrong with My Robots.txt?

Friday, June 1st, 2007 | Internet, SEO with 8 Comments

Hi!, If you're new here, you may want to subscribe to my RSS feed. Thanks for visiting!

I read this article by John Chow on reducing the number of pages in Google’s Supplemental Index and checked out the same for my blog and found that it had more than 700 pages in Google’s Supplemental Index and decided that I would do something about it. I had earlier created a robots.txt based on Everton’s and like him, I also experienced a steep increase in traffic. When a further change guaranteed some more increase in traffic, I was more than happy to try it out.

Here is the SEO for Firefox stats for my blog. This was taken yesterday and there has been absolutely no change since May 24th (That’s when I had changed the robots.txt file).

Tech Spikes - SEO for Firefox

Based on John Chow’s robots.txt I modified mine. You can see it here. That is when trouble started. My traffic started going down. Drastically. I tried to reason out why it happened. My blogging pattern hadn’t changed. Apart from the robots.txt, I couldn’t find any other difference. When the drop went down by 60%, I reverted back to my old robots.txt (day before yesterday) and immediately I began to see a slight increase in the number of hits. I also checked out SEO for Firefox for John Chow which shows that his blog has crossed more than 2000 pages in Google’s Supplemental Index. Check out the screenshot below.

SEO for Firefox - John Chow

This experiment doesn’t seem to have helped John Chow. I’m not sure if he noticed any spike in traffic. It definitely has not helped me in any way. However, Nathan at Not So Boring Life seems to have had an increase of 20% in Search Engine traffic.

Below is an excerpt of my conversation with an ex-colleague who has some experience in SEO

me: then how do i reduce the suplementary indexing?

Anil: Actually once the page rank of ur blog increases, all the pages which are in supplementary index of search engines will come in to main indexing…. no need to worry abt it…. but remove all “disallows” in the code…this will cause more pain than supplementary indexing..

I’m not sure how correct this is, but that’s exactly what I did by going back to my earlier robots.txt. Can someone help me out here? These questions have been bothering me for quite some time now.

  1. What went wrong with this experiment?
  2. Why did I lose more than 60% of my traffic?
  3. Why has the number of pages in Google’s Supplemental Index for John Chow increased while it should have decreased?
  4. How did it work for Nathan and not for me?

Any answers??

If you like this post, then buy me a beer!

Popularity: 1% [?]

Microsoft adCenter losing out?

Tuesday, May 8th, 2007 | Internet, SEO with No Comments »

Microsoft adCenter is turning one year old this month but looks like it has failed to achieve anything great except better monetization than their previous system, Overture (which was later bought by Yahoo!). Well, the problem is not with adCenter but with their search engine, Live Search.

Microsoft adCenter

To add to their woes, they overbilled customers because of a bug and advertisers were upset when Microsoft moved their ads outside the search engine to its MSN Web sites. Still others say adCenter’s software, while indeed sophisticated, is slow and unreliable. You can find more complaints about adCenter here.

adCenter’s ad revenue soared by 23 percent to $456 million for the quarter ended March 31, 2007. The business had $623 million in overall revenue, up from $562 million for the same period the previous year, but it showed an operating loss of $200 million, compared with a loss of $24 million a year ago.

Via: The Seattle Times

If you like this post, then buy me a beer!

Popularity: 1% [?]

Search Engine Ranking Factors - Simplified version

Monday, April 30th, 2007 | SEO with No Comments »

I had put up a post earlier on the Top 10 SEO Ranking Factors based on the Search Engine Ranking Factors guide Version Two by SEOmoz. Now Carsten of Search Engine Journal has brought out a simplified version of the much more extensive version based on the opinions of the 37 experts, who are considered leaders in the world of organic search engine optimization.

The simplified version will hopefully catch the eyes of the not so tech savvy people as it is very simple to understand and alongwith a little bit of research on SEO, they would be much better off than what they were before reading Carsten’s version.

# Type Factor Importance Consensus
1 Keyword Keyword Use in Title Tag High Yes
2 Site Global Link Popularity of Site High Yes
3 In-Link Anchor Text of Inbound Link High Yes
4 Page Link Popularity within the Site’s Internal Link Structure High Yes
5 Site Age of Site High Somewhat
6 Site Topical Relevance of Inbound Links to Site High Somewhat
7 Site Link Popularity of Site in Topical Community High Somewhat
8 Negative Server is Often Inaccessible to Bots High No
9 Keyword Keyword Use in Body Text High Somewhat
10 In-Link Global Link Popularity of Linking Site High No
11 Negative Content Very Similar or Duplicate of Existing Content in the Index High Somewhat
12 Page Quality/Relevance of Links to External Sites/Pages High Somewhat
13 Site Rate of New Inbound Links to Site High Somewhat
14 In-Link Topical Relationship of Linking Page High Somewhat
15 In-Link Link Popularity of Site in Topical Community High Somewhat
16 Negative External Links to Low Quality/Spam Sites High Somewhat
17 Keyword Relationship of Body Text Content to Keywords (Topic Analysis) High Somewhat
18 Keyword Keyword Use in H1 Tag High Somewhat
19 Page Age of Document High Somewhat
20 Negative Duplicate Title/Meta Tags on Many Pages High No
21 Negative Participation in Link Schemes or Actively Selling Links High No
22 Negative Overuse of Targeted Keywords (Stuffing/Spamming) High Somewhat
23 Page Amount of Indexable Text Content High Somewhat
24 Site Relevance of Site’s Primary Subject Matter to Query High No
25 In-Link Topical Relationship of Linking Site High Somewhat
26 In-Link Age of Link High Somewhat
27 In-Link Text Surrounding the Link High Yes
28 Keyword Keyword Use in Domain Name Medium Somewhat
29 Page Quality of the Document Content (as measured algorithmically) Medium No
30 In-Link Internal Link Popularity of Linking Page within Host Site/Domain Medium Somewhat
31 Keyword Keyword Use in Page URL Medium Somewhat
32 Keyword Keyword Use in H2, H3, H(x) Tags Medium Somewhat
33 Page Organization/Hierarchy of Document Flow (i.e. broad > narrow) Medium Somewhat
34 Negative Very Slow Server Response Times Medium Somewhat
35 Site Historical Performance of Site as Measured by Time Spent on Page, Clickthroughs from SERPs, Direct Visits, Bookmarks, etc. Medium Somewhat
36 Site Manual Authority/Weight Given to Site by Google Medium No
37 Keyword Keyword Use in Alt Tags and Image Titles Medium Yes
38 Site TLD Extension of Site (edu, gov, us, ca, com, etc) Medium Somewhat
39 Site Rate of New Pages Added to Site Medium Somewhat
40 In-Link Domain Extension of Linking Site (edu, gov, com, ca, co.uk, etc) Medium Somewhat
41 In-Link PageRank (as measured by the GG Toolbar) of Linking Page Medium Somewhat
42 In-Link Temporal Link Attributes (when in time the link was created/updated) Medium Somewhat
43 Keyword Keyword Use in Bold/Strong Tags Medium Somewhat
44 Page Frequency of Updates to Page Medium Somewhat
45 Negative Inbound Links from Spam Sites Medium Somewhat
46 Keyword Keyword Use in Meta Description Tag Medium Somewhat
47 Negative Low Levels of Visitors to the Site (Measured via Toolbar, Clicks in SERPs, etc.) Medium Somewhat
48 Site Number of Queries for Site/Domain over Time Low Somewhat
49 Page Number of Trailing Slashes (/) in URL Low Somewhat
50 Page Accuracy of Spelling & Grammar Low Somewhat
51 Page HTML Validation of Document (to W3C Standards) Low Yes
52 Site Verification of Site with Google Webmaster Central Low Yes
53 Keyword Keyword Use in Meta Keywords Tag Low Yes

If you like this post, then buy me a beer!

Popularity: 1% [?]

Top 10 SEO Ranking Factors

Wednesday, April 25th, 2007 | SEO with No Comments »

SEOmoz have released Version Two of their Search Engine Ranking Factors guide. V2 is the result of the collective wisdom 37 leaders in the world of Organic Search Engine Optimization. The contributers rated each factor on a scale of 5.

Top 10 positive factors were:

1. Keyword Use in Title Tag
2. Global Link Popularity of Site
3. Anchor Text of Inbound Link
4. Link Popularity within the Site’s Internal Link Structure
5. Age of Site
6. Topical Relevance of Inbound Links to Site
7. Link Popularity of Site in Topical Community
8. Keyword Use in Body Text
9. Global Link Popularity of Linking Site
10. Topical Relationship of Linking Page

Top 5 negative factors were:

1. Server is Often Inaccessible to Bots
2. Content Very Similar or Duplicate of Existing Content in the Index
3. External Links to Low Quality/Spam Sites
4. Participation in Link Schemes or Actively Selling Links
5. Duplicate Title/Meta Tags on Many Pages

And the most controversial factors were:

1. Manual Authority/Weight Given to Site by Google
2. Relevance of Site’s Primary Subject Matter to Query
3. Participation in Link Schemes or Actively Selling Links
4. Duplicate Title/Meta Tags on Many Pages
5. Global Link Popularity of Linking Site
6.
Quality of the Document Content (as measured algorithmically)
7.
Domain Extension of Linking Site (edu, gov, com, ca, co.uk, etc)
8.
Server is Often Inaccessible to Bots
9.
External Links to Low Quality/Spam Sites
10.
TLD Extension of Site (edu, gov, us, ca, com, etc)

The complete SEOmoz report can be read here and it is highly recommended. For those who also want to have a look at the Version 1 made in the year 2005, you can find it here.

If you like this post, then buy me a beer!

Popularity: 1% [?]