Setting up robots.txt on Blogger

Blogger now allows custom robots.txt, this is very useful because we can set the visibility of our articles on search engines, we can determine whether the article will be indexed by search engines or not.

By default, every blog that uses the Blogger platform will have a robots.txt as follows:

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search
Allow: /

Sitemap: http://www.example.com/feeds/posts/default?orderby=updated

And has the following explanations:

Mediapartners-Google is a robot from Google Adsense, leave it as is because if you mistakenly change that than the ads served will not fit with your content.

The next line is for all the robots and marked with an asterisk (*). On the default configuration, it is clear that the label of our blog is not indexed Disallow: /search.

Keep in mind that a slash (/) is as your homepage, so for example if you want the label to get indexed, do not just fill up with a slash like this Disallow: / because that would be you do not allow the robot tracing your blog, but it should like the example below:

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow:
Allow: /

Sitemap: http://www.example.com/feeds/posts/default?orderby=updated

With the configuration as above then all of the articles and the label will be indexed. And to block a robot for particular page (I take the example of my FAQ page) you can simply write as follows:

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /p/faq.html
Allow: /

Sitemap: http://www.example.com/feeds/posts/default?orderby=updated

Update: To resolve the pagination problems on blogspot after we remove the Disallow: /search than we can use the following configuration to block the pagination page:

User-agent: Mediapartners-Google
Disallow: 

User-agent: *
Disallow: /search?updated-min=
Disallow: /search?updated-max=
Disallow: /search/label/*?updated-min=
Disallow: /search/label/*?updated-max=
Allow: /

Sitemap: http://www.example.com/feeds/posts/default?orderby=updated

After the changes, make sure everything is fit like what we want by visiting www.example.com/robots.txt. Replace the Example.com with your domain name.

Warning! Use with caution. Incorrect use of these features can result in your blog being ignored by search engines.

Note: Last updated on January 5, 2013.

Blogger new features: Search preferences

Starting today Blogger added some new features, the "Search preferences" that aims to maximize our blogs in search engines. If you care about the ranking of your blog, then this new feature is very exciting news.

Here are the new features are:

Maybe you realize that there is new option in the settings tab, the "Search preferences".


By clicking on it will bring up the three categories, the Meta tags, Errors and redirections, Crawlers and indexing.

For Meta tags category is serve to add a description tags on our blog, by enabling the Meta tags option then everytime we make new article will appear a new option called "Search Description" that allows us to add meta description to any post.


The next category is Errors and redirections, with this feature you can set the message that appears when visitors visit a page that is no longer exists on our blog, the "Page Not Found 404" error, and more helpful is that now we can redirect visitors to a particular page as we wish.

The last feature is Crawlers and indexing, here we can create our own robots.txt and header tags for our blog. It seems that now we can set the label of our blog to got indexed in the search result.



And there is one additional feature on the link tool, where there is a new option, the ability to add rel = "nofollow" on every link.


Blogger is now becoming increasingly intense. Lots of improvements, and all these new features become my favorite.

See also: Setting up robots.txt on Blogger.

Cheap or even free SSL certificate

SSL certificate is essential if you want more security for your website, but unfortunately the price of a valid and cheap SSL certificate is rarely to be found. The average price of SSL certificate ranges from $100 - $200, a price that usually can only get the lower-class certificate.

A few days ago, I made an observations to some of SSL Certificate providers out there, where I want the SSL certificate to meet my needs as follows:
  • Multiple Domains (UCC)
  • Wild Card Capability
  • S/MIME Client + Auth / SMTP
And after several days of searching, I finally found a SSL certificate provider that provides features like I was looking for with a very cheap price at only $59.90 for two years. Not only that, they also provide a free SSL certificate, valid for 1 year and can be renewed again.

Company that provide this SSL certificate is StartCom Ltd, which is an Israel-based company and founded by Eddy Nigg. Get your cheap or free SSL certificate here.

See also: Comparison of SSL certificates for web servers.

XPS Annotator has made a new history

Finally ..

Blogger Dynamic Views and SEO

Previously I was a little worried when switching my blog theme to Blogger Dynamic Views theme, it's because I read many articles if the Dynamic Views theme is not SEO friendly. But I decided to install it regardless of people's opinions.

After trying it for over a week, I did not find any bad effects on traffic, even an increase in visitors and page views, indicating that changing the theme from regular theme to Dynamic Views theme is the perfect choice.

Update: Blogger finally adding Search preferences feature for SEO purposes.

P5RD1-VM and Windows 7

I have a very old computer, built in 2006 by using Asus P5RD1-VM motherboard and an Intel 2.8GHz processor. This system was built when Windows 7 has not been released so that the default driver of the P5RD1-VM motherboard is no longer compatible.

After looking on the internet and visiting a few forums, I finally found the drivers needed so that I could install Windows 7 on my old computer, here are the new driver for P5RD1-VM:
  • P5RD1-VM has an integrated graphic card based on ATI Radeon X300. You can download the driver here.
  • P5RD1-VM has an integrated sound card, the SoundMAX from Analog Devices. Download the sound card driver here.
  • P5RD1-VM use the ULi SATA M5287. Download the SATA driver here.
  • P5RD1-VM use the ULi M526X Ethernet Controller. Download the ULi Lan driver here.
Indeed, the graphic driver used is using the driver for Windows Vista but it works well with Windows 7, even I can got the Windows Aero to work as well.

Overcome the effects of Panda in our life

I see a lot of sites affected by Panda, if you rely on Google traffic of course your life would be a nightmare.. and than how to overcome the effects of Panda in our life? to start is not as difficult as you think.

Here are some of my opinions about how to eliminate your dependence on Google:
  1. Uninstall your Google toolbar or any other similar tool.
  2. Do not get stuck in the optimization process related to the text and link.
  3. Treat the visitors as once in a life time opportunity.
  4. Make sure that a new visitor to your site has lots of reasons to remember you.
The main goal is how we can make a free Google visitor a visitor that remembers us without needing Google again so although the Panda is raging, our lives will not be affected. Good luck!