• Tech: 60 free feed icons http://ow.ly/5a72 #
• Infoboard: Fantastic HD Wallpapers http://ow.ly/5gJv #
• The forecast for Sat, 9 May 2009 is AM Showers. High: 80 F Low: 53 F. #
• Canadians to get Android phones in June http://ow.ly/5OhX #
• News: Visionary or plane crazy? Airbus contest to decide http://ow.ly/5NWc #
• Ten Brunch Wines For Mother’s Day http://ow.ly/5TYi #
• Google’s plans for Android’s YouTube http://ow.ly/5O6W #
• Tech: Wolfram Alpha shows data in a way Google can’t http://ow.ly/5OjR #
• Windows 7 “Not Much Faster” Than Vista?? #
• Report: AT&T to cut iPhone service plan by $10 #
• Tech: Windows 7 raises complaints from rivals: report http://ow.ly/5NWN #
• Tech: Microsoft to buy game maker BigPark http://ow.ly/5NVS #
• Tech: Google: American phenomenon and antitrust target http://ow.ly/5NUu #
• Ubuntu 9.04 Is As Slick As Win7, Mac OS X #
• New Firefox Project Could Mean Multi-Processor Support #
• ObamaNews: Service, Coming to a Town Near You http://ow.ly/5NPM #
• College Police Think Using Linux Is Suspicious Behavior #
• The forecast for Fri, 8 May 2009 is Isolated Thunderstorms. High: 78 F Low: 57 F. #
• Cooked a nice south Indian dinner #
• Social Networking administration welcome to the new ERA …. http://ow.ly/5FVW #
• Body Builder ?? http://ow.ly/5FQH #
• Infoboard: Interested in #Space Travel. Tickets will costs $200,000 says virgingalactic http://ow.ly/5BDo #
• FLASH: Ten of 19 banks in stress tests must raise net new capital of $74.6 billion, U.S. regulators say #
• News: The Recession Is Over?? Indicators point to a fast-approaching end date: May 2009. http://ow.ly/5tbK #
• BlackBerry Overthrows Apple iPhone in First Quarter - http://tinyurl.com/c77e9e #
• rt @Reuters: USDA may help ailing pork industry hit by H1N1 http://r.reuters.com/mav25c #
• rt @Reuters: Pirates fire at U.S. Navy ship off Somalia http://r.reuters.com/veq25c #
• rt @ReutersIndia: BUSINESS: Tata Steel sees India demand rising 4.5-6 pct - exec http://r.reuters.com/heq25c #
• The forecast for Thu, 7 May 2009 is Showers. High: 69 F Low: 53 F. #
• #google search right in gmail. the link http://ow.ly/5r1k will take you to the gmail labs page #
• News: #Tata introduces ‘Nano’ housing for Rs 3.9 lakh-Rs 6.7 lakh http://ow.ly/5qWB #
• New Browser #Security Paper: Why Silent Updates Boost Security http://ow.ly/5rir #
• #Tech: #Webdesign and IE6 incompatibility - Fix your problems in 5 minutes http://ow.ly/5reW #
• Tech: #Google #Flu Trends for #Mexico, #Facebook Track #SwineFlu http://ow.ly/5r0s #
• rt @GoogleAtWork: Attend the @appirio/Google Enterprise webinar on custom apps using App Engine for Java + Google Apps: http://bit.ly/djIQZ #
• #YouTube Tests New Design for Channels http://ow.ly/5raI #
• Tech: Health Care IT Slideshow: How #Google, #CDC, #Twitter, #Wikipedia Are Tracking #SwineFlu http://ow.ly/5r0M #
• U.S. reports 642 new #H1N1 flu cases #
• The charter flights arrangement between China and Mexico may sooth the latest Sino-Mexican tension aroused by the spread of #swine flu. #
• #Google Page Creator will be closed on June 2009 http://ow.ly/5r3q #
• #Porsche and #Volkswagen AG to merge #
• Blackberry outsells #iPhone - http://is.gd/wFGW #
• News: Is Google Any Help in Tracking an Epidemic? #swineflu #h1n1 http://ping.fm/1svUm #
• RT @NASA: Today’s Progress undocking sets the stage for tomorrow’s launch of the Progress 33 cargo craft from Kazakhstan at 2:37pm EDT. * rt #
• The forecast for Wed, 6 May 2009 is Cloudy. High: 70 F Low: 54 F. #
• RT @firefox: Firefox at 270 million users: http://bit.ly/YdnKU #
• ReutersIndia: BUSINESS: BSE Sensex to open up, but resistance seen http://r.reuters.com/hyt94c #
• fed up of deployments #
• Test #
• installed twitter tool on my blog #
• Infoboard: how to ask smart questions? #tech #php #geek #smart http://ow.ly/5fCJ #
• News: #Schwarzenegger welcomes debate http://ow.ly/5k5y #
• Tech: Store passwords in #linux with pwsafe http://ow.ly/5fhg #
• News/Tech: #Facebook’s Hacking Problem http://ow.ly/5fOb #
• oh!! its great news i got 50 followers #
• 25 movies you must watch this recession! http://ping.fm/r69Mc #
• Now playing: S.P.Balasubramaniam - Pani Vizhum http://bit.ly/DRavm #
• testing ping.fm service #
• Now playing: Yuvan Shankar Raja - Theepidikka http://bit.ly/xRr1k #
• News: Say no to Bangalore, yes to Buffalo http://ow.ly/5a8U #
• configuring my Laptop #
• Vista suck really bad with the best possible laptop hard ware also #
• Tech: #Drupal 6.11 and 5.17 released #PHP #Programming http://ow.ly/5fLA #
• News:Indian Multiplexes face 3-bln-rupee hit on producer spat http://ow.ly/56Ig #
• News: Gold extends gains above $900 on dollar http://ow.ly/5asQ #
• The forecast for Tue, 5 May 2009 is Cloudy. High: 55 F Low: 48 F. #
• I joined twitter on 4 September 2007 - http://whendidyoujointwitter.com ? #
• News: Software engineer Shubhra Saxena tops UPSC exam #

Like the regular website, google is also using robots.txt. Interestingly Google is using it to block search bots to index some of their content. Below is a small list from their robots.txt file. Looks like they are blocking those pages which will generate dynamic content. In other words they have tried to blog those pages which will return search results. Not sure how effective it is.

Looking @ this robots.txt file you will find out lot of interesting information. Ofcourse you need some patients for that…

User-agent: *
Allow: /searchhistory/
Disallow: /search
Disallow: /groups
Disallow: /images
Disallow: /catalogs
Disallow: /catalogues
Disallow: /news
Disallow: /nwshp
Allow: /news?btcid=
Disallow: /news?btcid=*&
Allow: /news?btaid=
Disallow: /news?btaid=*&
Disallow: /setnewsprefs?
Disallow: /index.html?
Disallow: /?
Disallow: /addurl/image?
Disallow: /pagead/
Disallow: /relpage/

Wallpaper Link : http://www.flickr.com/photos/25305804@N08/2379631425/

EEEPC Linux Wallpaper, originally uploaded by tortugoc.