Bing works out a ‘New & Enhanced Bot’

by admin on Jul.18, 2009, under News, Updates

bing botAlthough Bing had a decent and abuzzed launch but Microsoft isn’t getting carried away with this moment of success, simply because the dynamics can swing either way any moment. Bing leapfrogged Yahoo! twice so far but consistent win over Yahoo! in search battle is still to be achieved.

And now, it appears that team at Bing is focussing on a more critical factor that can influence the end users to actually make a Switch(from Google, of course): Search Engine Crawler efficiency using new Bing bot

The problem

Generally, if anyone who owns a web property(a website or a blog) on internet would need to judge how the abuzzed search engine(bing) stands in front of the De facto search destination(Google) then the first few searches are most probable to be ‘Ego‘ searches.

And if, the user realises that his website or Facebook/Twitter profile is making into the top ten search results then he may rate the search engine, much higher than normal and may also suggest his family and friends to switch to that search engine.

Now, as the majority of the websites or blogs aren’t as big and frequent as NYTimes or Wired, it’s probably one of the the toughest challenges for any search engine to keep everyone happy with the crawl rate and faster indexing of hundreds of millions of small and occasional-to-rarely updated websites/blogs, together with maintaining the Search relevance.

And i must admit that Bing, although step ahead of Google in many dimensions, is still a poor performer than Google when it comes to crawling and appreciating fresh and relevant content in its search results.

The latest Bing update addresses the above issue as they have finally worked out a new web crawler for Bing (or Bing bot).

The new Bing bot user agent string will be msnbot/2.0b, compared to the old msn crawler, which is  msnbot/1.1. Bing has decided not to change the name of the Bing bot (for no specific reasons). The crawler work is on priority for Bing now as it’s a critical factor for Bing and still needs a lot of work before standing competitive in front of Google in this regard.

Although Bing has a new crawler now but the old crawler(msnbot/1.1) will continue to persist.

One reason why we literally hate using Yahoo! search is because of the Stale search results it presents. We would be pleasantly surprised to see Bing bots indexing websites and blogs, faster than Google’s. (Are you hearing Bing bots?)

Here’s what Techcrunch has to say about this !

:,

5 Comments for this entry

  • EricT

    Owners of small sites have done really well with google and yahoo! Words like “sarmouni” and “Idries Shah successor” bring my site up in #1 place, but hardly get a look in at bing.

    Bing demands quality backlinks which aren’t easy for small sites to obtain. So when I hear that bing will soon be powering yahoo!search, it makes me cringe.

  • melatoninlady

    Microsoft Bing would be the closet competitor of Google. but i still use Google because it shows more relevant results on the serp.

  • George

    i have been evaluating the search results of Microsoft Bing compared to Google and they are comparable. Bing gives almost the same relevant search results just like Google.

  • Acneboy

    Bing search engine gives almost the same search results as Google. Looks like Google will now have a tough competition when it comes to search engine technology.

  • Amanda

    Nice post on web crawlers, simple and too the point :) , I use python for simple html web crawlers, but for larger projects like documents, files, or the web i tried http://www.extractingdata.com/web%20crawler.htm which worked great, they build quick custom screen scrapers, web crawlers, and data parsing programs

1 Trackback or Pingback for this entry

  • Submit blog to bing | Bingsters

    [...] but many folks are still not bothered to submit their site to Bing. We recently reported about the new bot for bing but we can still see many people ignoring an opportunity of getting plenty of traffic from a new [...]

Leave a Reply