Googlebot?

Post by **Paco103** » February 13, 2005, 11:52 pm

Ok, anyone that has noticed the 1 Guest that always seems to be on bearnotes for the last few days, meet our newest member "Googlebot"

He has yet to register, but as long as he spends lingering around, he must be a faithful member. What I don't get is he's been there for the past 3 or 4 days, with a minimum of three open connections browsing the board. With all this browsing, he has pulled less than 300K, while MSNbot indexing the page I didn't even notice connecting, pulled over 26MB. Now if MSN is pulling that much data to create it's search indexes, why is it that Google creates such a much more effective search engine in many opinions with it's minimal usage? If you read Google's Googlebot policy, they state that they do a lot of things to minimize bandwidth, but they still get all they need. Guess the old "Slow and steady" story proves true!

rchif0 · Post by **rchif0** » February 14, 2005, 1:51 am

Maybe MSNBot indexes specific images and perhaps caches them?