03) Specific Crawler Report - Agent Filter


Specific Crawler Report

Report created on 4/14/97
First request found: Friday, January 24, 1997 09:57 PM
Last request found: Thursday, April 10, 1997 04:34 PM

Crawler Agent Name
Browser Total Requests Visits
Slurp/2.0 (slurp@inktomi.com, http://www.inktomi.com/slurp.html) 165 62
Slurp/2.0 (slurp@inktomi.com; http://www.inktomi.com/slurp.html) 77 16

Crawler Host Names
Site IP Total Requests Visits
j10.inktomi.com 50 26
j11.inktomi.com 38 20
j17.inktomi.com 76 16
crawler1.anzwers.ozemail.net 12 5
j16.inktomi.com 54 5
i0.inktomi.com 4 2
ozcrawl1.inktomi.com 4 2
203.138.73.181 2 1
203.138.73.183 2 1

Total Requests By Day
Day Total Requests
1/24/97 4
1/25/97 4
1/31/97 8
2/11/97 12
2/12/97 14
2/13/97 6
2/14/97 2
2/15/97 10
2/16/97 16
2/17/97 6
2/18/97 2
2/19/97 6
2/26/97 8
2/27/97 2
2/28/97 54
3/2/97 11
3/5/97 1
3/6/97 2
3/7/97 6
3/29/97 4
4/3/97 2
4/4/97 11
4/7/97 4
4/10/97 47

Pages Requested By Day
Day Object URL Total Requests
1/24/97 / 2
/robots.txt 2
1/25/97 / 2
/robots.txt 2
1/31/97 / 4
/robots.txt 4
2/11/97 / 6
/robots.txt 6
2/12/97 / 7
/robots.txt 7
2/13/97 / 3
/robots.txt 3
2/14/97 / 1
/robots.txt 1
2/15/97 / 5
/robots.txt 5
2/16/97 / 8
/robots.txt 8
2/17/97 / 3
/robots.txt 3
2/18/97 / 1
/robots.txt 1
2/19/97 / 3
/robots.txt 3
2/26/97 / 1
/webmasters/work.htm 1
/access/ 1
/webmasters/others.htm 1
/webmasters/yahoo.htm 1
/webmasters/study.htm 1
/webmasters/index.html 1
/study.htm 1
2/27/97 /robots.txt 2
2/28/97 /webmasters/ 1
/webmasters/major.htm 1
/webmasters/chart.htm 1
/webmasters/meta.htm 1
/webmasters/sitemap.htm 1
/webmasters/compare.htm 1
/webmasters/resources.htm 1
/webmasters/tips.htm 1
/ 2
/webmasters/survey.htm 1
/webmasters/ads.htm 1
/webmasters/work.htm 1
/webmasters/altavista.htm 1
/webmasters/lycos.htm 1
/webmasters/intro.htm 1
/webmasters/excite.htm 1
/webmasters/infoseek.htm 1
/webmasters/hotbot.htm 1
/webmasters/webcrawler.htm 1
/webmasters/whatsnew.htm 1
/webmasters/support.htm 1
/webmasters/awards.htm 1
/webmasters/details.htm 1
/webmasters 1
/webmasters/honor.htm 1
/robots.txt 2
/webmasters/list.htm 1
/services/ 1
/webmasters/index.html 1
/webmasters/faq.htm 1
/webmasters/rawdata.htm 1
/forms/feedform.htm 1
/classroom/multi.htm 1
/services/tuneup.htm 1
/access/numbers.htm 1
/access/report.htm 1
/access/whatsnew.htm 1
/access/reports/ 1
/access/reports/oct95/ 1
/access/reports/nov95/ 1
/access/reports/dec95/ 1
/access/reports/jan96/ 1
/access/about.htm 1
/access/subscribers.htm 1
/access/comment.htm 1
/access/comments.htm 1
/classroom/ 1
/access/links.htm 1
/access/reports/feb96/ 1
/access/reports/mar96/ 1
/access/uses.htm 1
/access/delivery.htm 1
3/2/97 /webmasters/0596.htm 1
/webmasters/checkurl.htm 1
/webmasters/popularity.htm 1
/webmasters/general.htm 1
/webmasters/1296.htm 1
/webmasters/0796.htm 1
/steve/ 1
/classroom/stats.htm 1
/webmasters/0396.htm 1
/webmasters/0996.htm 1
/classroom/demographics.htm 1
3/5/97 /webmasters/frames.htm 1
3/6/97 /robots.txt 2
3/7/97 /webmasters/. 1
/webmasters/subscribe.htm 1
/webmasters/feedback.htm 1
/webmasters/services.htm 1
/forms/request.htm 1
/webmasters/permission.htm 1
3/29/97 / 2
/robots.txt 2
4/3/97 / 1
/robots.txt 1
4/4/97 / 3
/webmasters/work.htm 1
/access/ 1
/webmasters/others.htm 1
/webmasters/yahoo.htm 1
/webmasters/study.htm 1
/robots.txt 2
/webmasters/index.html 1
4/7/97 / 2
/robots.txt 2
4/10/97 /webmasters/ 1
/webmasters/major.htm 1
/webmasters/chart.htm 1
/webmasters/meta.htm 1
/webmasters/sitemap.htm 1
/webmasters/compare.htm 1
/webmasters/resources.htm 1
/webmasters/tips.htm 1
/webmasters/survey.htm 1
/webmasters/ads.htm 1
/webmasters/altavista.htm 1
/webmasters/lycos.htm 1
/webmasters/intro.htm 1
/webmasters/excite.htm 1
/webmasters/infoseek.htm 1
/webmasters/hotbot.htm 1
/webmasters/webcrawler.htm 1
/webmasters/whatsnew.htm 1
/webmasters/support.htm 1
/webmasters/awards.htm 1
/webmasters/details.htm 1
/webmasters/honor.htm 1
/webmasters/list.htm 1
/services/ 1
/webmasters/faq.htm 1
/webmasters/rawdata.htm 1
/forms/feedform.htm 1
/classroom/multi.htm 1
/services/tuneup.htm 1
/access/numbers.htm 1
/access/report.htm 1
/access/whatsnew.htm 1
/access/reports/ 1
/access/reports/oct95/ 1
/access/reports/nov95/ 1
/access/reports/dec95/ 1
/access/reports/jan96/ 1
/access/about.htm 1
/access/subscribers.htm 1
/access/comment.htm 1
/access/comments.htm 1
/classroom/ 1
/access/links.htm 1
/access/reports/feb96/ 1
/access/reports/mar96/ 1
/access/uses.htm 1
/access/delivery.htm 1


Report generated by Marketwave Hit List. http://www.marketwave.com/ Phone: +1 206 682 6801

About the author

Danny Sullivan was the founder and editor of Search Engine Watch from June 1997 until November 2006.

To contact current Search Engine Watch editorial staff, please click here.