SEO News
Search

03) Specific Crawler Report - Agent Filter

author-default
by , Comments


Specific Crawler Report

Report created on 4/14/97
First request found: Friday, January 24, 1997 09:57 PM
Last request found: Thursday, April 10, 1997 04:34 PM

Crawler Agent Name
Browser Total Requests Visits
Slurp/2.0 ([email protected], http://www.inktomi.com/slurp.html) 165 62
Slurp/2.0 ([email protected]; http://www.inktomi.com/slurp.html) 77 16

Crawler Host Names
Site IP Total Requests Visits
j10.inktomi.com 50 26
j11.inktomi.com 38 20
j17.inktomi.com 76 16
crawler1.anzwers.ozemail.net 12 5
j16.inktomi.com 54 5
i0.inktomi.com 4 2
ozcrawl1.inktomi.com 4 2
203.138.73.181 2 1
203.138.73.183 2 1

Total Requests By Day
Day Total Requests
1/24/97 4
1/25/97 4
1/31/97 8
2/11/97 12
2/12/97 14
2/13/97 6
2/14/97 2
2/15/97 10
2/16/97 16
2/17/97 6
2/18/97 2
2/19/97 6
2/26/97 8
2/27/97 2
2/28/97 54
3/2/97 11
3/5/97 1
3/6/97 2
3/7/97 6
3/29/97 4
4/3/97 2
4/4/97 11
4/7/97 4
4/10/97 47

Pages Requested By Day
Day Object URL Total Requests
1/24/97 / 2
/robots.txt 2
1/25/97 / 2
/robots.txt 2
1/31/97 / 4
/robots.txt 4
2/11/97 / 6
/robots.txt 6
2/12/97 / 7
/robots.txt 7
2/13/97 / 3
/robots.txt 3
2/14/97 / 1
/robots.txt 1
2/15/97 / 5
/robots.txt 5
2/16/97 / 8
/robots.txt 8
2/17/97 / 3
/robots.txt 3
2/18/97 / 1
/robots.txt 1
2/19/97 / 3
/robots.txt 3
2/26/97 / 1
/webmasters/work.htm 1
/access/ 1
/webmasters/others.htm 1
/webmasters/yahoo.htm 1
/webmasters/study.htm 1
/webmasters/index.html 1
/study.htm 1
2/27/97 /robots.txt 2
2/28/97 /webmasters/ 1
/webmasters/major.htm 1
/webmasters/chart.htm 1
/webmasters/meta.htm 1
/webmasters/sitemap.htm 1
/webmasters/compare.htm 1
/webmasters/resources.htm 1
/webmasters/tips.htm 1
/ 2
/webmasters/survey.htm 1
/webmasters/ads.htm 1
/webmasters/work.htm 1
/webmasters/altavista.htm 1
/webmasters/lycos.htm 1
/webmasters/intro.htm 1
/webmasters/excite.htm 1
/webmasters/infoseek.htm 1
/webmasters/hotbot.htm 1
/webmasters/webcrawler.htm 1
/webmasters/whatsnew.htm 1
/webmasters/support.htm 1
/webmasters/awards.htm 1
/webmasters/details.htm 1
/webmasters 1
/webmasters/honor.htm 1
/robots.txt 2
/webmasters/list.htm 1
/services/ 1
/webmasters/index.html 1
/webmasters/faq.htm 1
/webmasters/rawdata.htm 1
/forms/feedform.htm 1
/classroom/multi.htm 1
/services/tuneup.htm 1
/access/numbers.htm 1
/access/report.htm 1
/access/whatsnew.htm 1
/access/reports/ 1
/access/reports/oct95/ 1
/access/reports/nov95/ 1
/access/reports/dec95/ 1
/access/reports/jan96/ 1
/access/about.htm 1
/access/subscribers.htm 1
/access/comment.htm 1
/access/comments.htm 1
/classroom/ 1
/access/links.htm 1
/access/reports/feb96/ 1
/access/reports/mar96/ 1
/access/uses.htm 1
/access/delivery.htm 1
3/2/97 /webmasters/0596.htm 1
/webmasters/checkurl.htm 1
/webmasters/popularity.htm 1
/webmasters/general.htm 1
/webmasters/1296.htm 1
/webmasters/0796.htm 1
/steve/ 1
/classroom/stats.htm 1
/webmasters/0396.htm 1
/webmasters/0996.htm 1
/classroom/demographics.htm 1
3/5/97 /webmasters/frames.htm 1
3/6/97 /robots.txt 2
3/7/97 /webmasters/. 1
/webmasters/subscribe.htm 1
/webmasters/feedback.htm 1
/webmasters/services.htm 1
/forms/request.htm 1
/webmasters/permission.htm 1
3/29/97 / 2
/robots.txt 2
4/3/97 / 1
/robots.txt 1
4/4/97 / 3
/webmasters/work.htm 1
/access/ 1
/webmasters/others.htm 1
/webmasters/yahoo.htm 1
/webmasters/study.htm 1
/robots.txt 2
/webmasters/index.html 1
4/7/97 / 2
/robots.txt 2
4/10/97 /webmasters/ 1
/webmasters/major.htm 1
/webmasters/chart.htm 1
/webmasters/meta.htm 1
/webmasters/sitemap.htm 1
/webmasters/compare.htm 1
/webmasters/resources.htm 1
/webmasters/tips.htm 1
/webmasters/survey.htm 1
/webmasters/ads.htm 1
/webmasters/altavista.htm 1
/webmasters/lycos.htm 1
/webmasters/intro.htm 1
/webmasters/excite.htm 1
/webmasters/infoseek.htm 1
/webmasters/hotbot.htm 1
/webmasters/webcrawler.htm 1
/webmasters/whatsnew.htm 1
/webmasters/support.htm 1
/webmasters/awards.htm 1
/webmasters/details.htm 1
/webmasters/honor.htm 1
/webmasters/list.htm 1
/services/ 1
/webmasters/faq.htm 1
/webmasters/rawdata.htm 1
/forms/feedform.htm 1
/classroom/multi.htm 1
/services/tuneup.htm 1
/access/numbers.htm 1
/access/report.htm 1
/access/whatsnew.htm 1
/access/reports/ 1
/access/reports/oct95/ 1
/access/reports/nov95/ 1
/access/reports/dec95/ 1
/access/reports/jan96/ 1
/access/about.htm 1
/access/subscribers.htm 1
/access/comment.htm 1
/access/comments.htm 1
/classroom/ 1
/access/links.htm 1
/access/reports/feb96/ 1
/access/reports/mar96/ 1
/access/uses.htm 1
/access/delivery.htm 1


Report generated by Marketwave Hit List. http://www.marketwave.com/ Phone: +1 206 682 6801


The Original Search Marketing Event is Back!
SES AtlantaSES Denver (Oct 16) offers an intense day of learning all the critical aspects of search engine optimization (SEO) and paid search advertising (PPC). The mission of SES remains the same as it did from the start - to help you master being found on search engines. Early Bird rates available through Sept 12. Register today!

Recommend this story

comments powered by Disqus