SEO News
author-default

03) Specific Crawler Report - Agent Filter

by ,  Comments

Specific Crawler Report
Report created on 4/14/97
First request found: Friday, January 24, 1997 09:57 PM
Last request found: Thursday, April 10, 1997 04:34 PM

Crawler Agent Name
Browser Total Requests Visits
Slurp/2.0 ([email protected], http://www.inktomi.com/slurp.html) 165 62
Slurp/2.0 ([email protected]; http://www.inktomi.com/slurp.html) 77 16

Crawler Host Names
Site IP Total Requests Visits
j10.inktomi.com 50 26
j11.inktomi.com 38 20
j17.inktomi.com 76 16
crawler1.anzwers.ozemail.net 12 5
j16.inktomi.com 54 5
i0.inktomi.com 4 2
ozcrawl1.inktomi.com 4 2
203.138.73.181 2 1
203.138.73.183 2 1

Total Requests By Day
Day Total Requests
1/24/97 4
1/25/97 4
1/31/97 8
2/11/97 12
2/12/97 14
2/13/97 6
2/14/97 2
2/15/97 10
2/16/97 16
2/17/97 6
2/18/97 2
2/19/97 6
2/26/97 8
2/27/97 2
2/28/97 54
3/2/97 11
3/5/97 1
3/6/97 2
3/7/97 6
3/29/97 4
4/3/97 2
4/4/97 11
4/7/97 4
4/10/97 47

Pages Requested By Day
Day Object URL Total Requests
1/24/97 / 2
/robots.txt 2
1/25/97 / 2
/robots.txt 2
1/31/97 / 4
/robots.txt 4
2/11/97 / 6
/robots.txt 6
2/12/97 / 7
/robots.txt 7
2/13/97 / 3
/robots.txt 3
2/14/97 / 1
/robots.txt 1
2/15/97 / 5
/robots.txt 5
2/16/97 / 8
/robots.txt 8
2/17/97 / 3
/robots.txt 3
2/18/97 / 1
/robots.txt 1
2/19/97 / 3
/robots.txt 3
2/26/97 / 1
/webmasters/work.htm 1
/access/ 1
/webmasters/others.htm 1
/webmasters/yahoo.htm 1
/webmasters/study.htm 1
/webmasters/index.html 1
/study.htm 1
2/27/97 /robots.txt 2
2/28/97 /webmasters/ 1
/webmasters/major.htm 1
/webmasters/chart.htm 1
/webmasters/meta.htm 1
/webmasters/sitemap.htm 1
/webmasters/compare.htm 1
/webmasters/resources.htm 1
/webmasters/tips.htm 1
/ 2
/webmasters/survey.htm 1
/webmasters/ads.htm 1
/webmasters/work.htm 1
/webmasters/altavista.htm 1
/webmasters/lycos.htm 1
/webmasters/intro.htm 1
/webmasters/excite.htm 1
/webmasters/infoseek.htm 1
/webmasters/hotbot.htm 1
/webmasters/webcrawler.htm 1
/webmasters/whatsnew.htm 1
/webmasters/support.htm 1
/webmasters/awards.htm 1
/webmasters/details.htm 1
/webmasters 1
/webmasters/honor.htm 1
/robots.txt 2
/webmasters/list.htm 1
/services/ 1
/webmasters/index.html 1
/webmasters/faq.htm 1
/webmasters/rawdata.htm 1
/forms/feedform.htm 1
/classroom/multi.htm 1
/services/tuneup.htm 1
/access/numbers.htm 1
/access/report.htm 1
/access/whatsnew.htm 1
/access/reports/ 1
/access/reports/oct95/ 1
/access/reports/nov95/ 1
/access/reports/dec95/ 1
/access/reports/jan96/ 1
/access/about.htm 1
/access/subscribers.htm 1
/access/comment.htm 1
/access/comments.htm 1
/classroom/ 1
/access/links.htm 1
/access/reports/feb96/ 1
/access/reports/mar96/ 1
/access/uses.htm 1
/access/delivery.htm 1
3/2/97 /webmasters/0596.htm 1
/webmasters/checkurl.htm 1
/webmasters/popularity.htm 1
/webmasters/general.htm 1
/webmasters/1296.htm 1
/webmasters/0796.htm 1
/steve/ 1
/classroom/stats.htm 1
/webmasters/0396.htm 1
/webmasters/0996.htm 1
/classroom/demographics.htm 1
3/5/97 /webmasters/frames.htm 1
3/6/97 /robots.txt 2
3/7/97 /webmasters/. 1
/webmasters/subscribe.htm 1
/webmasters/feedback.htm 1
/webmasters/services.htm 1
/forms/request.htm 1
/webmasters/permission.htm 1
3/29/97 / 2
/robots.txt 2
4/3/97 / 1
/robots.txt 1
4/4/97 / 3
/webmasters/work.htm 1
/access/ 1
/webmasters/others.htm 1
/webmasters/yahoo.htm 1
/webmasters/study.htm 1
/robots.txt 2
/webmasters/index.html 1
4/7/97 / 2
/robots.txt 2
4/10/97 /webmasters/ 1
/webmasters/major.htm 1
/webmasters/chart.htm 1
/webmasters/meta.htm 1
/webmasters/sitemap.htm 1
/webmasters/compare.htm 1
/webmasters/resources.htm 1
/webmasters/tips.htm 1
/webmasters/survey.htm 1
/webmasters/ads.htm 1
/webmasters/altavista.htm 1
/webmasters/lycos.htm 1
/webmasters/intro.htm 1
/webmasters/excite.htm 1
/webmasters/infoseek.htm 1
/webmasters/hotbot.htm 1
/webmasters/webcrawler.htm 1
/webmasters/whatsnew.htm 1
/webmasters/support.htm 1
/webmasters/awards.htm 1
/webmasters/details.htm 1
/webmasters/honor.htm 1
/webmasters/list.htm 1
/services/ 1
/webmasters/faq.htm 1
/webmasters/rawdata.htm 1
/forms/feedform.htm 1
/classroom/multi.htm 1
/services/tuneup.htm 1
/access/numbers.htm 1
/access/report.htm 1
/access/whatsnew.htm 1
/access/reports/ 1
/access/reports/oct95/ 1
/access/reports/nov95/ 1
/access/reports/dec95/ 1
/access/reports/jan96/ 1
/access/about.htm 1
/access/subscribers.htm 1
/access/comment.htm 1
/access/comments.htm 1
/classroom/ 1
/access/links.htm 1
/access/reports/feb96/ 1
/access/reports/mar96/ 1
/access/uses.htm 1
/access/delivery.htm 1

Report generated by Marketwave Hit List. http://www.marketwave.com/ Phone: +1 206 682 6801

ClickZ Academy e-Learning June Sale ClickZ Academy e-Learning June Sale JUNE SALE! Save 15%*
Save on all e-learning certification courses, including: SEO, Social Media, Online Marketing Foundation, Web Analytics and more. Enter CZAJU at checkout »
Offer expires June 30. *Discount not applicable on SES Online products.

Recommend this story

Commenting policy Add a Comment
 Comments
Tweets
Discussion Highlights