
百度蜘蛛ip:220.181.108.*段抓取了网站哪些东西?
网站索引量有所下降,今天分析了一下220.181.108.段百度蜘蛛ip,先来看下昨天网站日志的统计,经过整理之后的数据,需要长期跟踪才能有所发现:
220.181.165.198 | /UploadFiles/FCK/2016-01/6358767153000195311021046.png |
220.181.108.99 | POST /ajax.ashx action=hits&t=0.3141970573924482 |
220.181.108.97 | POST /ajax.ashx action=hits&t=0.3141970573924482 |
220.181.108.95 | /Skins/default/Style.css |
/Mobile/MArticles/ybynxppyls_page1.html | |
220.181.108.94 | /JS/Cls_jsPage.js |
220.181.108.92 | /Mobile/js/Nsw_mobile.js |
220.181.108.91 | /Mobile/sitemap.html |
220.181.108.89 | POST /ajax.ashx action=gethits |
/Mobile/MArticles/nzdrhzzclr_page1.html | |
220.181.108.87 | /ajax.ashx action=initcommonheader&t=0.4548729439266026 |
/JS/rollup.js | |
220.181.108.86 | /JS/Cls_jsPage.js |
220.181.108.85 | /xydt/jmylsybdlj_1.html |
220.181.108.84 | /JS/NSW_Details.js |
220.181.108.83 | /UploadFiles/Help/20140705101819_16392.png |
220.181.108.82 | /JS/rollup.min.js |
220.181.108.81 | /Css/fanhuidibu.css |
/ | |
220.181.108.80 | /Mobile/Css/common.css |
/Mobile/css/skins.css | |
/Mobile/js/Nsw_mobile.js | |
/gsdt/xtrndnghzm_1.html | |
/xydt/null | |
/Css/fanhuidibu.css | |
220.181.108.78 | /ajax.ashx action=initcommonheader&t=0.4332224077079445 |
220.181.108.75 | /Mobile/css/skins.css |
220.181.108.187 | /ykxw-43.html |
POST /Mobile/MAjax.ashx action=GetCommentById&t=0.22085682302713394 | |
/Skins/default/resetcommon.css | |
220.181.108.186 | /Mobile/Css/news.css |
220.181.108.184 | /Skins/default/Style.css |
220.181.108.183 | /Skins/default/Style.css |
220.181.108.182 | /ajax.ashx action=addhistory&t=0.09944928390905261&oid=319&mark=news |
220.181.108.180 | /gsdt/hwtyxqxzfc_1.html |
/JS/rollup.js | |
220.181.108.179 | /Skins/default/resetcommon.css |
220.181.108.178 | POST /ajax.ashx action=gethistory&t=0.26728004962205887 |
220.181.108.177 | /ajax.ashx action=initcommonheader&t=0.6086551186162978 |
/ykxw.html | |
220.181.108.176 | /ykxw-65.html |
220.181.108.163 | /Mobile/MArticles/sdjnykjtdy_1_page1.html |
/news/ | |
/UploadFiles/FCK/2014-08/20140820144635_59546.jpg | |
220.181.108.162 | /UploadFiles/Others/20140625154731_40967.jpg |
/ryzz/ylssdshbxy.html | |
/mbdg1/ylssrdgyyz.html | |
220.181.108.161 | /Mobile/MArticles/ptryybdtds_1_page1.html |
220.181.108.159 | /Mobile/MArticles/dzyjgsybsc_page1.html |
/ | |
220.181.108.158 | /Mobile/MProducts/ylshzmwr_page1.html |
220.181.108.157 | /Mobile/MArticles/zmdlybrhlx_1_page1.html |
220.181.108.156 | /gsdt/sczybdppdl_1.html |
/JS/MobileRewrite.js | |
220.181.108.155 | /gsdt/sczybdppdl_1.html |
/JS/MobileRewrite.js | |
220.181.108.154 | /tsgd/ylsmghd.html |
220.181.108.152 | /Article/qwjnynxybp_1.html |
/gsdt/ylsppybscc_1.html | |
/ajax.ashx action=imstate&t=0.6760054039768875 | |
220.181.108.151 | /Css/fanhuidibu.css |
220.181.108.150 | /JS/MobileRewrite.js |
/Mobile/MArticles/qyybtgykyl_1_page1.html | |
/gsdt/lrybxjshhb_1.html | |
/ajax.ashx action=gethistory&t=0.08731050626374781 | |
/ajax.ashx action=getnewproduct&t=0.04968832200393081 | |
220.181.108.149 | POST /ajax.ashx action=gethits |
/xydt-4.html | |
220.181.108.147 | POST /ajax.ashx action=gethits |
/gsdt/gsybyssybd_1.html | |
220.181.108.146 | POST /ajax.ashx action=hits&t=0.7423655034508556 |
POST /ajax.ashx action=getnewproduct&t=0.15561956027522683 | |
GET /Mobile/css/skins.css | |
/ | |
220.181.108.145 | /Mobile/Css/common.css |
/Skins/default/resetcommon.css | |
/ajax.ashx action=gethits | |
220.181.108.144 | / |
/Mobile/MArticles/ybdzfdqxrx_1_page1.html | |
220.181.108.142 | /Skins/Default/Img/Index/l2.jpg |
/Mobile/MArticles/zgppybscsj_1_page1.html | |
POST /ajax.ashx action=getnewproduct&t=0.8020989315118641 | |
/xydt/jmylsybdlj_1.html | |
/gsdt/zqppybylsg_1.html | |
/xydt/jmylsybdlj_1.html | |
/ssyb/xpspajmgyb.html | |
220.181.108.141 | POST /ajax.ashx action=gethistory&t=0.518056734232232 |
/ | |
/Skins/default/resetcommon.css | |
220.181.108.140 | POST /Mobile/MAjax.ashx action=GetCommentById&t=0.5390694083180279 |
/xydt/null | |
/Mobile/MAjax.ashx action=GetCommentById&t=0.12639937829226255 | |
220.181.108.139 | /xydt-32.html |
/Mobile/UploadFiles/FCK/2015-01/6355734103915136721394679.jpg_280.jpg | |
/ajax.ashx action=imstate&t=0.649451352423057 | |
POST /ajax.ashx action=initcommonheaderkeywords&t=0.8084878413937986 | |
/UploadFiles/News/20140710113732_31822.jpg | |
220.181.108.121 | /JS/NSW_Details.js |
/gsdt/zqppybylsg_1.html | |
220.181.108.120 | /ajax.ashx action=imstate&t=0.3732748886104673 |
220.181.108.119 | /Mobile/css/skins.css |
/xydt/szbszyhfxy_1.html | |
220.181.108.118 | /Article/jnqczmxzyl_1.html |
220.181.108.117 | /ajax.ashx action=imstate&t=0.1573430134449154 |
/JS/MobileRewrite.js | |
/xydt-27.html | |
220.181.108.116 | POST /ajax.ashx action=getlastarticle |
/xydt/jmylsybdlj_1.html | |
GET /JS/rollup.js | |
/Mobile/MArticles/yuebingbaocun_1_page1.html | |
220.181.108.115 | /ykxw-63.html |
/JS/NSW_Details.js | |
/ykxw-40.html | |
220.181.108.114 | /JS/Cls_jsPage.js |
POST /Mobile/MAjax.ashx action=GetCommentById&t=0.3089329316280782 | |
220.181.108.113 | /Css/fanhuidibu.css |
/Mobile/MArticles/sdlybptryy_1_page1.html | |
220.181.108.112 | /Mobile/MArticles/gzwytgdhyb_page1.html |
POST /ajax.ashx action=getlastarticle | |
220.181.108.111 | /Mobile/MArticles/ybsccjwmwm_1_page1.html |
/Css/fanhuidibu.css | |
220.181.108.110 | /null |
220.181.108.108 | /Mobile/Css/news.css |
/ | |
220.181.108.107 | POST /ajax.ashx action=initcommonheaderkeywords&t=0.6588882349897176 |
/Mobile/MArticles/sdlzhspyky_page1.html | |
/JS/rollup.min.js | |
220.181.108.105 | /ykxw-65.html |
/Mobile/Css/common.css | |
220.181.108.104 | /JS/rollup.js |
OPTIONS /ajax.ashx action=getlastarticle | |
/JS/NSW_JCIA.js | |
220.181.108.103 | /Mobile/Css/news.css |
220.181.108.102 | /Mobile/UploadFiles/FCK/2014-11/6355043751665625006263487.png_280.jpg |
/JS/rollup.min.js | |
220.181.108.101 | /Mobile/MArticles/ngpzdyxtyz_1_page1.html |
220.181.108.100 | /Mobile/Css/news.css |
/gsdt/zgybsjppyb_1.html |
以上就是220.181.108段的百度蜘蛛,网站日志分析使用的爱站工具包,不知道有哪些是伪蜘蛛,这一问题未曾一一验证,看客您请注意。下面问题来了:
1、哪些ip抓取了首页?
220.181.108.108
220.181.108.141
220.181.108.146
220.181.108.159
220.181.108.81
2、哪些ip抓取了PC内页?
220.181.108.100
220.181.108.115
220.181.108.116
220.181.108.117
220.181.108.121
220.181.108.139
220.181.108.142
220.181.108.147
220.181.108.149
220.181.108.150
220.181.108.152
220.181.108.154
220.181.108.155
220.181.108.156
220.181.108.162
220.181.108.176
220.181.108.177
220.181.108.180
220.181.108.187
220.181.108.80
220.181.108.85
3、哪些ip抓取了移动内页?
220.181.108.101
220.181.108.107
220.181.108.111
220.181.108.112
220.181.108.113
220.181.108.116
220.181.108.118
220.181.108.142
220.181.108.144
220.181.108.150
220.181.108.157
220.181.108.158
220.181.108.159
220.181.108.161
220.181.108.163
220.181.108.89
220.181.108.91
220.181.108.95
4、哪些ip既抓取PC页面又抓取移动页面?
220.181.108.101
220.181.108.116
220.181.108.142
5、哪些ip抓取了刚更新的文章?
昨天刚更新的文章gsdt/zsybzfd3dz_1.html,220.181.108段的没有进行抓取。123.段的ip抓取了,已经被收录。
小结:看到220段的蜘蛛,抓取效率也是非常低,抓取了很多没用的东西,还有一些图片。
明天分析123.125.71段的蜘蛛ip,持续更新中...
设计流 » 百度蜘蛛ip:220.181.108.*段抓取了网站哪些东西?