t99联盟
最新资源站
最大资源网
todyas广告联盟
聚合资源
设计流

百度蜘蛛ip:123.125.71.*蜘蛛抓取情况

作者: 设计流 发布时间: 2020-05-3 59 人阅读

网站索引量有所下降,今天分析了一下220.181.108.段百度蜘蛛ip,先来看下昨天网站日志的统计,经过整理之后的数据,需要长期跟踪才能有所发现:

220.181.165.198 /UploadFiles/FCK/2016-01/6358767153000195311021046.png
220.181.108.99 POST /ajax.ashx action=hits&t=0.3141970573924482
220.181.108.97 POST /ajax.ashx action=hits&t=0.3141970573924482
220.181.108.95 /Skins/default/Style.css
/Mobile/MArticles/ybynxppyls_page1.html
220.181.108.94 /JS/Cls_jsPage.js
220.181.108.92 /Mobile/js/Nsw_mobile.js
220.181.108.91 /Mobile/sitemap.html
220.181.108.89 POST /ajax.ashx action=gethits
/Mobile/MArticles/nzdrhzzclr_page1.html
220.181.108.87 /ajax.ashx action=initcommonheader&t=0.4548729439266026
/JS/rollup.js
220.181.108.86 /JS/Cls_jsPage.js
220.181.108.85 /xydt/jmylsybdlj_1.html
220.181.108.84 /JS/NSW_Details.js
220.181.108.83 /UploadFiles/Help/20140705101819_16392.png
220.181.108.82 /JS/rollup.min.js
220.181.108.81 /Css/fanhuidibu.css
/
220.181.108.80 /Mobile/Css/common.css
/Mobile/css/skins.css
/Mobile/js/Nsw_mobile.js
/gsdt/xtrndnghzm_1.html
/xydt/null
/Css/fanhuidibu.css
220.181.108.78 /ajax.ashx action=initcommonheader&t=0.4332224077079445
220.181.108.75 /Mobile/css/skins.css
220.181.108.187 /ykxw-43.html
POST /Mobile/MAjax.ashx action=GetCommentById&t=0.22085682302713394
/Skins/default/resetcommon.css
220.181.108.186 /Mobile/Css/news.css
220.181.108.184 /Skins/default/Style.css
220.181.108.183 /Skins/default/Style.css
220.181.108.182 /ajax.ashx action=addhistory&t=0.09944928390905261&oid=319&mark=news
220.181.108.180 /gsdt/hwtyxqxzfc_1.html
/JS/rollup.js
220.181.108.179 /Skins/default/resetcommon.css
220.181.108.178 POST /ajax.ashx action=gethistory&t=0.26728004962205887
220.181.108.177 /ajax.ashx action=initcommonheader&t=0.6086551186162978
/ykxw.html
220.181.108.176 /ykxw-65.html
220.181.108.163 /Mobile/MArticles/sdjnykjtdy_1_page1.html
/news/
/UploadFiles/FCK/2014-08/20140820144635_59546.jpg
220.181.108.162 /UploadFiles/Others/20140625154731_40967.jpg
/ryzz/ylssdshbxy.html
/mbdg1/ylssrdgyyz.html
220.181.108.161 /Mobile/MArticles/ptryybdtds_1_page1.html
220.181.108.159 /Mobile/MArticles/dzyjgsybsc_page1.html
/
220.181.108.158 /Mobile/MProducts/ylshzmwr_page1.html
220.181.108.157 /Mobile/MArticles/zmdlybrhlx_1_page1.html
220.181.108.156 /gsdt/sczybdppdl_1.html
/JS/MobileRewrite.js
220.181.108.155 /gsdt/sczybdppdl_1.html
/JS/MobileRewrite.js
220.181.108.154 /tsgd/ylsmghd.html
220.181.108.152 /Article/qwjnynxybp_1.html
/gsdt/ylsppybscc_1.html
/ajax.ashx action=imstate&t=0.6760054039768875
220.181.108.151 /Css/fanhuidibu.css
220.181.108.150 /JS/MobileRewrite.js
/Mobile/MArticles/qyybtgykyl_1_page1.html
/gsdt/lrybxjshhb_1.html
/ajax.ashx action=gethistory&t=0.08731050626374781
/ajax.ashx action=getnewproduct&t=0.04968832200393081
220.181.108.149 POST /ajax.ashx action=gethits
/xydt-4.html
220.181.108.147 POST /ajax.ashx action=gethits
/gsdt/gsybyssybd_1.html
220.181.108.146 POST /ajax.ashx action=hits&t=0.7423655034508556
POST /ajax.ashx action=getnewproduct&t=0.15561956027522683
GET /Mobile/css/skins.css
/
220.181.108.145 /Mobile/Css/common.css
/Skins/default/resetcommon.css
/ajax.ashx action=gethits
220.181.108.144  /
/Mobile/MArticles/ybdzfdqxrx_1_page1.html
220.181.108.142 /Skins/Default/Img/Index/l2.jpg
/Mobile/MArticles/zgppybscsj_1_page1.html
POST /ajax.ashx action=getnewproduct&t=0.8020989315118641
/xydt/jmylsybdlj_1.html
/gsdt/zqppybylsg_1.html
/xydt/jmylsybdlj_1.html
/ssyb/xpspajmgyb.html
220.181.108.141 POST /ajax.ashx action=gethistory&t=0.518056734232232
/
/Skins/default/resetcommon.css
220.181.108.140 POST /Mobile/MAjax.ashx action=GetCommentById&t=0.5390694083180279
/xydt/null
/Mobile/MAjax.ashx action=GetCommentById&t=0.12639937829226255
220.181.108.139 /xydt-32.html
/Mobile/UploadFiles/FCK/2015-01/6355734103915136721394679.jpg_280.jpg
/ajax.ashx action=imstate&t=0.649451352423057
POST /ajax.ashx action=initcommonheaderkeywords&t=0.8084878413937986
/UploadFiles/News/20140710113732_31822.jpg
220.181.108.121 /JS/NSW_Details.js
/gsdt/zqppybylsg_1.html
220.181.108.120 /ajax.ashx action=imstate&t=0.3732748886104673
220.181.108.119 /Mobile/css/skins.css
/xydt/szbszyhfxy_1.html
220.181.108.118 /Article/jnqczmxzyl_1.html
220.181.108.117 /ajax.ashx action=imstate&t=0.1573430134449154
/JS/MobileRewrite.js
/xydt-27.html
220.181.108.116 POST /ajax.ashx action=getlastarticle
/xydt/jmylsybdlj_1.html
GET /JS/rollup.js
/Mobile/MArticles/yuebingbaocun_1_page1.html
220.181.108.115 /ykxw-63.html
/JS/NSW_Details.js
/ykxw-40.html
220.181.108.114 /JS/Cls_jsPage.js
POST /Mobile/MAjax.ashx action=GetCommentById&t=0.3089329316280782
220.181.108.113 /Css/fanhuidibu.css
/Mobile/MArticles/sdlybptryy_1_page1.html
220.181.108.112 /Mobile/MArticles/gzwytgdhyb_page1.html
POST /ajax.ashx action=getlastarticle
220.181.108.111 /Mobile/MArticles/ybsccjwmwm_1_page1.html
/Css/fanhuidibu.css
220.181.108.110 /null
220.181.108.108 /Mobile/Css/news.css
 /
220.181.108.107 POST /ajax.ashx action=initcommonheaderkeywords&t=0.6588882349897176
/Mobile/MArticles/sdlzhspyky_page1.html
/JS/rollup.min.js
220.181.108.105 /ykxw-65.html
/Mobile/Css/common.css
220.181.108.104  /JS/rollup.js
OPTIONS /ajax.ashx action=getlastarticle
/JS/NSW_JCIA.js
220.181.108.103 /Mobile/Css/news.css
220.181.108.102 /Mobile/UploadFiles/FCK/2014-11/6355043751665625006263487.png_280.jpg
/JS/rollup.min.js
220.181.108.101 /Mobile/MArticles/ngpzdyxtyz_1_page1.html
220.181.108.100 /Mobile/Css/news.css
/gsdt/zgybsjppyb_1.html

以上就是220.181.108段的百度蜘蛛,网站日志分析使用的爱站工具包,不知道有哪些是伪蜘蛛,这一问题未曾一一验证,看客您请注意。下面问题来了:

1、哪些ip抓取了首页?

220.181.108.108

220.181.108.141

220.181.108.146

220.181.108.159

220.181.108.81

2、哪些ip抓取了PC内页?

220.181.108.100

220.181.108.115

220.181.108.116

220.181.108.117

220.181.108.121

220.181.108.139

220.181.108.142

220.181.108.147

220.181.108.149

220.181.108.150

220.181.108.152

220.181.108.154

220.181.108.155

220.181.108.156

220.181.108.162

220.181.108.176

220.181.108.177

220.181.108.180

220.181.108.187

220.181.108.80

220.181.108.85

3、哪些ip抓取了移动内页?

220.181.108.101

220.181.108.107

220.181.108.111

220.181.108.112

220.181.108.113

220.181.108.116

220.181.108.118

220.181.108.142

220.181.108.144

220.181.108.150

220.181.108.157

220.181.108.158

220.181.108.159

220.181.108.161

220.181.108.163

220.181.108.89

220.181.108.91

220.181.108.95

4、哪些ip既抓取PC页面又抓取移动页面?

220.181.108.101

220.181.108.116

220.181.108.142

5、哪些ip抓取了刚更新的文章?

昨天刚更新的文章gsdt/zsybzfd3dz_1.html,220.181.108段的没有进行抓取。123.段的ip抓取了,已经被收录。

小结:看到220段的蜘蛛,抓取效率也是非常低,抓取了很多没用的东西,还有一些图片。

明天分析123.125.71段的蜘蛛ip,持续更新中...

设计流资源网 , 版权所有丨本站资源仅限于学习研究,严禁从事商业或者非法活动!丨本网站采用BY-NC-SA协议进行授权 本站资源来自各大VIP网站及一些特殊渠道,如果在其他资源站看到有想要的资源,可以咨询站长能否转载。
设计流 » 百度蜘蛛ip:123.125.71.*蜘蛛抓取情况

发表评论