自定义HTTP抓包和过滤 http抓包http过滤http类 解决方案 » 免费领取超大流量手机卡,每月29元包185G流量+100分钟通话, 中国电信官方发货 在window的命令行下,提交请求,是可以收到数据的......可以收到数据 $url = 'http://www.mmkao.com/Beautyleg/';print_r(get_headers($url));Array( [0] => HTTP/1.1 200 OK [1] => Connection: close [2] => Date: Wed, 05 Nov 2014 08:53:09 GMT [3] => Content-Length: 13889 [4] => Content-Type: text/html [5] => Content-Location: http://www.mmkao.com/Beautyleg/index.html [6] => Last-Modified: Wed, 05 Nov 2014 05:39:09 GMT [7] => Accept-Ranges: bytes [8] => ETag: "e8939ad2baf8cf1:693" [9] => Server: IIS [10] => X-Powered-By: WAF/2.0 [11] => Set-Cookie: safedog-flow-item=8471BA510DA33350ED344AC374D3044A; expires=Sat, 12-Dec-2150 10:26:25 GMT; domain=mmkao.com; path=/) GET /Beautyleg/ HTTP/1.1Host:www.mmkao.comConnection:keep-aliveAccept:text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8Accept-Language:zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3Accept-Encoding:gzip, deflateHTTP/1.1 200 OKDate: Wed, 05 Nov 2014 09:34:02 GMTContent-Length: 13889Content-Type: text/htmlContent-Location: http://www.mmkao.com/Beautyleg/index.htmlLast-Modified: Wed, 05 Nov 2014 05:39:09 GMTAccept-Ranges: bytesETag: "e8939ad2baf8cf1:693"Server: IISX-Powered-By: WAF/2.0Set-Cookie: safedog-flow-item=BFC86EA38C3E0337FB45DCE403130335; expires=Sat, 12-Dec-2150 11:07:18 GMT; domain=mmkao.com; path=/<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head><meta http-equiv="Content-Type" content="text/html; charset=gb2312" /><title>Beautyleg_咪咪图秀</title><meta name="keywords" content="Beautyleg"><meta name="description" content="Beautyleg"><style type="text/css">a { color: #993399; text-decoration:none; }body { margin:10px; color: #993399; text-align:center; font-size:12px; font-family:宋体; }div { margin:auto; }ul { margin:0px; padding:0px; }li {list-style:none;}img{ border:0px; vertical-align:middle; }.dh li{ float:left; width:108px; height:39px; line-height:39px; background-image:url(../Image2/list_bg.gif); background-repeat:no-repeat; background-position:106px 4px; }.dh a:hover { text-decoration:underline;}.dh a{ color:#ffffff; font-weight:bold; }.dh li.vis a{color:#FFFFFF; font-weight:bolder;}.lm { width:980px; }.lm .left { float:left; line-height:38px; font-size:14px; color:#CC0066; font-weight:bold; padding-left:40px;}.lm .right { float:right; line-height:38px; font-size:14px; color:#CC0066; font-weight:bold; padding-right:10px; }.lm .new li{ float:left; text-align:left; padding:7px; }.lm .new li span.l{ float:left;}.lm .new li span.r{ float:right; padding-left:5px; }.lm .list li{ width:215px; float:left; text-align:left; padding:7px; border-bottom:#ddd 1px dashed;}.lm .list li span.l1,.l2 { display:block; float:left; width:9px; height:9px; text-align:center; color:#fff;}.lm .list li span.l1{ background: url(Image2/icon1.gif);}.lm .list li span.l2{ background: url(Image/num.gif);}.lm .list li span.r{ float:left; padding-left:5px; }.lm .photo { padding:8px; margin:0px; width:964px; height:190px; }.lm .photo li{ float:left; width:160px; line-height:30px; border-bottom:#ddd 1px dashed; overflow:hidden; text-overflow:ellipsis;white-space:nowrap; }.lm .photo img{ width:120px; height:160px; border:#ddd 1px solid;}.lm .link { width:970px; margin-left:10px;}.lm .link li { float:left; width:240px; line-height:30px; text-align:left; border-bottom:#ddd 1px dashed;overflow:hidden; text-overflow:ellipsis;white-space:nowrap;}</style></head><body>............................ <ul class="page" style="width:980px; padding-bottom:8px;"> 共 1035 组,每页 30 组,当前 1 / 35 页。<a href="./">首页</a> <a href="./">上一页</a> <a href="2.html">下一页</a> <a href="35.html">尾页</a>。 转到第 <select onchange="location.href = this.value"> <script language="javascript" type="text/javascript"> var Str = ""; for (i = 1; i <= 35 </ul> </div> <div style="height:10px; font-size:1px; background-image:url(../Image2/2.gif); background-repeat:no-repeat; background-position:0px -38px;"></div></div><div style="width:980px;" > <ul style="border:1px #CCCCCC solid; text-align:center; padding:5px;"> <script src='/g.js' language='JavaScript' charset='gb2312'></script> </ul></div><div style="width:980px;" > <ul style="border:1px #CCCCCC solid; text-align:center; padding:5px;"> <script src='/d.js' language='JavaScript' charset='gb2312'></script> </ul></div><div class="lm" style="background: url(../Image2/bottom.gif); background-repeat:no-repeat; background-position:0px 0px; height:100px; margin-top:8px; line-height:100px;"> <ul> <li><a href="http://www.mmkao.com/">咪咪图秀</a> www.mmkao.com <script src='/tj.js' language='JavaScript' charset='gb2312'></script></li> </ul></div></body></html>这个截图是我通过Httpwrap发送的请求头的信息,复制到telnent上也能完整获取网页 这个问题遗留了好久,今天花时间解决了,而且可以整站采集,,,,,http://blog.csdn.net/free_program_1314/article/details/41780835 现在网上到处使用的“@”功能是如何实现的? 如何讓我學好php PHP使用SNMP相关函数的问题 PHP怎样快速入门(基础足够扎实) php服务端接收文件的问题 求教一个正则表达式的问题 用户名和密码为何要同时保存在cookies中,只保存用户名不行吗 关于php类的问题!!help! 小妹?^_^?捉虫:为什么php的换行符号“\n”在heml页面中不好用,而在邮件中好用啊! apache如何设置浏览更目录文件夹 php将数据库查询结果转换为json格式 请问熟悉帝国CMS的朋友为何文件传不到阿里云上,这段代码哪里不对
可以收到数据
print_r(get_headers($url));Array
(
[0] => HTTP/1.1 200 OK
[1] => Connection: close
[2] => Date: Wed, 05 Nov 2014 08:53:09 GMT
[3] => Content-Length: 13889
[4] => Content-Type: text/html
[5] => Content-Location: http://www.mmkao.com/Beautyleg/index.html
[6] => Last-Modified: Wed, 05 Nov 2014 05:39:09 GMT
[7] => Accept-Ranges: bytes
[8] => ETag: "e8939ad2baf8cf1:693"
[9] => Server: IIS
[10] => X-Powered-By: WAF/2.0
[11] => Set-Cookie: safedog-flow-item=8471BA510DA33350ED344AC374D3044A; expires=Sat, 12-Dec-2150 10:26:25 GMT; domain=mmkao.com; path=/
)
Host:www.mmkao.com
Connection:keep-alive
Accept:text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language:zh-cn,zh;q=0.8,en-us;q=0.5,en;q=0.3
Accept-Encoding:gzip, deflate
HTTP/1.1 200 OK
Date: Wed, 05 Nov 2014 09:34:02 GMT
Content-Length: 13889
Content-Type: text/html
Content-Location: http://www.mmkao.com/Beautyleg/index.html
Last-Modified: Wed, 05 Nov 2014 05:39:09 GMT
Accept-Ranges: bytes
ETag: "e8939ad2baf8cf1:693"
Server: IIS
X-Powered-By: WAF/2.0
Set-Cookie: safedog-flow-item=BFC86EA38C3E0337FB45DCE403130335; expires=Sat, 12-Dec-2150 11:07:18 GMT; domain=mmkao.com; path=/<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=gb2312" />
<title>Beautyleg_咪咪图秀</title>
<meta name="keywords" content="Beautyleg">
<meta name="description" content="Beautyleg">
<style type="text/css">
a { color: #993399; text-decoration:none; }
body { margin:10px; color: #993399; text-align:center; font-size:12px; font-family:宋体; }
div { margin:auto; }
ul { margin:0px; padding:0px; }
li {list-style:none;}
img{ border:0px; vertical-align:middle; }
.dh li{ float:left; width:108px; height:39px; line-height:39px; background-image:url(../Image2/list_bg.gif); background-repeat:no-repeat; background-position:106px 4px; }
.dh a:hover { text-decoration:underline;}
.dh a{ color:#ffffff; font-weight:bold; }
.dh li.vis a{color:#FFFFFF; font-weight:bolder;}
.lm { width:980px; }
.lm .left { float:left; line-height:38px; font-size:14px; color:#CC0066; font-weight:bold; padding-left:40px;}
.lm .right { float:right; line-height:38px; font-size:14px; color:#CC0066; font-weight:bold; padding-right:10px; }
.lm .new li{ float:left; text-align:left; padding:7px; }
.lm .new li span.l{ float:left;}
.lm .new li span.r{ float:right; padding-left:5px; }
.lm .list li{ width:215px; float:left; text-align:left; padding:7px; border-bottom:#ddd 1px dashed;}
.lm .list li span.l1,.l2 { display:block; float:left; width:9px; height:9px; text-align:center; color:#fff;}
.lm .list li span.l1{ background: url(Image2/icon1.gif);}
.lm .list li span.l2{ background: url(Image/num.gif);}
.lm .list li span.r{ float:left; padding-left:5px; }
.lm .photo { padding:8px; margin:0px; width:964px; height:190px; }
.lm .photo li{ float:left; width:160px; line-height:30px; border-bottom:#ddd 1px dashed; overflow:hidden; text-overflow:ellipsis;white-space:nowrap; }
.lm .photo img{ width:120px; height:160px; border:#ddd 1px solid;}
.lm .link { width:970px; margin-left:10px;}
.lm .link li { float:left; width:240px; line-height:30px; text-align:left; border-bottom:#ddd 1px dashed;overflow:hidden; text-overflow:ellipsis;white-space:nowrap;}
</style>
</head><body>
............................
<ul class="page" style="width:980px; padding-bottom:8px;">
共 1035 组,每页 30 组,当前 1 / 35 页。<a href="./">首页</a> <a href="./">上一页</a> <a href="2.html">下一页</a> <a href="35.html">尾页</a>。 转到第 <select onchange="location.href = this.value">
<script language="javascript" type="text/javascript">
var Str = "";
for (i = 1; i <= 35 </ul>
</div>
<div style="height:10px; font-size:1px; background-image:url(../Image2/2.gif); background-repeat:no-repeat; background-position:0px -38px;"></div>
</div><div style="width:980px;" >
<ul style="border:1px #CCCCCC solid; text-align:center; padding:5px;">
<script src='/g.js' language='JavaScript' charset='gb2312'></script>
</ul>
</div><div style="width:980px;" >
<ul style="border:1px #CCCCCC solid; text-align:center; padding:5px;">
<script src='/d.js' language='JavaScript' charset='gb2312'></script>
</ul>
</div><div class="lm" style="background: url(../Image2/bottom.gif); background-repeat:no-repeat; background-position:0px 0px; height:100px; margin-top:8px; line-height:100px;">
<ul>
<li><a href="http://www.mmkao.com/">咪咪图秀</a> www.mmkao.com <script src='/tj.js' language='JavaScript' charset='gb2312'></script></li>
</ul>
</div></body>
</html>这个截图是我通过Httpwrap发送的请求头的信息,复制到telnent上也能完整获取网页
http://blog.csdn.net/free_program_1314/article/details/41780835