数据抓取 分页数据

Question

http://beijing.anjuke.com/tycoon/p25-st125 就是25页的数据。类似这样 的。 

Answer 1

楼上正解，看下面分页的url，就会找出对应的规律
 <span class="nolink prexpage"><img src="http://pages.anjukestatic.com/img/icon/arrow.left-10x10.gif" />&nbsp;上一页</span>
                                <span class="current">1</span>
                                <a href="http://beijing.anjuke.com/tycoon/p2-st1"><span>2</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p3-st1"><span>3</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p4-st1"><span>4</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p5-st1"><span>5</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p6-st1"><span>6</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p7-st1"><span>7</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p8-st1"><span>8</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p9-st1"><span>9</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p10-st1"><span>10</span></a>
                                <a href="http://beijing.anjuke.com/tycoon/p2-st1"><span class="nextpage"><ins>下一页</ins> <img src="http://pages.anjukestatic.com/img/icon/arrow.right-10x10.gif" /></span></a>

Answer 2

直接在360里面按F12，打开开发者工具，然后点击第2页，查看开发者工具的Network部分，打开请求就知道请求的url了。

Answer 3

有的网页有几千页，数据有好几万条，需要把所有页的数据都抓取出来，有什么更好的方法嘛？比如这个网址：http://bj.esf.sina.com.cn/agent/j2/

Answer 4

你当前页的链接， 跟第二页第三页的链接， 肯定是有相同之处的，不同的就是page=1 page=2这样的，你用jsoup去爬这段代码， 把总页数拿出来， 然后自己组装url， 请求！！