C#开发网页数据采集器要怎么做？

Question

C#网页数据采集器要怎么做？

Answer 1

    /// <summary>
    /// 下载网页
    /// </summary>
    /// <param name="Url">网址</param>
    /// <param name="myEncoding">编码</param>
    /// <returns>网页内容</returns>
    public static string DownHtml(string Url, Encoding myEncoding)
    {
        try
        {
            HttpWebRequest loHttp = (HttpWebRequest)WebRequest.Create(Url);
            loHttp.Timeout = 500;
           
            HttpWebResponse loWebResponse = (HttpWebResponse)loHttp.GetResponse();
            StreamReader loResponseStream = new StreamReader(loWebResponse.GetResponseStream(), myEncoding);
            string html = loResponseStream.ReadToEnd();
            loWebResponse.Close();
            return html;
        }
        catch
        {
            return null;
        }
    }

Answer 2

差着十万八千里了。看看这个贴子~~http://bbs.locoy.com/viewthread.php?tid=31216&highlight=%B2%C9%BC%AF%D4%AD%C0%ED