(高分)大虾救命啊 !!!!!WebClient怎么抓取https,不同的是:我需要搜索一次,才可以抓取

Question

<form Name="Advanced" method="POST" action="https://www.oxhp.com/cgi-bin/provider_roster/avsearch/avsearch_ch.pl"><input type="text" name="SearchFor" value="Doctor" />
<input type="text" name="lang" value="cn" />
<input type="text" name="_DOCTYPE_TEXT" value="" />
<input type="text" name="_SPECIALTY_TEXT" value="" />
<input type="text" name="_NETWORK_TEXT" value="" />
<input type="text" name="_MILES_TEXT" value="" />
<input type="text" name="_STATE_TEXT" value="" />
<input type="text" name="_LANGUAGE_TEXT" value="" />上面的是需要传的搜索参数,我应该怎么抓取?

Answer 1

 System.Net.WebClient wb = new System.Net.WebClient();
            System.Collections.Specialized.NameValueCollection param = new System.Collections.Specialized.NameValueCollection();
            param.Add("SearchFor", "Doctor");
            //...
            byte[] b= wb.UploadValues(new Uri("https://www.oxhp.com/cgi-bin/provider_roster/avsearch/avsearch_ch.pl ",param));
            //...最好用httplook看看，WebClient 可以完全伪装成ie

Answer 2

Compilation Error 
Description: An error occurred during the compilation of a resource required to service this request. Please review the following specific error details and modify your source code appropriately. Compiler Error Message: CS1502: The best overloaded method match for 'System.Uri.Uri(string, bool)' has some invalid argumentsSource Error: Line 44:         param.Add("_ZIP ", "11220");
Line 45:         //...
Line 46:         byte[] b = wb.UploadValues(new Uri("https://www.oxhp.com/cgi-bin/provider_roster/avsearch/avsearch_ch.pl", param));
Line 47:         //...
Line 48:         string result = Encoding.Default.GetString(b);
 Source File: e:\project\clinic\seachSSL.aspx.cs    Line: 46 
出现这样的错误,不知道什么问题啊!help

Answer 3

byte[] b = wb.UploadValues(new Uri("https://www.oxhp.com/cgi-bin/provider_roster/avsearch/avsearch_ch.pl "), param); 

Answer 4

public class TrustAllCertificatePolicy : System.Net.ICertificatePolicy
    {
        public TrustAllCertificatePolicy()
        { }        public bool CheckValidationResult(ServicePoint sp,X509Certificate cert, WebRequest req, int problem)
        {
            return true;
        }
    }
    
    protected void Page_Load(object sender, EventArgs e)
    {
        System.Net.ServicePointManager.CertificatePolicy = new TrustAllCertificatePolicy(); 
                string backstr = "";
        string param = "SearchFor=Doctor&lang=cn&_DOCTYPE_TEXT=Primary Care Physician 主治醫生/OBGYN婦科醫生&_SPECIALTY_TEXT=Pediatrics 兒科&_NETWORK_TEXT=Freedom&_MILES_TEXT=5 英哩&_STATE_TEXT=New York 紐約州&_LANGUAGE_TEXT=Any&_ZIP=11220";
        byte[] bs = Encoding.ASCII.GetBytes(param);        HttpWebRequest req = (HttpWebRequest)HttpWebRequest.Create("https://www.oxhp.com/cgi-bin/provider_roster/avsearch/avsearch_ch.pl");
        req.Method = "POST";
        req.ContentType = "application/x-www-form-urlencoded";
        req.ContentLength = bs.Length;        using (Stream reqStream = req.GetRequestStream())
        {
            reqStream.Write(bs, 0, bs.Length);
        }
        using (WebResponse wr = req.GetResponse())
        {
            StreamReader sr = new StreamReader(wr.GetResponseStream(), System.Text.Encoding.Default);
            backstr = sr.ReadToEnd();
            sr.Close();
            wr.Close();  
        }        Response.Write(backstr);
    }还是得不到东西啊！郁闷死了！

Answer 5

当你获取HTML的时候再用MILHTMLParser（到网上下载一个，开源的）来分析你的HTML
获取你想要的