currently see a very nice site , but requires input parameters and query to query the results, it is equivalent to the result of the query from the database , there are no tools or source can get all the data at one time among the local file or a local database? httplient? was the first to get his circulation static html file, and then extracted from a page of data ? How to crawl dynamic website data heroes think is how to do ?
------ Solution ------------------------------------ --------
not so simple. . You can choose to analyze what the real request after a search condition , and the rest is httpclient analog transmission requests.
------ Solution ---------------------------------------- ----
I think it is not a problem to take the data , the main difficulty in the analysis of the law of your request
------ For reference only -------------- -------------------------
caught dynamic interface calls the equivalent of a page
------ For reference only - --------------------------------------
analog data request < br>
没有评论:
发表评论