in Python crawling Baidu search content, Baidu search found URL is very long, often with a parameter, but many parameters are not necessary, is the same as the Java keyword search, can
http://www.baidu.com/s? Wd=java URL to get so simple, but this super complex URL is the same for the Java keyword search:
so, what's the use of so many parameters in the back,?
Query keywords, that is what you want to search.
The number of pages of search results per page, defaults to 10, and can be set to 50
The number of pages showing the results is 0 by default, and the other pages need to be incremented by RN per page. If the RN is the default, the third page PN should be 20.
Query key encoding format, the default is GB2312, that is simplified Chinese
Submit search request source, we can often see many websites are embedded in the Baidu search box, this parameter can be determined from the current search is which website. As the following URL is through the www.hao123.com website Baidu search box search:
note: we can see that many parameters are actually abbreviations, such as WD and word, too.
This represents what search box on Baidu's web page, such as search through the search box in the middle of Baidu's home page, the value is 0, 1.
The parameters of the specific meaning is not very clear, after testing can see the login account and Baidu search on the home page will have this parameter, and the value is 1, if there is no login or log in the search results page search. This parameter does not appear online to find some information, feel more reliable is that home the type of search, 1 said the new version of the Baidu home page search (first login to Baidu account), 2 said Baidu real-time hot search (first login Baidu account), 3 said the traditional Baidu search page.
This parameter is the type of search submitted, such as 3 when searching web pages, and 2
Some of the posts on this keyword online are said to be related to search drop-down lists, but according to my tests, this parameter now seems to represent only the last search key,.
there are many parameters, such as rsv_**, the meaning of these parameters is not very clear, in addition, the above parameters may not be very comprehensive testing, understanding may also be biased, if there is a mistake, welcome to communicate.