diff options
author | Alexandre Flament <alex@al-f.net> | 2020-12-09 21:23:20 +0100 |
---|---|---|
committer | Alexandre Flament <alex@al-f.net> | 2020-12-11 14:37:08 +0100 |
commit | d703119d3a313a406482b121ee94c6afee3bc307 (patch) | |
tree | 7834dc899b99db4ea3f9f81542e8e029bf5b7d04 /docs/dev | |
parent | 033f39bff7b3365256491014140e35aa1e974d4e (diff) | |
download | searxng-d703119d3a313a406482b121ee94c6afee3bc307.tar.gz searxng-d703119d3a313a406482b121ee94c6afee3bc307.zip |
[enh] add raise_for_httperror
check HTTP response:
* detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time.
* otherwise raise HTTPError as before
the check is done in poolrequests.py (was before in search.py).
update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
Diffstat (limited to 'docs/dev')
-rw-r--r-- | docs/dev/engine_overview.rst | 26 |
1 files changed, 13 insertions, 13 deletions
diff --git a/docs/dev/engine_overview.rst b/docs/dev/engine_overview.rst index 99726a456..3562ca61a 100644 --- a/docs/dev/engine_overview.rst +++ b/docs/dev/engine_overview.rst @@ -134,19 +134,19 @@ The function ``def request(query, params):`` always returns the ``params`` variable. Inside searx, the following paramters can be used to specify a search request: -================== =========== ========================================================================== -argument type information -================== =========== ========================================================================== -url string requested url -method string HTTP request method -headers set HTTP header information -data set HTTP data information (parsed if ``method != 'GET'``) -cookies set HTTP cookies -verify boolean Performing SSL-Validity check -max_redirects int maximum redirects, hard limit -soft_max_redirects int maximum redirects, soft limit. Record an error but don't stop the engine -raise_for_status bool True by default: raise an exception if the HTTP code of response is >= 300 -================== =========== ========================================================================== +=================== =========== ========================================================================== +argument type information +=================== =========== ========================================================================== +url string requested url +method string HTTP request method +headers set HTTP header information +data set HTTP data information (parsed if ``method != 'GET'``) +cookies set HTTP cookies +verify boolean Performing SSL-Validity check +max_redirects int maximum redirects, hard limit +soft_max_redirects int maximum redirects, soft limit. Record an error but don't stop the engine +raise_for_httperror bool True by default: raise an exception if the HTTP code of response is >= 300 +=================== =========== ========================================================================== example code |