summaryrefslogtreecommitdiff
path: root/searx/poolrequests.py
AgeCommit message (Collapse)Author
2021-04-12[httpx] replace searx.poolrequests by searx.networkAlexandre Flament
settings.yml: * outgoing.networks: * can contains network definition * propertiers: enable_http, verify, http2, max_connections, max_keepalive_connections, keepalive_expiry, local_addresses, support_ipv4, support_ipv6, proxies, max_redirects, retries * retries: 0 by default, number of times searx retries to send the HTTP request (using different IP & proxy each time) * local_addresses can be "192.168.0.1/24" (it supports IPv6) * support_ipv4 & support_ipv6: both True by default see https://github.com/searx/searx/pull/1034 * each engine can define a "network" section: * either a full network description * either reference an existing network * all HTTP requests of engine use the same HTTP configuration (it was not the case before, see proxy configuration in master)
2021-04-10[enh] replace requests by httpxAlexandre Flament
2021-03-08[mod] by default allow only HTTPS, not HTTPAlexandre Flament
Related to https://github.com/searx/searx/pull/2373
2021-02-09[mod] poolrequests: for one (user request, engine) always use the same ↵Alexandre Flament
HTTPAdapter The duckduckgo engine requires an additional request after the results have been sent. This commit makes sure that the second request uses the same HTTPAdapter = the same IP address, and the same proxy.
2020-12-11[enh] add raise_for_httperrorAlexandre Flament
check HTTP response: * detect some comme CAPTCHA challenge (no solving). In this case the engine is suspended for long a time. * otherwise raise HTTPError as before the check is done in poolrequests.py (was before in search.py). update qwant, wikipedia, wikidata to use raise_for_httperror instead of raise_for_status
2020-11-20[enh] Add multiple outgoing proxiesAlexandre Flament
credits go to @bauruine see https://github.com/searx/searx/pull/1958
2020-09-26[mod] upgrade requests to version 2.24.0. use ssl instead of pyopenssl.Alexandre Flament
requests 2.24.0 uses the ssl module except if it doesn't support SNI, in this case searx fallbacks to pyopenssl. searx logs a critical message and exit if the ssl modules doesn't support SNI and pyOpenSSL is not installed. searx logs a critical message and exit if the ssl version is older than 1.0.2. in requirements.txt, pyopenssl is still required to install searx as a fallback.
2020-09-10Drop Python 2 (3/n): objectsDalf
2020-09-01[enh] add option to configure proxies per engine - closes #1827Adam Tauber
2017-11-23[fix] measure request duration only if total_time attribute is set - fixes ↵Adam Tauber
autocompleter
2017-11-22[enh] timeout and total HTTP time are managed by searx.poolrequestsAlexandre Flament
2017-07-20[enh] allow default empty values for normal and result proxiesAdam Tauber
2016-05-02Fix pep8Guilhem Bonnefille
2016-04-28Use new settings to fine tune the connection poolGuilhem Bonnefille
In some circumstances, it is necessary to increase size of pool.
2016-01-18[fix] pep8 compatibiltyAdam Tauber
2015-10-31[fix] lock request pool generatorAdam Tauber
2015-08-02[mod] change settings file structure according to #314Adam Tauber
2015-04-25[enh] basic support for http proxy (see #236)Alexandre Flament
2015-02-22[enh] support of multiple outgoing IPsAdam Tauber
2015-01-22[fix] poolrequest post method parametersAdam Tauber
2015-01-21[enh] use one single http connection pool : improve response time. close #100dalf