summaryrefslogtreecommitdiff
path: root/searx/utils.py
AgeCommit message (Collapse)Author
2020-12-03[mod] bing_news: use eval_xpath_getindexAlexandre Flament
remove unused function searx.utils.list_get
2020-12-03[enh] record details exception per engineAlexandre Flament
add an new API /stats/errors
2020-12-01[mod] pylint: numerous minor code fixesAlexandre Flament
2020-11-14[mod] remove unused importAlexandre Flament
use from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA so it is possible to easily remove all unused import using autoflake: autoflake --in-place --recursive --remove-all-unused-imports searx tests
2020-10-28[mod] duckduckgo_definitions: display only user friendly attributes / URLAlexandre Flament
various bug fixes
2020-10-07[mod] Add searx.data moduleAlexandre Flament
Instead of loading the data/*.json in different location, load these files in the new searx.data module.
2020-10-06[fix] drop Python 2: use importlib instead of imp.load_sourceAlexandre Flament
imp.load_source is not documented in Python 3 see documentation : https://docs.python.org/3/library/importlib.html#importing-a-source-file-directly partial fix of https://github.com/searx/searx/issues/1674
2020-10-03[mod] searx.utils.normalize_url: remove Yahoo hackAlexandre Flament
* The hack for Yahoo URLs is not necessary anymore. (see searx.engines.yahoo.parse_url) * move the URL normalization in extract_url to normalize_url
2020-10-02[mod] searx/utils.py: add docstringAlexandre Flament
2020-10-02[mod] move extract_text, extract_url to searx.utilsAlexandre Flament
2020-09-22[mod] add searx/webutils.pyAlexandre Flament
contains utility functions and classes used only by webapp.py
2020-09-13[fix] searx.utils.HTMLTextExtractor: invalid HTML don't raise an ExceptionAlexandre Flament
Close #2188
2020-09-10Drop Python 2 (5/n): searx.utils.is_valid_lang, input parameter is a str ↵Alexandre Flament
instead of bytes Fix bug in translated.py and dictzone.py
2020-09-10Drop Python 2 (4/n): SearchQuery.query is a str instead of bytesDalf
2020-09-10Drop Python 2 (1/n): remove unicode string and url_utilsDalf
2019-11-15[mod] speed optimizationDalf
compile XPath only once avoid redundant call to urlparse get_locale(webapp.py): avoid useless call to request.accept_languages.best_match
2019-10-16fix pep 8 checkNoémi Ványi
2019-10-16add initial support for offline engines && command engineNoémi Ványi
2019-10-16[fix] convert bytes type to string in language detection (fixes dictzone)Adam Tauber
2019-08-02[fix] fix flickr_noapi decoding (#1655)Alexandre Flament
Characters that were not ASCII were incorrectly decoded. Add an helper function: searx.utils.ecma_unescape (Python implementation of unescape Javascript function).
2019-07-19[mod] use cache in _match_language function to speed up searx start time ↵Dalf
significantly
2019-07-17[fix] secret_key can be bytes instead of a string (#1602)rachmadani haryono
Fix #1600 In settings.yml, the secret_key can be written as string or as base64 encoded data using !!binary notation.
2018-08-05fetch_firefox_version.py : compatible with Python 3 and minor fixes.Alex
2018-08-05[mod] fetch firefox versions in a standalone scriptAlexandre Flament
2018-07-09Merge pull request #1303 from MarcAbonce/bingAdam Tauber
Fix bing "garbage" results
2018-06-23[fix] update user agent versionsMarc Abonce Seguin
this fixes duckduckgo error response
2018-06-14[fix] add basestring for py3Adam Tauber
2018-05-20fix bing "garbage" results (issue #1275)Marc Abonce Seguin
2018-03-27refactor engine's search language handlingMarc Abonce Seguin
Add match_language function in utils to match any user given language code with a list of engine's supported languages. Also add language_aliases dict on each engine to translate standard language codes into the custom codes used by the engine.
2017-12-01[fix] convert json engine result attributes to string - closes #1006Adam Tauber
2017-11-21[fix] remove trailing 0x00 from csv outputAdam Tauber
2017-11-21[fix] resurrect csv output in py2Adam Tauber
2017-09-08fix hmac python3 compatibilityNoémi Ványi
2017-09-04[mod] int_or_zero refactored to searx_utilsmisnyo
2017-06-25[fix] is_valid_lang fixed for new languages.py + dictzone engine encodingpotato
2017-05-15[mod] settings.yml can be /etc/searx/settings.ymlAlexandre Flament
The exact order is * first from SEARX_SETTINGS_PATH, * if not found then from searx code base, * if not found then from /etc/searx/settings.yml * if not found an exception stops searx loading
2017-05-15[mod] the static and templates directories can be defined in the settings.ymlAlexandre Flament
2017-05-15[enh] py3 compatibilityAdam Tauber
2017-01-20[mod] add a __common__ template that can't be selected but that provides a ↵Alexandre Flament
common place for shared templates. What has been moved into this template : * opensearch*.xml is always the same whatever the themes. * the text inside */about.html
2016-11-19[mod] move load_module function to utilsAdam Tauber
2016-10-22fix kickass torrents engineNoémi Ványi
2016-09-06[enh] is_valid_lang moved to utilspotato
2016-08-13add digbt engineNoemi Vanyi
Unfortunately, it is quite slow so it is disabled. Furthermore, the display of number of files is wrong on digbt.org, so it is not displayed on searx.
2016-08-05[fix] exception if locale doesn't have a date formatmarc
occitan, for example
2016-07-11Fix anomalous backslash in stringstepshal
2016-07-10Fix quantity of blank lines after code object.stepshal
2016-07-04[enh] update useragent versionsAdam Tauber
2016-04-09new preferences handlingNoemi Vanyi
Preferences class was introduced in order to handle user preferences. Right now it parses cookies and the form in preferences. Also it can retrieve settings based on the name of the setting. ATTENTION Please note that engine preferences are handled differently from now on. So it introduces incompatible changes. Every user who has saved preferences should reset and save his/her settings again. This change was needed, because everytime a default disabled engine was added saved user preferences would broke. Now engine setting tracking is fixed.
2015-09-08[enh] extend user agent versionsAdam Tauber
2015-09-07[fix][mod] wikidata date handling refactor - fixes #387Adam Tauber