summaryrefslogtreecommitdiff
path: root/searx/engines/xpath.py
AgeCommit message (Collapse)Author
2021-09-11[mod] xpath engine: remove logging of the requested URLAlexandre Flament
2021-09-07[pylint] engines: drop no longer needed 'missing-function-docstring'Markus Heiser
Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914168470 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-07[fix] add 'categories' to PYLINT_ADDITIONAL_BUILTINS_FOR_ENGINESMarkus Heiser
androp no longer needed (see line 591 in 7b235a1):: # pylint: disable=undefined-variable Suggested-by: @dalf https://github.com/searxng/searxng/issues/102#issuecomment-914068609 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-06[mod] one logger per engine - drop obsolete logger.getChildMarkus Heiser
Remove the no longer needed `logger = logger.getChild(...)` from engines. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-09-04[fix] remove minimum length of content for XPath engineMarkus Heiser
Instead of raising an exception and therefore hiding all results of the engine. It make sense to remove that requirement in order to allow the implementation of search engines that do not always have a description. In fact some search engines that in 99% of the case have a description like Brave Search or Mojeek crash completely if they for some reason included a result with no description. To test this patch try Mojeek: !mjk xyz before and after the patch. Suggested-by: 0xhtml in https://github.com/searx/searx/discussions/2933 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-05-23[enh] XPath engine - add time safe-search supportMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-05-23[enh] XPath engine - add time range supportMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-05-23[enh] XPath engine - add ISO 639-1 {lang} replacement to search-URLMarkus Heiser
BTW: remove obsolte params['query'] and not needed paging condition. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-05-23[doc] add documentation about the XPath engineMarkus Heiser
- pylint searx/engines/xpath.py - fix indentation of some long lines - add logging - add doc-strings Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-05-17[enh] xpath engine - add request parameter 'soft_max_redirects'Markus Heiser
Make 'soft_max_redirects' configurable per Xpath engine:: - name : <engine-name> engine : xpath soft_max_redirects: 1 ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-14[enh] engines: add about variableAlexandre Flament
move meta information from comment to the about variable so the preferences, the documentation can show these information
2020-12-10[fix] xpath, mojeek: fix commit 58d72f26925d56e22330c54be03c3dcbee0c4135Alexandre Flament
before commit 58d72f2, category was not set in xpath.py, so searx/engines/__init__py was setting the category to ['general'] the commit 58d72f2 set the category to [] which is not replaced by searx/engines/__init__.py consequence: the mojeek engine is hidden in the preferences. this commit revert the xpath.py change. close #2368
2020-12-03[mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* ↵Alexandre Flament
functions
2020-11-03[mod] pylint: minor code change to allow pylint globallyAlexandre Flament
This commit is only a step, it doesn't fix all the issues reported by pylint
2020-10-25[enh] Add onions category with Ahmia, Not Evil and Torcha01200356
Xpath engine and results template changed to account for the fact that archive.org doesn't cache .onions, though some onion engines migth have their own cache. Disabled by default. Can be enabled by setting the SOCKS proxies to wherever Tor is listening and setting using_tor_proxy as True. Requires Tor and updating packages. To avoid manually adding the timeout on each engine, you can set extra_proxy_timeout to account for Tor's (or whatever proxy used) extra time.
2020-10-02[mod] move extract_text, extract_url to searx.utilsAlexandre Flament
2020-09-10Drop Python 2 (1/n): remove unicode string and url_utilsDalf
2020-07-23Fix relative urls that do not start with '/'xywei
2019-11-15[mod] speed optimizationDalf
compile XPath only once avoid redundant call to urlparse get_locale(webapp.py): avoid useless call to request.accept_languages.best_match
2019-07-25[fix] fixes google play engines (#1651)Alexandre Flament
update commit 87baa74a863ac74ae4c86bbfcb04148ba7f70696
2019-07-25[fix] fixes google play engines and adds thumbnails to their results (#1612)Venca24
fix google play apps, google play apps, google play music engines xpath engine: thumbnail_xpath can define an optional thumbnail
2018-04-08[fix] append http if no scheme is provided in xpath's extact_urlMarc Abonce Seguin
This solves a bug with Yahoo where some results don't specify a protocol.
2017-05-22[fix] produce valid urls if scheme is missingAdam Tauber
2017-05-15[enh] py3 compatibilityAdam Tauber
2017-01-17[fix] allow empty contentDavid A Roberts
2016-12-31[fix] extract_text: use html.tostring instead html_to_text. Fix #711Alexandre Flament
2016-08-14[fix] behaviour for page_size>1 and first_page_num>0David A Roberts
eg. pageno=1,21,41,... instead of 20,40,60,...
2016-03-28Add paging support to XPath & Erowid enginesKirill Isakov
2016-01-18[fix] pep8 compatibiltyAdam Tauber
2015-01-25Sanitize extract_textCqoicebordel
2014-03-04[fix] error when xpath_results in extraxt_text is _ElementUnicodeResult ↵potato
instead of _ElementStringResult
2014-02-11[mod] len() removed from conditionsasciimoo
2014-01-30[fix] function parametersasciimoo
2014-01-30[fix] function parametersasciimoo
2014-01-30[enh] importable url extractorasciimoo
2014-01-23[fix] html tag removalasciimoo
2014-01-20[fix] pep/flake8 compatibilityasciimoo
2014-01-12[fix] whitespaces removedasciimoo
2014-01-05[mod][fix] xpath engine simplified, yahoo engine never returns truncated urlsDalf
2013-12-30xpath engine: bug fixdalf
2013-11-13[enh] suggestion support for xpath engineasciimoo
2013-11-09[enh] removing result html tagsasciimoo
2013-10-27[fix] urlparsing fixasciimoo
2013-10-26[enh] xpath engine absolute xpath supportasciimoo
2013-10-26[enh] xpath engine addedasciimoo