summaryrefslogtreecommitdiff
path: root/searx/engines
AgeCommit message (Collapse)Author
2020-12-09[mod) genious: return valid results even if contents are emptyAlexandre Flament
2020-12-04Merge pull request #2354 from dalf/fix-wikipediaAlexandre Flament
[fix] wikipedia engine: don't raise an error when the query is not found
2020-12-04[fix] wikipedia engine: don't raise an error when the query is not foundAlexandre Flament
Add a new parameter "raise_for_status", set by default to True. When True, any HTTP status code >= 300 raise an exception ( #2332 ) When False, the engine can manage the HTTP status code by itself.
2020-12-04[fix] wikidata: fix crash when the item has no description at all and at ↵Alexandre Flament
least one URL.
2020-12-03[mod] stackoverflow & yandex: detect CAPTCHA responseAlexandre Flament
2020-12-03[mod] various engines: use eval_xpath* functions and searx.exceptions.*Alexandre Flament
Engine list: ahmia, duckduckgo_images, elasticsearch, google, google_images, google_videos, youtube_api
2020-12-03[mod] xpath, 1337x, acgsou, apkmirror, archlinux, arxiv: use eval_xpath_* ↵Alexandre Flament
functions
2020-12-03[mod] bing_news: use eval_xpath_getindexAlexandre Flament
remove unused function searx.utils.list_get
2020-12-03[enh] record details exception per engineAlexandre Flament
add an new API /stats/errors
2020-12-02[refactor] digg - improve results and clean up source codeMarkus Heiser
- strip html tags and superfluous quotation marks from content - remove not needed cookie from request - remove superfluous imports Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02[mod] digg - pylint searx/engines/digg.pyMarkus Heiser
Eliminate redundant file names which are tested by test.pylint and ignored by test.pep8 Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-02[fix] digg - the ISO time stamp of published date has been changedMarkus Heiser
Error pattern:: Engines cannot retrieve results: digg (unexpected crash time data '2020-10-16T14:09:55Z' does not match format '%Y-%m-%d %H:%M:%S') Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-12-01[mod] pylint: numerous minor code fixesAlexandre Flament
2020-12-01[mod] wikidata: WDGeoAttribute class: doesn't change the method signature of ↵Alexandre Flament
get_str
2020-12-01[fix] /stats: report error percentage instead of error countAlexandre Flament
This bug exists since the PR https://github.com/searx/searx/pull/751
2020-11-30Add recoll engine (#2325)Noémi Ványi
recoll is a local search engine based on Xapian: http://www.lesbonscomptes.com/recoll/ By itself recoll does not offer web or API access, this can be achieved using recoll-webui: https://framagit.org/medoc92/recollwebui.git This engine uses a custom 'files' result template set `base_url` to the location where recoll-webui can be reached set `dl_prefix` to a location where the file hierarchy as indexed by recoll can be reached set `search_dir` to the part of the indexed file hierarchy to be searched, use an empty string to search the entire search domain
2020-11-27Photon API Link UpdateM. Efe Çetin
Via https://photon.komoot.io/
2020-11-20[enh] Add multiple outgoing proxiesAlexandre Flament
credits go to @bauruine see https://github.com/searx/searx/pull/1958
2020-11-14[refactor] deviantart - improve results and clean up source codeMarkus Heiser
Devian's request and response forms has been changed. - fixed title - fixed time_range_dict to 'popular-*-***' - use image from <noscript> if exists - drop obsolete "http to https, remove domain sharding" - use query URL https://www.deviantart.com/search/deviations?page=5&q=foo - add searx/engines/deviantart.py to pylint check (test.pylint) Error pattern:: There DEBUG:searx:result: invalid title: {'url': 'https://www.deviantart.com/ ... Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-11-14[mod] remove unused importAlexandre Flament
use from searx.engines.duckduckgo import _fetch_supported_languages, supported_languages_url # NOQA so it is possible to easily remove all unused import using autoflake: autoflake --in-place --recursive --remove-all-unused-imports searx tests
2020-11-14Merge pull request #2292 from kvch/elasticsearch-engineAlexandre Flament
New engine: Elasticsearch
2020-11-14Merge pull request #2289 from dalf/pylintAlexandre Flament
[mod] pylint: add extension-pkg-whitelist=lxml.etree
2020-11-10New engine: ElasticsearchNoémi Ványi
2020-11-03[mod] pylint: minor code change to allow pylint globallyAlexandre Flament
This commit is only a step, it doesn't fix all the issues reported by pylint
2020-11-03[fix] comamnd engine: fix importAlexandre Flament
2020-11-03[fix] scanr_structure engine: fix importAlexandre Flament
2020-10-28[mod] wikidata engine: use one SPARQL request instead of 2 HTTP requests.Alexandre Flament
2020-10-28[mod] duckduckgo_definitions: display only user friendly attributes / URLAlexandre Flament
various bug fixes
2020-10-25[enh] Add onions category with Ahmia, Not Evil and Torcha01200356
Xpath engine and results template changed to account for the fact that archive.org doesn't cache .onions, though some onion engines migth have their own cache. Disabled by default. Can be enabled by setting the SOCKS proxies to wherever Tor is listening and setting using_tor_proxy as True. Requires Tor and updating packages. To avoid manually adding the timeout on each engine, you can set extra_proxy_timeout to account for Tor's (or whatever proxy used) extra time.
2020-10-25Open Semantic Search EngineNicholas Kegler
2020-10-09Propagate error messages from YouTube APINoémi Ványi
2020-10-09Merge pull request #2255 from kvch/yacy-improvementsAdam Tauber
Add yacy improvements: HTTP digest auth, category checking
2020-10-09[fix] fix duckduckgo engineAlexandre Flament
- remove paging support: a "vqd" parameter is required between each request. This parameter is uniq for each request - update the URL (no redirect), use the POST method - language support: works if there is no more than request per minute, otherwise it is ignored !
2020-10-09Add yacy improvements: HTTP digest auth, category checkingNoémi Ványi
2020-10-08add ebay enginte to shopping categoryNoémi Ványi
2020-10-07[mod] Add searx.data moduleAlexandre Flament
Instead of loading the data/*.json in different location, load these files in the new searx.data module.
2020-10-06[fix] drop Python 2: use collections.abc.Iterable instead of ↵Alexandre Flament
collections.Iterable
2020-10-04Merge pull request #2241 from dalf/move-extract-text-and-urlAlexandre Flament
Move the extract_text and extract_url functions to searx.utils
2020-10-03[enh] Add SepiaSearch engine (#2227)Finn
supported_languages values: see https://framagit.org/framasoft/peertube/search-index/-/blob/master/client/src/views/Search.vue#L618-641
2020-10-02[mod] move extract_text, extract_url to searx.utilsAlexandre Flament
2020-10-01[fix] google engine - div classes has been renamed in HTML reultMarkus Heiser
Since 1. October 2020 google has changed the 'class' attribute of the HTML result page. Fix the xpath expressions and ignore <div class="g" ../> sections which do not match to title's xpath expression. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-09-28[fix] migration from github.com/asciimoo/searx to github.com/searx/searx : ↵Alexandre Flament
fix URLs
2020-09-22fetch google's search langs rather than ui langsMarc Abonce Seguin
2020-09-22fetch supported languages for startpage engineMarc Abonce Seguin
2020-09-22add language names in qwant's fetch languages functionMarc Abonce Seguin
2020-09-10Drop Python 2 (4/n): SearchQuery.query is a str instead of bytesDalf
2020-09-10Drop Python 2 (1/n): remove unicode string and url_utilsDalf
2020-09-10use Wikipedia's REST v1 APIMarc Abonce Seguin
2020-09-08[enh] Add command line engines: git grep, find, etc. (#2128)Noémi Ványi
A new "base" engine called command is introduced. It is the foundation for all command line engines for now. You can use this engine to create your own command line engine. Add some engines (commented out to make sure no one enables anything accidentally): * git grep: This engine lets you grep in the searx repo. * locate: If locate is installed and initialized, you can search on the FS. * find: You can find files with a specific name from where you started searx. * pattern search in files: This engine utilizes the command fgrep. * regex search in files: This engine runs `grep` to find a file based on its contents.
2020-09-07[enh] stop searx when an engine raise an SyntaxError exception (#2177)Alexandre Flament
and some other exceptions: * KeyboardInterrupt * SystemExit * RuntimeError * SystemError * ImportError: an engine with an unmet dependency will stop everything.
7apu2bq3rhoylwmucxizk54afw5jyda7pho4j5zdcqpwkufke7zdzwad.onion