summaryrefslogtreecommitdiff
path: root/searx/data
AgeCommit message (Collapse)Author
2021-03-06Merge pull request #2631 from searx/update_data_update_languages.pyAlexandre Flament
Update searx.data - update_languages.py
2021-03-05Merge pull request #2632 from searx/update_data_update_wikidata_units.pyAlexandre Flament
Update searx.data - update_wikidata_units.py
2021-03-05Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.pyAlexandre Flament
Update searx.data - update_ahmia_blacklist.py
2021-03-05Update searx.data - update_currencies.pydalf
2021-03-05Update searx.data - update_wikidata_units.pydalf
2021-03-05Update searx.data - update_languages.pydalf
2021-03-05Update searx.data - update_ahmia_blacklist.pydalf
2021-03-01[enh] google scholar - python implementation of the engineMarkus Heiser
The old xpath configuration for google scholar did not work and is replaced by a python implementation. Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-03-01Merge pull request #2604 from searx/update_data_firefox_versionAlexandre Flament
Update searx.data - firefox_version
2021-02-26Merge pull request #2605 from searx/update_data_currenciesAlexandre Flament
Update searx.data - currencies
2021-02-26Merge pull request #2606 from searx/update_data_wikidata_unitsAlexandre Flament
Update searx.data - wikidata_units
2021-02-26Update searx.data - ahmia_blacklistdalf
2021-02-26Update searx.data - wikidata_unitsdalf
2021-02-26Update searx.data - firefox_versiondalf
2021-02-26Update searx.data - currenciesdalf
2021-02-24[mod] add utils/fetch_external_bangs.pyAlexandre Flament
Based on duckduckgo bangs Store bangs on a trie to allow autocomplete (not in this commit)
2021-02-23Merge pull request #2595 from dalf/update-wikidata-unitsAlexandre Flament
[mod] update wikidata_units.json and fetch_wikidata_units.py
2021-02-23[mod] update currencies.json and fetch_currencies.pyAlexandre Flament
use a sparql request on wikidata to get the list of currencies. currencies.json contains the translation for all supported searx languages. Supersede #993
2021-02-23[mod] update wikidata_units.json and fetch_wikidata_units.pyAlexandre Flament
The fetch_wikidata_units.py result won't change randomly. See comments in the script.
2021-01-24[data] make engines.languagesMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-01-12[mod] drop Python 3.5 supportAlexandre Flament
2020-12-22[upd] make SEARX_DEBUG=1 useragents.updateMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-10-28[mod] add external_urls.json and wikidata_units.jsonAlexandre Flament
2020-10-27[mod] ahmia_filter.py: minor changesAlexandre Flament
- use result['parsed_url'] - load ahmia_blacklist.txt in searx.datae
2020-10-25add Ahmia filter plugin for onion resultsMarc Abonce Seguin
2020-10-07[mod] Add searx.data moduleAlexandre Flament
Instead of loading the data/*.json in different location, load these files in the new searx.data module.
2020-09-22fetch google's search langs rather than ui langsMarc Abonce Seguin
2020-09-22fix utils/fetch_languages to work with new languagesMarc Abonce Seguin
2020-08-08add peertube engine (#2109)Michael Ilsaas
2020-07-15[mod] bangs.json: remove the faviconsDalf
fix #2076
2020-07-03Created new plugin type custom_results. Added new plugin bang_redirect (#2027)Lukas van den Berk
* Made first attempt at the bangs redirects plugin. * It redirects. But in a messy way via javascript. * First version with custom plugin * Added a help page and a operator to see all the bangs available. * Changed to .format because of support * Changed to .format because of support * Removed : in params * Fixed path to json file and changed bang operator * Changed bang operator back to & * Made first attempt at the bangs redirects plugin. * It redirects. But in a messy way via javascript. * First version with custom plugin * Added a help page and a operator to see all the bangs available. * Changed to .format because of support * Changed to .format because of support * Removed : in params * Fixed path to json file and changed bang operator * Changed bang operator back to & * Refactored getting search query. Also changed bang operator to ! and is now working. * Removed prints * Removed temporary bangs_redirect.js file. Updated plugin documentation * Added unit test for the bangs plugin * Fixed a unit test and added 2 more for bangs plugin * Changed back to default settings.yml * Added myself to AUTHORS.rst * Refacored working of custom plugin. * Refactored _get_bangs_data from list to dict to improve search speed. * Decoupled bangs plugin from webserver with redirect_url * Refactored bangs unit tests * Fixed unit test bangs. Removed dubbel parsing in bangs.py * Removed a dumb print statement * Refactored bangs plugin to core engine. * Removed bangs plugin. * Refactored external bangs unit tests from plugin to core. * Removed custom_results/bangs documentation from plugins.rst * Added newline in settings.yml so the PR stays clean. * Changed searx/plugins/__init__.py back to the old file * Removed newline search.py * Refactored get_external_bang_operator from utils to external_bang.py * Removed unnecessary import form test_plugins.py * Removed _parseExternalBang and _isExternalBang from query.py * Removed get_external_bang_operator since it was not necessary * Simplified external_bang.py * Simplified external_bang.py * Moved external_bangs unit tests to test_webapp.py. Fixed return in search with external_bang * Refactored query parsing to unicode to support python2 * Refactored query parsing to unicode to support python2 * Refactored bangs plugin to core engine. * Refactored search parameter to search_query in external_bang.py
2020-04-21Update default user agentsÉmilien Devos
2020-03-26make project: re-build generic files of the searx projectMarkus Heiser
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-03-01update languages: engines_languages.json languages.pyMarkus Heiser
build by Makefile target: make project Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2020-03-01searx/data/engines_languages.json: sort json file (no content change)Markus Heiser
To get meaningfull diffs, the json file has to be sorted. Before applying any further content patch, the json file needs a inital sort (without changing any content). Sorted by:: import sys, json with open('engines_languages.json') as f: j = json.load(f) with open('engines_languages.json', 'w') as f: json.dump(j, f, indent=2, sort_keys=True) Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2019-11-23update user agentsMarc Abonce Seguin
2019-11-23add a shortcut for utils/fetch_firefox_version.py in manage.shMarc Abonce Seguin
2019-01-06[fix] fetch google's supported languagesMarc Abonce Seguin
2018-11-29Use a more human-friendly format in searx/data/engines_languages.json (#1399)Ivan Skytte Jørgensen
Instead of a single line with 500000 characters use nicely formatted JSON. Sort the lists in engine_languages.py so when updating it is possible to more easily see the differences (search engines do change the order their languages are listed in)
2018-08-05fetch_firefox_version.py : compatible with Python 3 and minor fixes.Alex
2018-08-05[mod] fetch firefox versions in a standalone scriptAlexandre Flament
2018-04-22switched currency convert to duckduckgo and added Bitcoin to currency listrinpatch
2018-03-27refactor engine's search language handlingMarc Abonce Seguin
Add match_language function in utils to match any user given language code with a list of engine's supported languages. Also add language_aliases dict on each engine to translate standard language codes into the custom codes used by the engine.
2018-03-20fix fetch_langauges to be more accurateMarc Abonce Seguin
Add languages supported by either all default general engines or 10 engines.
2017-10-10update engines_languages.json and languages.pymarc
Also, fix fetch_languages.py so it can run on python3.
2017-07-10[fix] duckduckgo images doesn't fail with countryless languagemarc
2017-03-18make search language handling less strictmarc
languages.py can change, so users may query on a language that is not on the list anymore, even if it is still recognized by a few engines. also made no and nb the same because they seem to return the same, though most engines will only support one or the other.
2017-03-18add language support for qwantmarc
closes issue #863
2016-12-29change language list to only include languages with a minimum of enginesmarc
that support them. users can still query lesser supported through the :lang_code bang.
2016-12-16minor fixes in utils/fetch_languages.pymarc