diff options
| author | Markus Heiser <markus.heiser@darmarit.de> | 2022-12-10 16:20:09 +0100 |
|---|---|---|
| committer | Markus Heiser <markus.heiser@darmarit.de> | 2022-12-11 11:26:07 +0100 |
| commit | ed901ab18edddcfd566ac37ddb1b429969ccc2ad (patch) | |
| tree | 2d698ac11b6dd96ba4a88984b0919cbecbe52ef9 /requirements.txt | |
| parent | 9925a209503cc41e37a1c032548a5fd8fd8ea362 (diff) | |
| download | searxng-ed901ab18edddcfd566ac37ddb1b429969ccc2ad.tar.gz searxng-ed901ab18edddcfd566ac37ddb1b429969ccc2ad.zip | |
[mod] improve 'Autodetect search language' plugin
- Add documentation to the plugin
- Harmonize FastText language model with SearXNG's language model
Reosurces::
import fasttext # --> +10 MB
fasttext.load_model(str(data_dir / 'lid.176.ftz')) # --> +4MB
Suggested-by: @dalf
- To speed up and simplify the deployment use fasttext-wheel instead of fasttext
- Building numpy on the Alpine Linux of docker-images takes ages --> install
py3-numpy from Alpines package manager (apk)
- Alpine Linux on docker-images (musl libc) do not support fasttext-wheel (gnu
libc) --> patch Dockerfile and build from fastetxt:
sed -i s/fasttext-wheel/fasttext/ requirements.txt
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
Diffstat (limited to 'requirements.txt')
| -rw-r--r-- | requirements.txt | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/requirements.txt b/requirements.txt index b5efb8d59..de48aea00 100644 --- a/requirements.txt +++ b/requirements.txt @@ -16,4 +16,4 @@ setproctitle==1.3.2 redis==4.4.0 markdown-it-py==2.1.0 typing_extensions==4.4.0 -fasttext==0.9.2 +fasttext-wheel==0.9.2 |