Commit Graph

3981 Commits

Author SHA1 Message Date
Alexandre Flament b8cd326464 Add searx_extra package
Split the utils directory into:
* searx_extra contains update scripts, standalone_searx.py
* utils contains the files to build and setup searx.
2021-03-04 11:59:14 +01:00
Noémi Ványi 111d38cd8f
Merge pull request #2621 from return42/fix-searx.sh
[fix] utils/serax.sh create_pyenv() - drop duplicate 'pip install .'
2021-03-03 20:08:37 +01:00
Markus Heiser 2e58988191 [fix] utils/serax.sh create_pyenv() - drop duplicate 'pip install .'
The wrong and unnecessary `pip install .` is executed in /usr/local/searx and is
responsible for the error message:

    ERROR: File "setup.py" not found. Directory cannot be installed in editable mode: /usr/local/searx

The correct pip-install comes right after changing to `cd ${SEARX_SRC}`.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-03-03 18:57:20 +01:00
Alexandre Flament c748fc66cf
Merge pull request #2610 from searx/dependabot/pip/master/pylint-2.7.2
Bump pylint from 2.6.2 to 2.7.2
2021-03-02 10:12:32 +01:00
dependabot[bot] b54dd66ef8
Bump pylint from 2.6.2 to 2.7.2
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.6.2 to 2.7.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/master/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/pylint-2.6.2...pylint-2.7.2)

Signed-off-by: dependabot[bot] <support@github.com>
2021-03-02 09:07:11 +00:00
Alexandre Flament 87ac6df9fc
Merge pull request #2611 from return42/google-scolar
[enh] google scholar - python implementation of the engine
2021-03-02 10:05:49 +01:00
Markus Heiser d48e2e7b0b [enh] google scholar - python implementation of the engine
The old xpath configuration for google scholar did not work and is replaced by a
python implementation.

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-03-01 15:16:37 +01:00
Alexandre Flament e2fb500892
Merge pull request #2608 from return42/unittest2
[py2to3] use unittest from py3, remove unittest2 from py2
2021-03-01 10:05:38 +01:00
Alexandre Flament 0c663e25fc
Merge pull request #2604 from searx/update_data_firefox_version
Update searx.data - firefox_version
2021-03-01 10:03:39 +01:00
Alexandre Flament f77983e174
Merge pull request #2602 from MarcAbonce/fix-bing-fetch-languages
Fix fetch_languages for Bing
2021-03-01 09:06:37 +01:00
GazoilKerozen 5f6ac3afa2
Add Freesound engine (#2596)
Add freesound engine with player.

Co-authored-by: Gazoil <maildeguzel@gmail.com>
2021-03-01 08:52:36 +01:00
Markus Heiser 3bae35940a [py2to3] use unittest from py3, remove unittest2 from py2
- unittest2 is a backport of the new features added to the unittest testing
  framework in Python 2.7

- unittest2 was only needed in py2 and can be dropped now

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
2021-02-28 11:37:06 +01:00
Alexandre Flament b05f4d0664
Merge pull request #2605 from searx/update_data_currencies
Update searx.data - currencies
2021-02-26 12:56:32 +01:00
Alexandre Flament aec5188b51
Merge pull request #2606 from searx/update_data_wikidata_units
Update searx.data - wikidata_units
2021-02-26 12:55:51 +01:00
Alexandre Flament 28ed5acde5
Merge pull request #2607 from searx/update_data_ahmia_blacklist
Update searx.data - ahmia_blacklist
2021-02-26 12:55:26 +01:00
dalf 893b6e4901 Update searx.data - ahmia_blacklist 2021-02-26 08:31:15 +00:00
dalf 7b9005df31 Update searx.data - wikidata_units 2021-02-26 08:31:01 +00:00
dalf 4c8ae5b7ed Update searx.data - firefox_version 2021-02-26 08:30:45 +00:00
dalf d2778b5efe Update searx.data - currencies 2021-02-26 08:30:45 +00:00
Marc Abonce Seguin d6681fd33b remove articles number from engines_languages.json 2021-02-25 23:54:21 -07:00
Marc Abonce Seguin 9b6ffed061 fix fetch_languages for bing
Bing has a list of regions that it supports and some of these regions
may have more than one possible language.

In some cases, like Switzerland, these languages are always shown as
options, so there is no issue. But in other cases, like Andorra, Bing
will only show one language at the time, either the region's default or
the request's language if the latter is supported by that region.

For example, if the HTTP request is in French, Andorra will appear as
fr-AD but if the same page is requested in any other language Andorra
will appear as ca-AD.

This is specially a problem when Bing assumes that the request is in
English because it overrides enough language codes to make several major
languages like Arabic dissappear from the languages.py file.

To avoid that issue, I set the Accept-Language header to a language
that's only supported in one region to hopefully avoid these overrides.
2021-02-25 23:51:49 -07:00
Alexandre Flament 728e096764
data-update.yml: on PR per file 2021-02-25 08:41:17 +01:00
Noémi Ványi bc590cbc47
Merge pull request #2592 from dalf/update-external-bangs
[mod] add utils/fetch_external_bangs.py
2021-02-24 20:27:26 +01:00
Alexandre Flament 7c1847d5f2 [mod] add utils/fetch_external_bangs.py
Based on duckduckgo bangs
Store bangs on a trie to allow autocomplete (not in this commit)
2021-02-24 18:48:36 +01:00
Alexandre Flament 606aa79e49
Merge pull request #2584 from searx/dependabot/pip/master/sphinx-3.5.1
Bump sphinx from 3.4.1 to 3.5.1
2021-02-24 13:52:15 +01:00
dependabot[bot] 048be86aaf
Bump sphinx from 3.4.1 to 3.5.1
Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 3.4.1 to 3.5.1.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/3.x/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v3.4.1...v3.5.1)

Signed-off-by: dependabot[bot] <support@github.com>
2021-02-23 20:20:21 +00:00
Alexandre Flament 5f4a085fc4
Merge pull request #2595 from dalf/update-wikidata-units
[mod] update wikidata_units.json and fetch_wikidata_units.py
2021-02-23 17:22:37 +01:00
Alexandre Flament 94c9320c6f
Merge pull request #2585 from dalf/update-currencies
[mod] update currencies.json and fetch_currencies.py
2021-02-23 17:22:05 +01:00
Alexandre Flament 46ca32c3cc [mod] update currencies.json and fetch_currencies.py
use a sparql request on wikidata to get the list of currencies.

currencies.json contains the translation for all supported searx languages.

Supersede #993
2021-02-23 16:42:28 +01:00
Alexandre Flament 93d1da4906 [mod] update wikidata_units.json and fetch_wikidata_units.py
The fetch_wikidata_units.py result won't change randomly.
See comments in the script.
2021-02-23 13:10:38 +01:00
Noémi Ványi 1be6ab2a91 Fix paging of Bing Images 2021-02-22 21:19:34 +01:00
Alexandre Flament 9ace31c829
Merge pull request #2588 from datagram1/master
Added rumble.com video search engine.
2021-02-21 14:08:02 +01:00
datagram1 1d0a32a2c5 Added rumble.com video search engine. TODO video embedding.
Update rumble.py

some lines too long.

Disable Rumble engine

disabled : True

PEP8 fix

change line spacing
2021-02-20 12:48:56 +00:00
Alexandre Flament 640d6ce778
Update dependabot.yml 2021-02-19 13:08:57 +01:00
dependabot[bot] c89e59650b
Merge pull request #2579 from searx/dependabot/pip/master/sphinx-tabs-2.0.1 2021-02-17 19:51:38 +00:00
dependabot[bot] 731206d003
Bump sphinx-tabs from 1.3.0 to 2.0.1
Bumps [sphinx-tabs](https://github.com/executablebooks/sphinx-tabs) from 1.3.0 to 2.0.1.
- [Release notes](https://github.com/executablebooks/sphinx-tabs/releases)
- [Changelog](https://github.com/executablebooks/sphinx-tabs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/sphinx-tabs/compare/v1.3.0...v2.0.1)

Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 18:04:37 +00:00
dependabot[bot] 22c6fac671
Merge pull request #2578 from searx/dependabot/pip/master/pyyaml-5.4.1 2021-02-16 18:03:57 +00:00
dependabot[bot] 5d8e77bf20
Bump pyyaml from 5.3.1 to 5.4.1
Bumps [pyyaml](https://github.com/yaml/pyyaml) from 5.3.1 to 5.4.1.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/master/CHANGES)
- [Commits](https://github.com/yaml/pyyaml/compare/5.3.1...5.4.1)

Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:59:36 +00:00
dependabot[bot] 7dc6060c9c
Merge pull request #2581 from searx/dependabot/pip/master/pylint-2.6.2 2021-02-16 17:58:57 +00:00
dependabot[bot] 567a28be93
Bump pylint from 2.6.0 to 2.6.2
Bumps [pylint](https://github.com/PyCQA/pylint) from 2.6.0 to 2.6.2.
- [Release notes](https://github.com/PyCQA/pylint/releases)
- [Changelog](https://github.com/PyCQA/pylint/blob/master/ChangeLog)
- [Commits](https://github.com/PyCQA/pylint/compare/pylint-2.6.0...pylint-2.6.2)

Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:55:24 +00:00
dependabot[bot] 0cdf7761c0
Merge pull request #2577 from searx/dependabot/pip/master/jinja2-2.11.3 2021-02-16 17:54:34 +00:00
dependabot[bot] acfe2c0d4e
Bump jinja2 from 2.11.2 to 2.11.3
Bumps [jinja2](https://github.com/pallets/jinja) from 2.11.2 to 2.11.3.
- [Release notes](https://github.com/pallets/jinja/releases)
- [Changelog](https://github.com/pallets/jinja/blob/master/CHANGES.rst)
- [Commits](https://github.com/pallets/jinja/compare/2.11.2...2.11.3)

Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:50:13 +00:00
dependabot[bot] 2b245a4609
Merge pull request #2580 from searx/dependabot/pip/master/nose2-coverage_plugin--0.10.0 2021-02-16 17:49:32 +00:00
dependabot[bot] b843dcc404
Bump nose2[coverage_plugin] from 0.9.2 to 0.10.0
Bumps [nose2[coverage_plugin]](https://github.com/nose-devs/nose2) from 0.9.2 to 0.10.0.
- [Release notes](https://github.com/nose-devs/nose2/releases)
- [Changelog](https://github.com/nose-devs/nose2/blob/master/docs/changelog.rst)
- [Commits](https://github.com/nose-devs/nose2/compare/0.9.2...0.10.0)

Signed-off-by: dependabot[bot] <support@github.com>
2021-02-16 17:43:13 +00:00
Alexandre Flament fd1b8f661b
Update dependabot.yml 2021-02-16 18:42:44 +01:00
Alexandre Flament 3ee24b685a
Create dependabot.yml
Only pip packages and ignore pygments, related to https://github.com/searx/searx/pull/2206
2021-02-16 18:41:34 +01:00
Alexandre Flament 44a6593c13
Merge pull request #2573 from unixfox/yggtorrent
update yggtorrent url + add it back
2021-02-16 08:22:07 +01:00
Alexandre Flament 09e28ae779
Merge pull request #2570 from xenrox/improve-peertube
Improve peertube searching
2021-02-16 08:17:42 +01:00
Emilien Devos 4b37e10dd9 fix yggtorrent url + add it back 2021-02-15 13:38:34 +01:00
Thorben Günther fbbd4cc21f
Improve peertube searching
At the moment videos without a description are not shown - setting
default content to "" fixes this.
Another current bug is that thumbnails are not displayed. This is caused
by a double slash in the url. For this every trailing slash is now
stripped (for backwards compatibility) and the API response is correctly
parsed.
2021-02-13 19:47:33 +01:00