Commit Graph

563 Commits

Author SHA1 Message Date
Bartosz Rumiński 4e04991762 Support short custom youtube channel urls 2020-10-09 17:06:59 +02:00
Fynn Godau cfe88a74c1 Throw ContentNotSupportedException when opening radio uploader channel 2020-08-09 10:07:49 +02:00
TobiGr 0fb73301e3 [YouTube] Fix crash on empty comment
Closes #380
2020-08-05 18:25:40 +02:00
Fynn Godau 932d094d6a Upgrade featured playlist urls to https 2020-08-02 16:55:18 +02:00
Fynn Godau c12ef3a02d Merge TNP/dev into fynngodau/dev 2020-08-02 16:43:04 +02:00
wb9688 ff560e907a Remove getNextStream() from StreamExtractor 2020-07-15 18:48:37 +02:00
Tobias Groza a70cb0283f
Merge pull request #314 from wb9688/remove-getnextpageurl
Next page stuff
2020-07-07 20:49:38 +02:00
wb9688 0a5a905bc7 Add final at more places 2020-07-07 20:45:47 +02:00
wb9688 17ba8a57fa Clean up the code 2020-07-06 20:19:31 +02:00
wb9688 4cc312086a Introduce Page class 2020-07-06 20:19:31 +02:00
wb9688 e3bfdba135 Remove getNextPageUrl() function from ListExtractor 2020-07-06 20:11:40 +02:00
wb9688 156a26b64b Support start= timestamps for YouTube 2020-07-06 14:08:40 +02:00
bopol 261471e7f4 remove invidiou.sh from tests
dead instance
2020-07-02 21:33:45 +02:00
Tobias Groza c0ceb5cb27
Merge pull request #340 from wb9688/peertube-deleted-comments
Handle isDeleted for PeerTube comments
2020-06-28 10:21:37 +02:00
Tobias Groza 339f1d9c43
Merge pull request #349 from wb9688/okhttp
Use OkHttp for tests like in NewPipe
2020-06-27 20:08:02 +02:00
Tobias Groza 92f6754f0f
Merge pull request #338 from wb9688/parse-duration-string-test
Add tests for parseDurationString()
2020-06-15 11:01:21 +02:00
Stypox 5808439c3f
[PeerTube] Change age restricted video in tests
The old one wasn't available anymore
2020-06-14 19:57:39 +02:00
wb9688 3239aa84f2 Handle isDeleted for PeerTube comments 2020-06-14 19:27:20 +02:00
wb9688 a65e46e4b1 Use OkHttp for tests like in NewPipe 2020-06-11 15:06:08 +02:00
Fynn Godau 39b55b5b42 Bandcamp radio stream extractor: test uploader url 2020-06-04 19:32:19 +02:00
Fynn Godau 9a555d97e5 Remove useless bandcamp tests 2020-06-04 19:31:01 +02:00
Fynn Godau e13f341a45 Bandcamp stream extractor: test service id 2020-06-04 19:29:37 +02:00
Fynn Godau 52103ac61f Remove "useless" comments 2020-06-04 19:27:13 +02:00
Fynn Godau 8fa81537c0 Better bandcamp stream extractor description test 2020-06-04 19:17:51 +02:00
Fynn Godau e6ecd91929 Bandcamp: Test full date 2020-06-04 19:12:10 +02:00
bopol 063f4be766 For #342: support PeerTube embeds 2020-06-04 14:26:42 +02:00
Fynn Godau 1be20ceeec Bandcamp: parse date 2020-06-04 14:09:21 +02:00
Fynn Godau 6822fe3dc8 Bandcamp: Get Stream upload date 2020-06-04 13:03:16 +02:00
Fynn Godau e98bff8ae9 Improved Bandcamp radio stream extractor tests 2020-06-04 12:30:53 +02:00
Fynn Godau 8f6c00f8d8 Use default test in BandcampSearchExtractorTest 2020-06-04 12:12:20 +02:00
Fynn Godau de776561b0 Bandcamp: fix loading uploader from streams in search 2020-06-04 12:02:18 +02:00
Fynn Godau dd955c7f0c Merge branch 'origin/dev' into dev 2020-06-03 21:13:40 +02:00
wb9688 33b1121fc7 Add tests for parseDurationString() 2020-05-30 17:20:54 +02:00
wb9688 4d683e7655 Support YouTube's learning playlists 2020-05-29 09:17:03 +02:00
Tobias Groza 0b4977bb0c
Merge pull request #333 from wb9688/playerresponse-dashmanifesturl
Extract dashManifestUrl in playerResponse
2020-05-28 21:17:07 +02:00
wb9688 036cc7e26e Upgrade jsoup 2020-05-28 11:34:41 +02:00
Fynn Godau 89b0639faa New Bandcamp tests for channel extractor 2020-05-25 20:22:23 +02:00
Fynn Godau e08256ebc6 Remove "url cleanup" in Bandcamp link handlers 2020-05-25 19:17:27 +02:00
Fynn Godau 692b2d06f4 Bandcamp: read info item data in place and not in advance 2020-05-25 18:53:15 +02:00
Fynn Godau fff21caa87 Fix Bandcamp no avatar test
I own the bandcamp artist account called "NewPipeExtractorTest", so it
shouldn't break again.
2020-05-25 18:53:10 +02:00
wb9688 7ef3e80493 Extract dashManifestUrl in playerResponse 2020-05-15 12:07:26 +02:00
wb9688 baf5dd3e8f
Merge pull request #311 from B0pol/fixSearchSuggestion
Search: add isCorrectedSearch() and fix YoutubeSearchExtractor#getSea…
2020-05-12 09:29:15 +02:00
Tobias Groza b40ccb5075
Merge pull request #307 from B0pol/playlists_peertube
[PeerTube] playlist support
2020-05-11 20:53:03 +02:00
bopol de26e00079 changed all == null || isEmpty() to isNullOrEmpty() 2020-05-11 11:40:24 +02:00
bopol 202a73516c refactor: add Utils.isNullOrEmpty() 2020-05-11 11:26:18 +02:00
bopol 7cae95bf09 add tests for subchannel stuff in playlists 2020-05-09 10:15:35 +02:00
bopol 5bab9d9fc0 [PeerTube] playlist support & refactoring 2020-05-09 00:52:04 +02:00
Tobias Groza f3913e241e
Merge pull request #324 from Stypox/music-detector-url
[YouTube] Support stream urls in `vnd.youtube://ID` form
2020-05-08 17:43:04 +02:00
wb9688 7320108c66 Rename SubChannel in channels back to ParentChannel 2020-05-08 16:02:59 +02:00
Roy Yosef a408661771 Fix PR review
Rename "ParentChannel" to "SubChannel"
Add Tests for sub-channel info fetching
2020-05-07 20:20:12 +02:00
Roy Yosef 4234740baa Add parent channel info to ChannelExtractor: name, url & avatar url 2020-05-07 20:20:12 +02:00
bopol 3757541a9c adapt new nanojson version 2020-05-07 15:40:41 +02:00
bopol e8d58e09c9 getSearchSuggestion now returns the corrected query if isCorrectedSearch() is true 2020-05-07 15:40:41 +02:00
bopol 29b639b454 Search: add isCorrectedSearch() and fix YoutubeSearchExtractor#getSearchSuggestion()
isCorrectedSearch: see the javadoc
getSearchSuggestion: in YoutubeSearchExtractor, it was giving the corrected search query. It now gives the suggested query, as it should
2020-05-07 15:39:57 +02:00
Stypox a02bfbeae5
[YouTube] Support stream urls in `vnd.youtube://ID` form 2020-05-07 15:31:31 +02:00
bopol bc13e0c616 Merge remote-tracking branch 'upstream/dev' into soundcloudComments 2020-05-05 14:49:21 +02:00
wb9688 a1eabc7589 Return null instead of "" in getTextFromObject() 2020-05-02 08:02:25 +02:00
Fynn Godau e7b046db9d Merge remote-tracking branch 'origin/dev' into dev 2020-04-26 23:12:43 +02:00
bopol 2564bcf399 refactor comments
rename methods in CommentsInfoItemExtractor interface to match the other method names across NewPipeExtractor
remove getName in (Youtube|SoundCloud|Peertube)CommentsExtractor and move it up in CommentsExtractor, return "Comments" instead
2020-04-21 20:05:54 +02:00
Fynn Godau f71bd29d58 Bandcamp playlist extractor: add more tests 2020-04-20 23:52:12 +02:00
Fynn Godau 5009d9f53b Bandcamp tests: remove certain tests 2020-04-20 23:25:00 +02:00
Fynn Godau b5e251c82f Bandcamp channel extractor: package-private access for getImageUrl(…) 2020-04-20 23:12:43 +02:00
Fynn Godau 00c0333059 Bandcamp: Fetch channelInfo in onFetchPage 2020-04-20 22:41:44 +02:00
Fynn Godau c133190c53 Bandcamp capitalization 2020-04-20 21:55:35 +02:00
wb9688 74f0ab1792
Merge pull request #301 from wb9688/media-ccc-non-api-urls
Use media.ccc.de instead of api.media.ccc.de
2020-04-19 17:06:57 +02:00
Fynn Godau 5c0a03328a Merge 'origin/dev' into dev 2020-04-19 14:26:51 +02:00
Roy Yosef 4afe657f6f Add tests for getUrlFromId and test for video-channels in acceptUrlTest 2020-04-10 19:05:38 +03:00
Roy Yosef 2c9f1260eb Fix wb9688 review comments
* Rename PeertubeUserExtractor to PeertubeAccountExtractor
* Add test for video-channels in PeertubeChannelLinkHandlerFactoryTest
* Compatibility support for older versions (use "accounts/" as default)
2020-04-10 16:40:53 +03:00
bopol 636c430743 refactor: create extractors and linkHandler packages for SoundCloud, move YoutubeParsingHelper to youtube package (not linkhandler anymore) 2020-04-10 10:51:05 +02:00
Roy Yosef b6e6f403a8 add support for PeerTube channels extraction 2020-04-09 20:37:49 +03:00
bopol 9a7c6b7ab0 use ContentNotSupportedException for channels without tabs 2020-04-07 14:33:43 +02:00
bopol a22104cbda add tests for ContentNotSupportedException 2020-04-07 14:33:43 +02:00
wb9688 bf24caa5f2 Use media.ccc.de instead of api.media.ccc.de 2020-04-01 13:25:10 +02:00
wb9688 2af610e3e7 Add tests for other YT Music search types 2020-04-01 10:30:51 +02:00
wb9688 cf0f2aff3e Extract uploader url from certain YouTube Music videos 2020-04-01 10:30:51 +02:00
wb9688 aa8cea47f3 Refactor YouTube Music search tests 2020-04-01 10:30:51 +02:00
wb9688 d58c0f230d Improve code for YouTube Music search 2020-04-01 10:30:51 +02:00
wb9688 dc29d87962 Extract YouTube search suggestions 2020-04-01 10:30:51 +02:00
wb9688 eb48524411 Add tests for YouTube Music search 2020-04-01 10:30:51 +02:00
Tobias Groza 69e0624e35
Merge pull request #298 from B0pol/feed_peertube
[peertube] add feed url in channels
2020-03-28 12:53:47 +01:00
bopol 0ae53c1e50 [peertube] adapt test for channel feed url 2020-03-28 11:48:24 +01:00
TobiGr 647e7cd450 Accept YouTube Music playlists but not YouTube Mixes 2020-03-25 22:24:18 +01:00
Tobias Groza e4874d554e
Merge pull request #296 from mauriciocolli/fix-search-errors-detection
Fix search errors detection and refactor search tests
2020-03-24 21:53:32 +01:00
Mauricio Colli 0a20c53f1a
Use easier-to-read asserts statements in tests 2020-03-23 18:08:59 -03:00
Tobias Groza 6fd9b38ad9
Merge pull request #287 from mauriciocolli/fix-channel-redirect
[YouTube] Fix channel with redirects directly in the response
2020-03-23 18:41:56 +01:00
Mauricio Colli 04bfa0ec6a
[PeerTube] Update video used in age limit test (was 404 not found) 2020-03-21 15:55:40 -03:00
Mauricio Colli 9704fc9952
Improve search extractor tests for services 2020-03-21 15:55:36 -03:00
TobiGr 2cf8cbf0df Merge branch 'master' into dev 2020-03-18 22:29:10 +01:00
Stypox 265cfb61f3
[SoundCloud] Add test for small playlist, use defaultTestGetPageInNewExtractor 2020-03-17 21:03:50 +01:00
Fynn Godau a1523eb293 Update Bandcamp service to latest interface changes 2020-03-17 20:40:25 +01:00
Stypox ae47c9587c
[SoundCloud] Optimize imports in edited files 2020-03-17 20:32:04 +01:00
Stypox 4389fd3b7b
[SoundCloud] Migrate StreamExtractor to api-v2 2020-03-17 18:06:13 +01:00
Stypox 5e4ddb368f
[SoundCloud] Fix extractors built from next playlist pages
They didn't have the information to calculate another next page url. So now `nextPageUrl` contains a full link with all video ids, and `getPage` takes the first part of the url (containing 15 streams) and produces another `nextPageUrl` with the remaining streams.
Also add a test for this.
2020-03-17 18:04:40 +01:00
fynngodau b78f788017
Merge branch 'dev' into dev 2020-03-17 18:03:14 +01:00
Stypox 0e1b4bbf17
[SoundCloud] Test playlists banner: it should not exist 2020-03-17 15:53:25 +01:00
Stypox 65bdb3bc9d
[SoundCloud] Unignore ignored playlist tests 2020-03-17 15:49:58 +01:00
Stypox 1558da6f6b
[SoundCloud] Fix playlist next page generation 2020-03-17 15:46:35 +01:00
Stypox ca8bf53b61
[SoundCloud] Fix playlist test: number of streams changed 2020-03-17 15:35:33 +01:00
Stypox 4b1121aac7
[SoundCloud] Add tests for api-v2 channel urls 2020-03-17 15:23:13 +01:00
TobiGr efad0be99f Test if the extractor can get AudiStreams with the hard-coded cliend_id
SoundCloud client_id are changed on a regular basis now. We might want to remove the hardcoded id completely on a later point of time when client_id is changed to often
2020-03-16 19:42:35 +01:00
Tobias Groza 65a7eda446
Merge pull request #256 from B0pol/mediaccc
Support for non-api mediaccc links, invidious shortened links, refactor mediaccc tests
2020-03-15 17:04:09 +01:00
TobiGr 40b3bc138f Remove hack to fix YoutubeStreamLinkHandlerFactoryTest of vnd.youtube videos 2020-03-14 21:54:54 +01:00
Stypox 957b78ed9b
[YouTube] Add test for an unlisted video, which has no next stream 2020-03-14 14:04:01 +01:00
Mauricio Colli 00d1ed439b
[YouTube] Fix channel extraction when redirects are in the response
Some redirects were embed directly into the response as instructions
for the page, instead of the usual http redirects.
2020-03-14 02:39:48 -03:00
bopol 66518ec444 check wether mediaccc streams url are secure 2020-03-13 20:07:36 +01:00
bopol 0cd5e05b7b MediaCCCLH: use substring instead of replace; improve a bit tests, return Collections.emptyList(); instead of null where it's annotated @NonNull 2020-03-13 20:00:49 +01:00
bopol f742a6bd3e code optimization 2020-03-13 20:00:49 +01:00
bopol e8e535b815 mediaccc: update linkhandlers & refactor tests 2020-03-13 20:00:49 +01:00
Mauricio Colli 6aa4d59b91
[PeerTube] Update video used in age limit test (the previous was 404) 2020-03-01 10:29:30 -03:00
Mauricio Colli 90ae5fbea2 Improve kiosk tests across services 2020-03-01 12:57:18 +01:00
Mauricio Colli e590417cc4 Test if services recognizes their own items urls 2020-03-01 12:57:18 +01:00
Mauricio Colli 5686a6f562 [YouTube] Detect when a stream is deleted or doesn't exist
Added a test case as well.
2020-03-01 12:49:13 +01:00
Mauricio Colli e65333c3ce [YouTube] Detect deleted/nonexistent/invalid channels and playlists
- Added tests for these cases.
2020-03-01 12:49:13 +01:00
Mauricio Colli 408f042127 [YouTube] Fix bug when url isn't present in the browseEndpoint object 2020-03-01 12:49:13 +01:00
Mauricio Colli 342bdbb852 [YouTube] Avoid crashing by letting exceptions bubble up 2020-03-01 12:49:13 +01:00
Mauricio Colli 5edd774fc4 Add latest url to the response to make detection of a redirect possible
Will be latest one in this commit because there's need to check the
history of redirects as of now.
2020-03-01 12:49:13 +01:00
Mauricio Colli 3441946bea Make test downloader return a response instead of throwing an exception
The test implementation was throwing an exception instead of just
returning the response and letting the caller handle it.
2020-03-01 12:49:13 +01:00
wb9688 3e4d2fd64e Improve testChannelUrl() 2020-02-29 18:20:35 +01:00
wb9688 bfe3eb1409 Use suggested try-if code style 2020-02-29 17:18:50 +01:00
wb9688 beb07a4852 Add test to check whether hardcoded client version is still valid 2020-02-28 16:36:14 +01:00
wb9688 365b0329f3 Implement getTextFromObject() function 2020-02-27 17:39:23 +01:00
wb9688 8d503407ef Parse browseEndpoint and watchEndpoint in descriptions 2020-02-26 19:37:58 +01:00
wb9688 8dc39d517a Fix tests
Except testGetFullLinksInDescription() in DescriptionTestUnboxing, since that requires other changes first.
2020-02-26 17:31:01 +01:00
TobiGr 9efcc61ca6 Adapt some tests to match the new URLs 2020-02-25 21:51:30 +01:00
TobiGr f33f9466ce Fix testDescription() in ChannelExtractor 2020-02-25 21:51:30 +01:00
TobiGr 21253abd9b Use Firefox ESR User-Agent: 68 2020-02-25 21:51:30 +01:00
TobiGr 39bf1ff1eb Add ytInitialData regex 2020-02-25 21:51:30 +01:00
TobiGr 030465b5d4 Improve code formatting and optimise imports 2020-02-15 13:36:54 +01:00
TobiGr 008b6f505c [PeerTube] Fix subscriber count in ChannelExtractorTest 2020-02-08 23:08:37 +01:00
TobiGr 0e33249c85 Fix SoundCloud description test 2020-02-08 22:20:20 +01:00
Fynn Godau 36a316eea5
Merge branch 'dev' into dev 2020-02-08 09:43:13 +01:00
bopol 0f8a7f9df2 fix testGetUploadDate for PeerTubeStreamExtractor 2020-02-07 13:33:50 +01:00
bopol 26c65b2948 Create class Description 2020-02-06 23:35:46 +01:00
B0pol b671a4ba18
Merge branch 'dev' into peertube 2020-02-01 18:18:23 +00:00
Mauricio Colli 26234a1c0f
Introduce FeedExtractor making fetching from dedicated feeds possible
YouTube, for example, has a dedicated feed which was built to be used
like this.
2020-01-28 02:44:18 -03:00
B0pol e392b6c68f getLanguageInfo returns Locale instead of String
so that java can automatically translate with Locale.getDisplayLanguage(), instead of always having English name of the language
2020-01-25 14:12:38 +01:00
bopol c790261eed update test 2020-01-23 19:08:41 +01:00
bopol 20da4750f8 empty support returns "", same for empty description 2020-01-23 14:37:14 +01:00
bopol 74439f692a add extraction for support info and rename getLanguageInfo function 2020-01-23 14:19:22 +01:00
B0pol 1a15c0e750 agelimit now returns 18 if the video is marked as nsfw, 0 otherwise
+ created getBoolean method in JsonUtils.java
2020-01-23 04:42:54 +01:00
B0pol bcfe7be4e6
Merge branch 'dev' into peertube 2020-01-22 19:19:41 +01:00
Tobias Groza b9afc9807c
Merge pull request #233 from Stypox/yt-stream-ext
Youtube stream extractor improvements by using playerResponse json
2020-01-20 23:17:36 +01:00
TobiGr 2308b074f0 [MediaCCC] Fix testGetTextualUploadDate() 2020-01-20 22:12:39 +01:00
TobiGr 089dbe8afb Fix StreamLinkHandlerFactoryTest by passing baseUrl to vdn.youtube urls 2020-01-20 22:10:18 +01:00
TobiGr 69ccb7e69d Update subtitle tests comments 2020-01-20 21:25:47 +01:00
TobiGr 39de55dcd3 [YouTube] Fix and move streamCountTest 2020-01-20 21:24:51 +01:00
bopol ad7f97ae83 fix PeerTube description and add more description tests
actually, the max description length is 250 after request with our extractor.
during my tests, I made API requests with Firefox, copy/pasted into echo "insert description" | wc, and it was giving a wrong length, maybe due to the escapers, I have no idea
anyway, it's now fixed
2020-01-20 15:14:23 +01:00
bopol a281519e77 added metadata, fix descriptions, fix thumbnail, update tests
thumbnail: quality before: https://peertube.cpy.re/static/thumbnails/d2a5ec78-5f85-4090-8ec5-dc1102e022ea.jpg
quality after: https://peertube.cpy.re/static/previews/d2a5ec78-5f85-4090-8ec5-dc1102e022ea.jpg

description: we were getting about the first 260 characters, we now get full description (with fallback to first 260 chars if the get request for full description fails)
test: updated tests to match description, also changed some test: it was assertEquals(extracted, expected), but the proper way to do it is assertEquals(expected, extracted)

metadata: got host, privacy (public, private, unlisted), licence, language, tags
2020-01-20 12:22:33 +01:00
Tobias Groza 2ee558fbe7
Merge pull request #237 from B0pol/fix_invidious_comments
Fix invidious comments
2020-01-17 22:55:51 +01:00
Tobias Groza 5a259fca94
Merge pull request #238 from B0pol/c_links_support
add support to /c/shortened_url channel links
2020-01-17 22:53:46 +01:00
bopol 221e8dd171 changed assertTrue(string.equals(string)) to assertEquals(string, string) 2020-01-17 21:24:52 +01:00
bopol 5e81ed1dff add support to /c/shortened_url channel links 2020-01-17 19:27:54 +01:00
B0pol 02930d08f1 added comments test for invidious 2020-01-17 12:58:50 +01:00
B0pol a12c0e2a37 fix:invidious: getID and onAccpetURl for comments 2020-01-17 12:09:59 +01:00
B0pol 3743c60695 fix: typos in Test 2020-01-15 14:27:52 +01:00
Stypox 7ba04836eb
Add tests for ratings in yt stream extractor tests 2020-01-06 23:57:08 +01:00
Stypox 1bb6cdee22
Enable commented-out test for yt stream extractor 2020-01-06 21:43:24 +01:00
Stypox d5ca02f3f6
Fix test failing because music channel could be Vevo
In yt stream extractor test.
The Vevo and the normal music channel are equivalent, so Youtube picks one of them at random, and in playerResponse the channel id is Vevo's one.
2020-01-06 21:41:15 +01:00
Stypox 1689037b01
Fix getLength() tests now that the value is rounded (not floor-ed)
In yt stream extractor
2020-01-06 20:49:08 +01:00
Fynn Godau ba967f1a15 Workaround enourmous load times for long bandcamp playlists
Additionally, get cover art from json instead of html
2020-01-03 13:17:04 +01:00
Fynn Godau 808c8aa087 Add bandcamp weekly kiosk
Unfortunately a little messy
2020-01-03 12:28:49 +01:00
Fynn Godau 13ef11e9c8 Bandcamp featured kiosk 2020-01-03 12:28:49 +01:00
Fynn Godau db02850d4f Bandcamp playlist extractor: support playlists with just one stream 2020-01-03 12:28:49 +01:00
Fynn Godau 13e4908b83 Bandcamp search extractor: read track count from result page 2020-01-03 12:28:49 +01:00
Fynn Godau 9b16baffb7 Bandcamp search: multiple pages 2020-01-03 12:28:49 +01:00
Fynn Godau ce2a88e56f Add bandcamp search suggestion extractor 2020-01-03 12:28:49 +01:00
Fynn Godau e12ddaef7f Bandcamp playlist and search extractors: better and more tests 2020-01-03 12:28:49 +01:00
Fynn Godau ba700bfb3e Add bandcamp playlists (albums) 2020-01-03 12:28:49 +01:00
Fynn Godau d05b14ae48 Add channels (artists) to search results 2020-01-03 12:28:49 +01:00
Fynn Godau 794ca5eeae Bandcamp channel extractor: handel nonexistent images better 2020-01-03 12:28:49 +01:00
Fynn Godau 91c0ec7cea Bandcamp stream extractor: catch NullPointerException 2020-01-03 12:28:49 +01:00
Fynn Godau d5cdc20be1 Bandcmap channel extractor: fix getting banner url 2020-01-03 12:28:49 +01:00
Fynn Godau a42c77425d Bandcamp channel extractor (ignoring everything but tracks) 2020-01-03 12:28:49 +01:00
Fynn Godau 5281456899 Bandcamp channel link handler factory 2020-01-03 12:28:49 +01:00
Fynn Godau c3d127ccd9 Bandcamp audio stream test and fix 2020-01-03 12:28:49 +01:00
Fynn Godau a579337c9a Bandcamp service with support for streams and searches 2020-01-03 12:28:49 +01:00
TobiGr 0b6e37e71f Improve YouTubeSearchPagingtest 2019-12-31 00:18:53 +01:00
Zsombor Gegesy 64729e5357 Improve the tests 2019-12-29 23:14:55 +01:00
Zsombor Gegesy 68b0fd9650 Add test for search paging 2019-12-29 23:14:55 +01:00
yausername 5115541268
fix peertube trending, added most-liked kiosk 2019-12-03 00:42:06 +05:30
yausername 279f175693 validate peertube instance 2019-11-22 22:59:14 +05:30
yausername 4e0adbefbc [peertube] use baseUrl instead of global instance url 2019-11-21 05:35:22 +05:30
yausername f3a59a6cdc merged upstream/dev 2019-11-20 03:08:17 +05:30
Mauricio Colli 0c6e2c8f23 Revert "Temp Commit: Ignore Test (Remove this before merge)"
This reverts commit 6ca4c8986a.
2019-11-18 10:09:18 +01:00
yausername 193442d01c add original url for share 2019-11-16 02:42:39 +05:30
yausername d7582734e7 merged upstream/dev 2019-11-16 00:07:45 +05:30
Mauricio Colli 3d21ef5dba
Introduce class that indicates when the time ago is an approximation 2019-11-03 15:46:28 -03:00
Mauricio Colli 6ca4c8986a
Temp Commit: Ignore Test (Remove this before merge) 2019-11-03 15:46:27 -03:00
Mauricio Colli d8280ce0da
[YouTube] Parse watching count in live streams items 2019-11-03 15:46:22 -03:00
Mauricio Colli 3638f0e0ea
Implement time ago parser and improve localization handling
- Handle special cases for languages where the number is not shown
- Rework the Downloader base implementation, allowing for more
advanced things to be done
- Separate the localization from the content country (just like
YouTube let's the user choose both).
2019-11-03 15:46:21 -03:00
wojcik-online 180836c180
Base Implementation: Parse the upload date of StreamInfoItems
In the format '2 days ago' (in English) on a YouTube channel page.
(Parser extensible to other pages.)
2019-11-03 15:46:20 -03:00
Mauricio Colli c4fe2183ce
[YouTube] Improve detection of reCAPTCHA pages 2019-10-29 02:00:41 -03:00
Mauricio Colli ddd563fe78 [SoundCloud] Add test for hardcoded client id 2019-10-23 16:54:20 +02:00
Mauricio Colli 250c0bb1e8 Add head request to the current downloader implementation 2019-10-23 16:54:20 +02:00
Vasiliy d8279f91f6
Merge branch 'dev' of https://github.com/TeamNewPipe/NewPipeExtractor into feature/frames 2019-09-28 14:46:14 +03:00
Stypox f6088c4fc1 Add test for Eminem channel (it has no "Subscribe" button) 2019-09-25 08:32:00 +02:00
TobiGr 6d504e0883 Add test for mixedNumberWordToLong method
Add Billion to mixedNumberWordToLong
2019-09-17 09:15:05 +02:00
TobiGr 06016d1ae3 Fix YouTube subscriber count
Modify test to fail on too small subscriber count
2019-09-16 23:16:05 +02:00
Tobias Groza dbdd9ed083
Merge pull request #195 from Stypox/livestream-fix
Fix livestreams
2019-09-12 22:40:44 +02:00
toehead2001 b709529cb6 Add link handler tests for music.youtube.com 2019-09-12 12:16:30 -06:00
Stypox 1a1672248a
Eliminate Android Studio warnings in livestream test 2019-09-12 15:11:23 +02:00
Stypox 4453a63447
Add test for YouTube livestreams
The current livestream is https://www.youtube.com/watch?v=EcEMX-63PKY
2019-09-12 15:05:22 +02:00
Stypox 5f8e76eb87
Move stream-related youtube tests to subfolder 2019-09-12 14:36:42 +02:00
Vasiliy b55c05d04f
Update frameset extractor test 2019-09-10 19:42:55 +03:00
Vasiliy f084cfec24
Refactor frames extraction 2019-09-10 19:38:51 +03:00
Vasiliy a6c94c7a9d
Grub frames preview from youtube 2019-08-26 19:14:09 +03:00
Christian Schabesberger 58e3996edc
Merge branch 'dev' into duplicate-subscription-fix 2019-08-18 00:42:24 +02:00
Stypox 06689a2f27
Add url to ReCaptchaException
Sometimes YouTube introduces recaptchas only on some pages. By adding an url to the ReCaptchaException the NewPipe app is able to use that url to load the page that originally caused the problem.
Also removed every instance of exception caught and rethrown with a different description: it makes no sense and it removes part of the useful stacktrace.
2019-08-17 09:09:07 +02:00
Stypox 216a4eb1f5
Complete fix inconsistency in youtube channel urls
It is not always possible to get the url in the form "https://www.youtube.com/channel/...", so a not has been added whenever that happens to be the case (i.e. only in InfoStreamItems).
2019-08-16 21:17:03 +02:00
Stypox 315c5c262f
Typo 2019-08-16 21:14:52 +02:00
Stypox d14c45c948
Fix SoundCloud tests 2019-08-12 17:15:21 +02:00
Stypox 31e74253f8
Fix tests 2019-08-12 16:38:56 +02:00
Stypox 09c6822b1d
Change youtube channel url test 2019-08-12 13:13:41 +02:00
Stypox b8bc57c53f
Add tests for youtube channel urls
They have to be in the form "https://www.youtube.com/channel/ID"
2019-08-12 11:58:50 +02:00
Christian Schabesberger 5798c8fdf5 fix duration can not be paresd
update gradle to version 5.1

fix sts issue for agegated videos

GOD DAMN FUCKING BULLSHIT

add duratin for controversal/age gated videos

bring back sts

remove ignores

fix ogg test
2019-07-31 16:11:42 +02:00
Tobias Groza 796c1b7bc0
Merge pull request #164 from TeamNewPipe/fix/test_comments
Fix failing YouTube comments tests
2019-06-02 11:36:16 +02:00
Tobias Groza 867ca1cabf Fix failing YouTube comments tests
The comment function has been disabled for the video on which we ran the test. We are testing the comments of a different video now.
2019-05-14 22:11:40 +02:00
Stypox 0eaca52c15
Add test for subscription with invalid url.
Also modified the test for empty title, since now  subscriptions with empty title are not ignored anymore.
2019-04-28 14:19:33 +02:00
Stypox d5043cdf49
Add test for subscriptions with empty title.
(youtube subscription extractor)
2019-04-26 19:59:23 +02:00
yausername e4e6d44770 reordered services 2019-03-23 19:12:26 +05:30
yausername 07a8129a73 fixed peertube search test 2019-03-23 19:11:19 +05:30
yausername bd22b55885 fixed youtube channel name test 2019-03-23 19:10:34 +05:30
yausername 2193119fab youtube's comment censorship breaks test 2019-03-23 19:09:40 +05:30
Connectety ed78f7dadc
Merge branch 'master' into invidious-support 2019-03-14 16:07:04 +01:00
Christian Schabesberger e072bf6461 fix dercrypt error due to wrong dollar sign detection 2019-03-14 08:49:11 +01:00
Ritvik Saraf c220700c94 fixed tests 2019-03-10 00:37:01 +05:30
Ritvik Saraf 36139558c6 handle stream 404 error, fixed tests 2019-03-09 23:33:51 +05:30
Ritvik Saraf 22dac63698 merged upstream/dev 2019-03-08 03:09:05 +05:30
Connectety 28c5b86f6d
Merge branch 'master' into invidious-support 2019-02-20 17:58:21 +01:00
Ritvik Saraf f8fb7b6500 Merge remote-tracking branch 'upstream/master' 2019-02-16 00:18:39 +05:30
Connectety 5079d5efe1
Merge branch 'master' into invidious-support 2019-02-07 23:06:19 +01:00
Ritvik Saraf f97d5ab4cd Merge remote-tracking branch 'upstream/master' 2019-01-29 22:10:07 +05:30
Christian Schabesberger 79b0a19d1a make search filter empty be equal to all 2019-01-29 16:49:37 +01:00
Christian Schabesberger d0efe8bd47 fix ogg 2019-01-29 16:04:19 +01:00
Christian Schabesberger 644da4fc3c add ogg as audioformat 2019-01-28 15:43:21 +01:00
Christian Schabesberger 14e1ccdb86 add conferences search 2019-01-28 15:30:17 +01:00
Christian Schabesberger 1503459292 add kiosk for conferences 2019-01-28 12:18:16 +01:00
Connectety-W 1ab7a1f930
added tests for YoutubePlaylistLinkHandlerFactory 2019-01-27 12:00:23 +01:00
Connectety-L ec4aa9e0cd
added Invidio subdomain test and fixed error in test caused by Invidio playlist support 2019-01-27 02:12:12 +01:00
Connectety-L cce5e4ad33
added support and tests for Invidio Trending-URLs 2019-01-27 01:29:23 +01:00
Christian Schabesberger 2148edc7d7 add channel and strem extractor for mediaccc 2019-01-26 17:47:58 +01:00
Christian Schabesberger ef576341c8 implement searchextractor for mediaccc 2019-01-26 15:22:16 +01:00
Connectety-L 2ede47d36c
added hooktube and invidio http test 2019-01-24 14:19:44 +01:00
Connectety-L 399b4f2eef
added support for "vnd.youtube.launch" URI-scheme 2019-01-24 10:53:03 +01:00
Connectety-L 79ba6aba95
added tests from https://github.com/TeamNewPipe/NewPipeExtractor/pull/128 2019-01-24 10:27:01 +01:00
Ritvik Saraf c4e502b9d2 Merge branch 'master' into peertube 2019-01-19 14:33:01 +05:30
Ritvik Saraf 25ed9deaf3 Merge remote-tracking branch 'upstream/master' 2019-01-19 14:28:12 +05:30
Christian Schabesberger 97d72590fc
Merge branch 'master' into master 2019-01-18 22:31:37 +01:00
Christian Schabesberger 99915e4527 fix failing tests 2019-01-18 12:44:34 +01:00
Christian Schabesberger 09bafe0660 fix failing viewcount test 2019-01-18 12:24:30 +01:00
Connectety-W 98f49852d7
refactored YouTube-linkHandler to use less regex and more URL-methods 2019-01-13 12:52:07 +01:00
Ritvik Saraf df0db8468d merged master 2018-12-25 19:12:22 +05:30
Ritvik Saraf 4c49a347f6 merged upstream/master 2018-12-04 21:20:26 +05:30
Christian Schabesberger a78ad16235 rebase correctly 2018-11-09 19:55:40 +01:00
kapodamy b40a1f3657 Delete Subtitles.java
change class name
2018-11-08 17:06:41 -03:00
Christian Schabesberger 7129d6db55 add inline documentation for StreamExtractor 2018-11-07 18:28:44 +01:00
Christian Schabesberger 4de99ae28f add support for segmented streams 2018-11-06 14:24:47 +01:00
Christian Schabesberger 32d316330c fix broken search results 2018-10-25 15:46:47 +02:00
Ritvik Saraf 05ef80c2eb Merge remote-tracking branch 'upstream/master' 2018-10-19 20:09:51 +05:30
Ritvik Saraf 20f280cb57 added peertube extractor 2018-10-12 00:40:22 +05:30
Christian Schabesberger 24cb684e23 fix failing test 2018-10-06 17:11:12 +02:00
Christian Schabesberger 0920680708 fix search country for next page 2018-10-06 17:03:55 +02:00
Christian Schabesberger 0c3dc86b07 add support for yt content country 2018-10-06 12:22:37 +02:00
Christian Schabesberger 3a865749e8 fix issues Kiosk issue about localization, nad rename to preferred localization 2018-10-05 16:01:10 +02:00
Ritvik Saraf e85958b180 merged upstream/master 2018-09-29 13:19:00 +05:30
Ritvik Saraf 6b620914b6 moved cookie logic outside 2018-09-27 02:04:12 +05:30
Ritvik Saraf ce76885553 removed generics 2018-09-26 04:21:58 +05:30
Ritvik Saraf 8e27801183 removed jackson and java 8 2018-09-26 03:20:29 +05:30
Christian Schabesberger 5223aece7b fix failing unit test 2018-09-24 15:17:57 +02:00
Christian Schabesberger f334dd07de fix youtub.be links in description 2018-09-24 15:06:00 +02:00
Christian Schabesberger ad4b15ac66
Merge pull request #114 from TeamNewPipe/localization
Localization
2018-09-24 14:00:20 +02:00
Ritvik Saraf 0e86475891 removed commentsInfo from streamInfo 2018-09-22 23:36:41 +05:30
Christian Schabesberger 49c2eb5185 fix failing watch links 2018-09-20 13:51:06 +02:00
Ritvik Saraf 4794e16dcb removed comment details form streamInfo. added commentsInfo instead 2018-09-19 04:58:40 +05:30
Ritvik Saraf ee239985ae added CommentsInfo 2018-09-19 04:58:40 +05:30
Ritvik Saraf 823551170d added loadable comments in stream info 2018-09-19 04:58:40 +05:30
Ritvik Saraf f62f147ea0 added comments to stream info 2018-09-19 04:58:40 +05:30
Ritvik Saraf 06898f47b2 close resource 2018-09-19 04:58:40 +05:30
Ritvik Saraf 95575756ee added http post method in downloader, formatting 2018-09-19 04:58:40 +05:30
Ritvik Saraf 53d3997904 added comments extractor 2018-09-19 04:58:40 +05:30
Christian Schabesberger ce2bbee1e9 add propper localization 2018-09-15 22:29:28 +02:00
Christian Schabesberger dc0d0bda24 replace uiHandler name with linkhandler 2018-09-15 22:29:28 +02:00
Christian Schabesberger 217d13b102 fix wrong subscription count 2018-09-11 15:14:22 +02:00
Christian Schabesberger 66c3c3f452 fix channel links in description part 2 2018-09-07 22:18:22 +02:00
Christian Schabesberger 4469d11307 fix channel links in description 2018-09-07 21:40:36 +02:00
Christian Schabesberger f498dd7875 fix failing unit tests
fix yt share url error
2018-08-28 17:19:22 +02:00
Christian Schabesberger fef71aeccc roleback using href for description links 2018-08-28 11:55:12 +02:00
Christian Schabesberger 3aa7ff6d0e make ytdescription alter href instead of the text of links 2018-08-27 20:45:43 +02:00
Christian Schabesberger e662c97433 make dash parser ignore segmented streams 2018-08-21 17:23:56 +02:00
Christian Schabesberger 389a87fc89 add link parsing for youtube description 2018-08-16 17:11:18 +02:00
Christian Schabesberger aeb813840d fix search querry tests 2018-08-05 14:14:36 +02:00
Christian Schabesberger 701666f498 block yt premium videos
fix logig error for block yt premium videos
2018-08-05 13:04:49 +02:00
Christian Schabesberger 558a973e43 rename search filters 2018-07-19 16:06:44 +02:00
Christian Schabesberger 28788a05db rename uih and remove afiliate link foo 2018-07-13 18:02:40 +02:00
Christian Schabesberger 35b46900c1 add outcomming items of searchextractor to searchinfo 2018-07-08 19:53:25 +02:00
Christian Schabesberger 31b0480e22 fix failing tests 2018-07-08 14:43:49 +02:00
Christian Schabesberger 291de18418 getUIHandler() to getUIHFactory()
handler to handlerFactory in kiosk
2018-07-01 19:01:39 +02:00
Christian Schabesberger bd5423fe2a make less tests fail 2018-07-01 16:55:48 +02:00
Christian Schabesberger 17f46b8b12 rename UrlIdHandler to UIHFactory 2018-07-01 16:55:48 +02:00
Christian Schabesberger 9bda761103 add test for soundcloud search extractor 2018-07-01 16:55:48 +02:00