417b79757f
Merge branch 'dev' of github.com:TeamNewPipe/NewPipeExtractor into channel-tabs
2023-04-27 11:56:50 +02:00
2deb023da4
Merge pull request #1050 from Theta-Dev/fix/channel-carousel-header
...
[YouTube] Add support for CarouselHeaderRenderer
2023-04-25 15:17:31 +02:00
47aa9fed40
fix: set musicClientVersion regex capture group
2023-04-16 19:25:05 +02:00
20370395c5
fix: add support for CarouselHeaderRenderer
2023-04-16 17:40:13 +02:00
2ad496fc2b
refactor: merge YoutubeChannelTabExtractor and YoutubeChannelVideosTabExtractor
2023-04-16 15:54:00 +02:00
6b627f822e
feat: fetch YT Shorts using internal playlist
2023-04-16 15:46:35 +02:00
308fc434fe
fix: make ChannelTabExtractorBuilder serializable
2023-04-16 15:32:15 +02:00
bad12385c8
Fix PeerTube channel tabs content filters
2023-04-14 19:51:29 +02:00
12ca6a22cf
fix tests
2023-04-14 14:10:26 +02:00
c3651bef5c
Channels are now an Info
...
The previous "main" tab is now just a normal tab returned in getTabs().
This is a breaking change.
2023-04-14 00:56:29 +02:00
e278a2d6d4
refactor: use streams instead of for loops
...
fix: extract more than 1 bandcamp album
2023-04-05 21:36:04 +02:00
750f1585a5
add comment to clarify channel tab param
2023-04-05 20:20:03 +02:00
e57d43f92d
Merge branch 'dev' of github.com:TeamNewPipe/NewPipeExtractor into channel-tabs
2023-04-05 14:52:18 +02:00
1b6fe5edd6
[YouTube] Fix ParsingException when comments are unavailable in a video ( #1040 )
...
Co-authored-by: bjs <bjs@elect-it.com>
Co-authored-by: Audric V. <74829229+AudricV@users.noreply.github.com>
Co-authored-by: Kavin <20838718+FireMasterK@users.noreply.github.com>
2023-03-30 19:58:06 +02:00
f306db0178
refactor: move YT channel utils to YouTubeChannelHelper
2023-03-30 13:23:44 +02:00
97d7ee5663
Merge branch 'dev' of github.com:Theta-Dev/NewPipeExtractor into channel-tabs
2023-03-30 13:08:12 +02:00
8d1303e18f
Add track types to audio streams ( #1041 )
2023-03-28 00:02:20 +02:00
c6ee2f3ff7
fix: add checkIfChannelResponseIsValid method
2023-03-22 01:27:55 +01:00
8cd6439d19
fix: YT shorts view count parsing (2)
2023-03-22 01:07:58 +01:00
8ecee8737c
fix: channel extractor tests, docs
2023-03-22 01:00:05 +01:00
76052de72a
fix: YT shorts view count parsing
2023-03-21 23:43:34 +01:00
9cebcf7ab6
Merge branch 'dev' of github.com:TeamNewPipe/NewPipeExtractor into channel-tabs
2023-03-21 00:45:53 +01:00
6bdd698c25
Merge pull request #1026 from AudricV/audio-streams-descriptive-and-locale-properties
...
Add descriptive and locale properties to audio streams
2023-03-01 11:15:46 +01:00
19e4b216c9
Merge pull request #1032 from AudricV/yt_fix-comments-hashtags-links-extraction
...
[YouTube] Fix hashtags links extraction and escape HTML links
2023-03-01 10:47:37 +01:00
bd79b921e8
[YouTube] Refactor the code to get stream items' view count
...
This refactoring avoids code duplication as much as possible.
2023-02-27 10:25:46 +01:00
51f9b39953
[YouTube] Fix partial non-extraction of no views string in stream items
...
As the "No views" string is returned in the case there is no view on a video, a
number cannot be parsed in this case, so -1 was returned.
This string is now detected in all methods to get the view count of a stream.
2023-02-27 10:18:45 +01:00
05e8cb39f7
[YouTube] Add language and descriptive audio properties to DASH manifests
2023-02-26 19:06:17 +01:00
76b7c19c5d
[YouTube] Extract whether a track is a descriptive audio and audio locale when available
...
Also use audio track setters only for audio itags.
2023-02-26 19:06:17 +01:00
3bb5eeef30
[YouTube] Add descriptive and locale audio support in ItagItem
2023-02-26 19:06:16 +01:00
1556adbb2d
[YouTube] Fix hashtags links extraction and escape text in attribute descriptions + HTML links
...
webCommandMetadata object is contained inside a commandMetadata one, so it is
not accessible from the root of the navigationEndpoint object.
The corresponding statement has been moved at the bottom of the specific
endpoints parsing, as the webCommandMetadata object is present almost
everywhere, otherwise URLs of some endpoints would have be changed, such as
uploader URLs (from channel IDs to handles).
As no ParsingException is now thrown by getUrlFromNavigationEndpoint, and so by
getTextFromObject, getUrlFromObject and getTextAtKey, the methods which were
catching ParsingExceptions thrown by these methods had to be updated.
URLs got in the HTML version of getTextFromObject are now escaped properly to
provide valid HTML to clients. This has been also done for attribute
descriptions, with the description text for this type of descriptions.
As YouTube descriptions are in HTML format (except for the fallback on the JSON
player response, which is plain text and only happens when there is no visual
metadata or a breaking change), all URLs returned are escaped, so tests which
are testing presence of URLs with escaped characters had to be updated (it was
only the case for YoutubeStreamExtractorDefaultTest.DescriptionTestUnboxing).
2023-02-26 18:43:36 +01:00
3f7df9536e
[YouTube] Fix getting the comment text if the comment contains a hashtag
2023-01-29 20:33:51 +01:00
3519d4c367
Merge pull request #1015 from AudricV/yt_fix-channel-id-rss-feeds
...
[YouTube] Fix channel ID extraction of YouTube channels RSS feeds
2023-01-29 10:41:38 +01:00
9aca710e86
Merge pull request #1013 from Stypox/fix-music-mixes
...
[YouTube] Now music mixes can be treated as normal mixes
2023-01-29 09:48:51 +01:00
76eeabac45
Merge pull request #1020 from TeamNewPipe/fix/yt-subscriber-count
...
[YouTube] Fix NPE in search when getting channel items without subscriber count
2023-01-29 09:44:22 +01:00
57f850bc2d
[YouTube] Support live URLs and do minor improvements to YoutubeStreamLinkHandlerFactory
...
- Move license header at the top;
- Use an unmodifiable set for the subpaths instead of a modifiable list;
- Add missing Nonnull and Nullable annotations;
- Improve exception messages.
2023-01-28 19:36:20 +01:00
1f4ed9dce9
[YouTube] Fix channel ID extraction of YouTube channel RSS feeds
...
The yt:channelId element doesn't provide the channel ID anymore and is empty,
like the id element, so we need now to extract it from the channel URL provided
in two elements: author -> uri and feed -> link.
Also avoid a NullPointerException in getUrl and getName methods.
2023-01-28 11:53:33 +01:00
c589a2c1a2
Merge pull request #1014 from TeamNewPipe/fix/yt-comments
...
[YouTube] Fix getting next comments pages
2023-01-27 11:14:55 +01:00
72573932cf
[YouTube] Fix NPE in search when getting channel items without subscriber count
2023-01-24 23:03:45 +01:00
f50b7275af
[YouTube] Fix getting next comments pages
2023-01-24 22:39:08 +01:00
9bdad40b06
Removed topStandaloneBadge
2023-01-20 02:41:21 +05:30
7293991832
[YouTube] Now music mixes can be treated as normal mixes
...
Using a playlist extractor on them would result in "Unviewable playlist" errors
2023-01-15 23:28:59 +01:00
c1040bccac
Merge pull request #794 from FireMasterK/comments-count
...
[YouTube] Add support to extract total comment count
2023-01-11 15:32:19 +01:00
56aab4d971
[YouTube] Fix escaping links in YouTubeParsingHelper.getTextFromObject
2023-01-05 00:28:12 +01:00
22a47da8c7
Fix requested change and remove outdated comment.
2023-01-02 20:42:32 +00:00
98a90fd9c8
Don't cache comments count and return early on page fetch if no token.
2023-01-02 20:40:48 +00:00
2974dfaa48
Only store ajaxJson for initial page and eager fetch the initial continuation.
2023-01-02 20:40:48 +00:00
67ef4f4c30
Cleanup and remove optional.
2023-01-02 20:40:48 +00:00
22f71b010c
Fix for requested changes.
2023-01-02 20:40:48 +00:00
981aee4092
Add support to extract total comment count.
2023-01-02 20:40:48 +00:00
45636b0d00
Merge pull request #986 from Isira-Seneviratne/Static_maps
...
Use immutable Map factory methods.
2023-01-02 18:11:14 +01:00
ThetaDev
Stypox
Björn Sigurbergsson
AudricV
TobiGr
Kunal
Kavin