-
Notifications
You must be signed in to change notification settings - Fork 421
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[YouTube] Make some improvements and fixes #1127
Commits on Dec 8, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 8a9ebcc - Browse repository at this point
Copy the full SHA 8a9ebccView commit details -
[YouTube] Improve payloads and URLs of InnerTube requests
For every InnerTube request: - Always add a `request` object with the following properties: - "internalExperimentFlags" set to an empty array; - "useSsl" set to "true"; - "lockedSafetyMode" set to "false". - Use proper TODO comment to provide a way to enable restricted mode on every request and add it on requests on which it wasn't present. For YouTube Music: - Remove alt query parameter, as it is not used anymore by the website; - Add prettyPrint query parameter with false value on YouTube Music search continuations.
Configuration menu - View commit details
-
Copy full SHA for d97c9e0 - Browse repository at this point
Copy the full SHA d97c9e0View commit details -
[YouTube] Add utcOffsetMinutes to all InnerTube payloads
This should make returned dates consistent between timezones and countries on which the extractor is ran. It was previously only set on YouTube Music search continuations.
Configuration menu - View commit details
-
Copy full SHA for 2c94179 - Browse repository at this point
Copy the full SHA 2c94179View commit details -
[YouTube] Add missing prettyPrint query parameter to some test InnerT…
…ube requests This query parameter for which its value is set to false was not added to two requests made in test classes of YoutubeMixPlaylistExtractorTest. Also remove an unneeded ParsingException exception throwing declaration in a test method.
Configuration menu - View commit details
-
Copy full SHA for ec838d7 - Browse repository at this point
Copy the full SHA ec838d7View commit details -
[YouTube] Switch to new consent cookie
Also move the documentation of the consent in its setter method in order to be accessible publicly and improve it.
Configuration menu - View commit details
-
Copy full SHA for ff8ed72 - Browse repository at this point
Copy the full SHA ff8ed72View commit details -
[YouTube] Extract only search results corresponding to a search type
YouTube returns sometimes videos inside channel search results. As we only want results corresponding to the type we requested, this commits makes YoutubeSearchExtractor ignoring non-requested search results we get, using the extractor LinkHandler's first content filter value. Also remove an unneeded exception throwing declaration in YoutubeSearchExtractor.
Configuration menu - View commit details
-
Copy full SHA for b71ce11 - Browse repository at this point
Copy the full SHA b71ce11View commit details -
[YouTube] Support new A/B tested like data and avoid like count conve…
…rsion from integer to long Also make minor improvements to current like data extraction and remove previous like count data support, as it is not returned anymore.
Configuration menu - View commit details
-
Copy full SHA for 3782d9a - Browse repository at this point
Copy the full SHA 3782d9aView commit details -
[YouTube] Remove Channels channel tab support
This tab has been removed by YouTube.
Configuration menu - View commit details
-
Copy full SHA for 7dea2d0 - Browse repository at this point
Copy the full SHA 7dea2d0View commit details -
[YouTube] Bypass crisis resources blocking search results
These crisis resources are preventing search results to be returned. See https://support.google.com/youtube/answer/10726080?hl=en for more info on them. This commit changes search parameters to include the property allowing to show search results.
Configuration menu - View commit details
-
Copy full SHA for 6ba8251 - Browse repository at this point
Copy the full SHA 6ba8251View commit details -
[YouTube] Fix expected data in YoutubeStreamExtractorRelatedMixTest
Video's title and tags have been changed by its uploader, so they have to be updated. Also make some package-private constants private, as they are not used outside of the class, and remove unneeded test overrides.
Configuration menu - View commit details
-
Copy full SHA for 0bcb241 - Browse repository at this point
Copy the full SHA 0bcb241View commit details -
[YouTube] Fix YoutubeChannelExtractorTest tests
- Change CarouselHeader test channel to Sports system one, as the Coachella one doesn't return this channel header anymore; - Fix InteractiveTabbedHeader test by checking whether the test's channel description is not empty instead of containing some words, as it is changing frequently.
Configuration menu - View commit details
-
Copy full SHA for fc45941 - Browse repository at this point
Copy the full SHA fc45941View commit details -
[YouTube] Fix YoutubeStreamExtractorDefaultTest.RatingsDisabledTest
Replace the video used in this test class with another one publicly available and update the corresponding expected test values. The test class's mocks will be updated in a different commit.
Configuration menu - View commit details
-
Copy full SHA for e111814 - Browse repository at this point
Copy the full SHA e111814View commit details -
[YouTube] Fix testRelatedItems method of YoutubeStreamExtractorRelate…
…dMixTest This commit fixes the testRelatedItems test method by: - accepting consent in the test class, in order to extract mixes in recommendations; - removing assertion of a music mix inside the recommendations, as YouTube doesn't seem to return such mixes anymore, at least for the video used in the test class.
Configuration menu - View commit details
-
Copy full SHA for ad3d187 - Browse repository at this point
Copy the full SHA ad3d187View commit details -
[YouTube] Fix expected upload dates of StreamExtractor tests
YouTube is rolling out or A/B testing a new date format returned inside player responses, which are precise to the second instead of the day. This commit makes the StreamExtractor tests use these more precise dates.
Configuration menu - View commit details
-
Copy full SHA for 9dc1eab - Browse repository at this point
Copy the full SHA 9dc1eabView commit details -
[YouTube] Fix potential NullPointerException in YoutubeSearchExtracto…
…r.getSearchSuggestion
Configuration menu - View commit details
-
Copy full SHA for 56ab354 - Browse repository at this point
Copy the full SHA 56ab354View commit details -
[YouTube] Fix YoutubeSearchExtractorTest.Suggestion
YouTube doesn't return anymore a suggestion for the query "algorythm", but does for the query "on board ing" ("on boarding"). This search query is now used and had to be URL-encoded. URL encoding in the complete YoutubeSearchExtractorTest test class uses now extractor's Util class instead of Java's URLDecoder class directly.
Configuration menu - View commit details
-
Copy full SHA for 29dc762 - Browse repository at this point
Copy the full SHA 29dc762View commit details -
[YouTube] Enable and change testRelatedItems method of YoutubePlaylis…
…tExtractorTest.LearningPlaylist This change makes the method test whether there is no more items instead of being disabled.
Configuration menu - View commit details
-
Copy full SHA for 5fa22ae - Browse repository at this point
Copy the full SHA 5fa22aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for bedc9e5 - Browse repository at this point
Copy the full SHA bedc9e5View commit details -
[YouTube] Fix testSubscriberCount method of YoutubeChannelExtractorTe…
…st.CarouselHeader The subscriber count is now lower than the expected count as some people unsubscribed to the Sports system channel. The expected count has been so lowered.
Configuration menu - View commit details
-
Copy full SHA for 642bb01 - Browse repository at this point
Copy the full SHA 642bb01View commit details -
[YouTube] Fix YoutubeSearchQHTest tests
As search parameters to bypass crisis resources blocking search results have been implemented, they need to be added to search tests, in order to pass them.
Configuration menu - View commit details
-
Copy full SHA for 06838d7 - Browse repository at this point
Copy the full SHA 06838d7View commit details -
[YouTube] Add a blocking crisis resources bypass in search results test
This test only tests that search results are returned, when no content filters are provided and crisis resources blocking search results should be returned. Searches with blocking crisis resources and content filters should work too, as the bypass has been implemented for them.
Configuration menu - View commit details
-
Copy full SHA for 00a0f1a - Browse repository at this point
Copy the full SHA 00a0f1aView commit details -
Configuration menu - View commit details
-
Copy full SHA for ec0194c - Browse repository at this point
Copy the full SHA ec0194cView commit details