Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Investigate the cookie CONSENT for Google #1555

Open
unixfox opened this issue Jul 25, 2022 · 2 comments
Open

Investigate the cookie CONSENT for Google #1555

unixfox opened this issue Jul 25, 2022 · 2 comments
Assignees
@unixfox
Labels
area: engine google-engine new feature New feature or request

Comments

@unixfox
Copy link
Member

unixfox commented Jul 25, 2022

We need to investigate the correct parameters to send to Google so that the consent dialog is not being returned and doesn't cause an issue in parsing the results.

Currently, I don't know why, but for google images just adding the query parameter 'ucbcb': 1 in the URL only works on Firefox but not on SearXNG. But it works in both cases for the Google engine.

Useful information:

The ultimate goal is to send a PENDING consent to Google so that we don't give Google the legal rights to collect information about us.
@unixfox unixfox self-assigned this Jul 25, 2022
@return42 return42 mentioned this issue Jul 26, 2022
Merged
@return42
Copy link
Member

return42 commented Jul 26, 2022 •
edited
Loading

The ultimate goal is to send a PENDING consent to Google so that we don't give Google the legal rights to collect information about us.

AFAIK: setting YES+ ...

searxng/searx/engines/google_images.py

Line 144 in 50ec821

params['cookies']['CONSENT'] = "YES+"

prevents from redirects to (e.g.) consent.google.fr .. compare Error from #1494 ...

Error
  * Error: 1 redirects, maximum: 0
  * Percentage: 100
  * Parameters: `('200', 'OK', 'consent.google.fr')`
  * File name: `searx/search/processors/online.py:105`
  * Function: `_send_http_request`
  * Code: `count_error(`

and citation from TeamNewPipe/NewPipeExtractor#592

Google change the way for consent about YouTube cookies agreement
in EU countries ...
Instead of showing a popup in the website, YouTube redirects the user to a new
webpage at consent.youtube.com domain ...
Fix for this is to put a cookie CONSENT with YES+ value ...

This comment is about YouTube .. but (AFAIK) the cookies are the same in all google services.

@unixfox
Copy link
Member Author

unixfox commented Jul 26, 2022 •
edited
Loading

But YES+ tell Google that they can legal collect data about the searx instance. That's the issue.

Where as they legally can't if we send PENDING+

@return42 return42 mentioned this issue Aug 19, 2022
Closed
@dirkf dirkf mentioned this issue Jul 22, 2023
Closed
10 tasks
@unixfox unixfox added new feature New feature or request area: engine labels Nov 28, 2023
rodarima added a commit to dillo-browser/dillo that referenced this issue Aug 18, 2024
@rodarima
Avoid Google consent dialog by denying it
3483a4e 
When directly opening a search, there may be cases in which a consent
dialog is shown. The ucbcb=1 param is added to the URL when the consent
is denied, so we may just as well add it permanently to avoid the
consent dialog.

> ucbcb could stand for: User Consent Blocked, Cookies Blocked

Link: searxng/searxng#1555
Link: searxng/searxng#1679
Link: https://old.reddit.com/r/youtube/comments/mvcr5q/what_is_the_ucbcb1_tag_added_to_yt_urls/?rdt=50554
rodarima added a commit to dillo-browser/dillo that referenced this issue Aug 18, 2024
@rodarima
Avoid Google consent dialog by denying it
f2b6324 
When directly opening a search, there may be cases in which a consent
dialog is shown. The ucbcb=1 param is added to the URL when the consent
is denied, so we may just as well add it permanently to avoid the
consent dialog.

> ucbcb could stand for: User Consent Blocked, Cookies Blocked

Link: searxng/searxng#1555
Link: searxng/searxng#1679
Link: https://old.reddit.com/r/youtube/comments/mvcr5q/what_is_the_ucbcb1_tag_added_to_yt_urls/?rdt=50554
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@unixfox unixfox

Labels
area: engine google-engine new feature New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@return42 @unixfox