Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update pornography-hosts #291

Merged
merged 48 commits into from
Feb 24, 2024
Merged

Update pornography-hosts #291

merged 48 commits into from
Feb 24, 2024

Conversation

Raviu56
Copy link
Contributor

@Raviu56 Raviu56 commented Jan 6, 2024

No description provided.

@Raviu56
Copy link
Contributor Author

Raviu56 commented Jan 25, 2024

Please squash merge this pr

Verified against some upstream paid porn blacklists.
Most of the domains in this specific commit have been grabbed from this pr
Sinfonietta#296
Add all relevant domains from this pr Sinfonietta#224
Domains were checked against paid list, then reviewed manually
@Raviu56
Copy link
Contributor Author

Raviu56 commented Feb 14, 2024

@Sinfonietta Can you merge this pr?
It's been here for long time and became large enough I think

@Raviu56
Copy link
Contributor Author

Raviu56 commented Feb 24, 2024

@Sinfonietta @StevenBlack
I've made a huge effort for this pr:

  1. Collecting domains from many sources, only Live domains that are actually being queried are considered.
  2. Developing scripts and regex dedicated to sort, filter valid domains, and remove duplicates
  3. Subscribing to and querying against paid porn blacklists
  4. Reviewing old PRs with conflicts and extracting all related domains
  5. Manually reviewing hundreds of domains to avoid false positives
  6. Querying https://radar.cloudflare.com/domains/domain/ against many hundreds of random domains and manually reviewing its categorization out there.
  7. Adding this list after each commit to some smart DNS service used by hundreds of thousands of people and getting feedback from them if people complains against some valid service blocked.

I hope this does not get stalled and people can make use of it.
Thank you

@Sinfonietta
Copy link
Owner

Thank you @Raviu56 I am sorry for delay, I've been overseas and not really able.

Merging.

@Sinfonietta Sinfonietta merged commit 78af017 into Sinfonietta:master Feb 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants