Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setting: Block AI bots #736

Open
1 task done
jeffpaul opened this issue Mar 5, 2024 · 0 comments
Open
1 task done

Setting: Block AI bots #736

jeffpaul opened this issue Mar 5, 2024 · 0 comments
Labels
hacktoberfest type:enhancement New feature or request. type:good-first-issue Good for newcomers.

Comments

@jeffpaul
Copy link
Member

jeffpaul commented Mar 5, 2024

Is your enhancement related to a problem? Please describe.

In conversations that I've had with ClassifAI users (actual and prospective) one item that's come up a couple times (more regularly with medium-to-large publishers) is the ability to block AI bots from scraping content from a site (so that a publishers content isn't used to train an AI model without their consent). Some related content for anyone that chooses to research this further:

Designs

The one place where this could be integrated is the basic ClassifAI Registration step in the Set Up flow that currently only includes the registration email and key fields. We could possibly add a disabled-by-default setting there akin to Block AI bots from crawling my site. Alternatively, it could be a setting like Block the following bots from crawling my site that then has disabled options for the current list of known AI bots (CCBot, ChatGPT-User, GPTBot, Google-Extended, anthropic-ai, claude-web, cohere-ai).

Describe alternatives you've considered

While this isn't necessarily a direct relationship to ClassifAI's focus, and more akin to a robots.txt management plugin, its certainly something that could be added (should more confirmed interest warrant it).

Code of Conduct

  • I agree to follow this project's Code of Conduct
@jeffpaul jeffpaul added type:enhancement New feature or request. type:good-first-issue Good for newcomers. labels Mar 5, 2024
@jeffpaul jeffpaul added this to the Future Release milestone Mar 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
hacktoberfest type:enhancement New feature or request. type:good-first-issue Good for newcomers.
Projects
Status: Backlog
Development

No branches or pull requests

1 participant