Cloudflare will block AI bots from crawling websites by default for new customers, and broker pay-per-crawl deals between its customers and bot operators.
  • Ulrich@feddit.orgEnglish
    25·
    16 days ago

    Their business is largely based on security and preventing specific types of actions on a site. Not just the mere act of visiting it.