LemmyLocal
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 2 days ago

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

external-link
message-square
24
fedilink
142
external-link

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 2 days ago
message-square
24
fedilink
Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
  • FundMECFS@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    13
    ·
    2 days ago

    This thing Anubis always flags me for some reason. I use mullvad and safari (ios) with some add and tracker blocking extensions.

    • Appoxo@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      4
      ·
      2 days ago

      I wonder why traffic from known VPN companies are under more scrutiny than traffic from domestic households…

    • Photuris@lemmy.ml
      link
      fedilink
      arrow-up
      6
      ·
      2 days ago

      More sites in general are blocking mullvad traffic lately (in my experience), and I’m not sure what, if anything, can be done about it.

      • FundMECFS@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        6
        ·
        2 days ago

        I expect better from a popular FOSS tool being used by privacy aware people though.

        • Lime Buzz (fae/she)@beehaw.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          2 days ago

          Can you open an issue, or see if one is open already for this?

      • Powderhorn@beehaw.org
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 days ago

        Agreed. Luckily, they don’t seem to have the full list of Mullvad IPs, so if I really want to read something, I just try another tunnel.

    • simple@piefed.social
      link
      fedilink
      English
      arrow-up
      6
      ·
      2 days ago

      Do you have javascript or cookies disabled? That might stop you from getting past.

      • FundMECFS@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        3
        ·
        2 days ago

        nope

Technology@beehaw.org

technology@beehaw.org

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

  • Free and Open Source Software
  • Programming
  • Operating Systems

This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 460 users / day
  • 1.17K users / week
  • 2.61K users / month
  • 6.61K users / 6 months
  • 1 local subscriber
  • 39.5K subscribers
  • 3.34K Posts
  • 51.1K Comments
  • Modlog
  • mods:
  • alyaza [they/she]@beehaw.org
  • TheRtRevKaiser@beehaw.org
  • rs5th@beehaw.org
  • coldredlight@beehaw.org
  • Leigh@beehaw.org
  • gyrfalcon@beehaw.org
  • TheRtRevKaiser@kbin.social
  • Chris Remington@beehaw.org
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org