this post was submitted on 23 Sep 2024
143 points (99.3% liked)

Technology

34478 readers
771 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS
top 27 comments
sorted by: hot top controversial new old
[–] VirtualOdour@sh.itjust.works 2 points 16 hours ago (1 children)

Another wall to try and make it so only the rich corporations can make AI, what a shock.

This is what all the useful idiots bleating against ai have been working towards.

[–] poplargrove@lemmy.world 1 points 13 hours ago

There are models that have only used data with permissive licenses.

[–] delirious_owl@discuss.online 2 points 18 hours ago

God damn it, stop seeing scrapers as a bad thing. If we rate limit, there's nothing wrong with scraping.

[–] toastal@lemmy.ml 15 points 1 day ago (2 children)

The gall of Cloudflare to think they can be the arbitrator of scraping… this is what happen when all y’all give a singular publicly-traded, US-based major control of the general internet infrastructure by purposefully letting them man-in-the-middle your production sites. Now they get to sell access to what was once an open internet. Instead every time Clouflare or Fastly go down, half of the internet goes down with them.

[–] piyuv@lemmy.world 5 points 1 day ago (1 children)

“We can scrape open internet” is such a CEO take. I’m no fan of Cloudflare but what they’re doing here is good for open web and bad for AI bros

[–] toastal@lemmy.ml 4 points 23 hours ago* (last edited 23 hours ago) (1 children)

This assumes that just since abuse could happen means we should block access for everyone. Folks might make illegal photocopies of books so we should ban libraries. I & others have done general scraping for our own uses that isn’t done in some abusive manner. But to assume a company beholden to US shareholder is going to “to the right thing” would be to go against the history of US corporations.

And you know who is going to be able to afford to do the scraping? Big US-based “AI Bros” that can do it with venture capital preventing the average user or researcher from grepping the net.

[–] piyuv@lemmy.world 1 points 20 hours ago

Good points, you made clear this is no black/white case, it depends on how much we can trust cloudflare. It’s a US based for-profit company so the answer is “not much”.

However, if you check the link, you’ll see that they’re able to distinguish AI bot scrapping from other forms of scrapping. They also give the website owners a choice, so if it’s about principles, owners can choose to boycott, as most are already doing with robots.txt, which AI bros have no respect for.

Cloudflare does not benefit from a handful of websites getting all the traffic, and their track record is good so far. They also don’t profit from people visiting websites with a browser, they don’t show/own ads. To me, they have enough credit for me to believe they can protect open web.

We’ll see how this take ages though. I still won’t put all my eggs in a single basket.

https://www.theverge.com/24121399/cloudflare-matthew-prince-internet-free-speech-8chan-ukraine-aristotle-decoder-interview

[–] morrowind@lemmy.ml 2 points 1 day ago (1 children)

They don't think they're the arbitrer of scraping dumbass, this is a service they're selling to websites who don't want AI scrapers taking adnatage of them.

[–] toastal@lemmy.ml 7 points 1 day ago (1 children)

They are precisely deciding who can scrape what by sitting in the middle of like 30% of internet traffic & denying access. There is no way to tell if this ‘scraping’ is for research, hobby, commercial, or “AI” purposes; conveniently if it can make Cloudflare money, they’ll let you charge a toll. If Cloudflare cared about AI issues, they wouldn’t be having unpaid users solve/train their hCAPTCHA models just for visiting a site from Tor, a VPN, or even just a non-‘Western’ IP address. The fact that folks/businesses bought into this centralization is frightening—with little open access to information or allowing folks to stay anonymous (whatever their motivation).

Also don’t dare call someone “dumbass” if you can’t be bothered to turn on spell check or understand how commas work.

[–] themusicman@lemmy.world -2 points 1 day ago (1 children)

Them being able to offer this service, and them proxying 30% of the internet are completely unrelated. Any other company could offer this scrape protection if they wanted, with roughly the same cost of entry.

You can hate cloudflare all you like, but only a certified dumbass would try to pretend this feature is somehow enabled by their market dominance...

[–] toastal@lemmy.ml 2 points 23 hours ago

A US corporation cornering the market then charging their own fees to use the service (surfing & scraping are basically the same action)? Never seen this before. Sounds uber evil—I couldn’t airbnbelieve it.

[–] Appoxo@lemmy.dbzer0.com 28 points 1 day ago (2 children)

Does that mean scraping without paying access to scrape it is circumventing a protection and so can be treated like cracked software/piracy of movies? /s

[–] ashley@lemmy.ca 19 points 1 day ago (1 children)
[–] Appoxo@lemmy.dbzer0.com 10 points 1 day ago (1 children)

Because this will never actually happen

[–] General_Effort@lemmy.world 2 points 1 day ago

Why do you believe that?

[–] morrowind@lemmy.ml 1 points 1 day ago (1 children)
[–] Appoxo@lemmy.dbzer0.com 1 points 1 day ago (1 children)

Preferably. You do not?
Maybe something like fair-use for the common folk but any commercial product has to pay?

[–] morrowind@lemmy.ml 1 points 1 day ago

Technically it's only for AI stuff, so honestly it doesn't matter if you're doing other stuff

[–] InternetCitizen2@lemmy.world 6 points 1 day ago (2 children)

CF needs some good PR after the gambling website stuff.

[–] delirious_owl@discuss.online 2 points 18 hours ago* (last edited 18 hours ago)

Or protecting jihadist websites? They have a pretty bad track record

[–] morrowind@lemmy.ml 6 points 1 day ago (1 children)
[–] sunzu2@thebrainbin.org 1 points 1 day ago (2 children)

~~i think he is talking about 🤡strike debucle from fee month back.~~

[–] Orbituary@lemmy.world 7 points 1 day ago (1 children)

Debacle.

"debucle" is what happens before CF dry-humps you.

[–] thefartographer@lemm.ee 5 points 1 day ago

Debuckle is what my dad did before I got the belt

Whoever says parents aren't hitting their kids enough either weren't abused much as a child or were abused far too much. I was abused just enough to avoid ever having kids.

[–] Canadian_Cabinet@lemmy.ca 4 points 1 day ago (1 children)
[–] InternetCitizen2@lemmy.world 1 points 1 day ago

This, and I think the firing of some ppl but might be confusing it

[–] SerotoninSwells@lemmy.world 2 points 1 day ago

I guess if you can't beat them it's the next best thing.