this post was submitted on 31 Jul 2024
28 points (100.0% liked)

Chat

7498 readers
17 users here now

Relaxed section for discussion and debate that doesn't fit anywhere else. Whether it's advice, how your week is going, a link that's at the back of your mind, or something like that, it can likely go here.


Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

I am a Kagi user and have been for 7 months now. I signed up for the 300 searches per month plan because I felt like that would fit me well enough and it turns out I average 87 searches per month. That's a lot lower than I thought it would be by quite a bit.

top 15 comments
sorted by: hot top controversial new old
[–] theangriestbird@beehaw.org 11 points 3 months ago (2 children)

Do you find that your searches are higher quality than something like, say, DuckDuckGo?

[–] shortwavesurfer@lemmy.zip 8 points 3 months ago (1 children)

Yeah, I'd say they're pretty comparable. And you can add filters, so like for example, I have all of Reddit blocked out from searches.

[–] l_b_i@yiffit.net 5 points 3 months ago (2 children)

That reddit filter will have less than an effect than it used to. Reddit blocked all crawlers except google.

[–] shortwavesurfer@lemmy.zip 3 points 3 months ago

Fair point.

[–] ardi60@reddthat.com 2 points 3 months ago (1 children)

Brave search works for Reddit

[–] l_b_i@yiffit.net 4 points 3 months ago (2 children)

reddit recently updated their robots.txt to disallow all crawlers Google paid a bunch of money to have access to crawl reddit

You'll still see old stuff, but crawlers that care about robots.txt will get no new information.

[–] azerial@lemmy.dbzer0.com 6 points 3 months ago (1 children)

The best part of that robots.txt is:

Reddit believes in an open internet, but not the misuse of public content.

Sure Jan.

[–] l_b_i@yiffit.net 2 points 3 months ago

Reddit believes in ~~an open~~ pay to access internet, but not the ~~mis~~use of ~~public content~~ our content we didn't make.

[–] ardi60@reddthat.com 1 points 3 months ago (1 children)
[–] l_b_i@yiffit.net 3 points 3 months ago

A few possibilities,

  1. brave has state in the past they use the googlebot user agent, if all reddit does is check the useragnet, it won't block brave. This does however mean brave is violating the robots.txt file.
  2. I saw some mentions of google fall back, I don't know if they still do it, but that could be another possibility.
  3. Brave ignores robots.txt files
  4. Brave paid for access

No matter the reason, well behaving crawlers will no longer crawl reddit, Everything is disallowed in the robots.txt

User-agent: *
Disallow: /
[–] azerial@lemmy.dbzer0.com 4 points 3 months ago* (last edited 3 months ago)

Oh 100%. You can try kagi out on a free trial, which is what I'm on. It's nice because you get different search results that aren't constrained to the Google algorithm.

What I mean by this, I search for recipes a lot, on Google all the recipes are identical. When I use Kagi, they differ with the main search team I want.

I plan on using Kagi and subbing when I have the money.

It's better to pay for a product than be the product imho.

edit: for the recipes I mean on Google it's the same promoted main steam food network bs, etc every. Single. Time. With Kagi I feel like it's smaller people with recipes with more relevancy to the terms I type in.

[–] Whimseymimple@beehaw.org 5 points 3 months ago (1 children)

Oh, wow. I've made 1,065 in July alone! My 7-month average (from January 2024 through today) is 811/month.

[–] shortwavesurfer@lemmy.zip 3 points 3 months ago

Oh wow. That's a whole different league of searching. LOL.

[–] hawdini 2 points 3 months ago

I didn’t know if 300 would be enough, so I ended up with the Professional account. It was a good call as I hit 300 searches in a week!

That being said, Kagi is worth every cent, its search results are much better than many of the underdog search engines, and even out does Google for me on a regular basis. Kagi’s AI results are also really good and also cites its sources so you can fact check yourself. (I think Bing’s copilot does similar, but I wasn’t that impressed with it when I tried it a while ago)

[–] tiago@beehaw.org 1 points 3 months ago

I only hit the 300 search quota back in March, just on the last day of that month's plan. I do like the service, but I'm uncertain on Vlad so I've established using other services.