Kagi has tons of results from Reddit and they're always high and relevant. I don't know if this means they're doing it even though they're "not allowed to" or what but they definitely get it somehow.
Kagi's search results (at least used to) include many Google search results mixed in with results from other sources. That used to be explained on Kagi's main webpage, but I don't see it there now. (And I don't know who pays whom for what in that type of arrangement.)
Kagi uses a third party API that scrapes Google results for their searches. Possibly SerpAPI? Either way, Google doesn't get paid because you can't pay for the kind of search access they want.
Kagi had a post discussing this which made the front page of HN about a month ago [1]:
> Google does not offer a public search API. The only available path is an ad-syndication bundle with no changes to result presentation - the model Startpage uses. Ad syndication is a non-starter for Kagi’s ad-free subscription model.
I see the same phenomenon on other smaller forums, too, though. DuckDuckGo always feels like it has a smaller database than Google, which isn't really a surprise.
I mostly use a web engine (DDG) to find web sites these days, not content. Then I use the site's search instead or just browse the navigation tree. Make everything simpler.
I much prefer to use scholar.google.com or npmjs.com for research. The URL is already in my history/bookmarks and the scoped query is more useful than the generic websearch.
Kagi has tons of results from Reddit and they're always high and relevant. I don't know if this means they're doing it even though they're "not allowed to" or what but they definitely get it somehow.
Kagi's search results (at least used to) include many Google search results mixed in with results from other sources. That used to be explained on Kagi's main webpage, but I don't see it there now. (And I don't know who pays whom for what in that type of arrangement.)
Kagi uses a third party API that scrapes Google results for their searches. Possibly SerpAPI? Either way, Google doesn't get paid because you can't pay for the kind of search access they want.
Kagi sources their search results from Google.
This is false.
Kagi had a post discussing this which made the front page of HN about a month ago [1]:
> Google does not offer a public search API. The only available path is an ad-syndication bundle with no changes to result presentation - the model Startpage uses. Ad syndication is a non-starter for Kagi’s ad-free subscription model.
[1]: https://news.ycombinator.com/item?id=46708678
3 replies →
Kagi is probably paying Google for those results?
I responded to another comment in this thread with the details, but in summary, no.
See this previous discussion: https://news.ycombinator.com/item?id=46708678
When that news first went out, the article[0] I read at the time said that Kagi does purchase some of its indexing from Google.
[0] https://www.404media.co/email/4650b997-7cc3-4578-834c-7e663e...
That sounds like some excellent fodder for an anti-trust suit if you ask me.
It does. Reddit has defined what truth is. Banning r/nonewnormal is merely one part of that
Thanks, that explains Reddit.
I see the same phenomenon on other smaller forums, too, though. DuckDuckGo always feels like it has a smaller database than Google, which isn't really a surprise.
I mostly use a web engine (DDG) to find web sites these days, not content. Then I use the site's search instead or just browse the navigation tree. Make everything simpler.
I much prefer to use scholar.google.com or npmjs.com for research. The URL is already in my history/bookmarks and the scoped query is more useful than the generic websearch.
I'm sure Baidu could safely index Reddit if they wanted to.
Holy shit have we come far.