Comment by thimabi
1 day ago
Suppose I'd like to use models like this one to perform web searches. Is there anything available in the open-source world that would let me do that without much tinkering needed?
I think it’s something that even Google should consider: publishing open-source models with the possibility of grounding their replies in Google Search.
I have been using ollama + open web ui. open webUI already have a web search tool all you would need to do is click the toggle for it under the chat.
Unfortunately the OWUI web search is really slow and just not great overall. I would suggest using an MCP integration instead.
Can you recommend a specific piece of software for using an MCP integration for web searches with local LLMs? That’s the first time I’ve heard of this.
1 reply →
Google do have an API for this. It has limits but perfectly good for personal use.
https://developers.google.com/custom-search/v1/overview
Unfortunately 100 queries per day is quite low for LLMs, which tend to average 5-10 searches per prompt in my experience. And paying for the search API doesn’t seem to be worth it compared to something like a ChatGPT subscription.
You're not limited to 100 queries per day though. You're limited to 10,000 queries per day.
3 replies →
The Google programmable search engine is unlimited and can search the web: https://programmablesearchengine.google.com/about/
1 reply →