You must log in or # to comment.
I use jan-beta GUI, you can use locally any model that supports tool calling like qwen3-30B or jan-nano. You can download and install MCP servers (from, say, mcp.so) that serve different tools for the model to use, like web search, deep research, web scrapping, download or summarize videos, etc there are hundreds of MCP servers for different use cases.
https://context7.com/ Free API-based MCP that provides up to date code docs. Incredibly useful.
What does an MCP server do?
An MCP server can also just be an interface to something useful but simple like a calculator.
Basically it’s a layer to let your LLMs plug into tools.
They generally run on your machine (I use docker to sandbox them) and may or may not call out to useful APIs
One example is I just wrote one to connect to my national weather services RSS feed, so my LLMs can get and summarize the weather for me in the morning.
Works well with Gemma 3n
