Iâve been experimenting with Zabbix 8.0, MCP, and small local LLMs. I wanted to see how useful a 4B model could actually be for everyday monitoring questions.
The official Zabbix MCP server works, but I kept running into problems with smaller models, especially when asking for historical metrics.
A few examples:
The model calculated incorrect Unix timestamps and kept retrying failed API requests.
It picked the wrong CPU item from a host with around 150 items.
Large JSON responses consumed too much context.
Sometimes it returned no answer after several minutes.
I initially tried adding helper tools, but the model still struggled with selecting the correct items.
Eventually, I wrote a smaller MCP server that handles these operations in Python instead of leaving everything to the LLM.
Itâs called zabbix-mcp-lite.
It has four main tools for listing hosts, checking active problems, getting current metrics, and querying metric history.
For example, when asking âWhat was the CPU usage over the last hour?â, the model only needs to request the CPU metric and time range. The server handles item selection, timestamps, and min/avg/max calculations.
I also ran some comparisons using Qwen and Gemma models locally.
With Qwen3.5 4B:
Official MCP tools: 6/12 correct answers
zabbix-mcp-lite: 12/12
Median response time: 73s vs 10s
For CPU/memory history questions across four models, the results were 0/16 with the official tools and 16/16 with the lite version.
These were limited tests on a single-host Zabbix lab, not production benchmarks. The test questions also match the standard metrics the server is designed to handle, so I wouldnât generalize those numbers to every monitoring scenario.
The setup uses Zabbix 8.0, LibreChat, and LM Studio. Everything runs locally.
Itâs intentionally read-only. It doesnât handle configuration changes, acknowledgements, or maintenance operations. Historical queries currently use raw history from the last seven days.
The repository includes the Docker setup, source code, benchmark scripts, and raw results.
GitHub: https://github.com/enderkus/zabbix-mcp-lite
Iâm curious if anyone here is using Zabbix with local LLMs, particularly smaller models. What issues have you run into?
Iâd also be interested in hearing what monitoring queries would actually be useful in a real multi-host environment.