Comment by nannal
1 day ago
I do have a log reading / action / resolution product in the works.
Its sort of like having a sysadmin constantly watching. Poking through logs pcaps & monitoring for unusual activities.
Also works with local models well enough.
I love how LLMs have brought DIY software back. Need an app? Just make it. Like back when you’d write programs in BASIC
I just built a retro OS for ESP32’s so that I can write BASIC programs and plop them on microcontrollers. My first ESP32 was a wrist watch. My second is a distraction free writer.
It’s good fun building for retro-like machines.
This is where I silently found gold. All those old TODO when if I have time in retirement
I've got a whole heap of unfinished side projects that I'm digging through
That's cute but bill for going thru even tens of log lines per second gonna be more expensive than entire rest of the infrastructure.
You don't have to use frontier for this & all my agentic work is local only.
You may have trouble catching good attempts then.
I’ve set up something like that with Opus. Works well enough, and points out CVEs to fix on the regular.
Running NixOS helps.
I've set up something like that with a small local model in my homelab.
How does it resolve the prompt injection?