September 2026 field notes: local LLMs, agent memory, and spec-driven development

KV cache on 16 GB GPUs, OpenSpec and gstack, self-hosted deep research, and what comes after transformers.

Subscribe to this Newsletter

September was mostly about bringing AI systems under control: running them on your own hardware, keeping their memory honest, and building development workflows that hold up against agent output.

The dominant thread was self-hosting and the tradeoffs that come with it — how much context fits on a 16 GB card, which AMD backend to build, which runtime to standardize on, and where the open-model cost curve bends. Around it ran a quieter but important theme: agent memory, how it goes bad, and how to store and govern it locally.

A big chunk of the month was about making models actually run on consumer and mid-tier hardware, with the numbers laid out rather than hand-waved. The recurring finding is that the bottleneck is rarely the model file — it is the KV cache, the backend, and how you size the context window.

The second cluster was about the moving parts that make agents usable in practice: what you choose to remember, how to stop memory from feeding on the model’s own inferences, which extension model fits your setup, and how to carry an agent between frameworks without losing state or secrets.

Several articles focused on the tooling that structures how agents write code. OpenSpec came up twice — the setup workflow and the problem of proposals that get rejected — and there was a look at a more opinionated stack built on top of Claude Code and how it composes with the rest.

A smaller pair of pieces looked past the present: where architectures are heading once transformers hit their compute and data limits, and the landscape of self-hosted systems you can point a question at and get a sourced answer back.

If one of these articles is useful to someone building AI systems, backend systems, infrastructure, or technical knowledge workflows, please forward this email or share the link with them.

Thanks for reading, Rost