I wanted to understand what happens when you stop treating an LLM as a chatbot and start treating it as a component in a software system.

So I built a local AI storyteller using a local LLM through an OpenAI-compatible API.