A family budget where the agent decides once and a rule handles it forever
Published
How does this AI workflow work?
- Replaces: several hours a month of hand-categorising bank transactions and pulling a budget together, the "fourth step" every personal-finance book leaves manual.
- Scripts poll five bank accounts daily, drop duplicates and load everything into Actual (open-source budgeting app). Rules classify anything seen before.
- Anything new goes to an agent (Hermesa, built on the open-source Hermes Agent), which compares it with the allowed categories and labelled examples, checks payee history via Actual's CLI, and searches the web and a map when unsure.
- If it still can't tell, it writes its findings to an Obsidian note and the payment lands in the weekly review.
- Every confirmed answer becomes a rule: 100 hand-labelled transactions to start, 194 rules today (187 set a category across 21 categories).
- A weekly agent checks the plan and messages on Telegram only when something is over budget or needs review; a monthly agent drafts next month's budget for a chat edit.
- What to connect: a budgeting app with rules and a CLI or API (Actual), bank sync or exports, an agent with web and map search, a notes store for unresolved cases, and a messaging channel for exceptions.
- Cost: the software is free and open source; the model is either a self-hosted open model (Qwen on your own GPU server) or a paid hosted API.
- Starter prompt in the post: pick 100 varied transactions for me to label, label the rest with my logic, list anything you're unsure about instead of guessing.
- Who it's for: households and sole traders who want categorised spending without a monthly bookkeeping session, and anyone building an agent that should get cheaper and more consistent over time.
From the Morning Tokens issue of Nov 9, 2026