Your AI bill is thousands a month. Nobody can say which feature spends it.
I instrument every call, build the tracking that shows where the money actually goes, and then spend two months cutting it and watching what happens. Month one finds the big waste. Month two is the part that matters: proving the cuts held while your product kept shipping.
Fixed price, no hourly surprises. Two months, actively on it the whole time. Paid in four milestones, you release each one only when you approve it. No percentage of the saving, no subscription afterwards.
How it works
Measure continuously. Cut as it shows up. Stay until it holds.
This is not an audit that hands you a PDF and leaves. I am on your spend for two months: instrumenting, finding, shipping fixes, and watching the number move. I do 100% of the work. What I need from you is access to the repository that makes the LLM calls, and someone who can tell me what each feature is for.
Instrument and track, about two weeks
I read your call paths and build the tracking: a thin layer around every LLM call plus the table behind it, recording feature, model, tokens in and out, cached tokens, latency and cost on every request. It ships through your normal review and your normal pipeline.
Month one: find it and cut it
Real traffic accumulates and the picture sharpens: which feature, which model, which call shape. I ship the cuts as the data justifies them, each one checked against an agreed quality bar, each one annotated on the timeline so you can see what it was worth.
Month two: make sure it stays cut
Spend creeps back. A new feature adds calls, a prompt grows, someone bumps a model, retries pile up quietly. I keep watching, catch the creep, ship the smaller stuff, and confirm month one’s cuts survived contact with your roadmap.
What you get
A breakdown, the cuts worth making, and two months of evidence.
One fixed price for the whole engagement, and everything built stays in your repository running on your infrastructure. There is nothing here to subscribe to afterwards.
The breakdown nobody has
- Per-call instrumentation wired into your own call path: feature, model, prompt and completion tokens, cached tokens, latency and cost recorded on every request
- A tracking table you own, holding the record of every call, which is what makes attribution and later comparison possible at all
- Spend by feature, which turns one account total into a line per thing your product does, and usually finds at least one feature nobody expected near the top
- Spend by model and by call shape, where the surprises live: long system prompts, context re-sent on every turn, retries, and calls somebody shipped and forgot
- Cost per request, tracked over time, so a bill that moved because your usage grew is visibly a different thing from a bill that moved because something got wasteful
Levers, applied where they pay
- Trim prompts and context: strip the dead weight out of system prompts and stop re-sending history that nothing reads
- Cache repeated work: provider prompt caching where it applies, plus a result cache for calls whose inputs genuinely repeat
- Route by difficulty: cheap requests go to a cheap model, the expensive model stays on the calls that actually need it
- Batch what can wait: non-interactive work moves to batch endpoints or an off-peak queue instead of paying interactive rates
- Self-host the heavy repetitive work when the numbers justify it: classification, extraction, embeddings and other fixed-shape calls that run constantly
Yours after I leave
- Two months of per-call history with every change annotated on it, so the saving is a tracked line and not a claim about two invoices
- A cost dashboard you keep: live spend by feature and by model, so the next regression shows up as a line going up and not as a surprise invoice
- The instrumentation and the tracking table are yours, plain code in your repository, shipped through your own review and your own pipeline
- A written handover of what changed, why, what each change was worth, what the quality bar was, and which levers are still on the table
- No retainer and no licence. When the two months are done, it is done, and the saving keeps running without me
What this will not do.
One price for the whole two months, no retainer and nothing to renew. You are paying for sustained measurement and the engineering that follows from it: the instrumentation and the tracking, the analysis as real traffic accumulates, the changes implemented and shipped through your pipeline, and a second month of watching that turns a dip into a result. The model spend you save is yours to keep. I take no percentage of it.
- 1
Instrumentation and tracking $2,500
Your call paths read, the per-call layer and the tracking table built and shipped through your pipeline, and the first spend breakdown by feature, model and call shape.
- 2
Month one: findings and the first cuts $4,000
The ranked list with what each change is worth, then the agreed cuts implemented, checked against the quality bar, shipped and annotated on the timeline.
- 3
Month two: held and tuned $4,000
Continued monitoring, the creep caught and corrected, the remaining smaller cuts shipped, and month one’s savings confirmed against a second month of real traffic.
- 4
Report and handover $1,500
The full before and after with every change and its measured value, the dashboard, and the written handover of what is still on the table.
Each milestone is agreed before it starts and paid only when you approve its deliverable, so you never pay up front for work you have not seen. The two months are equally priced because I am equally on it: the second one is where a saving either holds or quietly disappears.
Why two months and not two weeks
Anyone can cut a bill for a week.
A week of traffic is not your traffic
A short window catches weekday against weekend and nothing else. It misses the monthly shape entirely: the reporting run, the invoicing job, the end-of-month spike. Measure a week, cut against it, and you have optimised for a week.
Two invoices are not a comparison
Compare one month against another and every confounder rides along: your usage grew, you shipped other code, the feature mix moved, the vendor changed prices. Per-call tracking across the whole period separates what you did from what they did.
Savings regress, quietly
The cut lands, the line drops, everyone is happy. Then a feature ships, a prompt grows, a retry loop gets added, and six weeks later the bill is back. The second month exists because a saving that was not watched is a saving you cannot bank.
What being on it actually means.
Who is doing the measuring.
Ciprian Mandache. Backend and AI engineer, 13+ years, Go and Python. This service is measurement discipline applied to a bill, and that is work I have done before.
Benchmarking providers against self-hosted
At Nomad Nomes I benchmarked transcription providers against self-hosted models and built the testing infrastructure, with metrics and tracking, that the comparison ran on. Same question as this one: what does this actually cost, and what do you give up by moving it.
Evaluations that catch a quality drop
I built custom AI evaluations there too, using synthetic scenarios and historical replay. That is exactly the machinery that stops a cost change quietly making your product worse, which is the whole risk in this kind of work.
Self-hosting is something I run
I build and run aigate, a self-hosted AI gateway with provider routing and fallback behind one OpenAI-compatible endpoint, plus local model serving on CPU or GPU. When I tell you a workload is worth self-hosting, that is operational experience, not a slide.
Everything I build stays yours.
You own everything I build
The instrumentation, the tracking table, the dashboard and every change are plain code in your repository, shipped through your own review. Nothing proprietary, no agent of mine left running in your stack, no licence to renew. The reusable pieces I draw on are open source on my GitHub.
Runs on your infrastructure
The instrumentation, the tracking and the cost dashboard live in your environment. Your prompts and your traffic stay there. I work from the aggregates and from whatever samples you choose to show me, and I sign your NDA before we talk specifics if that is your policy.
Paid in four phases, never up front
Each milestone is agreed before it starts and paid only when you approve its deliverable. You are never paying for a month before you have seen what the previous one produced.
Fixed term. No percentage.
Two months, then it is finished. Not a subscription, and not a cut of what you save, which is the model that quietly punishes you for the savings lasting. The saving keeps running every month afterwards without me and without another invoice.
Straight answers
What does the price cover?
Two months of engagement in four milestones. The instrumentation and the tracking table built and shipped into your call path; the analysis as real traffic accumulates; the changes you approve, implemented and shipped through your pipeline against an agreed quality bar; a second month of monitoring, correction and smaller cuts; and a final report with every change and what it measured out at. $12,000 total, and the only thing outside it is your own model spend, which you pay your provider directly as you already do.
Why two months, and not a two week audit?
Because a two week audit cannot prove anything. A week of traffic misses your monthly shape, so a cut made against it is a cut made against a sample. And comparing the month before to the month after is not a controlled comparison: your usage changed, you shipped other code, the vendor may have changed prices. Two months of per-call tracking, with each change annotated where it shipped, is what lets you separate what I did from everything else that happened. The second month is also when savings regress, so it is the month that decides whether there was a saving at all.
Why does month two cost the same as month one?
Because I am equally on it. Month one is louder, bigger cuts and more shipping. Month two is monitoring, catching the creep, the smaller fixes and the confirmation work, and it is the month that turns a dip into a result you can bank. Charging less for it would price the engagement as if the proof were optional. If month two turns out to be quiet, that is a good outcome you paid for, not a discount you are owed.
How does payment work?
In four phases: instrumentation and tracking ($2,500), month one findings and first cuts ($4,000), month two held and tuned ($4,000), report and handover ($1,500). A phase is agreed before it starts and paid when you approve that phase’s deliverable, so you are never paying up front for work you have not seen.
How do we actually engage?
Direct B2B, on your own contract and invoicing, through whatever procurement process your company already has. There is no platform in the middle and no marketplace fee. Reach me on LinkedIn and we sort the terms directly, including an NDA first if your policy wants one.
How much will I actually save?
I will not put a number on that before the measurement, and you should be suspicious of anyone who does. Nobody can predict the saving on a workload they have not seen. What I commit to is the measurement: once the tracking is live you get a ranked list with an estimated saving per change and what each costs to implement, from your own traffic rather than from an industry average, and you decide which ones ship.
What if the first month finds nothing worth cutting?
Then I write that down rather than inventing work. It is rarer than you would think, but it happens, and at that point we talk about what the rest of the engagement should be: it might become monitoring and a regression watch, it might become a smaller scope, it might stop. What I will not do is spend a month manufacturing changes so the invoice looks earned. You keep the instrumentation, the tracking and the dashboard either way, which is worth having the next time the bill moves.
What do you need from my team?
One call to walk through what your product does and which features call a model. Then access to the repository that makes those calls, read access to wherever the calls are logged today, and whoever normally reviews and merges in that repository. After that I mostly need answers to the occasional question about what a feature is for and who uses it. For shipping, your team merges and deploys as usual, or you give me a path to do it, your call.
Do you see my prompts and my user data?
The instrumentation records metadata by default: feature, model, token counts, cached tokens, latency and cost. It does not need prompt or completion bodies to produce the breakdown, and it will not store them unless you explicitly want sampling turned on for prompt-trimming work, in which case it is scoped and redacted to whatever your policy allows. Everything runs in your environment, and I work from the aggregates. NDA signed before specifics if you want one.
Will this make the product worse?
That is the real risk, and it is the thing the engagement is built around. A quality bar is agreed up front, in whatever form fits your product: an evaluation set, a golden set of outputs, a human review pass, or a metric you already trust. Every change gets checked against it before it ships, and a change that crosses it does not ship. If a call genuinely needs the expensive model, it keeps the expensive model and I say so in writing.
Which providers and frameworks does this work with?
Anything you call over an API. The big hosted providers, the aggregators and gateways, and anything you already run yourself behind an OpenAI-compatible endpoint. On the code side it does not matter much whether you call the SDK directly or go through a framework, because the instrumentation sits at the point where your code decides to make a call. If your calls are spread across several services in different languages, that comes up during scoping and shapes where the layer goes.
What happens after the two months?
Nothing you have to pay for. The instrumentation keeps recording, the dashboard keeps showing spend by feature and by model, and the changes keep saving money. If a new feature starts burning tokens, you see it as a line going up in a dashboard you already own. There is no retainer to sign and no support plan to renew. If you want me back later for another pass once the product has moved on, that is a new engagement, quoted then.
Do I own it, or am I locked in?
You own all of it. The instrumentation, the tracking table and the dashboard are plain code in your repository, running on your infrastructure, and the changes are changes to your own codebase reviewed by your own team. There is no licence, no seat count, no subscription, and nothing phoning home.
Send me your invoice and your stack.
This is for teams spending enough on models every month that the number has started getting mentioned in meetings, and where nobody can yet say which feature is responsible. Tell me roughly what you spend, which providers you call and what your product does with them. We get on a call, I scope it, and two months later you have the breakdown, the cuts, and the tracked evidence that they held.
Direct B2B only, on your own contract and invoicing, with no platform in the middle. Reach me on LinkedIn and we sort the terms directly.