The hard case is an agent that gets worse while every check still passes. Every fact it uses is up to date and has an owner. Every message is allowed. And yet it is slowly getting worse.
Five warning signs, none enough on its own
- The right people overruling it. For example, the deal desk lead changes a price, or legal rewrites a term. This is the main sign. You decide whose changes count, because a junior rep undoing an expert's work tells you little.
- It asks for approval more often, or less often. Fewer requests can mean it has learned. They can also mean it has stopped asking. Fewer requests together with more overruling is the worst sign there is.
- More near misses. These are messages that were allowed only because a fact happened to be up to date that day.
- Its writing changes. It gets longer, more certain, or more absolute, meaning it leaves no room for exceptions.
- Someone says it feels off. Write that down.
Reading the signs fairly
- Compare against something that shouldn't have changed. If every agent changed at the same time, the cause lies in your market or your data, so look there.
- Group problems before you count them. Four bad emails with the same wrong phrase are one problem. Fix the fact the phrase came from, and there is no need to demote the agent four times.
What to do about it
Tighten what the agent may do, tell someone, and let a person decide what happens next. If an agent is stopped automatically on a hunch, people soon start working around the control.
Where Reynforce fits
The Activity page records what each agent asked, what it relied on and what it was told. Every sign above is built from that. A report that spots an agent getting worse is designed, but not built yet. Today you can read the record yourself.
When Reynforce is the wrong choice
- You need to test an AI model before it goes live, by trying it against a fixed set of cases. An evaluation tool is the right choice for that.
What it costs
£99 a month for each agent for your first 10 agents. After that it is £79 a month for each agent, up to 49 agents. If you pay for a year at once, you get two months free. If you want us to set it up and get it signed off with you, that starts at £2,500, paid once, and the price depends on the agent's job. Pricing has the rest.