- Does it redo completed work? If it re-migrates the seven modules, the export recorded intent and misplaced completion. Repeated adjustments are low cost in a logging improve. In a schema migration, they’re an incident.
- Does it convey again a retired assumption? That is the failure I care about most. If the second agent helpfully “fixes” the module the workforce intentionally skipped, the export carried the unique plan and dropped the choice that overrode it. A handoff has simply undone a human name, and nothing within the construct will flag it, as a result of the code is completely in step with the plan that not exists.
- How lengthy does a human spend rebuilding context? Time it with a stopwatch. Each query the engineer has to reply from reminiscence is state the export didn’t maintain.
- What broke on the way in which over? Instruction information that identify one vendor’s instructions. Expertise written in a single instrument’s format. Hooks that fireplace on one instrument’s occasions. Credentials scoped to 1 product. Write every of those down. That checklist is your actual switching price, and in my expertise it’s longer than something within the contract suggests.
Run the drill twice. As soon as inside the identical product, a brand new session selecting up the outdated one’s work, and as soon as throughout distributors. The primary tells you whether or not the product’s personal continuity is actual. The second tells you what leaving prices.
Don’t let the seller choose the duty. Each product has a demo path the place its reminiscence appears flawless, and it’s normally a greenfield function with no historical past and no one’s earlier resolution to journey over. Hold the duty boring sufficient that no one argues about the best reply. The query isn’t whether or not the second agent writes good code; most of them will. It’s whether or not the agent is aware of which code it shouldn’t write. Your logging improve, with its one awkward exception that exists solely as a result of somebody mentioned so in a gathering in March, is the case that issues. In case your activity doesn’t have an ungainly exception, add one. Actual tasks are stuffed with them, and they’re precisely what a transcript export loses first, as a result of they had been determined out loud and written down in a single sentence that no one tagged as a requirement.
Ask the seller to point out you, not let you know
Ask them to run the drill in your activity, reside, utilizing the export format they’d truly hand you on exit. Ask what that export incorporates, discipline by discipline, and whether or not choices and accomplished actions are saved individually from the chat log. Ask whether or not their reminiscence and talent codecs are documented effectively sufficient for an additional instrument to learn. Ask what occurs to that state on the day the contract ends: how lengthy you have got, in what format and at what cost.
