The loop
1
Pick an issue
Under Open issues, choose the one you want to fix.
2
Draft a change
Click Draft a fix and the copilot reads the issue and its calls, then writes the change. Or write it yourself with New draft. A draft is text only, and nothing reaches Retell.
3
Test it against calls
Run a Quick check for a fast, approximate read, and Run tests for Retell’s own simulation on a copy of your agent.
4
Compare
Read the diff, the test results and the conversations behind them. A failing result does not block publishing, so the decision is yours.
5
Publish
An admin reviews the diff in the publish dialog and confirms. SignalMD then records the new version and compares production calls before and after.
What a draft is
A draft is a change to the text of your live agent’s prompts or flow: the general prompt, the begin message, the global prompt, step and state instructions, transition conditions and variable descriptions. It cannot change tools, URLs, ids, voice, settings, knowledge bases or the steps themselves. A fix that needs one of those is made in Retell. Each draft is based on one version of your agent, shown as From version 7 under the title. Nothing exists in Retell until it is published. A draft carries one status tag:The Build page
The header has Ask copilot and New draft. Drafts lists drafts for the selected agent, newest first, filtered by Open, Published and Discarded. Each row shows the title, the tag, the latest test result and the date. The result reads “Not tested”, “Quick check 2 of 3 passed”, “Retell 4 of 5 passed”, “Tests running”, “Tests waiting for approval” or “Tests did not run”. Open issues lists the eight issues SignalMD ranks highest, with a link to All issues. Draft a fix on a row asks the copilot for a fix. An issue whose cause is not established is listed last with Investigate instead: the copilot helps find the cause and proposes no change, and SignalMD refuses a draft written for it. Resolved issues, caller behaviour, count-only issues and issues that follow from another are left out.A draft’s page
Click a row to open the draft. On an open draft the header has Ask copilot, Quick check, Run tests, Publish and a Discard icon. On a published draft it has Roll back.- Why. The issue, the evidence and why the change should help.
- Changes. One block per changed text, with lines added and removed and words changed inside a line marked. Edit opens the editor.
- Tests. A row for Retell simulation (not run, a status, or “4 of 5 passed” with View run) and a row for Quick check, tagged Approximate.
- Quick checks. Every check on the draft, newest first. Open a conversation for each criterion’s Pass, Fail or Unclear with a reason, what SignalMD’s own checks Found with a quote and turn, and the Transcript.
Test a draft
Quick check
SignalMD plays both sides, a caller and your agent built from the draft’s text, and scores each conversation against the test’s criteria and SignalMD’s own checks. It needs no Retell setup and takes minutes. A conversation passes only when every criterion is met, SignalMD’s checks found nothing and it ran to its end. Callers come from the tests made from the draft’s issue. With none, SignalMD builds up to three from the issue’s latest calls, using their real lines; a draft with no issue gets one typical caller from your brief. The newest five checks are kept. Each uses credits from your plan’s balance, so a longer check, or one that does more lookups, uses more of them. A quick check approximates Retell and never marks a draft verified. Text has no timing, shared components in a flow are not played, a tool with no recorded answer gets a neutral stand-in reply (marked in the transcript), and a long flow may be cut off before your change, which the result says.Run tests
Run tests plays your tests in Retell on a copy of the live agent with the draft applied. The copy appears in your Retell workspace with a name that starts with “[Signal shadow]”, and your live agent is not touched. It needs testing turned on for the agent, with a Retell write key and a Monthly test budget (USD): open Runs, then Settings, then the Testing panel. It runs the tests made from the draft’s issue, or else your guard tests. With neither, it refuses and tells you to choose tests or run a quick check. A run can wait for approval. See Test a fix.Edit a draft by hand
New draft opens a blank editor, and Edit reopens a draft’s changed texts. Give the draft a Title and a Why, then choose texts from Pick a text to change; Revert puts back the live text. Create draft or Save stays disabled until there is a title and a change. Saving follows the same rules as the copilot, so a change to a tool, URL or id is refused. It also sets the draft back to Draft and drops its Retell result, because that run tested earlier text; a test counts toward publishing only when it ran on the exact text you publish. A published or discarded draft cannot be edited.Publish
Only an admin of your workspace can publish. Click Publish on the draft page or on the copilot’s draft card. The dialog is titled “Publish to” with your agent’s name, and shows the latest Retell simulation and Quick check results and the whole diff. Keyboard focus starts on Cancel. Confirming sends the diff you reviewed, and SignalMD refuses if the draft changed after the dialog showed it. SignalMD reads the live agent, checks it still matches what the draft was based on, writes the draft’s text to the agent’s flow or prompt with the Retell write key, publishes the agent, and reads it back for its new version number. Publish is grey, with the reason in a tooltip, when:
An edit made in Retell after the draft is never overwritten. The Stale tag appears once SignalMD has read the new version, which can take up to 10 minutes, but publishing checks the live agent itself and refuses even before the tag shows.
If Retell refuses to publish
If Retell refuses to publish
SignalMD writes the text first and publishes second. If Retell refuses the publish, SignalMD writes the old text back, and the error says whether that worked. If it did not, your agent’s flow or prompt in Retell holds the draft’s text unpublished, and you check it in Retell.
Discard and roll back
- Before publishing, discard. The Discard icon opens “Discard this draft?” and moves the draft to Discarded. To undo only part of a draft, use Revert in the editor.
- After publishing, roll back. Only an admin can roll back. Roll back opens a dialog with your agent’s name and Changes to undo, writes the earlier text back and publishes it, so Retell shows it as a new version. The draft returns to Draft and can be published again. A published draft cannot be discarded.
After you publish
SignalMD checks Retell for the new version at once, records what changed, and starts comparing production calls on it with the version before. Release tests, if set up, start when your budget covers them. Build does not show the comparison: open Agent config for the change and its effect, and the issue’s By version for the problem you targeted. See Compare versions.Next steps
Compare versions
Check whether the published change helped.
Versions
What a version is and how to read a comparison.