Skip to main content
Metis is the self-improvement tab in the AOP editor. It reads the runs of an AOP that failed, were stopped, were denied, were rated poorly, or were handed back to a person unfinished, and proposes changes to the prompt. Nothing changes until you approve.

​
What Metis looks at

Metis only works from runs that went wrong: If an AOP has no runs like these, Metis has nothing to propose.
Metis is in early access. Today only Athena staff can see the Metis tab, and it is turned on separately for each AOP. If you’d like it on one of your AOPs, ask your Athena contact to turn it on.

​
How it works

1

Find improvements

Open the AOP, go to the Metis tab, click Turn on Metis for this AOP if it is off, then click Find improvements. Metis reads the recent runs that went wrong and works out what in the prompt caused them.
2

Review the proposal

Each proposal shows the change to the prompt, the issue it fixes (for example a missing instruction, error handling, tool usage, output format, or input handling), a risk level, and links to the runs that motivated it.
3

Check the replays

Metis replays past runs of the AOP against the proposed prompt and shows how many passed. If there are no past runs to replay, review the change by hand.
4

Decide

Choose Approve and apply, Edit before applying, Ask Metis to revise (with a note on what to change), or Reject proposal. If some replays went wrong you can still Apply anyway with a note.

​
Guardrails

  • Propose only. Metis never edits a live AOP by itself. A person approves, edits, or rejects every change.
  • Every change is a version. An applied change is saved as a new version of the AOP, so you can roll back from version history.
  • Inputs stay intact. A proposal that removes any of the AOP’s [[ Variable ]] inputs is refused.
  • No stale changes. If the AOP’s prompt changed after Metis made a proposal, the proposal is marked Out of date and can’t be applied.
  • Limited access. While Metis is in early access, only Athena staff can open the Metis tab, request proposals, and apply them. It doesn’t open to everyone who can edit the AOP.