Skip to content

by Startups.Studio

Core grammar Action

Action.evaluate

POST /{namespace}/actions/{action}/evaluate

Evaluate grades an Action’s output against a rubric and records the verdict as an Event.

Noun: Action
Mode: do
Event: Action.evaluated

You, to your agent

Evaluate the latest action.

curl -X POST https://api.sb/routewise.dev/actions/action_1/evaluate \
  -H "Authorization: Bearer $STARTUP_BUILDER_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"evaluator":"Example evaluator"}'

import { $ } from 'startup-builder'

const { verdict, action } = await $.Action.evaluate({ action: 'action_1', evaluator: 'Example evaluator' })

npx startup-builder do Action.evaluate --json '{"action":"action_1","evaluator":"Example evaluator"}'

{
  "name": "do",
  "arguments": {
    "code": "return await $.Action.evaluate({ action: 'action_1', evaluator: 'Example evaluator' })"
  }
}

Inputs

Input	Type	Required	Description
`action`	Action	required	The Action whose output is graded.
`evaluator`	`string`	required	The Evaluator to run.

Outputs

Output	Type	Required	Description
`verdict`	`json`	required	The score and the reasons for it.
`action`	Action	required	The Action graded, with the verdict attached.

Effects

Emits Action.evaluated.
Performed by the Quality Lead.

Refuses when

Check	Error	Fix	Then call
The input does not match the schema of the operation.	`invalid-input`	Read the schema of the operation, then send every required field with the right type.	Action.evaluate
The key is valid, but its scopes do not allow this operation.	`forbidden`	Use a key whose scopes cover the operation, or ask an owner of the namespace to grant them.	Action.evaluate

When it waits

Gate	Default
Decision class	Low: two-way, nothing at stake
Delay window	None: it runs once review passes.
Limit	The call Limit of the Permission it runs under.
Over the Limit	It waits `pending` for an Approval from the Founder. Approved, it runs; refused, it ends `refused` with `limit-exceeded`; unanswered by its deadline, it ends `canceled`.

Action.create

Previous Page

Action.get

Next Page