Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.
Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.
Path parameters
string (uuid)
required
The agent id.
Request body
object
integer
How many of the agent’s evals to run (newest first). Capped at 20 per call. Default: 10. Minimum: 1. Maximum: 20.
string
Only run evals with this status. Maximum length: 50.
Response
object
string
required
Allowed values: 'eval.run_summary'.
string (uuid)
required
integer
required
Number of evals run (runs.length).
integer
required
Runs with passed: true.
integer
required
Runs with passed: false.
integer
required
Runs with passed: null.
boolean
required
True when more evals exist for the agent than were run — the suite stopped at limit.
string
Present only when has_more is true: states that only the first N were run.
object[]
required
Show runs
string
required
Allowed values: 'eval.run'.
string (uuid)
required
string (uuid)
required
The agent the eval was replayed against (the request agent_id, else the eval’s own).
string,null
The replayed customer message. Absent when the run itself failed (reason: 'run_failed').
string,null
The eval’s preferred_output. Absent when the run itself failed.
string,null
The agent’s reply on this run; null when the agent returned no reply. Absent when the run itself failed.
boolean,null
required
True when verdict is pass, false when it is partial or fail, and null when the reply was not graded — ‘the judge was unavailable’ and ‘the agent got it wrong’ are kept distinct.
boolean
required
Whether the judge produced a verdict. When false, reason says why and the verdict fields are absent.
string
Present only when graded is false. Allowed values: 'judge_unavailable', 'judge_failed', 'judge_empty', 'judge_invalid_json', 'judge_invalid_verdict', 'agent_returned_no_reply', 'run_failed'.
string
Present only when reason is run_failed (a run inside a suite threw); the public error message.
integer
Generation plus judge time. Absent when the run itself failed.
string
Present only when graded is true. Judged on substance, not wording. Allowed values: 'pass', 'partial', 'fail'.
number,null
Present only when graded is true. 0–5, how closely the substance matches (5 = equivalent); one decimal. Minimum: 0. Maximum: 5.
boolean,null
Present only when graded is true.
string[]
Present only when graded is true. Essential points from the reference that the reply is missing. Maximum items: 10.
string,null
Present only when graded is true. Maximum length: 2000.
string,null
Present only when graded is true. The judge’s reasoning, so a caller can disagree with the grade. Maximum length: 2000.
Status codes
Code
Meaning
200
The suite result. Evals run sequentially; a run that throws is recorded as an ungraded eval.run with reason: 'run_failed' rather than failing the whole suite.
400
Invalid request. issues names the offending field(s).
401
Missing, invalid, or expired API key.
403
The key lacks a required scope.
404
Not found, or not in the organization that owns the key.
429
Rate limit exceeded.
Access
Required scope
responses:write
Rate limit
30 requests per minute
Using this contract
Read the source OpenAPI document for declared schemas and alternatives.
This page also includes documented corrections from the spec overlays.
Example IDs and values are illustrative; replace them with records from your workspace.
{"docsConfig":{"theme":"mint","$schema":"https://mintlify.com/docs.json","name":"StateSet","colors":{"primary":"#1854D8","light":"#9ABBFF","dark":"#1854D8"},"logo":{"light":"https://mintcdn.com/stateset/4wTHkssFeA2M0XSV/logo/stateset28.svg?fit=max\u0026auto=format\u0026n=4wTHkssFeA2M0XSV\u0026q=85\u0026s=24804c100796a1bf65ec331da17e6d35","dark":"https://mintcdn.com/stateset/JA8nckTOtvEhuHo_/logo/stateset-dark.svg?fit=max\u0026auto=format\u0026n=JA8nckTOtvEhuHo_\u0026q=85\u0026s=65eb9e8c70dcd90948e7767e33664716","href":"https://docs.stateset.com"},"favicon":"https://mintcdn.com/stateset/-A-d_TFUEdlnuegX/logo/favicon.png?fit=max\u0026auto=format\u0026n=-A-d_TFUEdlnuegX\u0026q=85\u0026s=0104c780f4ff026e880a05450e1156b0","api":{"mdx":{"auth":{"method":"bearer"},"server":"https://api.stateset.com"}},"background":{"color":{"light":"#FFFFFF","dark":"#101827"}},"navbar":{"links":[{"href":"https://stateset.com/contact-us","label":"Talk to us"}],"primary":{"type":"button","label":"Dashboard","href":"https://console.stateset.com"}},"footer":{"socials":{"x":"https://x.com/stateset","github":"https://github.com/stateset","linkedin":"https://www.linkedin.com/company/stateset"},"links":[{"header":"Explore","items":[{"label":"Sandbox","href":"https://sandbox.stateset.com"},{"label":"ResponseCX","href":"https://response.cx"},{"label":"Console","href":"https://console.stateset.com"}]},{"header":"Resources","items":[{"label":"Customers","href":"https://stateset.com/customers"},{"label":"Blog","href":"https://stateset.com/blog"},{"label":"Pricing","href":"https://stateset.com/pricing"},{"label":"Contact support","href":"https://stateset.com/support"},{"label":"Glossary","href":"https://www.stateset.com/glossary/icommerce/glossary"},{"label":"Status","href":"https://stateset.com/status"}]},{"header":"Company","items":[{"label":"Careers","href":"https://stateset.com/careers"},{"label":"FAQs","href":"https://stateset.com/faqs"},{"label":"Community","href":"https://discord.gg/VfcaqgZywq"},{"label":"Newsletter","href":"https://stateofmind.beehiiv.com/"}]},{"header":"Legal","items":[{"label":"Privacy Policy","href":"https://stateset.com/privacy"},{"label":"Terms of Service","href":"https://stateset.com/terms"},{"label":"Trust Center","href":"https://trust.stateset.com"}]}]},"search":{"prompt":"Search guides, APIs, and MCP tools…"},"seo":{"metatags":{"og:type":"website","og:site_name":"StateSet API Docs","og:title":"StateSet API Docs","og:description":"Documentation for the StateSet iCommerce Engine — the execution layer for AI commerce. APIs, SDKs, MCP servers and skills for every service.","twitter:card":"summary_large_image","twitter:site":"@stateset"},"indexing":"all"},"fonts":{"family":"Inter"},"icons":{"library":"lucide"},"styling":{"eyebrows":"breadcrumbs","latex":true},"errors":{"404":{"redirect":false,"title":"This page does not exist","description":"It may have been retired — 376 old URLs redirect automatically, but you found one that doesn't. Try the [API router](/api-reference/introduction) to find the right surface, [host status](/api-reference/hosts) if a service seems missing, or [Getting Help](/support)."}},"contextual":{"options":["copy","chatgpt","claude","cursor"],"display":"header"},"thumbnails":{"appearance":"dark"},"interaction":{"drilldown":false},"metadata":{"timestamp":true},"navigation":{"global":{"anchors":[{"anchor":"GitHub","icon":"github","href":"https://github.com/stateset"}]},"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"stateset","hasAudioNarration":false,"actualSubdomain":"stateset","customDomains":["docs.stateset.com"],"gitSource":{"type":"github","owner":"stateset","repo":"api-docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"entitlements":{},"buildId":"6af760fef96917bc1916b111","clientVersion":"0.0.4227","searchFilterCounts":[{"language":"default","tag":"API Reference","count":1570},{"language":"default","tag":"iCommerce","count":482},{"language":"default","tag":"Platform docs","count":317},{"language":"default","tag":"NSR","count":264},{"language":"default","tag":"Learn \u0026 build","count":238},{"language":"default","tag":"EDI","count":204},{"language":"default","tag":"Temporal Engine","count":182},{"language":"default","tag":"Financials","count":97},{"language":"default","tag":"Computer Use","count":92},{"language":"default","tag":"Orders \u0026 Customers","count":88}],"searchSettings":{"maxResults":8}},"assistantConfig":{},"basePath":"","hasChatPermissions":false,"hasWebMcpPermissions":false,"toggles":[],"googleFontsInlined":false},"customCss":[{"filePath":"style.css","content":":root{--ss-page: #ffffff;--ss-ink: #15243b;--ss-muted: #4e6078;--ss-line: #dce4ef;--ss-surface: #f5f8fd;--ss-accent: #1854d8}.dark{--ss-page: #101827;--ss-ink: #edf3ff;--ss-muted: #b0bfd4;--ss-line: #304057;--ss-surface: #182337;--ss-accent: #9abbff}html,body{background-color:var(--ss-page)}#navbar{border-bottom-color:var(--ss-line)}#search-bar-entry{border-color:var(--ss-line);border-radius:12px}#sidebar a{transition:background-color 140ms ease, color 140ms ease}#content-area h1{letter-spacing:-0.035em;text-wrap:balance}#content-area h2{letter-spacing:-0.025em}#content-area h3{letter-spacing:-0.015em}#content-area :is(a,button,[role=\"link\"]):focus-visible,#sidebar :is(a,button):focus-visible,#navbar :is(a,button):focus-visible,#footer :is(a,button):focus-visible{outline:3px solid var(--ss-accent);outline-offset:4px}#content-area .card{border-color:var(--ss-line);border-radius:16px;box-shadow:0 2px 5px rgb(15 35 65 / 3%);transition:border-color 160ms ease, box-shadow 160ms ease}#content-area .card:hover{border-color:var(--ss-accent);box-shadow:0 6px 20px rgb(15 35 65 / 7%)}#content-area th{background:var(--ss-surface)}#content-area :is(th,td){border-bottom-color:var(--ss-line)}.ss-home-actions{display:flex;flex-wrap:wrap;align-items:center;gap:0.75rem 1.5rem;margin:0 0 1.75rem}.ss-eyebrow{display:block;font-size:0.75rem;font-weight:700;letter-spacing:0.08em;color:var(--ss-accent)}#content-area .ss-primary-link,#content-area .ss-secondary-link{display:inline-flex;align-items:center;gap:0.75rem;font-size:0.875rem;font-weight:600;text-decoration:none;border-bottom:0}#content-area .ss-primary-link{padding:0.7rem 1rem;border-radius:10px;background:#1854d8;color:#fff}#content-area .ss-primary-link:hover{background:#1244b7}#content-area .ss-secondary-link{color:var(--ss-accent)}#content-area .ss-secondary-link:hover{text-decoration:underline;text-underline-offset:4px}.ss-reference-strip{display:flex;flex-wrap:wrap;gap:0.5rem 1rem;margin:1.25rem 0 2rem;padding:1rem 1.25rem;background:var(--ss-surface);border:1px solid var(--ss-line);border-radius:12px;font-size:0.875rem}.ss-reference-strip>span{flex-basis:100%;font-weight:600;color:var(--ss-muted)}.ss-operation-map{display:grid;grid-template-columns:repeat(3, minmax(0, 1fr));margin:1.5rem 0 2.5rem;border:1px solid var(--ss-line);border-radius:16px;background:var(--ss-surface)}.ss-operation-map>div{padding:1.25rem}.ss-operation-map>div+div{border-left:1px solid var(--ss-line)}.ss-operation-map strong{display:block;margin-top:0.65rem;font-size:0.95rem;color:var(--ss-ink)}#content-area .ss-operation-map p{margin:0.5rem 0 0;font-size:0.875rem;line-height:1.6;color:var(--ss-muted)}.ss-guide-summary{display:grid;grid-template-columns:1fr 1.3fr 1.3fr;gap:1.25rem;padding:1.25rem;margin:0 0 1.75rem;border:1px solid var(--ss-line);border-radius:14px;background:var(--ss-surface)}.ss-guide-summary strong{display:block;margin-top:0.5rem;color:var(--ss-ink);font-size:0.9rem}#content-area .ss-guide-summary p{margin:0.5rem 0 0;font-size:0.875rem;line-height:1.6;color:var(--ss-muted)}.ss-checkpoint{border-left:3px solid var(--ss-accent);border-radius:0 10px 10px 0;background:var(--ss-surface);padding:0.85rem 1.1rem;margin:1.5rem 0}#content-area .ss-checkpoint p{margin:0}#content-area th{padding:0.7rem 0.75rem}#content-area td{padding:0.8rem 0.75rem;vertical-align:top;line-height:1.6}#content-area :is(h2,h3){scroll-margin-top:8rem}#content-area :is(a,button,[role=\"tab\"]),#navbar button{-webkit-tap-highlight-color:transparent}#content-area .ss-primary-link,#content-area .ss-secondary-link{min-height:44px}#content-area [data-component-part=\"card-icon\"]{padding:0.5rem;box-sizing:content-box;background:var(--ss-surface);border-radius:10px}@media (max-width: 640px){.ss-home-actions{gap:0.5rem 1rem}.ss-operation-map,.ss-guide-summary{grid-template-columns:1fr}.ss-operation-map>div+div{border-left:0;border-top:1px solid var(--ss-line)}.ss-guide-summary{gap:1rem}.ss-guide-summary>div{display:grid;grid-template-columns:6.5rem 1fr;gap:0.5rem;align-items:baseline}#content-area .ss-guide-summary :is(p,strong){margin-top:0}}@media (prefers-reduced-motion: reduce){#sidebar a,#content-area .card{transition:none}}@media (forced-colors: active){.ss-checkpoint,.ss-guide-summary,.ss-operation-map,.ss-reference-strip{border:1px solid CanvasText}#content-area .ss-primary-link{border:1px solid ButtonText}}@media (max-width: 400px){#footer .nav-logo{max-width:140px}#footer div:has(>a .nav-logo){flex-wrap:wrap;gap:1rem}}#footer :is(a,span){color:var(--ss-muted)}#footer a:hover{color:var(--ss-accent)}.ss-test-sequence{display:grid;gap:1rem;margin:1.5rem 0}.ss-test-sequence .ss-test-case{border:1px solid var(--ss-line);border-radius:14px;padding:1.25rem}#content-area .ss-test-sequence h3{margin:0.5rem 0 0.75rem;font-size:1.1rem}#content-area .ss-test-sequence .ss-test-question{margin:0;padding:0.75rem 1rem;background:var(--ss-surface);border-left:3px solid var(--ss-accent);font-style:normal;color:var(--ss-ink)}#content-area .ss-test-sequence p{margin:0.85rem 0 0;font-size:0.9rem;line-height:1.7}"}]}
{"page":{"pagePath":"api-reference/responsecx/agents-by-evals-run-create","slug":"/api-reference/responsecx/agents-by-evals-run-create","pageMetadata":{"title":"Run an agent's eval suite (regression check)","api":"POST https://response.stateset.com/api/v1/agents/{id}/evals/run","description":"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.","href":"/api-reference/responsecx/agents-by-evals-run-create"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,p:`p`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,..._provideComponents(),...props.components},{Expandable,Heading,ParamField,ResponseField,Table}=_components;if(!Expandable)_missingMdxReference(`Expandable`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!ParamField)_missingMdxReference(`ParamField`,true);if(!ResponseField)_missingMdxReference(`ResponseField`,true);if(!Table)_missingMdxReference(`Table`,true);return _jsxs(_Fragment,{children:[_jsx(_components.p,{children:`Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.`}),`\n`,_jsx(Heading,{level:`3`,id:`path-parameters`,children:`Path parameters`}),`\n`,_jsx(ParamField,{path:`id`,type:`string (uuid)`,required:true,id:`param-id`,children:_jsx(_components.p,{children:`The agent id.`})}),`\n`,_jsx(Heading,{level:`3`,id:`request-body`,children:`Request body`}),`\n`,_jsx(_components.p,{children:_jsx(_components.code,{children:`object`})}),`\n`,_jsx(ParamField,{body:`limit`,type:`integer`,id:`param-limit`,children:_jsxs(_components.p,{children:[`How many of the agent’s evals to run (newest first). Capped at 20 per call. Default: `,_jsx(_components.code,{children:`10`}),`. Minimum: `,_jsx(_components.code,{children:`1`}),`. Maximum: `,_jsx(_components.code,{children:`20`}),`.`]})}),`\n`,_jsx(ParamField,{body:`status`,type:`string`,id:`param-status`,children:_jsxs(_components.p,{children:[`Only run evals with this `,_jsx(_components.code,{children:`status`}),`. Maximum length: `,_jsx(_components.code,{children:`50`}),`.`]})}),`\n`,_jsx(Heading,{level:`3`,id:`response`,children:`Response`}),`\n`,_jsx(_components.p,{children:_jsx(_components.code,{children:`object`})}),`\n`,_jsx(ResponseField,{name:`object`,type:`string`,required:true,id:`param-object`,children:_jsxs(_components.p,{children:[`Allowed values: `,_jsx(_components.code,{children:`'eval.run_summary'`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`agent_id`,type:`string (uuid)`,required:true,id:`param-agent-id`}),`\n`,_jsx(ResponseField,{name:`total`,type:`integer`,required:true,id:`param-total`,children:_jsxs(_components.p,{children:[`Number of evals run (`,_jsx(_components.code,{children:`runs.length`}),`).`]})}),`\n`,_jsx(ResponseField,{name:`passed`,type:`integer`,required:true,id:`param-passed`,children:_jsxs(_components.p,{children:[`Runs with `,_jsx(_components.code,{children:`passed: true`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`failed`,type:`integer`,required:true,id:`param-failed`,children:_jsxs(_components.p,{children:[`Runs with `,_jsx(_components.code,{children:`passed: false`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`ungraded`,type:`integer`,required:true,id:`param-ungraded`,children:_jsxs(_components.p,{children:[`Runs with `,_jsx(_components.code,{children:`passed: null`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`has_more`,type:`boolean`,required:true,id:`param-has-more`,children:_jsxs(_components.p,{children:[`True when more evals exist for the agent than were run — the suite stopped at `,_jsx(_components.code,{children:`limit`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`note`,type:`string`,id:`param-note`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`has_more`}),` is true: states that only the first N were run.`]})}),`\n`,_jsx(ResponseField,{name:`runs`,type:`object[]`,required:true,id:`param-runs`,children:_jsxs(Expandable,{title:`runs`,children:[_jsx(ResponseField,{name:`object`,type:`string`,required:true,id:`param-object-1`,children:_jsxs(_components.p,{children:[`Allowed values: `,_jsx(_components.code,{children:`'eval.run'`}),`.`]})}),_jsx(ResponseField,{name:`eval_id`,type:`string (uuid)`,required:true,id:`param-eval-id`}),_jsx(ResponseField,{name:`agent_id`,type:`string (uuid)`,required:true,id:`param-agent-id-1`,children:_jsxs(_components.p,{children:[`The agent the eval was replayed against (the request `,_jsx(_components.code,{children:`agent_id`}),`, else the eval’s own).`]})}),_jsx(ResponseField,{name:`user_message`,type:`string,null`,id:`param-user-message`,children:_jsxs(_components.p,{children:[`The replayed customer message. Absent when the run itself failed (`,_jsx(_components.code,{children:`reason: 'run_failed'`}),`).`]})}),_jsx(ResponseField,{name:`expected`,type:`string,null`,id:`param-expected`,children:_jsxs(_components.p,{children:[`The eval’s `,_jsx(_components.code,{children:`preferred_output`}),`. Absent when the run itself failed.`]})}),_jsx(ResponseField,{name:`actual`,type:`string,null`,id:`param-actual`,children:_jsx(_components.p,{children:`The agent’s reply on this run; null when the agent returned no reply. Absent when the run itself failed.`})}),_jsx(ResponseField,{name:`passed`,type:`boolean,null`,required:true,id:`param-passed-1`,children:_jsxs(_components.p,{children:[`True when `,_jsx(_components.code,{children:`verdict`}),` is `,_jsx(_components.code,{children:`pass`}),`, false when it is `,_jsx(_components.code,{children:`partial`}),` or `,_jsx(_components.code,{children:`fail`}),`, and null when the reply was not graded — ‘the judge was unavailable’ and ‘the agent got it wrong’ are kept distinct.`]})}),_jsx(ResponseField,{name:`graded`,type:`boolean`,required:true,id:`param-graded`,children:_jsxs(_components.p,{children:[`Whether the judge produced a verdict. When false, `,_jsx(_components.code,{children:`reason`}),` says why and the verdict fields are absent.`]})}),_jsx(ResponseField,{name:`reason`,type:`string`,id:`param-reason`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is false. Allowed values: `,_jsx(_components.code,{children:`'judge_unavailable'`}),`, `,_jsx(_components.code,{children:`'judge_failed'`}),`, `,_jsx(_components.code,{children:`'judge_empty'`}),`, `,_jsx(_components.code,{children:`'judge_invalid_json'`}),`, `,_jsx(_components.code,{children:`'judge_invalid_verdict'`}),`, `,_jsx(_components.code,{children:`'agent_returned_no_reply'`}),`, `,_jsx(_components.code,{children:`'run_failed'`}),`.`]})}),_jsx(ResponseField,{name:`error`,type:`string`,id:`param-error`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`reason`}),` is `,_jsx(_components.code,{children:`run_failed`}),` (a run inside a suite threw); the public error message.`]})}),_jsx(ResponseField,{name:`duration_ms`,type:`integer`,id:`param-duration-ms`,children:_jsx(_components.p,{children:`Generation plus judge time. Absent when the run itself failed.`})}),_jsx(ResponseField,{name:`verdict`,type:`string`,id:`param-verdict`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. Judged on substance, not wording. Allowed values: `,_jsx(_components.code,{children:`'pass'`}),`, `,_jsx(_components.code,{children:`'partial'`}),`, `,_jsx(_components.code,{children:`'fail'`}),`.`]})}),_jsx(ResponseField,{name:`equivalence`,type:`number,null`,id:`param-equivalence`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. 0–5, how closely the substance matches (5 = equivalent); one decimal. Minimum: `,_jsx(_components.code,{children:`0`}),`. Maximum: `,_jsx(_components.code,{children:`5`}),`.`]})}),_jsx(ResponseField,{name:`contradicts`,type:`boolean,null`,id:`param-contradicts`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true.`]})}),_jsx(ResponseField,{name:`omits`,type:`string[]`,id:`param-omits`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. Essential points from the reference that the reply is missing. Maximum items: `,_jsx(_components.code,{children:`10`}),`.`]})}),_jsx(ResponseField,{name:`differences`,type:`string,null`,id:`param-differences`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. Maximum length: `,_jsx(_components.code,{children:`2000`}),`.`]})}),_jsx(ResponseField,{name:`explanation`,type:`string,null`,id:`param-explanation`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. The judge’s reasoning, so a caller can disagree with the grade. Maximum length: `,_jsx(_components.code,{children:`2000`}),`.`]})})]})}),`\n`,_jsx(Heading,{level:`3`,id:`status-codes`,children:`Status codes`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Code`}),_jsx(_components.th,{children:`Meaning`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`200`})}),_jsxs(_components.td,{children:[`The suite result. Evals run sequentially; a run that throws is recorded as an ungraded `,_jsx(_components.code,{children:`eval.run`}),` with `,_jsx(_components.code,{children:`reason: 'run_failed'`}),` rather than failing the whole suite.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`400`})}),_jsxs(_components.td,{children:[`Invalid request. `,_jsx(_components.code,{children:`issues`}),` names the offending field(s).`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`401`})}),_jsx(_components.td,{children:`Missing, invalid, or expired API key.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`403`})}),_jsx(_components.td,{children:`The key lacks a required scope.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`404`})}),_jsx(_components.td,{children:`Not found, or not in the organization that owns the key.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`429`})}),_jsx(_components.td,{children:`Rate limit exceeded.`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`access`,children:`Access`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{}),_jsx(_components.th,{})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`Required scope`}),_jsx(_components.td,{children:_jsx(_components.code,{children:`responses:write`})})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`Rate limit`}),_jsx(_components.td,{children:`30 requests per minute`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`using-this-contract`,children:`Using this contract`}),`\n`,_jsxs(_components.p,{children:[`Read the `,_jsx(_components.a,{href:`/spec/responsecx.json`,children:`source OpenAPI document`}),` for declared schemas and alternatives.\nThis page also includes documented corrections from the `,_jsx(_components.a,{href:`https://github.com/stateset/docs/tree/main/spec/overlays`,children:`spec overlays`}),`.\nExample IDs and values are illustrative; replace them with records from your workspace.`]})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Run an agent's eval suite (regression check)","api":"POST https://response.stateset.com/api/v1/agents/{id}/evals/run","description":"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.","href":"/api-reference/responsecx/agents-by-evals-run-create"}}},"mdxSourceWithNoJs":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx,jsxs:_jsxs}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){const _components={a:`a`,code:`code`,p:`p`,pre:`pre`,span:`span`,tbody:`tbody`,td:`td`,th:`th`,thead:`thead`,tr:`tr`,..._provideComponents(),...props.components},{CodeBlock,Expandable,Heading,ParamField,RequestExample,ResponseExample,ResponseField,Table}=_components;if(!CodeBlock)_missingMdxReference(`CodeBlock`,true);if(!Expandable)_missingMdxReference(`Expandable`,true);if(!Heading)_missingMdxReference(`Heading`,true);if(!ParamField)_missingMdxReference(`ParamField`,true);if(!RequestExample)_missingMdxReference(`RequestExample`,true);if(!ResponseExample)_missingMdxReference(`ResponseExample`,true);if(!ResponseField)_missingMdxReference(`ResponseField`,true);if(!Table)_missingMdxReference(`Table`,true);return _jsxs(_Fragment,{children:[_jsx(_components.p,{children:`Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.`}),`\n`,_jsx(Heading,{level:`3`,id:`path-parameters`,children:`Path parameters`}),`\n`,_jsx(ParamField,{path:`id`,type:`string (uuid)`,required:true,id:`param-id`,children:_jsx(_components.p,{children:`The agent id.`})}),`\n`,_jsx(Heading,{level:`3`,id:`request-body`,children:`Request body`}),`\n`,_jsx(_components.p,{children:_jsx(_components.code,{children:`object`})}),`\n`,_jsx(ParamField,{body:`limit`,type:`integer`,id:`param-limit`,children:_jsxs(_components.p,{children:[`How many of the agent’s evals to run (newest first). Capped at 20 per call. Default: `,_jsx(_components.code,{children:`10`}),`. Minimum: `,_jsx(_components.code,{children:`1`}),`. Maximum: `,_jsx(_components.code,{children:`20`}),`.`]})}),`\n`,_jsx(ParamField,{body:`status`,type:`string`,id:`param-status`,children:_jsxs(_components.p,{children:[`Only run evals with this `,_jsx(_components.code,{children:`status`}),`. Maximum length: `,_jsx(_components.code,{children:`50`}),`.`]})}),`\n`,_jsx(Heading,{level:`3`,id:`response`,children:`Response`}),`\n`,_jsx(_components.p,{children:_jsx(_components.code,{children:`object`})}),`\n`,_jsx(ResponseField,{name:`object`,type:`string`,required:true,id:`param-object`,children:_jsxs(_components.p,{children:[`Allowed values: `,_jsx(_components.code,{children:`'eval.run_summary'`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`agent_id`,type:`string (uuid)`,required:true,id:`param-agent-id`}),`\n`,_jsx(ResponseField,{name:`total`,type:`integer`,required:true,id:`param-total`,children:_jsxs(_components.p,{children:[`Number of evals run (`,_jsx(_components.code,{children:`runs.length`}),`).`]})}),`\n`,_jsx(ResponseField,{name:`passed`,type:`integer`,required:true,id:`param-passed`,children:_jsxs(_components.p,{children:[`Runs with `,_jsx(_components.code,{children:`passed: true`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`failed`,type:`integer`,required:true,id:`param-failed`,children:_jsxs(_components.p,{children:[`Runs with `,_jsx(_components.code,{children:`passed: false`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`ungraded`,type:`integer`,required:true,id:`param-ungraded`,children:_jsxs(_components.p,{children:[`Runs with `,_jsx(_components.code,{children:`passed: null`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`has_more`,type:`boolean`,required:true,id:`param-has-more`,children:_jsxs(_components.p,{children:[`True when more evals exist for the agent than were run — the suite stopped at `,_jsx(_components.code,{children:`limit`}),`.`]})}),`\n`,_jsx(ResponseField,{name:`note`,type:`string`,id:`param-note`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`has_more`}),` is true: states that only the first N were run.`]})}),`\n`,_jsx(ResponseField,{name:`runs`,type:`object[]`,required:true,id:`param-runs`,children:_jsxs(Expandable,{title:`runs`,children:[_jsx(ResponseField,{name:`object`,type:`string`,required:true,id:`param-object-1`,children:_jsxs(_components.p,{children:[`Allowed values: `,_jsx(_components.code,{children:`'eval.run'`}),`.`]})}),_jsx(ResponseField,{name:`eval_id`,type:`string (uuid)`,required:true,id:`param-eval-id`}),_jsx(ResponseField,{name:`agent_id`,type:`string (uuid)`,required:true,id:`param-agent-id-1`,children:_jsxs(_components.p,{children:[`The agent the eval was replayed against (the request `,_jsx(_components.code,{children:`agent_id`}),`, else the eval’s own).`]})}),_jsx(ResponseField,{name:`user_message`,type:`string,null`,id:`param-user-message`,children:_jsxs(_components.p,{children:[`The replayed customer message. Absent when the run itself failed (`,_jsx(_components.code,{children:`reason: 'run_failed'`}),`).`]})}),_jsx(ResponseField,{name:`expected`,type:`string,null`,id:`param-expected`,children:_jsxs(_components.p,{children:[`The eval’s `,_jsx(_components.code,{children:`preferred_output`}),`. Absent when the run itself failed.`]})}),_jsx(ResponseField,{name:`actual`,type:`string,null`,id:`param-actual`,children:_jsx(_components.p,{children:`The agent’s reply on this run; null when the agent returned no reply. Absent when the run itself failed.`})}),_jsx(ResponseField,{name:`passed`,type:`boolean,null`,required:true,id:`param-passed-1`,children:_jsxs(_components.p,{children:[`True when `,_jsx(_components.code,{children:`verdict`}),` is `,_jsx(_components.code,{children:`pass`}),`, false when it is `,_jsx(_components.code,{children:`partial`}),` or `,_jsx(_components.code,{children:`fail`}),`, and null when the reply was not graded — ‘the judge was unavailable’ and ‘the agent got it wrong’ are kept distinct.`]})}),_jsx(ResponseField,{name:`graded`,type:`boolean`,required:true,id:`param-graded`,children:_jsxs(_components.p,{children:[`Whether the judge produced a verdict. When false, `,_jsx(_components.code,{children:`reason`}),` says why and the verdict fields are absent.`]})}),_jsx(ResponseField,{name:`reason`,type:`string`,id:`param-reason`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is false. Allowed values: `,_jsx(_components.code,{children:`'judge_unavailable'`}),`, `,_jsx(_components.code,{children:`'judge_failed'`}),`, `,_jsx(_components.code,{children:`'judge_empty'`}),`, `,_jsx(_components.code,{children:`'judge_invalid_json'`}),`, `,_jsx(_components.code,{children:`'judge_invalid_verdict'`}),`, `,_jsx(_components.code,{children:`'agent_returned_no_reply'`}),`, `,_jsx(_components.code,{children:`'run_failed'`}),`.`]})}),_jsx(ResponseField,{name:`error`,type:`string`,id:`param-error`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`reason`}),` is `,_jsx(_components.code,{children:`run_failed`}),` (a run inside a suite threw); the public error message.`]})}),_jsx(ResponseField,{name:`duration_ms`,type:`integer`,id:`param-duration-ms`,children:_jsx(_components.p,{children:`Generation plus judge time. Absent when the run itself failed.`})}),_jsx(ResponseField,{name:`verdict`,type:`string`,id:`param-verdict`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. Judged on substance, not wording. Allowed values: `,_jsx(_components.code,{children:`'pass'`}),`, `,_jsx(_components.code,{children:`'partial'`}),`, `,_jsx(_components.code,{children:`'fail'`}),`.`]})}),_jsx(ResponseField,{name:`equivalence`,type:`number,null`,id:`param-equivalence`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. 0–5, how closely the substance matches (5 = equivalent); one decimal. Minimum: `,_jsx(_components.code,{children:`0`}),`. Maximum: `,_jsx(_components.code,{children:`5`}),`.`]})}),_jsx(ResponseField,{name:`contradicts`,type:`boolean,null`,id:`param-contradicts`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true.`]})}),_jsx(ResponseField,{name:`omits`,type:`string[]`,id:`param-omits`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. Essential points from the reference that the reply is missing. Maximum items: `,_jsx(_components.code,{children:`10`}),`.`]})}),_jsx(ResponseField,{name:`differences`,type:`string,null`,id:`param-differences`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. Maximum length: `,_jsx(_components.code,{children:`2000`}),`.`]})}),_jsx(ResponseField,{name:`explanation`,type:`string,null`,id:`param-explanation`,children:_jsxs(_components.p,{children:[`Present only when `,_jsx(_components.code,{children:`graded`}),` is true. The judge’s reasoning, so a caller can disagree with the grade. Maximum length: `,_jsx(_components.code,{children:`2000`}),`.`]})})]})}),`\n`,_jsx(Heading,{level:`3`,id:`status-codes`,children:`Status codes`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{children:`Code`}),_jsx(_components.th,{children:`Meaning`})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`200`})}),_jsxs(_components.td,{children:[`The suite result. Evals run sequentially; a run that throws is recorded as an ungraded `,_jsx(_components.code,{children:`eval.run`}),` with `,_jsx(_components.code,{children:`reason: 'run_failed'`}),` rather than failing the whole suite.`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`400`})}),_jsxs(_components.td,{children:[`Invalid request. `,_jsx(_components.code,{children:`issues`}),` names the offending field(s).`]})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`401`})}),_jsx(_components.td,{children:`Missing, invalid, or expired API key.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`403`})}),_jsx(_components.td,{children:`The key lacks a required scope.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`404`})}),_jsx(_components.td,{children:`Not found, or not in the organization that owns the key.`})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{\"data-numeric\":`true`,children:_jsx(_components.code,{children:`429`})}),_jsx(_components.td,{children:`Rate limit exceeded.`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`access`,children:`Access`}),`\n`,_jsxs(Table,{children:[_jsx(_components.thead,{children:_jsxs(_components.tr,{children:[_jsx(_components.th,{}),_jsx(_components.th,{})]})}),_jsxs(_components.tbody,{children:[_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`Required scope`}),_jsx(_components.td,{children:_jsx(_components.code,{children:`responses:write`})})]}),_jsxs(_components.tr,{children:[_jsx(_components.td,{children:`Rate limit`}),_jsx(_components.td,{children:`30 requests per minute`})]})]})]}),`\n`,_jsx(Heading,{level:`3`,id:`using-this-contract`,children:`Using this contract`}),`\n`,_jsxs(_components.p,{children:[`Read the `,_jsx(_components.a,{href:`/spec/responsecx.json`,children:`source OpenAPI document`}),` for declared schemas and alternatives.\nThis page also includes documented corrections from the `,_jsx(_components.a,{href:`https://github.com/stateset/docs/tree/main/spec/overlays`,children:`spec overlays`}),`.\nExample IDs and values are illustrative; replace them with records from your workspace.`]}),`\n`,_jsx(RequestExample,{children:_jsx(CodeBlock,{filename:`cURL`,numberOfLines:`8`,language:`shellscript`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`shellscript`,children:_jsxs(_components.code,{language:`shellscript`,numberOfLines:`8`,children:[_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#953800`,\"--shiki-dark\":`#DCDCAA`},children:`curl`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --silent`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --show-error`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --fail-with-body`}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --request`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` POST`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --url`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` 'https://response.stateset.com/api/v1/agents/{id}/evals/run'`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --header`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"Authorization: Bearer `}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#9CDCFE`},children:`$RESPONSECX_API_KEY`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --header`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` 'Content-Type: application/json'`}),_jsx(_components.span,{style:{color:`#CF222E`,\"--shiki-dark\":`#D7BA7D`},children:` \\\\`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:` --data`}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` '{`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"limit\": 10,`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"status\": \"pending\"`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`}'`})}),`\n`]})})})}),`\n`,_jsx(ResponseExample,{children:_jsx(CodeBlock,{filename:`200`,numberOfLines:`33`,language:`json`,children:_jsx(_components.pre,{className:`shiki shiki-themes github-light-default dark-plus`,style:{backgroundColor:`#ffffff`,\"--shiki-dark-bg\":`#0B0C0E`,color:`#1f2328`,\"--shiki-dark\":`#D4D4D4`},language:`json`,children:_jsxs(_components.code,{language:`json`,numberOfLines:`33`,children:[_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`{`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"object\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"eval.run_summary\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"agent_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"3fa85f64-5717-4562-b3fc-2c963f66afa6\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"total\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`102`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"passed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"failed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"ungraded\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"has_more\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"note\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"Two-person tent, green — replacement for damaged pole set.\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"runs\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` {`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"object\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"eval.run\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"eval_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"3fa85f64-5717-4562-b3fc-2c963f66afa6\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"agent_id\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"3fa85f64-5717-4562-b3fc-2c963f66afa6\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"user_message\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"string\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"expected\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"string\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"actual\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"string\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"passed\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"graded\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"reason\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"judge_unavailable\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"error\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"string\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"duration_ms\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`8`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"verdict\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"pass\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"equivalence\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#B5CEA8`},children:`1.5`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"contradicts\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0550AE`,\"--shiki-dark\":`#569CD6`},children:`true`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"omits\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: [`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:` \"string\"`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ],`})}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"differences\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"string\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`,`})]}),`\n`,_jsxs(_components.span,{className:`line`,children:[_jsx(_components.span,{style:{color:`#116329`,\"--shiki-dark\":`#9CDCFE`},children:` \"explanation\"`}),_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`: `}),_jsx(_components.span,{style:{color:`#0A3069`,\"--shiki-dark\":`#CE9178`},children:`\"string\"`})]}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` }`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:` ]`})}),`\n`,_jsx(_components.span,{className:`line`,children:_jsx(_components.span,{style:{color:`#1F2328`,\"--shiki-dark\":`#D4D4D4`},children:`}`})}),`\n`]})})})})]})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent};function _missingMdxReference(id,component){throw new Error(`Expected `+(component?`component`:`object`)+\" `\"+id+\"` to be defined: you likely forgot to import, pass, or provide it.\")}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"title":"Run an agent's eval suite (regression check)","api":"POST https://response.stateset.com/api/v1/agents/{id}/evals/run","description":"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.","href":"/api-reference/responsecx/agents-by-evals-run-create"}}}},"mdxExtracts":{"tableOfContents":[{"title":"Path parameters","slug":"path-parameters","depth":3,"children":[]},{"title":"Request body","slug":"request-body","depth":3,"children":[]},{"title":"Response","slug":"response","depth":3,"children":[]},{"title":"Status codes","slug":"status-codes","depth":3,"children":[]},{"title":"Access","slug":"access","depth":3,"children":[]},{"title":"Using this contract","slug":"using-this-contract","depth":3,"children":[]}],"codeExamples":{"request":{"type":"RequestExample","children":[{"filename":"cURL","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"shellscript\">\u003ccode language=\"shellscript\" numberOfLines=\"8\">\u003cspan class=\"line\">\u003cspan style=\"color:#953800;--shiki-dark:#DCDCAA\">curl\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --silent\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --show-error\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --fail-with-body\u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --request\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> POST\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --url\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> 'https://response.stateset.com/api/v1/agents/{id}/evals/run'\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --header\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"Authorization: Bearer \u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#9CDCFE\">$RESPONSECX_API_KEY\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --header\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> 'Content-Type: application/json'\u003c/span>\u003cspan style=\"color:#CF222E;--shiki-dark:#D7BA7D\"> \\\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\"> --data\u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> '{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"limit\": 10,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"status\": \"pending\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">}'\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]},"response":{"type":"ResponseExample","children":[{"filename":"200","html":"\u003cpre class=\"shiki shiki-themes github-light-default dark-plus\" style=\"background-color:#ffffff;--shiki-dark-bg:#0B0C0E;color:#1f2328;--shiki-dark:#D4D4D4\" language=\"json\">\u003ccode language=\"json\" numberOfLines=\"33\">\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">{\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"object\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"eval.run_summary\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"agent_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"3fa85f64-5717-4562-b3fc-2c963f66afa6\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"total\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">102\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"passed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"failed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"ungraded\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"has_more\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"note\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"Two-person tent, green — replacement for damaged pole set.\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"runs\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> {\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"object\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"eval.run\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"eval_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"3fa85f64-5717-4562-b3fc-2c963f66afa6\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"agent_id\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"3fa85f64-5717-4562-b3fc-2c963f66afa6\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"user_message\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"string\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"expected\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"string\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"actual\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"string\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"passed\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"graded\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"reason\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"judge_unavailable\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"error\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"string\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"duration_ms\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">8\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"verdict\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"pass\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"equivalence\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#B5CEA8\">1.5\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"contradicts\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0550AE;--shiki-dark:#569CD6\">true\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"omits\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: [\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\"> \"string\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ],\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"differences\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"string\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">,\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#116329;--shiki-dark:#9CDCFE\"> \"explanation\"\u003c/span>\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">: \u003c/span>\u003cspan style=\"color:#0A3069;--shiki-dark:#CE9178\">\"string\"\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> }\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\"> ]\u003c/span>\u003c/span>\n\u003cspan class=\"line\">\u003cspan style=\"color:#1F2328;--shiki-dark:#D4D4D4\">}\u003c/span>\u003c/span>\n\u003c/code>\u003c/pre>"}],"attributes":[]}},"endpoint":{"title":"Run an agent's eval suite (regression check)","path":"/api/v1/agents/{id}/evals/run","servers":[{"url":"https://response.stateset.com"}],"method":"post","request":{"security":[{"title":"Bearer Auth","parameters":{"header":{"Authorization":{"type":"http","scheme":"bearer","description":"Bearer authentication header of the form `Bearer \u003ctoken>`, where `\u003ctoken>` is your auth token."}},"query":{},"cookie":{}}}],"parameters":{"query":{},"header":{},"cookie":{},"path":{"id":{"schema":[{"type":"object","properties":{},"description":"The agent id.","required":true}]}}},"body":{"application/json":{"schemaArray":[{"type":"object","properties":{"limit":[{"type":"integer","description":"How many of the agent’s evals to run (newest first). Capped at 20 per call. Default: `10` . Minimum: `1` . Maximum: `20` ."}],"status":[{"type":"string","description":"Only run evals with this `status` . Maximum length: `50` ."}]}}],"examples":{"example":{"value":{"limit":123,"status":"\u003cstring>"}}}}}},"response":{"200":{"application/json":{"schemaArray":[{"type":"object","properties":{"object":[{"type":"string","description":"Allowed values: `'eval.run_summary'` .","required":true}],"agent_id":[{"type":"object","properties":{},"required":true}],"total":[{"type":"integer","description":"Number of evals run ( `runs.length` ).","required":true}],"passed":[{"type":"integer","description":"Runs with `passed: true` .","required":true}],"failed":[{"type":"integer","description":"Runs with `passed: false` .","required":true}],"ungraded":[{"type":"integer","description":"Runs with `passed: null` .","required":true}],"has_more":[{"type":"boolean","description":"True when more evals exist for the agent than were run — the suite stopped at `limit` .","required":true}],"note":[{"type":"string","description":"Present only when `has_more` is true: states that only the first N were run."}],"runs":[{"type":"array","items":[{"type":"object","properties":{"object":[{"type":"string","description":"Allowed values: `'eval.run'` .","required":true}],"eval_id":[{"type":"object","properties":{},"required":true}],"agent_id":[{"type":"object","properties":{},"description":"The agent the eval was replayed against (the request `agent_id` , else the eval’s own).","required":true}],"user_message":[{"type":"object","properties":{},"description":"The replayed customer message. Absent when the run itself failed ( `reason: 'run_failed'` )."}],"expected":[{"type":"object","properties":{},"description":"The eval’s `preferred_output` . Absent when the run itself failed."}],"actual":[{"type":"object","properties":{},"description":"The agent’s reply on this run; null when the agent returned no reply. Absent when the run itself failed."}],"passed":[{"type":"object","properties":{},"description":"True when `verdict` is `pass` , false when it is `partial` or `fail` , and null when the reply was not graded — ‘the judge was unavailable’ and ‘the agent got it wrong’ are kept distinct.","required":true}],"graded":[{"type":"boolean","description":"Whether the judge produced a verdict. When false, `reason` says why and the verdict fields are absent.","required":true}],"reason":[{"type":"string","description":"Present only when `graded` is false. Allowed values: `'judge_unavailable'` , `'judge_failed'` , `'judge_empty'` , `'judge_invalid_json'` , `'judge_invalid_verdict'` , `'agent_returned_no_reply'` , `'run_failed'` ."}],"error":[{"type":"string","description":"Present only when `reason` is `run_failed` (a run inside a suite threw); the public error message."}],"duration_ms":[{"type":"integer","description":"Generation plus judge time. Absent when the run itself failed."}],"verdict":[{"type":"string","description":"Present only when `graded` is true. Judged on substance, not wording. Allowed values: `'pass'` , `'partial'` , `'fail'` ."}],"equivalence":[{"type":"object","properties":{},"description":"Present only when `graded` is true. 0–5, how closely the substance matches (5 = equivalent); one decimal. Minimum: `0` . Maximum: `5` ."}],"contradicts":[{"type":"object","properties":{},"description":"Present only when `graded` is true."}],"omits":[{"type":"array","items":[{"type":"string"}],"description":"Present only when `graded` is true. Essential points from the reference that the reply is missing. Maximum items: `10` ."}],"differences":[{"type":"object","properties":{},"description":"Present only when `graded` is true. Maximum length: `2000` ."}],"explanation":[{"type":"object","properties":{},"description":"Present only when `graded` is true. The judge’s reasoning, so a caller can disagree with the grade. Maximum length: `2000` ."}]}}],"required":true}]}}],"examples":{"example":{"value":{"object":"\u003cstring>","agent_id":{},"total":123,"passed":123,"failed":123,"ungraded":123,"has_more":true,"note":"\u003cstring>","runs":[{"object":"\u003cstring>","eval_id":{},"agent_id":{},"user_message":{},"expected":{},"actual":{},"passed":{},"graded":true,"reason":"\u003cstring>","error":"\u003cstring>","duration_ms":123,"verdict":"\u003cstring>","equivalence":{},"contradicts":{},"omits":["\u003cstring>"],"differences":{},"explanation":{}}]}}}}}},"deprecated":false}},"jsLinks":[],"subdomain":"stateset","siteName":"StateSet","title":"StateSet API Docs","navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-11-13T19:12:28.751Z","gitLastModified":"2026-09-21T02:16:48.000Z","originalFileLocation":"api-reference/responsecx/agents-by-evals-run-create.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.\">\u003cmeta data-mint-head name=\"application-name\" content=\"StateSet\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"StateSet API Docs\">\u003cmeta data-mint-head property=\"og:description\" content=\"Documentation for the StateSet iCommerce Engine — the execution layer for AI commerce. APIs, SDKs, MCP servers and skills for every service.\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"StateSet API Docs\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://stateset.mintlify.site/_mintlify/api/og/v2?division=Agents\u0026amp;title=Run+an+agent%27s+eval+suite+%28regression+check%29\u0026amp;description=Each+eval+costs+a+real+generation+plus+a+judge+call%2C+so+runs+are+sequential+and+capped+per+call%3B+has_more+reports+when+the+suite+was+longer+than+the+cap.\u0026amp;theme=8b886a933b8fdd889c9fff09\u0026amp;signature=fe8c676eb4c73b0d51f273d419f99e9bf5d0b734a576d8435b40f8532836d4d6\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"StateSet API Docs\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Documentation for the StateSet iCommerce Engine — the execution layer for AI commerce. APIs, SDKs, MCP servers and skills for every service.\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://stateset.mintlify.site/_mintlify/api/og/v2?division=Agents\u0026amp;title=Run+an+agent%27s+eval+suite+%28regression+check%29\u0026amp;description=Each+eval+costs+a+real+generation+plus+a+judge+call%2C+so+runs+are+sequential+and+capped+per+call%3B+has_more+reports+when+the+suite+was+longer+than+the+cap.\u0026amp;theme=8b886a933b8fdd889c9fff09\u0026amp;signature=fe8c676eb4c73b0d51f273d419f99e9bf5d0b734a576d8435b40f8532836d4d6\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/stateset/e2dvUYlL-CpWYzc1/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"StateSet\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#1854D8\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/api-reference/responsecx/agents-by-evals-run-create.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.stateset.com/#organization\",\"name\":\"StateSet\",\"url\":\"https://docs.stateset.com\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/stateset/4wTHkssFeA2M0XSV/logo/stateset28.svg?fit=max\u0026auto=format\u0026n=4wTHkssFeA2M0XSV\u0026q=85\u0026s=24804c100796a1bf65ec331da17e6d35\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.stateset.com#website\",\"name\":\"StateSet\",\"url\":\"https://docs.stateset.com\",\"publisher\":{\"@id\":\"https://docs.stateset.com/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create#webpage\",\"url\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create\",\"name\":\"Run an agent's eval suite (regression check)\",\"description\":\"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.\",\"dateModified\":\"2026-09-21T02:16:48.000Z\",\"isPartOf\":{\"@id\":\"https://docs.stateset.com#website\"},\"breadcrumb\":{\"@id\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"StateSet\",\"item\":\"https://docs.stateset.com\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Run an agent's eval suite (regression check)\",\"item\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create#apireference\",\"headline\":\"Run an agent's eval suite (regression check)\",\"name\":\"Run an agent's eval suite (regression check)\",\"description\":\"Each eval costs a real generation plus a judge call, so runs are sequential and capped per call; has_more reports when the suite was longer than the cap.\",\"url\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create\",\"mainEntityOfPage\":{\"@id\":\"https://docs.stateset.com/api-reference/responsecx/agents-by-evals-run-create#webpage\"},\"dateModified\":\"2026-09-21T02:16:48.000Z\",\"publisher\":{\"@id\":\"https://docs.stateset.com/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.stateset.com#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"StateSet\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"StateSet\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/api-reference/responsecx/agents-by-evals-run-create.md","siteName":"StateSet","nav":{"global":{"anchors":[{"anchor":"GitHub","icon":"github","href":"https://github.com/stateset"}]},"dropdowns":[{"dropdown":"Platform docs","icon":"book","description":"Products, guides and concepts","tabs":[{"tab":"Learn \u0026 build","icon":"book","groups":[{"group":"Get started","icon":"rocket","pages":[{"sidebarTitle":"Overview","title":"Build your first working operation","href":"/introduction"},{"sidebarTitle":"Signup to first value","title":"From Signup to First Value","icon":"rocket","href":"/guides/platform-onboarding"},{"sidebarTitle":"First local operation","title":"Your First Operation","icon":"play","href":"/guides/first-operation"},{"sidebarTitle":"Agent quickstart","title":"Getting Started for AI Agents","icon":"robot","href":"/getting-started-for-ai-agents"},{"title":"Why StateSet","icon":"scale-balanced","href":"/why-stateset"}]},{"group":"Build your first integration","icon":"blocks","pages":[{"sidebarTitle":"First support agent","title":"Your First Support Agent","icon":"bot","href":"/guides/first-support-agent"},{"sidebarTitle":"Workflow trial","title":"Your First Workflow Trial","icon":"workflow","href":"/guides/first-workflow-trial"},{"sidebarTitle":"Connect through MCP","title":"Manage Agents \u0026 Workflows with MCP","icon":"plug","href":"/guides/manage-platform-with-mcp"},{"title":"ResponseCX Quickstart","href":"/quickstart"},{"sidebarTitle":"Connect your systems","title":"Connect Your Operation","icon":"plug","href":"/guides/connect-your-operation"},{"sidebarTitle":"Rust engines \u0026 MCP","title":"Build Operations with Rust Engines \u0026 MCP","icon":"cpu","href":"/guides/rust-engines-and-mcp"},{"title":"Developer Guide","href":"/development"}]},{"group":"Operate and improve","icon":"activity","pages":[{"sidebarTitle":"Agent evaluations","title":"Your First Agent Evaluation","icon":"check-check","href":"/guides/first-agent-evaluation"},{"sidebarTitle":"Configuration changes","title":"Your First Workflow Configuration Change","icon":"git-pull-request","href":"/guides/first-workflow-config-change"},{"sidebarTitle":"Durable agents","title":"Operate Your First Durable Agent","icon":"bot","href":"/guides/first-durable-agent"},{"sidebarTitle":"Your first week","title":"Your First Week with StateSet","icon":"chart-line","href":"/guides/first-week-with-stateset"},{"title":"Launch a brand that runs itself","href":"/guides/launch-a-brand-autonomously"}]},{"group":"Resources and support","icon":"life-buoy","pages":[{"title":"Brand Onboarding","icon":"rocket","href":"/stateset-onboarding"},{"title":"ResponseCX","href":"/guides/response-quickstart"},{"sidebarTitle":"Troubleshooting","title":"Troubleshoot Your First Operation","icon":"life-ring","href":"/guides/onboarding-troubleshooting"},{"title":"Changelog","icon":"clock-rotate-left","href":"/changelog"},{"title":"Getting Help","icon":"life-ring","href":"/support"}]},{"group":"Platform","icon":"grid-2","pages":[{"title":"MCP Servers","icon":"plug","href":"/mcp-servers"},{"title":"StateSet Overview","icon":"eye","iconType":"solid","href":"/stateset-overview"},{"title":"StateSet Agent Operations Architecture","href":"/stateset-agentic-os"},{"title":"Global Commerce Architecture","href":"/global-commerce-architecture"},{"title":"Autonomous Agent Architecture","href":"/autonomous-agent-architecture"},{"title":"StateSet Billing","href":"/stateset-billing"},{"title":"Security \u0026 Compliance","icon":"shield","iconType":"solid","href":"/security"},{"title":"Service-as-a-Software (SaaS 3.0)","icon":"brain","iconType":"solid","href":"/service-as-a-software"}]},{"group":"Using the APIs","icon":"briefcase","pages":[{"title":"API Reference","href":"/api-reference/introduction"},{"title":"Host status","href":"/api-reference/hosts"},{"title":"Errors across the engines","href":"/api-reference/errors-across-engines"},{"title":"Authentication","icon":"shield-halved","iconType":"solid","href":"/api-reference/authentication"},{"title":"API Design Guidelines","icon":"book","href":"/api-reference/api-design-guidelines"},{"title":"Overview","icon":"desktop","iconType":"solid","href":"/api-reference/overview"},{"title":"Getting Started","icon":"browser","iconType":"solid","href":"/api-reference/getting-started"},{"group":"Architecture","pages":[{"title":"Web Framework","icon":"browser","iconType":"solid","href":"/api-reference/framework"},{"title":"StateSet API","href":"/api-reference/backend-framework"},{"title":"gRPC","icon":"route","iconType":"solid","href":"/api-reference/grpc-framework"},{"title":"Workflow Framework with Temporal","icon":"arrow-progress","iconType":"solid","href":"/api-reference/temporal"},{"title":"Event-Driven APIs with StateSet One","icon":"webhook","iconType":"solid","href":"/api-reference/events"}]},{"title":"Features","href":"/api-reference/features"},{"title":"Reporting and Reconciliation","icon":"file-chart-column","href":"/api-reference/reporting"},{"title":"Integrations","icon":"plug","iconType":"solid","href":"/api-reference/integrations"},{"title":"API Changelog","icon":"clock-rotate-left","iconType":"solid","href":"/api-reference/changelog"}]},{"group":"StateSet Response","icon":"comments","pages":[{"title":"ResponseCX Platform","href":"/stateset-response/responsecx-platform"},{"title":"Chat Desk","sidebarTitle":"Chat Desk","icon":"inbox","href":"/stateset-response/chat-desk"},{"title":"Your First Shift in Chat Desk","sidebarTitle":"First desk shift","icon":"inbox","href":"/guides/chat-desk-first-shift"},{"title":"Connect the Chat Widget to Your Desk","sidebarTitle":"Widget to desk","icon":"messages-square","href":"/stateset-response/chat-desk-widget"},{"title":"Chat Desk Across Channels","sidebarTitle":"Desk channel coverage","icon":"network","href":"/stateset-response/chat-desk-channels"},{"title":"Autonomy dial","href":"/stateset-response/responsecx-autonomy"},{"title":"Workflow Studio","href":"/stateset-response/responsecx-workflow-studio"},{"title":"Website Onboarding","href":"/stateset-response/responsecx-website-onboarding"},{"title":"ResponseCX API","href":"/response-api-reference/overview"},{"title":"Agents","href":"/response-api-reference/agents"},{"title":"Authentication","icon":"key","iconType":"solid","href":"/response-api-reference/authentication"},{"title":"Models","href":"/response-api-reference/models"},{"title":"Agent Framework and SDK","href":"/response-api-reference/framework"},{"title":"Computer Use","href":"/response-api-reference/computer-use"},{"title":"ReasonCX","href":"/response-api-reference/reason"},{"title":"Realtime Voice","href":"/response-api-reference/voice"},{"title":"Response Public API (v1)","href":"/stateset-response/response-public-api"},{"title":"Response MCP Servers","href":"/stateset-response/response-mcp"},{"title":"Response ChatGPT App Guide","href":"/stateset-response/stateset-response-chatgpt-guide"},{"title":"Onsite Chat Quickstart","href":"/stateset-response/response-chat-widget-quickstart"},{"title":"Response Chat Widget","href":"/stateset-response/response-chat-widget"},{"title":"Widget Authentication and Conversation Recovery","sidebarTitle":"Auth and recovery","href":"/stateset-response/response-chat-widget-reliability"},{"title":"Native Widget Live Chat","sidebarTitle":"Native live chat","href":"/stateset-response/response-chat-widget-live-chat"},{"title":"Widget Sites, Configuration and MCP","sidebarTitle":"Sites and admin","href":"/stateset-response/response-chat-widget-admin"},{"title":"Deploy and Qualify the Onsite Widget","sidebarTitle":"Deployment","href":"/stateset-response/response-chat-widget-deployment"}]},{"group":"StateSet ResponseCX","icon":"headset","pages":[{"title":"Set up ResponseCX","href":"/stateset-response/stateset-responsecx"},{"title":"ResponseCX Platform","href":"/stateset-response/responsecx-platform"},{"title":"Autonomy dial","href":"/stateset-response/responsecx-autonomy"},{"title":"ResponseCX Workflows","href":"/stateset-response/stateset-responsecx-workflows"},{"title":"StateSet ResponseCX CLI","href":"/stateset-responsecx-cli"}]},{"group":"Temporal Engine","icon":"diagram-project","pages":[{"title":"Temporal Engine","href":"/next-temporal/overview"},{"title":"Start Automating Responses","href":"/next-temporal/getting-started"},{"title":"ResponseAutomationV2","href":"/next-temporal/workflow"},{"title":"Active-horizon agents","href":"/next-temporal/active-horizon-agents"},{"title":"Connectors \u0026 Capabilities","href":"/next-temporal/connectors"},{"title":"Policy Engine \u0026 Decision Gate","href":"/next-temporal/policy-engine"},{"title":"Control Plane","href":"/next-temporal/control-plane"},{"title":"Configuration","href":"/next-temporal/configuration"},{"title":"Workstream MCP","href":"/next-temporal/mcp-connector"},{"title":"Operations","href":"/next-temporal/operations"},{"title":"Kubernetes Deployment","href":"/next-temporal/kubernetes-deployment"},{"title":"Runbooks","href":"/next-temporal/runbooks"}]},{"group":"StateSet iCommerce Engine","icon":"shopping-bag","pages":[{"group":"Overview","pages":[{"title":"iCommerce Quickstart","href":"/stateset-icommerce/stateset-icommerce-quickstart"},{"title":"The Embedded iCommerce Engine","href":"/stateset-icommerce/stateset-icommerce-embedded"},{"title":"Governed Execution and Replay","href":"/stateset-icommerce/governed-execution"},{"title":"Physical Stock Fulfillment","href":"/stateset-icommerce/stock-fulfillment"},{"title":"Native Commerce and Inventory Simulations","href":"/stateset-icommerce/simulations"},{"title":"Build an iCommerce Storefront","href":"/stateset-icommerce/storefront"},{"title":"HTTP Retry Receipts and Reconciliation","href":"/stateset-icommerce/http-receipt-recovery"},{"title":"iCommerce Scenarios and Examples","href":"/stateset-icommerce/stateset-icommerce-scenarios"},{"title":"iCommerce Language Bindings","href":"/stateset-icommerce/stateset-icommerce-bindings"},{"title":"iCommerce Paper","href":"/icommerce-paper"},{"title":"iCommerce Intro","href":"/icommerce"},{"title":"StateSet iCommerce Engine Architecture","href":"/icommerce-architecture"},{"title":"iCommerce Quickstart for AI Agents","href":"/stateset-icommerce-quickstart"},{"title":"StateSet iCommerce Engine Skills","href":"/stateset-icommerce/stateset-icommerce-skills"},{"title":"iCommerce MCP Server","href":"/stateset-icommerce/stateset-icommerce-mcp"}]},{"group":"Agent Sandbox","pages":[{"title":"iCommerce Agent Execution","href":"/stateset-icommerce/stateset-icommerce-agent"},{"title":"Run iCommerce Inside Sandbox","href":"/stateset-icommerce/stateset-icommerce-agent-sandbox"},{"title":"Agent Sandbox Costs","href":"/stateset-icommerce/stateset-icommerce-agent-sandbox-costs"},{"title":"iCommerce Sandbox Runbook","href":"/stateset-icommerce/stateset-icommerce-agent-sandbox-runbook"},{"title":"iCommerce Sandbox Troubleshooting","href":"/stateset-icommerce/stateset-icommerce-agent-sandbox-troubleshooting"}]},{"group":"Lifecycle \u0026 Workflows","pages":[{"title":"Order Lifecycle","href":"/stateset-icommerce/stateset-icommerce-order-lifecycle"},{"title":"Returns Workflow","href":"/stateset-icommerce/stateset-icommerce-returns-workflow"},{"title":"Inventory Lifecycle","href":"/stateset-icommerce/stateset-icommerce-inventory-lifecycle"}]},{"group":"Platform \u0026 Operations","pages":[{"title":"Finance \u0026 Accounting","href":"/stateset-icommerce/stateset-icommerce-finance"},{"title":"Admin Console","href":"/stateset-icommerce/stateset-icommerce-admin"},{"title":"Commerce HTTP Access and Retry Controls","href":"/stateset-icommerce/stateset-icommerce-api-hardening"},{"title":"Backup, Restore, and Durability","href":"/stateset-icommerce/stateset-icommerce-backup-restore"}]},{"group":"CLI","pages":[{"title":"iCommerce CLI Reference","href":"/stateset-icommerce/stateset-icommerce-cli-reference"},{"title":"Operational CLI Workflows","href":"/stateset-icommerce/stateset-icommerce-cli-workflows"},{"title":"CLI and Agent Write Controls","href":"/stateset-icommerce/stateset-icommerce-cli-safety"}]},{"group":"Messaging \u0026 Payments","pages":[{"title":"Messaging Orchestrator","href":"/stateset-icommerce/stateset-icommerce-messaging-orchestrator"},{"title":"Run the WhatsApp gateway","href":"/stateset-icommerce/stateset-icommerce-whatsapp-integration"},{"title":"x402 Intents and Settlement Boundaries","href":"/stateset-icommerce/stateset-icommerce-x402-payments"},{"title":"Connect messaging channels","href":"/stateset-icommerce/stateset-icommerce-messaging-channels"}]},{"group":"Deployment","pages":[{"title":"Deploy StateSet iCommerce Engine on GCP","href":"/stateset-icommerce/stateset-icommerce-gcp"},{"title":"Deploy StateSet iCommerce Engine on Hetzner","href":"/stateset-icommerce/stateset-icommerce-hetzner"},{"title":"Deploy StateSet iCommerce Engine on Fly.io","href":"/stateset-icommerce/stateset-icommerce-flyio"}]}]},{"group":"StateSet Warehouse (WMS)","icon":"warehouse","pages":[{"title":"StateSet Warehouse (WMS)","sidebarTitle":"Overview","icon":"warehouse","href":"/stateset-warehouse/overview"},{"title":"Run StateSet Warehouse locally","sidebarTitle":"Quickstart","href":"/stateset-warehouse/quickstart"},{"title":"Warehouse REST API and MCP","sidebarTitle":"API and MCP","href":"/stateset-warehouse/api-and-mcp"},{"title":"Connect Sync OMS, Warehouse WMS, and Freight TMS","sidebarTitle":"OMS, WMS, and TMS","href":"/guides/oms-wms-tms"}]},{"group":"StateSet Freight (TMS)","icon":"truck","pages":[{"title":"StateSet Freight (TMS)","sidebarTitle":"Overview","icon":"truck","href":"/stateset-freight/overview"},{"title":"Run StateSet Freight locally","sidebarTitle":"Quickstart","href":"/stateset-freight/quickstart"},{"title":"Freight REST API and MCP","sidebarTitle":"API and MCP","href":"/stateset-freight/api-and-mcp"}]},{"group":"StateSet EDI","icon":"file-import","pages":[{"title":"StateSet EDI","href":"/stateset-edi/overview"},{"title":"Workspace Onboarding and Readiness","href":"/stateset-edi/onboarding"},{"title":"EDI Quickstart","href":"/stateset-edi/quickstart"},{"title":"Orders, Reviewed Sends, and Recovery","href":"/stateset-edi/orders-and-recovery"},{"title":"EDI Transaction Sets","href":"/stateset-edi/transaction-sets"},{"title":"EDI Transports","href":"/stateset-edi/transports"},{"title":"Guides, Mappings, and Callbacks","href":"/stateset-edi/mappings-and-callbacks"},{"title":"EDI Operations","href":"/stateset-edi/operations"},{"title":"EDI CLI and JavaScript SDK","href":"/stateset-edi/cli-and-sdk"},{"title":"EDI MCP Server","href":"/stateset-edi/mcp-server"},{"title":"EDI Configuration","href":"/stateset-edi/configuration"},{"title":"EDI Deployment and Qualification","href":"/stateset-edi/deployment-and-qualification"}]},{"group":"StateSet Mail","icon":"envelope","pages":[{"title":"StateSet Mail","href":"/stateset-mail/overview"},{"title":"Mail Quickstart","href":"/stateset-mail/quickstart"},{"title":"Conversations","href":"/stateset-mail/conversations"},{"title":"Mail MCP Server","href":"/stateset-mail/mcp-server"},{"title":"Mail Configuration","href":"/stateset-mail/configuration"}]},{"group":"StateSet iCommerce Voice Engine","icon":"phone","pages":[{"title":"StateSet iCommerce Voice Engine","href":"/stateset-voice/overview"},{"title":"Build Your First Voice Agent","href":"/stateset-voice/quickstart"},{"title":"Voice API","href":"/stateset-voice/api"},{"title":"Voice SDKs","href":"/stateset-voice/sdks"},{"title":"Voice Webhooks","href":"/stateset-voice/webhooks"},{"title":"Voice Configuration","href":"/stateset-voice/configuration"},{"title":"Voice MCP Server","href":"/stateset-voice/mcp-server"},{"title":"Voice Operations","href":"/stateset-voice/operations"}]},{"group":"StateSet iCommerce NSR Engine","icon":"brain","pages":[{"title":"Neuro-Symbolic Architecture","href":"/stateset-nsr"},{"title":"NSR-L Language Reference","href":"/stateset-nsr-l"},{"title":"Verified Decisions API","href":"/stateset-nsr-decisions"},{"title":"Jev + NSR","sidebarTitle":"Jev + NSR","icon":"scan-text","href":"/stateset-nsr-jev"},{"title":"Your First Jev + NSR Decision","sidebarTitle":"First Jev decision","icon":"play","href":"/guides/jev-first-decision"},{"title":"Jev + NSR Industry Pack Examples","sidebarTitle":"Industry examples","icon":"building","href":"/guides/jev-industry-packs"},{"title":"Use Industry Packs with the Decisions API","sidebarTitle":"Decisions API walkthrough","icon":"code","href":"/guides/jev-decisions-api"},{"title":"Connect Jev to Your NSR Workspace","sidebarTitle":"Jev workspace setup","icon":"key-round","href":"/guides/jev-workspace-setup"},{"title":"Agent Gate","href":"/stateset-nsr-agent-gate"},{"title":"Formal Verification","href":"/stateset-nsr-formal-verification"},{"title":"NSR as a Model Provider","href":"/stateset-nsr-providers"},{"title":"NSR Console \u0026 Billing","href":"/stateset-nsr-console"},{"title":"NSR SDKs","href":"/stateset-nsr-sdks"},{"title":"NSR MCP Server","href":"/stateset-nsr-mcp"}]},{"group":"AI Agents","icon":"robot","pages":[{"title":"StateSet Computer Use Agent","href":"/computer-use-agent"},{"title":"Engines and Commerce MCP Servers","href":"/computer-use-engines-mcp"},{"title":"Computer Use MCP Servers","href":"/computer-use-mcp"},{"title":"StateSet RL agents","href":"/stateset-rl-agents"}]},{"group":"StateSet Agents","pages":[{"title":"StateSet Agents","href":"/stateset-agents/overview"},{"title":"Prepare your first fine-tuning run","sidebarTitle":"Quickstart","href":"/stateset-agents/quickstart"},{"title":"Fine-tuning studio","href":"/stateset-agents/finetuning-studio"},{"title":"Fine-tuning from AI agents","href":"/stateset-agents/finetuning-agents"},{"title":"Checkpoint recovery and evaluation","href":"/stateset-agents/checkpoints-and-evaluation"},{"title":"River SFT, native RL, and retained evidence","sidebarTitle":"River training","href":"/stateset-agents/river-training"},{"title":"Industry data and fine-tuning","href":"/stateset-agents/industry-finetuning"},{"title":"StateSet Agents CLI","sidebarTitle":"CLI reference","href":"/stateset-agents/cli"},{"title":"Agents MCP server","href":"/stateset-agents/mcp-server"}]},{"group":"StateSet Sandbox","icon":"flask","pages":[{"title":"StateSet Sandbox","href":"/stateset-sandbox/stateset-sandboxes"},{"title":"Sandbox Quickstart","href":"/stateset-sandbox/stateset-sandbox-quickstart-guide"},{"title":"Get started with StateSet Swarm","href":"/stateset-sandbox/swarm-getting-started"},{"title":"Execution, workers, and recovery","href":"/stateset-sandbox/execution-and-recovery"},{"title":"Sandbox terminal workbench","href":"/stateset-sandbox/workbench"},{"title":"Prepared agent tasks and teams","href":"/stateset-sandbox/agent-tasks"},{"title":"Artifacts and recoverable tunnels","href":"/stateset-sandbox/artifacts-and-tunnels"},{"group":"Architecture \u0026 Operations","pages":[{"title":"Sandbox architecture","href":"/stateset-sandbox/stateset-sandbox-architecture"},{"title":"Sandbox operations and release evidence","href":"/stateset-sandbox/stateset-sandbox-operations"},{"title":"Sandbox webhooks and event delivery","href":"/stateset-sandbox/stateset-sandbox-webhooks"},{"title":"Sandbox security boundaries","href":"/stateset-sandbox/stateset-sandbox-security-guide"},{"title":"Sandbox API workflow","href":"/stateset-sandbox/stateset-sandbox-api-flow"},{"title":"Durable sandboxes and agent sessions","href":"/stateset-sandbox/stateset-sandbox-agent-sessions"},{"title":"Self-host Sandbox","href":"/stateset-sandbox/stateset-sandbox-deployments"},{"title":"Sandbox API directory","href":"/stateset-sandbox/stateset-sandbox-api-reference"},{"title":"Sandbox production configuration","href":"/stateset-sandbox/stateset-sandbox-production-guide"},{"title":"Sandbox Quickstart","href":"/stateset-sandbox/stateset-sandbox-quickstart-guide"},{"title":"Sandbox runtime selection","href":"/stateset-sandbox/stateset-sandbox-runtime-selection"},{"title":"Sandbox on AWS EKS","href":"/stateset-sandbox/stateset-sandbox-deployment-aws"},{"title":"Sandbox on GCP GKE","href":"/stateset-sandbox/stateset-sandbox-deployment-gcp"},{"title":"Sandbox on Azure AKS","href":"/stateset-sandbox/stateset-sandbox-deployment-azure"},{"title":"Sandbox MCP server","href":"/stateset-sandbox/stateset-sandbox-mcp"}]},{"group":"SDKs","pages":[{"title":"Sandbox TypeScript SDK","sidebarTitle":"Node.js SDK","href":"/stateset-sandbox/stateset-sandbox-sdk-node"},{"title":"Sandbox Python SDK","href":"/stateset-sandbox/stateset-sandbox-sdk-python"}]},{"title":"Build with StateSet Sandbox","href":"/guides/stateset-sandbox"}]},{"group":"StateSet ACP","icon":"bolt","pages":[{"title":"Agentic Commerce Protocol","href":"/stateset-acp/stateset-acp"},{"title":"ACP Overview","href":"/stateset-acp/stateset-acp-overview"},{"title":"ACP Quickstart","href":"/stateset-acp/stateset-acp-quickstart"},{"group":"Reference","pages":[{"title":"ACP Async Processing","href":"/stateset-acp/stateset-acp-async-processing"},{"title":"ACP API Endpoints","href":"/stateset-acp/stateset-acp-endpoints"},{"title":"ACP Routing Options","href":"/stateset-acp/stateset-acp-routing"},{"title":"ACP Request Schemas","href":"/stateset-acp/stateset-acp-schemas"}]},{"title":"Agentic Commerce Protocol Handler","href":"/guides/agentic-commerce-protocol-handler"},{"title":"Agentic Commerce Protocol Checkout Guide","href":"/agentic-commerce/agentic-commerce-checkout-guide"}]},{"group":"StateSet UCP","icon":"arrows-split-up-and-left","pages":[{"title":"Universal Commerce Protocol","href":"/stateset-ucp"},{"title":"UCP Quickstart","href":"/stateset-ucp-quickstart"},{"title":"Universal Commerce Protocol Handler","href":"/guides/universal-commerce-protocol-handler"}]},{"group":"StateSet ICP","icon":"network-wired","pages":[{"title":"Intelligent Commerce Protocol (ICP)","href":"/stateset-icp"}]},{"group":"StateSet Sequencer","icon":"layer-group","pages":[{"title":"StateSet VES System Overview","href":"/stateset-sequencer/stateset-sequencer"},{"title":"Sequencer Architecture: Deep Dive","href":"/stateset-sequencer-architecture"},{"title":"Sequencer Quickstart","href":"/stateset-sequencer/stateset-sequencer-quickstart"},{"title":"Sequencer Operations","href":"/stateset-sequencer/stateset-sequencer-operations"},{"title":"x402 payments reference","href":"/stateset-sequencer/stateset-sequencer-x402"}]},{"group":"StateSet Set L2","icon":"cube","pages":[{"title":"Set L2","href":"/set/set"},{"title":"StateSet Set L2","href":"/set/stateset-set-l2"},{"title":"Set L2 Architecture","href":"/set/stateset-set-l2-architecture"},{"title":"Set L2 Verification","href":"/set/stateset-set-l2-verification"},{"title":"Set L2 Verification Example","href":"/set/stateset-set-l2-verification-example"},{"title":"Set L2 Compliance Proofs","href":"/set/stateset-set-l2-compliance-proof"},{"title":"STARK Compliance Proofs","href":"/set/stateset-stark"}]},{"group":"StateSet Cloud","icon":"cloud","pages":[{"title":"StateSet Cloud Overview","href":"/cloud-api-reference/overview"},{"title":"Authentication","href":"/cloud-api-reference/authentication"},{"title":"API Keys","href":"/cloud-api-reference/api-keys"},{"group":"Cloud API","pages":[{"group":"Projects","pages":[{"title":"Create Projects","api":"POST https://api.stateset.com/v1/projects","href":"/cloud-api-reference/projects/create"},{"title":"Delete Project","api":"DELETE https://api.stateset.com/v1/projects/{id}","href":"/cloud-api-reference/projects/delete"},{"title":"Get Projects","api":"GET https://api.stateset.com/v1/projects","href":"/cloud-api-reference/projects/get"}]},{"group":"Deployments","pages":[{"title":"Create Deployment","api":"POST https://api.stateset.com/v1/deployments","href":"/cloud-api-reference/deployments/create"},{"title":"Delete Deployment","api":"DELETE https://api.stateset.com/v1/deployments/{id}","href":"/cloud-api-reference/deployments/delete"},{"title":"Get Deployments","api":"GET https://api.stateset.com/v1/deployments","href":"/cloud-api-reference/deployments/get"}]},{"group":"Secrets","pages":[{"title":"Create Secrets","api":"POST https://api.stateset.com/v1/secrets","href":"/cloud-api-reference/secrets/create"},{"title":"Delete Secret","api":"DELETE https://api.stateset.com/v1/secrets/{id}","href":"/cloud-api-reference/secrets/delete"},{"title":"Get Secrets","api":"GET https://api.stateset.com/v1/secrets","href":"/cloud-api-reference/secrets/get"},{"title":"Update Secrets","api":"PUT https://api.stateset.com/v1/secrets/{id}","href":"/cloud-api-reference/secrets/update"}]},{"group":"Logs","pages":[{"title":"Create Logs","api":"POST https://api.stateset.com/v1/logs","href":"/cloud-api-reference/logs/create"},{"title":"Get Logs","api":"GET https://api.stateset.com/v1/logs","href":"/cloud-api-reference/logs/get"}]},{"group":"Templates","pages":[{"title":"Create Template","api":"POST https://api.stateset.com/v1/templates","href":"/cloud-api-reference/templates/create"},{"title":"Delete Template","api":"DELETE https://api.stateset.com/v1/templates/{id}","href":"/cloud-api-reference/templates/delete"},{"title":"Get Templates","api":"GET https://api.stateset.com/v1/templates","href":"/cloud-api-reference/templates/get"},{"title":"Update Template","api":"PUT https://api.stateset.com/v1/templates/{id}","href":"/cloud-api-reference/templates/update"}]}]}]},{"group":"Apps \u0026 Consoles","pages":[{"title":"StateSet Console","href":"/stateset-console/stateset-console-overview"},{"title":"Get Started with Console on the Web","sidebarTitle":"Web Console quickstart","icon":"globe","href":"/guides/console-web-getting-started"},{"title":"Get Started with Console on Mobile","sidebarTitle":"Mobile Console quickstart","icon":"mobile-screen","href":"/guides/console-mobile-getting-started"},{"title":"Get Started with StateSet Desktop","sidebarTitle":"Desktop quickstart","icon":"monitor","href":"/guides/desktop-getting-started"},{"title":"StateSet Demo App","href":"/stateset-demo-app-overview"},{"title":"StateSet Worker","href":"/stateset-worker"},{"title":"Console Mobile","href":"/stateset-console/stateset-console-mobile"},{"title":"StateSet Desktop","href":"/stateset-desktop"}]},{"group":"Tools","icon":"wrench","pages":[{"title":"StateSet iCommerce CLI","href":"/stateset-cli-overview"},{"title":"Console Agent Pipeline","href":"/stateset-console/stateset-console-agent-pipeline"},{"title":"Console Auth Flow","href":"/stateset-console/stateset-console-auth-flow"},{"title":"Deploy the ACP Handler","href":"/stateset-deploy-acp-handler"},{"title":"Sync Server: What's New","href":"/stateset-sync-server-whats-new"},{"title":"Sync Server MCP","href":"/stateset-sync-mcp"},{"title":"Sync Server API Basics","href":"/stateset-sync-server-api-basics"},{"title":"StateSet Deploy","href":"/stateset-deploy-overview"},{"title":"Deploy the Response ChatGPT App","href":"/stateset-deploy-chatgpt-app"},{"title":"Sync Server gRPC Dispatch Flow","href":"/stateset-sync-server-grpc-flow"},{"title":"Sync Server connectors","href":"/stateset-sync-server-connectors"},{"title":"Sync Server troubleshooting","href":"/stateset-sync-server-troubleshooting"},{"title":"iCommerce Agent Operating Guide","href":"/stateset-icommerce-skill"},{"title":"Sandbox agent operating guide","href":"/stateset-sandbox-skill"},{"title":"Sync Server API Contract","href":"/stateset-sync-server-api-contract"},{"title":"Sync Server ACP Guide","href":"/stateset-sync-server-acp-guide"},{"title":"Sync Server gRPC Dispatch","href":"/stateset-sync-server-grpc-dispatch"}]}]},{"tab":"Guides","icon":"graduation-cap","groups":[{"group":"Overview","icon":"book-open","pages":[{"title":"SDK Installation and Setup","icon":"code","href":"/guides/sdk-installation"}]},{"group":"Quickstarts","icon":"play","pages":[{"title":"ResponseCX","href":"/guides/response-quickstart"},{"title":"Warranty Claims Quickstart","icon":"right-left","iconType":"solid","href":"/guides/warranties-quickstart"},{"title":"Customers Quickstart","icon":"user","href":"/guides/customers-quickstart"},{"title":"Agentic Commerce Protocol Checkout Guide","href":"/agentic-commerce/agentic-commerce-checkout-guide"},{"title":"StateSet Cloud Quickstart","icon":"cloud","iconType":"solid","href":"/guides/stateset-cloud-quickstart"},{"title":"Onsite Chat Quickstart","href":"/stateset-response/response-chat-widget-quickstart"}]},{"group":"End-to-end","icon":"route","pages":[{"title":"Launch a brand that runs itself","href":"/guides/launch-a-brand-autonomously"},{"title":"EDI Order to Cash Across StateSet","href":"/guides/journey-edi-order-to-cash"},{"title":"From 'where is my order?' to a closed operation","href":"/guides/journey-wismo-to-resolution"},{"title":"Sync a Shopify store with NetSuite","href":"/guides/sync-shopify-to-netsuite"},{"title":"Your First EDI Purchase-Order Cycle","href":"/guides/edi-first-850"},{"title":"Gate a refund with a verified decision","href":"/guides/nsr-first-verified-decision"},{"title":"Run a durable order workflow end to end","href":"/guides/temporal-first-durable-workflow"},{"title":"Automate a back-office tool that has no API","href":"/guides/computer-use-first-task"},{"title":"Put an agent on the phone","href":"/guides/voice-first-phone-agent"},{"title":"Your first Sandbox runtime workflow","href":"/guides/sandbox-first-runtime"}]},{"group":"Commerce Workflows","icon":"diagram-project","pages":[{"title":"Order to cash","href":"/guides/commerce/order-to-cash"},{"title":"AR and collections","href":"/guides/commerce/ar-collections"},{"title":"Period close","href":"/guides/commerce/period-close"},{"title":"Procure to pay","href":"/guides/commerce/procure-to-pay"},{"title":"Receiving and Put-away","href":"/guides/commerce/receiving-and-putaway"},{"title":"Fulfillment \u0026 Shipping","href":"/guides/commerce/fulfillment"},{"title":"Returns and return-to-vendor","href":"/guides/commerce/returns-and-rtv"},{"title":"Lot and serial traceability","href":"/guides/commerce/traceability"}]},{"group":"Order Management","icon":"shopping-cart","pages":[{"title":"Orders Quickstart","href":"/guides/orders-quickstart"},{"title":"Payments \u0026 Refunds Quickstart","href":"/guides/payments-quickstart"},{"title":"Order Settlements Quickstart","icon":"gears","iconType":"solid","href":"/guides/order-settlement"},{"title":"Wholesale Quickstart","icon":"cart-shopping","iconType":"solid","href":"/guides/wholesale-quickstart"},{"title":"Order Operations","href":"/guides/order-operations"}]},{"group":"Returns \u0026 Warranties","icon":"rotate-left","pages":[{"title":"Returns Quickstart","href":"/guides/returns-quickstart"},{"title":"Warranty Vision Workflow User Guide","icon":"brain","iconType":"solid","href":"/guides/warranty-vision-guide"}]},{"group":"Supply Chain","icon":"truck","pages":[{"title":"Manufacturing Quickstart","href":"/guides/manufacturing-quickstart"},{"title":"Warehouse Receiving Quickstart","icon":"warehouse","href":"/guides/warehouse-quickstart"},{"title":"Supplier \u0026 Purchase Order Quickstart","icon":"truck","iconType":"solid","href":"/guides/supplier-quickstart"},{"title":"Inventory Quickstart","href":"/guides/inventory-quickstart"},{"title":"COGS","href":"/guides/cogs-quickstart"}]},{"group":"Agent Development","icon":"robot","pages":[{"title":"Agents Quickstart","icon":"message-bot","iconType":"solid","href":"/guides/agents-quickstart"},{"title":"Agent Training Guide","icon":"graduation-cap","iconType":"solid","href":"/guides/agent-trainer-guide"},{"title":"Agent Objectives, Goals, Metrics \u0026 Rewards Guide","icon":"brain","iconType":"solid","href":"/guides/agent-objectives-guide"},{"title":"Multi-Agent System Architectures","icon":"brain","iconType":"solid","href":"/guides/multi-agent-systems"},{"title":"StateSet Computer Use Agents - Quick Start Guide","icon":"brain","iconType":"solid","href":"/guides/stateset-computer-use-agents"},{"title":"StateSet Computer Use Agents - Architecture Overview","icon":"brain","iconType":"solid","href":"/guides/stateset-computer-use-agents-architecture"},{"title":"Reinforcement learning and fine-tuning","href":"/guides/reinforcement-learning-platform"},{"title":"GRPO and the StateSet training framework","sidebarTitle":"GRPO framework","href":"/guides/grpo-agent-framework"},{"title":"MCP Integration for AI Agents","icon":"plug","iconType":"solid","href":"/guides/mcp-integration-guide"}]},{"group":"Knowledge \u0026 RAG","icon":"brain","pages":[{"title":"Knowledge Base Quickstart","icon":"brain","iconType":"solid","href":"/guides/knowledgebase-quickstart"},{"title":"RAG Quickstart","icon":"wand-magic-sparkles","iconType":"solid","href":"/guides/rag-quickstart"},{"title":"Sources Quickstart","icon":"database","iconType":"solid","href":"/guides/sources-quickstart"}]},{"group":"Response Features","icon":"wand-magic-sparkles","pages":[{"title":"Agent Attributes \u0026 Personality","icon":"palette","iconType":"solid","href":"/guides/attributes-quickstart"},{"title":"Agent Rules Quickstart","icon":"scale-balanced","iconType":"solid","href":"/guides/rules-quickstart"},{"title":"Examples Quickstart","icon":"lightbulb","iconType":"solid","href":"/guides/examples-quickstart"},{"title":"Evaluations Guide","sidebarTitle":"Evaluations","icon":"clipboard-check","href":"/guides/evaluations-guide"},{"title":"Agent Schedules \u0026 Automation","icon":"clock","iconType":"solid","href":"/guides/schedules-quickstart"},{"title":"Agent Functions Quickstart","icon":"plug","iconType":"solid","href":"/guides/functions-quickstart"}]},{"group":"Advanced Features","icon":"flask","pages":[{"title":"Vision Quickstart","icon":"eye","iconType":"solid","href":"/guides/vision-quickstart"},{"title":"Voice AI Guide","icon":"microphone","iconType":"solid","href":"/guides/voice-quickstart"},{"title":"Synthetic Fixtures for Agent Testing","icon":"brain","href":"/guides/synthetic-data"},{"title":"StateSet Synthetic Data Studio Architecture Guide","icon":"diagram-project","iconType":"solid","href":"/guides/synthetic-data-architecture"}]},{"group":"Integrations","icon":"plug","pages":[{"title":"Shopify Product Embeddings","icon":"shopify","iconType":"solid","href":"/guides/shopify-quickstart"},{"title":"Gorgias Ticket Quickstart","icon":"ticket","iconType":"solid","href":"/guides/gorgias-quickstart"},{"title":"Multi-Channel Commerce Integration Guide","icon":"store","iconType":"solid","href":"/guides/multi-channel-integration-guide"}]},{"group":"Commerce Network","icon":"link","pages":[{"title":"StateSet Network Quickstart","icon":"globe","iconType":"solid","href":"/guides/stateset-network"},{"title":"Commerce Network Orders: Migration Guide","href":"/guides/stateset-network-orders"},{"title":"StateSet Contracts","icon":"file-contract","iconType":"solid","href":"/guides/stateset-contracts"},{"title":"Agent Payments: Build and Verify","href":"/guides/smart-agents-usdc-guide"},{"title":"Complete an x402 payment","href":"/stateset-x402-walkthrough"},{"title":"CCTP Integration: Availability and Prerequisites","href":"/guides/cctp-module-integration"},{"title":"Agent Payments and Legacy Network Examples","href":"/smart-agents-usdc-guide"}]},{"group":"Self-Hosted","icon":"server","pages":[{"title":"Build with StateSet Sandbox","href":"/guides/stateset-sandbox"},{"title":"Agentic Commerce Protocol Handler","href":"/guides/agentic-commerce-protocol-handler"},{"title":"Universal Commerce Protocol Handler","href":"/guides/universal-commerce-protocol-handler"}]},{"group":"Best Practices","icon":"shield-check","pages":[{"title":"Error Handling \u0026 Retries","icon":"triangle-exclamation","href":"/guides/error-handling-best-practices"},{"title":"Handle Rate Limits Without Losing Requests","icon":"gauge-high","href":"/guides/api-rate-limiting"},{"title":"Performance Optimization Guide","icon":"rocket","iconType":"solid","href":"/guides/performance-optimization"},{"title":"Integration Test Plan","icon":"flask","href":"/guides/comprehensive-testing-guide"},{"title":"Integration Testing","icon":"flask","href":"/guides/api-testing"},{"title":"Batch Operations Guide","icon":"cogs","iconType":"solid","href":"/guides/batch-operations"},{"title":"Webhook Security Guide","icon":"shield","iconType":"solid","href":"/guides/webhook-security"}]},{"group":"E-commerce Workflows","icon":"cart-shopping","pages":[{"title":"Ecommerce Agent Workflows Guide","icon":"gears","href":"/guides/ecommerce-agent-workflows-guide"}]}]}]},{"dropdown":"API Reference","icon":"code","description":"Every endpoint, with a playground","tabs":[{"tab":"iCommerce","icon":"shopping-cart","pages":[{"title":"iCommerce","href":"/api-reference/commerce/overview"}]},{"tab":"ResponseCX","icon":"headset","groups":[{"group":"Overview","pages":[{"title":"ResponseCX API","href":"/api-reference/responsecx/overview"},{"title":"ResponseCX API history","href":"/api-reference/responsecx/history"}]},{"group":"Workspace","pages":[{"title":"Orientation: agents, configuration state, and a suggested next action","api":"GET https://response.stateset.com/api/v1/workspace","description":"The org's agents with their configuration state, the three top-level counts, and a suggested next action.","href":"/api-reference/responsecx/workspace-list"}]},{"group":"Agents","pages":[{"title":"Run an agent's eval suite (regression check)","api":"POST https://response.stateset.com/api/v1/agents/{id}/evals/run","href":"/api-reference/responsecx/agents-by-evals-run-create"},{"title":"Give the agent an API-call tool","api":"POST https://response.stateset.com/api/v1/agents/{id}/functions","description":"The tool","href":"/api-reference/responsecx/agents-by-functions-create"},{"title":"List an agent's tools","api":"GET https://response.stateset.com/api/v1/agents/{id}/functions","href":"/api-reference/responsecx/agents-by-functions-get"},{"title":"Get one agent, including its instructions","api":"GET https://response.stateset.com/api/v1/agents/{id}","href":"/api-reference/responsecx/agents-by-get"},{"title":"Attach a guardrail rule","api":"POST https://response.stateset.com/api/v1/agents/{id}/rules","href":"/api-reference/responsecx/agents-by-rules-create"},{"title":"List an agent's guardrail rules","api":"GET https://response.stateset.com/api/v1/agents/{id}/rules","href":"/api-reference/responsecx/agents-by-rules-get"},{"title":"Read an agent's model and behaviour settings","api":"GET https://response.stateset.com/api/v1/agents/{id}/settings","href":"/api-reference/responsecx/agents-by-settings-get"},{"title":"Set model, temperature, token limits and escalation behaviour","api":"PUT https://response.stateset.com/api/v1/agents/{id}/settings","href":"/api-reference/responsecx/agents-by-settings-update"},{"title":"Update an agent; set activated:true to launch it","api":"PATCH https://response.stateset.com/api/v1/agents/{id}","href":"/api-reference/responsecx/agents-by-update"},{"title":"Create an agent","api":"POST https://response.stateset.com/api/v1/agents","href":"/api-reference/responsecx/agents-create"},{"title":"List agents","api":"GET https://response.stateset.com/api/v1/agents","href":"/api-reference/responsecx/agents-list"},{"title":"Build a complete agent — rules, tools and settings — in one atomic call","api":"POST https://response.stateset.com/api/v1/agents/provision","href":"/api-reference/responsecx/agents-provision-create"}]},{"group":"Rules","pages":[{"title":"Get one rule","api":"GET https://response.stateset.com/api/v1/rules/{id}","href":"/api-reference/responsecx/rules-by-get"},{"title":"Update a rule; activated:false retires it","api":"PATCH https://response.stateset.com/api/v1/rules/{id}","href":"/api-reference/responsecx/rules-by-update"}]},{"group":"Functions","pages":[{"title":"Get one tool","api":"GET https://response.stateset.com/api/v1/functions/{id}","href":"/api-reference/responsecx/functions-by-get"},{"title":"Probe a tool's endpoint and report whether it works","api":"POST https://response.stateset.com/api/v1/functions/{id}/test","href":"/api-reference/responsecx/functions-by-test-create"},{"title":"Update a tool; activated:false retires it","api":"PATCH https://response.stateset.com/api/v1/functions/{id}","href":"/api-reference/responsecx/functions-by-update"}]},{"group":"Knowledge","pages":[{"title":"Remove an obsolete knowledge document (not reversible)","api":"DELETE https://response.stateset.com/api/v1/knowledge/{id}","href":"/api-reference/responsecx/knowledge-by-delete"},{"title":"Correct a knowledge document in place","api":"PATCH https://response.stateset.com/api/v1/knowledge/{id}","href":"/api-reference/responsecx/knowledge-by-update"},{"title":"Add a knowledge-base document (near-duplicates update in place)","api":"POST https://response.stateset.com/api/v1/knowledge","href":"/api-reference/responsecx/knowledge-create"},{"title":"List stored knowledge documents","api":"GET https://response.stateset.com/api/v1/knowledge","href":"/api-reference/responsecx/knowledge-list"},{"title":"Semantic search over the knowledge base","api":"POST https://response.stateset.com/api/v1/knowledge/search","href":"/api-reference/responsecx/knowledge-search-create"}]},{"group":"Conversations","pages":[{"title":"Read one conversation with its message transcript","api":"GET https://response.stateset.com/api/v1/conversations/{id}","href":"/api-reference/responsecx/conversations-by-get"},{"title":"List recent customer conversations","api":"GET https://response.stateset.com/api/v1/conversations","href":"/api-reference/responsecx/conversations-list"}]},{"group":"Responses","pages":[{"title":"Get one response","api":"GET https://response.stateset.com/api/v1/responses/{id}","href":"/api-reference/responsecx/responses-by-get"},{"title":"List handled response turns","api":"GET https://response.stateset.com/api/v1/responses","href":"/api-reference/responsecx/responses-list"}]},{"group":"Evals","pages":[{"title":"Get one eval","api":"GET https://response.stateset.com/api/v1/evals/{id}","href":"/api-reference/responsecx/evals-by-get"},{"title":"Replay one eval and grade it against the recorded answer","api":"POST https://response.stateset.com/api/v1/evals/{id}/run","href":"/api-reference/responsecx/evals-by-run-create"},{"title":"Record what the agent should have said","api":"POST https://response.stateset.com/api/v1/evals","href":"/api-reference/responsecx/evals-create"},{"title":"List recorded evals (corrections made to agent replies)","api":"GET https://response.stateset.com/api/v1/evals","href":"/api-reference/responsecx/evals-list"}]},{"group":"Analytics","pages":[{"title":"Per-agent volume, AI vs human handling, and human-handled rate","api":"GET https://response.stateset.com/api/v1/analytics/agents","href":"/api-reference/responsecx/analytics-agents-list"},{"title":"Total, AI-handled and human-handled counts over a window","api":"GET https://response.stateset.com/api/v1/analytics/summary","href":"/api-reference/responsecx/analytics-summary-list"}]},{"group":"Integrations","pages":[{"title":"Connect Gorgias with an agent email + REST API key","api":"POST https://response.stateset.com/api/v1/integrations/gorgias","href":"/api-reference/responsecx/integrations-gorgias-create"},{"title":"Shopify and Gorgias connection status (identifiers, never tokens)","api":"GET https://response.stateset.com/api/v1/integrations","href":"/api-reference/responsecx/integrations-list"},{"title":"Connect Shopify with a custom-app Admin API token","api":"POST https://response.stateset.com/api/v1/integrations/shopify","href":"/api-reference/responsecx/integrations-shopify-create"},{"title":"Ground agents from the store: import products, collections and policies","api":"POST https://response.stateset.com/api/v1/integrations/shopify/import-knowledge","href":"/api-reference/responsecx/integrations-shopify-import-knowledge-create"}]},{"group":"Changes","pages":[{"title":"Configuration change log for agents, rules and tools","api":"GET https://response.stateset.com/api/v1/changes","href":"/api-reference/responsecx/changes-list"}]}]},{"tab":"Chat Widget","icon":"message-square","pages":[{"title":"Chat Widget","href":"/api-reference/chat-widget/overview"}]},{"tab":"Voice","icon":"phone","pages":[{"title":"Voice","href":"/api-reference/voice/overview"}]},{"tab":"Sandbox","icon":"box","pages":[{"title":"Sandbox","href":"/api-reference/sandbox/overview"}]},{"tab":"Sync Server","icon":"refresh-cw","pages":[{"title":"Sync Server","href":"/api-reference/sync/overview"}]},{"tab":"Temporal Engine","icon":"workflow","pages":[{"title":"Temporal Engine","href":"/api-reference/temporal/overview"}]},{"tab":"EDI","icon":"file-text","pages":[{"title":"EDI","href":"/api-reference/edi/overview"}]},{"tab":"NSR","icon":"brain","pages":[{"title":"NSR","href":"/api-reference/nsr/overview"}]},{"tab":"Computer Use","icon":"monitor","pages":[{"title":"Computer Use","href":"/api-reference/computer-use/overview"}]},{"tab":"Agents","icon":"bot","pages":[{"title":"Agents","href":"/api-reference/agents/overview"}]}]},{"dropdown":"For AI Agents","icon":"bot","description":"MCP servers and skills for agents using StateSet","tabs":[{"tab":"MCP Servers","icon":"plug","groups":[{"group":"Start here","pages":[{"sidebarTitle":"Signup to first value","title":"From Signup to First Value","icon":"rocket","href":"/guides/platform-onboarding"},{"sidebarTitle":"Rust engines \u0026 MCP","title":"Build Operations with Rust Engines \u0026 MCP","icon":"cpu","href":"/guides/rust-engines-and-mcp"},{"sidebarTitle":"Connect through MCP","title":"Manage Agents \u0026 Workflows with MCP","icon":"plug","href":"/guides/manage-platform-with-mcp"},{"sidebarTitle":"Configuration changes","title":"Your First Workflow Configuration Change","icon":"git-pull-request","href":"/guides/first-workflow-config-change"},{"sidebarTitle":"Durable agents","title":"Operate Your First Durable Agent","icon":"bot","href":"/guides/first-durable-agent"},{"sidebarTitle":"Agent evaluations","title":"Your First Agent Evaluation","icon":"check-check","href":"/guides/first-agent-evaluation"},{"sidebarTitle":"Your first week","title":"Your First Week with StateSet","icon":"chart-line","href":"/guides/first-week-with-stateset"},{"sidebarTitle":"Troubleshooting","title":"Troubleshoot Your First Operation","icon":"life-ring","href":"/guides/onboarding-troubleshooting"},{"sidebarTitle":"Workflow trial","title":"Your First Workflow Trial","icon":"workflow","href":"/guides/first-workflow-trial"},{"sidebarTitle":"Agent quickstart","title":"Getting Started for AI Agents","icon":"robot","href":"/getting-started-for-ai-agents"},{"sidebarTitle":"First local operation","title":"Your First Operation","icon":"play","href":"/guides/first-operation"},{"sidebarTitle":"Connect your systems","title":"Connect Your Operation","icon":"plug","href":"/guides/connect-your-operation"},{"title":"MCP Servers","icon":"plug","href":"/mcp-servers"},{"title":"MCP Integration for AI Agents","icon":"plug","iconType":"solid","href":"/guides/mcp-integration-guide"}]},{"group":"Commerce","pages":[{"title":"iCommerce MCP Server","href":"/stateset-icommerce/stateset-icommerce-mcp"},{"title":"Sandbox MCP server","href":"/stateset-sandbox/stateset-sandbox-mcp"},{"title":"Sync Server MCP","href":"/stateset-sync-mcp"},{"title":"EDI MCP Server","href":"/stateset-edi/mcp-server"},{"title":"Warehouse REST API and MCP","sidebarTitle":"API and MCP","href":"/stateset-warehouse/api-and-mcp"},{"title":"Freight REST API and MCP","sidebarTitle":"API and MCP","href":"/stateset-freight/api-and-mcp"}]},{"group":"Customer experience","pages":[{"title":"Response MCP Servers","href":"/stateset-response/response-mcp"},{"title":"Voice MCP Server","href":"/stateset-voice/mcp-server"},{"title":"Mail MCP Server","href":"/stateset-mail/mcp-server"}]},{"group":"Decisions and automation","pages":[{"title":"NSR MCP Server","href":"/stateset-nsr-mcp"},{"title":"Workstream MCP","href":"/next-temporal/mcp-connector"},{"title":"Agents MCP server","href":"/stateset-agents/mcp-server"},{"title":"Computer Use MCP Servers","href":"/computer-use-mcp"},{"title":"Engines and Commerce MCP Servers","href":"/computer-use-engines-mcp"}]}]},{"tab":"Skills","icon":"graduation-cap","groups":[{"group":"Start here","pages":[{"title":"Skills","href":"/agent-skills"}]},{"group":"Skills","pages":[{"title":"iCommerce Agent Operating Guide","href":"/stateset-icommerce-skill"},{"title":"NSR Skill","href":"/stateset-nsr-skill"},{"title":"Sandbox agent operating guide","href":"/stateset-sandbox-skill"},{"title":"Voice Skill","href":"/stateset-voice-skill"},{"title":"Computer Use Skill","href":"/computer-use-skill"},{"title":"Sync Server Skill","href":"/stateset-sync-server-skill"},{"title":"StateSet iCommerce Engine Skills","href":"/stateset-icommerce/stateset-icommerce-skills"}]}]}]}]},"basePath":"","title":"StateSet API Docs","deploymentId":"dpl_vSEmv961Ncyvz1psVwgUnTXQMSYk","buildId":"dpl_vSEmv961Ncyvz1psVwgUnTXQMSYk","dynamics":["c2aa737661","2b790eda92","b0f84f53ff"],"chunks":["OpenApiReferenceProvider-CrDfRf61.js","snippetPresets-Dv-cOUrx.js","utils-BUTreAgv.js","style-to-object-BY3JEAdk.js","utils-wsznt9RM.js","v4-DIgz8zy6.js","addUniqueKeysToSchema-DEsMlaPy.js","conditional-requirements-CFM0id0Q.js","cloneDeep-DontW4xJ.js","_Uint8Array-pP7X6_RM.js","isObject-FP1Yky1u.js","ApiExamples-CU_aGGP0.js","usePlaygroundInputsStore-7dNmUIbS.js","shallow-fTtruD8x.js","isEqual-BRfNFpSD.js","CodeSnippets-52884wUJ.js","CodeSnippet-eoRjC4Le.js","getApiPlaygroundDisplay-CZyAPlR2.js","Page-Cr9IwkK7.js","DynamicMarkdown-NFqqduU7.js","SectionHeading-DQ-mJoAt.js","icon-DXTBUt6s.js","MethodPill-2v-b3js5.js","getPastedJson-v_8Y1_4v.js","DuplicateIcon-DXIkhZIo.js","createIcon-DRpYuPZs.js","axios-CsQoIw0U.js"]}