Proxy an LLM inference request
Forwards an inference request to a supported LLM provider from within the sandbox context
POST
Forwards an inference request to a supported LLM provider from within the sandbox context
Path parameters
string (uuid)
required
Unique sandbox identifier
Request body
InferenceRequest
string
required
LLM provider to route the request to
string
required
API path on the provider (e.g., ‘/v1/messages’)
object
required
Request body to forward to the provider
string
Name of the stored secret containing the provider API key
object
Additional headers to include in the provider request
Response
InferenceResponse
integer
HTTP status code from the provider
object
Response body from the provider
object
Response headers from the provider