Llm
For instructions on how to authenticate to use this endpoint, see API overview.
Endpoints
GET | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
POST | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
GET | |
POST | |
GET | |
POST | |
GET | |
PATCH | |
DELETE |
Retrieve llm analytics models
List available models, for one provider or for every supported provider.
Required API key scopes
llm_analytics:readQuery parameters
- key_idstring
- providerstringOne of:
"anthropic""azure_openai""fireworks""gemini""minimax""openai""openai_compatible""openrouter""system_one""together_ai""zeabur"
Response
Example request
GET /api /projects /:project_id /llm_analytics /modelsExample response
Status 200
RESPONSE
List all llm analytics parser recipes
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /projects /:project_id /llm_analytics /parser_recipesExample response
Status 200
RESPONSE
Create llm analytics parser recipes
Required API key scopes
llm_analytics:writeRequest parameters
- namestring
- sourcestring
Response
Example request
POST /api /projects /:project_id /llm_analytics /parser_recipesExample response
Status 201
RESPONSE
Retrieve llm analytics parser recipes
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 200
RESPONSE
Update llm analytics parser recipes
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- namestring
- sourcestring
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 200
RESPONSE
Delete llm analytics parser recipes
Required API key scopes
llm_analytics:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 204 No response body
Create llm analytics provider key validations
Validate LLM provider API keys without persisting them
Required API key scopes
llm_provider_key:writeExample request
POST /api /projects /:project_id /llm_analytics /provider_key_validationsExample response
Status 200
List all llm analytics provider keys
Required API key scopes
llm_provider_key:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keysExample response
Status 200
RESPONSE
Create llm analytics provider keys
Required API key scopes
llm_provider_key:writeRequest parameters
- provider
- namestring
- api_keystring
- base_urlstring
- system_one_modelstring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keysExample response
Status 201
RESPONSE
Retrieve llm analytics provider keys
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Update llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- base_urlstring
- system_one_modelstring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Delete llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 204 No response body
Retrieve llm analytics provider keys dependent configs
Get evaluations using this key and alternative keys for replacement.
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:id /dependent_configsExample response
Status 200
RESPONSE
Create llm analytics provider keys validate
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- base_urlstring
- system_one_modelstring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keys /:id /validateExample response
Status 200
RESPONSE
List all llm analytics review queue items
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
- order_bystring
- queue_idstring
- searchstring
- trace_idstring
- trace_id__instring
Response
Example request
GET /api /projects /:project_id /llm_analytics /review_queue_itemsExample response
Status 200
RESPONSE
Create llm analytics review queue items
Required API key scopes
llm_analytics:writeRequest parameters
- queue_idstring
- trace_idstring
Response
Example request
POST /api /projects /:project_id /llm_analytics /review_queue_itemsExample response
Status 201
RESPONSE
Retrieve llm analytics review queue items
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE
Update llm analytics review queue items
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- queue_idstring
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE
Delete llm analytics review queue items
Required API key scopes
llm_analytics:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /review_queue_items /:id










