Llm
For instructions on how to authenticate to use this endpoint, see API overview.
Endpoints
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
POST | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
POST | |
GET | |
POST | |
GET | |
GET | |
POST | |
GET | |
PATCH |
List all llm analytics parser recipes
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /projects /:project_id /llm_analytics /parser_recipesExample response
Status 200
RESPONSE
Create llm analytics parser recipes
Required API key scopes
llm_analytics:writeRequest parameters
- namestring
- sourcestring
Response
Example request
POST /api /projects /:project_id /llm_analytics /parser_recipesExample response
Status 201
RESPONSE
Retrieve llm analytics parser recipes
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 200
RESPONSE
Update llm analytics parser recipes
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- namestring
- sourcestring
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 200
RESPONSE
Delete llm analytics parser recipes
Required API key scopes
llm_analytics:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /parser_recipes /:idExample response
Status 204 No response body
Create llm analytics provider key validations
Validate LLM provider API keys without persisting them
Required API key scopes
llm_provider_key:writeExample request
POST /api /projects /:project_id /llm_analytics /provider_key_validationsExample response
Status 200
List all llm analytics provider keys
Required API key scopes
llm_provider_key:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keysExample response
Status 200
RESPONSE
Create llm analytics provider keys
Required API key scopes
llm_provider_key:writeRequest parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keysExample response
Status 201
RESPONSE
Retrieve llm analytics provider keys
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Update llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Delete llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Example request
DELETE /api /projects /:project_id /llm_analytics /provider_keys /:idExample response
Status 204 No response body
Create llm analytics provider keys assign
Assign this key to evaluations and optionally re-enable them.
Path parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keys /:id /assignExample response
Status 200
RESPONSE
Retrieve llm analytics provider keys dependent configs
Get evaluations using this key and alternative keys for replacement.
Path parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /:id /dependent_configsExample response
Status 200
RESPONSE
Create llm analytics provider keys validate
Path parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /projects /:project_id /llm_analytics /provider_keys /:id /validateExample response
Status 200
RESPONSE
Retrieve llm analytics provider keys trial evaluations
List enabled evaluations currently using trial credits for a given provider.
Response
Example request
GET /api /projects /:project_id /llm_analytics /provider_keys /trial_evaluationsExample response
Status 200
RESPONSE
List all llm analytics review queue items
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
- order_bystring
- queue_idstring
- searchstring
- trace_idstring
- trace_id__instring
Response
Example request
GET /api /projects /:project_id /llm_analytics /review_queue_itemsExample response
Status 200
RESPONSE
Create llm analytics review queue items
Required API key scopes
llm_analytics:writeRequest parameters
- queue_idstring
- trace_idstring
Response
Example request
POST /api /projects /:project_id /llm_analytics /review_queue_itemsExample response
Status 201
RESPONSE
Retrieve llm analytics review queue items
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /projects /:project_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE
Update llm analytics review queue items
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- queue_idstring
Response
Example request
PATCH /api /projects /:project_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE