Llm
For instructions on how to authenticate to use this endpoint, see API overview.
Endpoints
POST | |
POST | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
POST | |
GET | |
POST | |
GET | |
GET | |
POST | |
GET | |
PATCH | |
DELETE | |
GET | |
POST | |
GET |
Create environments llm analytics offline evaluations experiment items
Required API key scopes
llm_analytics:readRequest parameters
- experiment_idstring
- date_fromstringnull
- date_tostringnull
Response
Example request
POST /api /environments /:environment_id /llm_analytics /offline_evaluations /experiment_itemsExample response
Status 200
RESPONSE
Status 400
Status 500
Create environments llm analytics provider key validations
Validate LLM provider API keys without persisting them
Required API key scopes
llm_provider_key:writeExample request
POST /api /environments /:environment_id /llm_analytics /provider_key_validationsExample response
Status 200
List all environments llm analytics provider keys
Required API key scopes
llm_provider_key:readQuery parameters
- limitinteger
- offsetinteger
Response
Example request
GET /api /environments /:environment_id /llm_analytics /provider_keysExample response
Status 200
RESPONSE
Create environments llm analytics provider keys
Required API key scopes
llm_provider_key:writeRequest parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /environments /:environment_id /llm_analytics /provider_keysExample response
Status 201
RESPONSE
Retrieve environments llm analytics provider keys
Required API key scopes
llm_provider_key:readPath parameters
- idstring
Response
Example request
GET /api /environments /:environment_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Update environments llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
PATCH /api /environments /:environment_id /llm_analytics /provider_keys /:idExample response
Status 200
RESPONSE
Delete environments llm analytics provider keys
Required API key scopes
llm_provider_key:writePath parameters
- idstring
Example request
DELETE /api /environments /:environment_id /llm_analytics /provider_keys /:idExample response
Status 204 No response body
Create environments llm analytics provider keys assign
Assign this key to evaluations and optionally re-enable them.
Path parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /environments /:environment_id /llm_analytics /provider_keys /:id /assignExample response
Status 200
RESPONSE
Retrieve environments llm analytics provider keys dependent configs
Get evaluations using this key and alternative keys for replacement.
Path parameters
- idstring
Response
Example request
GET /api /environments /:environment_id /llm_analytics /provider_keys /:id /dependent_configsExample response
Status 200
RESPONSE
Create environments llm analytics provider keys validate
Path parameters
- idstring
Request parameters
- provider
- namestring
- api_keystring
- azure_endpointstring
- api_versionstring
- set_as_activebooleanDefault:
false
Response
Example request
POST /api /environments /:environment_id /llm_analytics /provider_keys /:id /validateExample response
Status 200
RESPONSE
Retrieve environments llm analytics provider keys trial evaluations
List enabled evaluations currently using trial credits for a given provider.
Response
Example request
GET /api /environments /:environment_id /llm_analytics /provider_keys /trial_evaluationsExample response
Status 200
RESPONSE
List all environments llm analytics review queue items
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- offsetinteger
- order_bystring
- queue_idstring
- searchstring
- trace_idstring
- trace_id__instring
Response
Example request
GET /api /environments /:environment_id /llm_analytics /review_queue_itemsExample response
Status 200
RESPONSE
Create environments llm analytics review queue items
Required API key scopes
llm_analytics:writeRequest parameters
- queue_idstring
- trace_idstring
Response
Example request
POST /api /environments /:environment_id /llm_analytics /review_queue_itemsExample response
Status 201
RESPONSE
Retrieve environments llm analytics review queue items
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /environments /:environment_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE
Update environments llm analytics review queue items
Required API key scopes
llm_analytics:writePath parameters
- idstring
Request parameters
- queue_idstring
Response
Example request
PATCH /api /environments /:environment_id /llm_analytics /review_queue_items /:idExample response
Status 200
RESPONSE
Delete environments llm analytics review queue items
Required API key scopes
llm_analytics:writePath parameters
- idstring
Example request
DELETE /api /environments /:environment_id /llm_analytics /review_queue_items /:idExample response
Status 204 No response body
List all environments llm analytics review queues
Required API key scopes
llm_analytics:readQuery parameters
- limitinteger
- namestring
- offsetinteger
- order_bystring
- searchstring
Response
Example request
GET /api /environments /:environment_id /llm_analytics /review_queuesExample response
Status 200
RESPONSE
Create environments llm analytics review queues
Required API key scopes
llm_analytics:writeRequest parameters
- namestring
Response
Example request
POST /api /environments /:environment_id /llm_analytics /review_queuesExample response
Status 201
RESPONSE
Retrieve environments llm analytics review queues
Required API key scopes
llm_analytics:readPath parameters
- idstring
Response
Example request
GET /api /environments /:environment_id /llm_analytics /review_queues /:idExample response
Status 200
RESPONSE