Skip to main content
POST
/
api
/
v1
/
eval_rubrics
/
from_feedback
Create From Feedback
import requests

url = "https://www.datalab.to/api/v1/eval_rubrics/from_feedback"

payload = {
    "name": "<string>",
    "feedback_items": [
        {
            "content_snippet": "<string>",
            "feedback": "<string>",
            "feedback_type": "incorrect",
            "block_id": "<string>",
            "block_type": "<string>",
            "page_number": 123,
            "expected_output": "<string>"
        }
    ]
}
headers = {
    "X-API-Key": "<api-key>",
    "Content-Type": "application/json"
}

response = requests.post(url, json=payload, headers=headers)

print(response.text)
{
  "id": 123,
  "name": "<string>",
  "description": "<string>",
  "eval_definition": {},
  "source": "<string>",
  "source_pipeline_id": "<string>",
  "archived": true,
  "version": 123,
  "created": "2023-11-07T05:31:56Z",
  "updated": "2023-11-07T05:31:56Z",
  "version_history": [
    "<unknown>"
  ]
}

Authorizations

X-API-Key
string
header
required

Cookies

wos-session
string
access_token
string
datalab_active_team
string

Body

application/json
name
string
required
Maximum string length: 200
feedback_items
FeedbackItem · object[]
required
Required array length: 1 - 20 elements

Response

Successful Response

id
integer
required
name
string
required
description
string | null
required
eval_definition
Eval Definition · object
required
source
string
required
source_pipeline_id
string | null
required
archived
boolean
required
version
integer
required
created
string<date-time> | null
required
updated
string<date-time> | null
required
version_history
any[] | null