Skip to main content

Async Job Models

AsyncJobHandle

Generic async job handle used by failure analysis and other modules. Wraps polling, cancellation, and result retrieval.
Property/MethodReturn TypeDescription
job_idstrJob identifier.
job_typestrJob type string.
status()AsyncJobStatusPoll current status.
is_running()boolWhether still running.
is_completed()boolWhether completed.
cancel()Dict[str, Any]Cancel the job.
result()AnyBlock until complete and return result. Raises RuntimeError if failed.
wait(poll_interval, timeout, on_progress)AsyncJobStatusPoll with progress callback. Raises TimeoutError if exceeded.
wait() parameters:
ParameterTypeDefaultDescription
poll_intervalfloat2.0Seconds between polls.
timeoutOptional[float]NoneMax wait time in seconds. None = no timeout.
on_progressOptional[Callable]NoneCallback receiving AsyncJobStatus.

AsyncJobStatus

FieldTypeDescription
job_idstrJob identifier.
job_typestrJob type.
statusstr"queued", "running", "processing", "completed", "failed", "cancelled".
progress_percentfloatProgress (0–100).
current_itemintCurrent item.
total_itemsintTotal items.
started_atOptional[str]ISO timestamp.
finished_atOptional[str]ISO timestamp.
errorOptional[str]Error message.
Properties: is_running, is_completed, is_failed.

Trace Models

TraceRecord

A trace summary in a list response.
FieldTypeDescription
trace_idstrTrace identifier.
project_idstrProject ID.
statusstrTrace status.
session_idOptional[str]Session identifier.
project_nameOptional[str]Project name.
app_nameOptional[str]Application name.
duration_msOptional[float]Total duration in milliseconds.
total_costOptional[float]Estimated cost in USD.
total_tokensOptional[int]Total tokens used.
llm_callsOptional[int]Number of LLM calls.
tool_callsOptional[int]Number of tool calls.
input_previewOptional[str]Truncated input text.
output_previewOptional[str]Truncated output text.
eval_availableboolWhether evaluation data exists.
created_atOptional[str]ISO timestamp.

TraceListResponse

Paginated list of traces. Supports len() and iteration.
FieldType
tracesList[TraceRecord]
totalint
pageint
page_sizeint

TraceOverview

Basic trace information.
FieldType
trace_idstr
statusstr
duration_msOptional[float]
total_costOptional[float]
llm_callsOptional[int]
tool_callsOptional[int]

TraceSummary

Detailed trace summary with full metadata.
FieldTypeDescription
trace_idstrTrace identifier.
project_idstrProject ID.
statusstrTrace status.
duration_msOptional[float]Duration in milliseconds.
total_costOptional[float]Estimated cost.
total_tokensOptional[int]Total tokens.
input_tokensOptional[int]Input tokens.
output_tokensOptional[int]Output tokens.
llm_callsOptional[int]LLM call count.
tool_callsOptional[int]Tool call count.
retrieval_callsOptional[int]Retrieval call count.
message_countintNumber of messages.
span_countintNumber of spans.
tagsOptional[List[str]]Trace tags.
custom_fieldsOptional[Dict]Custom metadata.

TraceMessage

A message in a trace’s conversation.
FieldType
rolestr
contentstr
timestampOptional[str]
tool_callsOptional[List[Dict]]
tool_call_idOptional[str]
nameOptional[str]

TraceSpan

A span in a trace’s execution tree.
FieldType
span_idstr
namestr
kindstr
parent_span_idOptional[str]
start_timeOptional[str]
end_timeOptional[str]
duration_msOptional[float]
statusOptional[str]
attributesDict[str, Any]
eventsList[Dict[str, Any]]

TraceFullResult

Complete trace data including messages, spans, retrievals, and execution tree.
FieldType
trace_idstr
metadataDict[str, Any]
summaryDict[str, Any]
messagesList[Dict[str, Any]]
spansDict[str, Any]
retrievalsList[Dict[str, Any]]
diagnosticsOptional[Dict]
execution_treeOptional[Dict]

TraceEvalStep

An evaluation step computed from a trace.
FieldType
metricstr
scoreOptional[float]
explanationOptional[str]
statusstr
input_textOptional[str]
output_textOptional[str]
contextOptional[str]

RAG Models

DocumentHit

A document match from a retrieval step.
FieldTypeDescription
doc_idstrDocument identifier.
rankintRank position.
scorefloatSimilarity/relevance score.
spanOptional[List[int]][start, end] character positions.
snippet_previewOptional[str]First 200 characters.
metadataOptional[Dict]Custom document metadata.

RetrievalInfo

Information about a retrieval step.
FieldTypeDescription
retrieverstrRetriever type: "vectordb", "bm25", "api", "hybrid".
embedding_modelOptional[str]Embedding model used.
chunk_sizeOptional[int]Chunk size in tokens.
chunk_overlapOptional[int]Chunk overlap.
top_kOptional[int]Number of results requested.
similarity_thresholdOptional[float]Minimum similarity score.
queryOptional[str]The retrieval query.
hitsOptional[List[DocumentHit]]Retrieved documents.
latency_msOptional[float]Retrieval latency.

Citation

A citation linking a generated answer to a source document.
FieldType
doc_idstr
spanOptional[List[int]]
confidenceOptional[float]
relevance_scoreOptional[float]

GenerationInfo

Information about a generation step.
FieldTypeDescription
answerstrGenerated answer.
citationsOptional[List[Citation]]Source citations.
format_checkOptional[FormatCheck]Output format analysis.
model_usedOptional[str]Model used.
prompt_templateOptional[str]Template used.
context_lengthOptional[int]Context window used.
generation_latency_msOptional[float]Generation latency.
reasoning_traceOptional[List[str]]Reasoning steps.

FormatCheck

Output format analysis.
FieldTypeDefault
is_completeboolTrue
length_tokensOptional[int]None
length_charsOptional[int]None
refusalboolFalse
contains_citationsboolFalse
citation_countOptional[int]None
languageOptional[str]None
format_typeOptional[str]None