ReasoningCallback interface

A callback that the evaluation LLM can invoke via tool calling. The callback definition (name, description, arguments) is sent to the planning LLM so it can design the spec around these tools. At evaluation time, when the LLM calls a tool, the SDK dispatches to the corresponding fn.

Signature:

export interface ReasoningCallback

Properties

Property Type Description

arguments

CallbackArgument[]

description?

string

(Optional)

fn

(…​args: any[]) ⇒ void

name

string