Skip to content

@gettoor/core v0.1.0


@gettoor/core / Experiment

Interface: Experiment

Experiment settings and configuration.

Properties

dataset

dataset: ExperimentDatasetEntry[]

Dataset to evaluate.


listeners?

optional listeners?: ExperimentListeners

Listeners to the experiment.


modelParameters

modelParameters: ExperimentModelParameters[]

Model parameters.


modelProvider?

optional modelProvider?: ModelProvider

Model provider to resolve the models. If not provided, the default model provider will be used.

See

DefaultModelProvider


models

models: ExperimentModel[]

Models to evaluate.


prompts

prompts: ExperimentPrompt[]

Prompts to evaluate.


settings

settings: ExperimentSettings

Experiment settings.


structuredOutput?

optional structuredOutput?: ExperimentStructuredOutput

Structured output to evaluate.