The core package

The core package @gettoor/core provides the core types and functions for evaluations and experimentation. See the below sections for more details:

• LLM-as-a-judge - An evaluation in which an output from a model is evaluated against predefined criteria by assigning scores (e.g. overall score, correctness, relevance or completeness).
• LLM experiments - A process to measure performance of different models, model parameters, prompts on a dataset, typically to find the best combination.