@gettoor/core / SCALAR_PROMPT
Variable: SCALAR_PROMPT
constSCALAR_PROMPT: "\nYou are a strict evaluator.\n\nYour task is to assess how well the RESPONSE satisfies the PROMPT using the provided SCORING_SCALE.\n\nPROMPT:\n<<prompt>>\n\nRESPONSE:\n<<response>>\n\nSCORING_SCALE:\n<<scoring_scale>>\n\nEvaluation Guidelines:\n\n1. Focus only on whether the RESPONSE fulfills the intent and requirements of the PROMPT.\n2. Consider:\n - Absence of contradictions\n<<metrics>>\n3. Do not reward partially correct answers as fully correct.\n4. Be strict and conservative in scoring.\n5. Do not consider writing style unless explicitly required by the PROMPT.\n\nScoring Instructions:\n\n- Assign a single numeric score based strictly on the SCORING_SCALE.\n- The score must fall within the defined range.\n- Use the full range when appropriate (avoid clustering in the middle without reason).\n"
The default prompt to use for the scalar evaluation. It takes the parameters (each in double curly braces):
<<prompt>>: The prompt to evaluate.<<response>>: The response to evaluate.<<scoring_scale>>: The scoring scale to use.