LocalEval

LocalEval = object

Defined in: packages/cloud/src/client/types.gen.ts:3404

Evaluation result, EvaluationResult from llama_index.

Output of an BaseEvaluator.

Properties

query?

optional query: string | null

Defined in: packages/cloud/src/client/types.gen.ts:3408

Query string

---

contexts?

optional contexts: string[] | null

Defined in: packages/cloud/src/client/types.gen.ts:3412

Context strings

---

response?

optional response: string | null

Defined in: packages/cloud/src/client/types.gen.ts:3416

Response string

---

passing?

optional passing: boolean | null

Defined in: packages/cloud/src/client/types.gen.ts:3420

Binary evaluation result (passing or not)

---

feedback?

optional feedback: string | null

Defined in: packages/cloud/src/client/types.gen.ts:3424

Feedback or reasoning for the response

---

score?

optional score: number | null

Defined in: packages/cloud/src/client/types.gen.ts:3428

Score for the response

---

pairwise_source?

optional pairwise_source: string | null

Defined in: packages/cloud/src/client/types.gen.ts:3432

Used only for pairwise and specifies whether it is from original order of presented answers or flipped order

---

invalid_result?

optional invalid_result: boolean

Defined in: packages/cloud/src/client/types.gen.ts:3436

Whether the evaluation result is an invalid one.

---

invalid_reason?

optional invalid_reason: string | null

Defined in: packages/cloud/src/client/types.gen.ts:3440

Reason for invalid evaluation.