Namespace: ContextEntityRecall
Estimates context recall by estimating TP and FN using annotated answer and retrieved context.
Functions
partial
▸ partial<T>(args): Scorer<string, Omit<{ azureOpenAi?: AzureOpenAiAuth ; client?: OpenAI ; context?: string | string[] ; input?: string ; maxTokens?: number ; model?: string ; openAiApiKey?: string ; openAiBaseUrl?: string ; openAiDangerouslyAllowBrowser?: boolean ; openAiDefaultHeaders?: Record<string, string> ; openAiOrganizationId?: string ; pairwiseScorer?: Scorer<string, {}> ; temperature?: number }, T> & Partial<Pick<{ azureOpenAi?: AzureOpenAiAuth ; client?: OpenAI ; context?: string | string[] ; input?: string ; maxTokens?: number ; model?: string ; openAiApiKey?: string ; openAiBaseUrl?: string ; openAiDangerouslyAllowBrowser?: boolean ; openAiDefaultHeaders?: Record<string, string> ; openAiOrganizationId?: string ; pairwiseScorer?: Scorer<string, {}> ; temperature?: number }, T>>>
Type parameters
| Name | Type |
|---|---|
T | extends "openAiApiKey" | "client" | "openAiOrganizationId" | "openAiBaseUrl" | "openAiDefaultHeaders" | "openAiDangerouslyAllowBrowser" | "azureOpenAi" | "model" | "temperature" | "maxTokens" | "context" | "input" | "pairwiseScorer" |
Parameters
| Name | Type |
|---|---|
args | { [K in "openAiApiKey" | "client" | "openAiOrganizationId" | "openAiBaseUrl" | "openAiDefaultHeaders" | "openAiDangerouslyAllowBrowser" | "azureOpenAi" | "model" | "temperature" | "maxTokens" | "context" | "input" | "pairwiseScorer"]: Object[K] } |
Returns
Scorer<string, Omit<{ azureOpenAi?: AzureOpenAiAuth ; client?: OpenAI ; context?: string | string[] ; input?: string ; maxTokens?: number ; model?: string ; openAiApiKey?: string ; openAiBaseUrl?: string ; openAiDangerouslyAllowBrowser?: boolean ; openAiDefaultHeaders?: Record<string, string> ; openAiOrganizationId?: string ; pairwiseScorer?: Scorer<string, {}> ; temperature?: number }, T> & Partial<Pick<{ azureOpenAi?: AzureOpenAiAuth ; client?: OpenAI ; context?: string | string[] ; input?: string ; maxTokens?: number ; model?: string ; openAiApiKey?: string ; openAiBaseUrl?: string ; openAiDangerouslyAllowBrowser?: boolean ; openAiDefaultHeaders?: Record<string, string> ; openAiOrganizationId?: string ; pairwiseScorer?: Scorer<string, {}> ; temperature?: number }, T>>>