-jiddlmZddlZddlmZmZddlmZddlm Z m Z ej e Z dd Zdd ZddZe jgde jddge jddge jddge jddge jgde jgdiZddZdS)) annotationsN)DatasetSequence)ContextPrecision)EvaluationModeMetricdatasetr column_mapdict[str, str]returnchd|D}||S)zL Remap the column names in case dataset uses different column names ci|]\}}|| Sr).0kvs Z/lsinfo/ai/hellotax_ai/base_platform/venv/lib/python3.11/site-packages/ragas/validation.py z&remap_column_names..s>>>41a!Q>>>)itemsrename_columns)r r inverse_column_maps rremap_column_namesr s9 ?>:+;+;+=+=>>>  ! !"4 5 55rdsc<d|jvrd|jvrd}t|j|trg|j|jjdkrLt dd|dD}|d||jdz}|S)N ground_truths ground_truthstringzpassing column names as 'ground_truths' is deprecated and will be removed in the next version, please use 'ground_truth' instead. Note that `ground_truth` should be of type string and not Sequence[string] like `ground_truths`cg|] }|d S)rr)rgts r z3handle_deprecated_ground_truths.. s666B"Q%666ra)new_fingerprint) features isinstancerfeaturedtypeloggerwarning add_column _fingerprint)r column_namesr s rhandle_deprecated_ground_truthsr-s"+%%. *K*K& r{<0( ; ;  L)178CC NNt   76"_"5666B "!B Irc `dD]4}||jvr)|j|jdkrtd|d5dD]s}||jvrht|j|tr|j|jjdks-td|dt |j|tdS)N)questionanswerrrzDataset feature "z" should be of type string)contextsz*" should be of type Sequence[string], got )r$r' ValueErrorr%rr&type)rr,s rvalidate_column_dtypesr4*s> 2; & &{<(.(:: P PPP%   2; & &2;|4h?? K -5;xGG P PP.22;|3L.M.MPP  r)r/r0r1r/r0r1r)r/rr0)r/r1rmetrics list[Metric]c X|D]}tt|j}t|j}||sJd}t |trd|vrd}td|j dt||z d|dS)z validates the dataset and returns the evaluation type possible evaluation types 1. (q,a,c) 2. (q,a) 3. (q,c) 4. (g,a) rzLooks like you're trying to use 'context_precision' without ground_truth. Please use consider using `context_utilization' instead.z The metric [z>] that that is used requires the following additional columns z to be present in the dataset. N) setEVALMODE_TO_COLUMNSevaluation_moder$keysissubsetr%rr2namelist)rr5mrequired_columnsavailable_columns extra_msgs rvalidate_evaluation_modesrDIs213DEFF 0 0 2 233(():;; I1.// b"*;;;b =qv==&*+;>O+O&P&P==1:==  r)r rr r r r)rrr r)rr)rrr5r6) __future__rloggingdatasetsrr ragas.metrics._context_precisionrragas.metrics.baserr getLogger__name__r(rr-r4qacqaqcgcgaqgaqcgr:rDrrrrSs9""""""&&&&&&&&======55555555  8 $ $6666(*::: H- J/ 31>>>@@@r