jUdZddlmZddlZddlZddlZddlmZeedrejejfn ejfZ de d<d dZ d d Zd d Zy) aStatic extraction of feedback keys from evaluator functions. An evaluator's feedback key is the ``key`` value it returns (e.g. ``{"key": "correctness", "score": 1}``). The runner uses these keys to render per-evaluator progress and to synthesize error feedback when an evaluator raises. They are inferred by parsing the function's source into an AST and reading the literal ``key`` values it produces -- never by executing the function. ) annotationsN)CallableStrtuple_AST_STR_TYPEScft|tjr |jS|jS)z.Get string value from ast.Str or ast.Constant.) isinstanceastConstantvalues)nodes n/var/www/html/Fitness-lenito-AI-main/venv/lib/python3.12/site-packages/langsmith/evaluation/_key_extraction.py_get_str_valuers"#D#,,74::CTVVCc(tj|}d}dfd}tj|} t j |}|j d}t|tjtjfsgSi}g}t j|D]M}t|tjrt|jtjsCg} |jjD]} | j| t|j dtj"s| ||j dj$<t|tj&s|j||j} |j} ||j|} |j| |j| |j| P|r|S|j(gS#t*$rgcYSwxYw)Ncpt|tjrqg}d}t|j|j D]C\}}t|t st|}|dk(s(t|t s9t|}E|r|gS|St|tjrt|jtjrl|jjdk(rS|jD]D}|jdk(st|jt s.t|jgcSgS)Nkeydict)r r DictzipkeysvaluesrrCallfuncNameidkeywordsargr )rr key_valuerr key_strkeywords rextract_dict_keysz@_extract_code_evaluator_feedback_keys..extract_dict_keys s dCHH %DI!$))T[[9 Uc>2,S1G%'Jun,M$25$9 : #,I; 5 5 tSXX &499chh/ &==;;%'Jw}}n,U*7==9::) rcZt|tjrt|jtjrl|jj dk(rS|j D]D}|jdk(st|jts.t|jgcSgS)NEvaluationResultr) r r rrrrrrr rr)rr"s rextract_evaluation_result_keyzL_extract_code_evaluator_feedback_keys..extract_evaluation_result_key4ss tSXX &499chh/ 22==;;%'Jw}}n,U*7==9::) rc t|tjrt|jtjr|jj dk(r|j D]}|jdk(st|jtjr(|j|jj gcSt|jtjsg}|jjD]}|j ||cSgSt|tjrt|j|j D]\}}t|t"st%|dk(s't|tjsBg}|jD]J}t|tjrtt|j|j D]P\}}t|t"st%|dk(s&t|t"s7|j't%|Rt|tjst|jtjs|jj dvs|j D]Q}|jdk(st|jt"s.|j't%|jSM|cSgS)NEvaluationResultsresultsr)r%r)r r rrrrrrr getListeltsextendrrrrrrappend) r variablesr"reltrr elt_key elt_valuer&s rextract_evaluation_results_keyszN_extract_code_evaluator_feedback_keys..extract_evaluation_results_keys?s  tSXX &499chh/ 33==;;)+!'--:(}}W]]-=-=rBB#GMM388<!#*==#5#5C KK(Ec(JK$6# )F 5chh '!$))T[[9 Uc>2~c7Ji7W!%2!#(::C)#sxx8:=chh :S$6GY(27N(K,:7,Cu,L+5i+P,0KKy8Q,R ;T!+3 9$.sxx$B$'HHKK3O$O/2||G'.{{e'; (/ ~A&)- N7==4Q(R 0<$.( $ 1:2 rr)inspect getsourcetextwrapdedentr parsebodyr FunctionDefAsyncFunctionDefwalkAssignr r+r,r-targetsrrReturnname SyntaxError)r python_coder#r3tree function_defr/rr list_keysr0 dict_keyseval_result_keyeval_results_keysr&s @r%_extract_code_evaluator_feedback_keysrIs##D)K( )V//+.K yy%yy| ,#:N:N(OPI HH\*D$ +djj#((3 "I#zz!(()Fs)KL /!$,,q/388<8A $,,q/"4"45D#**-$**2H-djj9 "? "K$CJJ %! I& O, -.#+(t4,"3"3!44  s9AHAH$AH7H8 HA0H6 H HHc< t|S#t$rgcYSwxYw)a'Best-effort static extraction of an evaluator's feedback keys. Reads the function's source and returns the literal ``key`` values it emits. Degrades to ``[]`` when keys can't be statically inferred (dynamic keys, source unavailable, etc.) so evaluator construction never fails. )rI Exception)rs r_safe_extract_feedback_keysrLs&4T::  s )rzast.exprreturnstr)rrrMz list[str])__doc__ __future__rr r4r6typingrhasattrrr r__annotations__rrIrLrrrUs\#  'sE2SWWcll D od r