§ ™ŠtjÇãó¾—dZddlZddlZddlmZddlmZddlmZm Z ddl m Z ddl m Z ddlmZeje¦«ZGd „d e¦«ZGd „d e¦«ZdS) zEvaluators for parsing strings.éN)ÚCallable)Úeq)ÚAnyÚcast)Úparse_json_markdown)Úoverride)ÚStringEvaluatorcóÔ‡—eZdZdZdeddfˆfd„ Zeedefd„¦«¦«Z eedefd„¦«¦«Z eede fd„¦«¦«Z ed e d ede fd „¦«ZˆxZS) ÚJsonValidityEvaluatorazEvaluate whether the prediction is valid JSON. This evaluator checks if the prediction is a valid JSON string. It does not require any input or reference. Attributes: requires_input: Whether this evaluator requires an input string. Always False. requires_reference: Whether this evaluator requires a reference string. Always False. evaluation_name: The name of the evaluation metric. Always "json". Examples: >>> evaluator = JsonValidityEvaluator() >>> prediction = '{"name": "John", "age": 30, "city": "New York"}' >>> evaluator.evaluate(prediction) {'score': 1} >>> prediction = '{"name": "John", "age": 30, "city": "New York",}' >>> evaluator.evaluate(prediction) {'score': 0, 'reasoning': 'Expecting property name enclosed in double quotes'} Ú_ÚreturnNc óH•—t¦« ¦«dS)z%Initialize the JsonValidityEvaluator.N)ÚsuperÚ__init__)Úselfr Ú __class__s €úg/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain_classic/evaluation/parsing/base.pyrzJsonValidityEvaluator.__init__*sø€å ‰Œ×ÒÑÔÐÐÐócó—dS©NF©©rs rÚrequires_inputz$JsonValidityEvaluator.requires_input.ó €ðˆurcó—dSrrrs rÚrequires_referencez(JsonValidityEvaluator.requires_reference3rrcó—dS)NÚ json_validityrrs rÚevaluation_namez%JsonValidityEvaluator.evaluation_name8ó €ðˆrÚ predictionÚkwargsc ó— t|tj¬¦«nl#tj$r}dt |¦«dœcYd}~Sd}~wt $r6}t  d¦«dt |¦«dœcYd}~Sd}~wwxYwddiS)aÜEvaluate the prediction string. Args: prediction: The prediction string to evaluate. **kwargs: Additional keyword arguments (not used). Returns: `dict` containing the evaluation score. The score is `1` if the prediction is valid JSON, and `0` otherwise. If the prediction is not valid JSON, the dictionary also contains a `reasoning` field with the error message. )Úparserr)ÚscoreÚ reasoningNz*Passing JSON failed with unexpected error.r%é)rÚjsonÚloadsÚJSONDecodeErrorÚstrÚ ExceptionÚ_loggerÚ exception)rr!r"Úes rÚ_evaluate_stringsz'JsonValidityEvaluator._evaluate_strings=s¾€ð( 5Ý   µ4´:Ð >Ñ >Ô >Ð >Ð >øÝÔ#ð 5ð 5ð 5Ø­S°©V¬VÐ4Ð4Ð 4Ð 4Ð 4Ð 4Ð 4Ð 4øøøøÝð 5ð 5ð 5Ý × Ò ÐJÑ KÔ KÐ KØ­S°©V¬VÐ4Ð4Ð 4Ð 4Ð 4Ð 4Ð 4Ð 4øøøøð 5øøøð˜ˆ|Ðs+‚žB­A¾BÁ BÁ+BÁ<BÂB)Ú__name__Ú __module__Ú __qualname__Ú__doc__rrÚpropertyrÚboolrrr+rÚdictr0Ú __classcell__©rs@rr r s$ø€€€€€ððð0˜Cð DðððððððØ ð ðððñ„Xñ„XððØ ð Dðððñ„Xñ„XððØ ð ðððñ„Xñ„Xðððàðððð ð ððñ„Xðððððrr c ó"‡—eZdZdZddedzdeddfˆfd„ Zeede fd„¦«¦«Z eede fd„¦«¦«Z eede fd „¦«¦«Z d edeezdzeze zeze zfd „Ze dd e d e dzdedefd„¦«ZˆxZS)ÚJsonEqualityEvaluatora‡Json Equality Evaluator. Evaluate whether the prediction is equal to the reference after parsing both as JSON. This evaluator checks if the prediction, after parsing as JSON, is equal to the reference, which is also parsed as JSON. It does not require an input string. Attributes: requires_input: Whether this evaluator requires an input string. Always False. requires_reference: Whether this evaluator requires a reference string. Always True. evaluation_name: The name of the evaluation metric. Always "parsed_equality". Examples: >>> evaluator = JsonEqualityEvaluator() >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 1}') {'score': True} >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 2}') {'score': False} >>> evaluator = JsonEqualityEvaluator(operator=lambda x, y: x["a"] == y["a"]) >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 1}') {'score': True} >>> evaluator.evaluate_strings('{"a": 1}', reference='{"a": 2}') {'score': False} NÚoperatorr r c ód•—t¦« ¦«|pt|_dS)z¶Initialize the JsonEqualityEvaluator. Args: operator: A custom operator to compare the parsed JSON objects. Defaults to equality (`eq`). N)rrrr<)rr<r rs €rrzJsonEqualityEvaluator.__init__|s*ø€õ ‰Œ×ÒÑÔÐØ ˜¥BˆŒ ˆ ˆ rcó—dSrrrs rrz$JsonEqualityEvaluator.requires_input†rrcó—dS)NTrrs rrz(JsonEqualityEvaluator.requires_reference‹s €ðˆtrcó—dS)NÚ json_equalityrrs rrz%JsonEqualityEvaluator.evaluation_namer rÚstringcóN—t|t¦«rt|¦«S|S©N)Ú isinstancer+r)rrBs rÚ _parse_jsonz!JsonEqualityEvaluator._parse_json•s)€õ fcÑ "Ô "ð /Ý& vÑ.Ô.Ð .؈ rr!Ú referencer"c óV—| |¦«}| td|¦«¦«}t|t¦«rEt|t¦«sddiSt |t ¬¦«}t |t ¬¦«}d| ||¦«iS)a7Evaluate the prediction string. Args: prediction: The prediction string to evaluate. reference: The reference string to compare against. **kwargs: Additional keyword arguments (not used). Returns: `dict` containing the evaluation score. r+r%r)Úkey)rFrrEÚlistÚsortedr+r<)rr!rGr"ÚparsedÚlabels rr0z'JsonEqualityEvaluator._evaluate_stringssŸ€ð"×!Ò! *Ñ-Ô-ˆØ× Ò ¥ e¨YÑ!7Ô!7Ñ8Ô8ˆÝ eTÑ "Ô "ð +ݘf¥dÑ+Ô+ð $Ø |Ð#ݘF­Ð,Ñ,Ô,ˆFݘ5¥cÐ*Ñ*Ô*ˆEؘŸš v¨uÑ5Ô5Ð6Ð6rrD)r1r2r3r4rrrr5rr6rrr+rr7rJÚfloatÚintrFr0r8r9s@rr;r;[sø€€€€€ððð@'ð' ¨D¡ð'¸cð'Àdð'ð'ð'ð'ð'ð'ðØ ð ðððñ„Xñ„XððØ ð Dðððñ„Xñ„XððØ ð ðððñ„Xñ„Xððàðð ‰tÑ ˜eÑ # dÑ *¨SÑ 0°3Ñ 6ðððððð!%ð7ð7àð7ð˜‘:ð7ðð 7ð ð 7ð7ð7ñ„Xð7ð7ð7ð7ð7rr;)r4r(ÚloggingÚcollections.abcrr<rÚtypingrrÚlangchain_core.utils.jsonrÚtyping_extensionsrÚ#langchain_classic.evaluation.schemar Ú getLoggerr1r-r r;rrrúrWsðØ%Ð%à € € € Ø€€€Ø$Ð$Ð$Ð$Ð$Ð$ØÐÐÐÐÐØÐÐÐÐÐÐÐà9Ð9Ð9Ð9Ð9Ð9Ø&Ð&Ð&Ð&Ð&Ð&à?Ð?Ð?Ð?Ð?Ð?à ˆ'Ô ˜HÑ %Ô %€ðGðGðGðGðG˜OñGôGðGðTZ7ðZ7ðZ7ðZ7ðZ7˜OñZ7ôZ7ðZ7ðZ7ðZ7r