dhfSSKJr SSKrSSKJr SSKJrJrJrJ r J r SSK J r SSK Jr SSKJr SSKJr "S S \5rg) ) annotationsN)Path)AnyDictIterableListOptional)CallbackManagerForRetrieverRun)Document) BaseRetriever) ConfigDictc\rSrSr%SrSrS\S'S\S'SrS\S'S rS \S '\ "S S 9r \ SSSjj5r \ SS.SSjj5r SSjrSSSjjr\ SSS.SSjj5rSrg)TFIDFRetriever z`TF-IDF` retriever. Largely based on https://github.com/asvskartheek/Text-Retrieval/blob/master/TF-IDF%20Search%20Engine%20(SKLEARN).ipynb Nr vectorizerList[Document]docs tfidf_arrayintkT)arbitrary_types_allowedc SSKJn U=(d 0nU"S0UD6nURU5nU=(d SU5n[ X5VV s/sHup[ XS9PM n nn U"SXjUS.UD6$![a [S5ef=fs sn nf)Nr)TfidfVectorizerzNCould not import scikit-learn, please install with `pip install scikit-learn`.c3$# UHn0v M g7fN).0_s \/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/retrievers/tfidf.py ,TFIDFRetriever.from_texts..4s!4e"es page_contentmetadatarrrr)sklearn.feature_extraction.textr ImportError fit_transformzipr ) clstexts metadatas tfidf_paramskwargsrrrtmrs r from_textsTFIDFRetriever.from_texts!s  G$)r $4|4  ..u5 4!4e!4 ADUAVWAVa4AVWWjWPVWW !  XsA. B.B)r.c N[SU56upEUR"SXBUS.UD6$)Nc3N# UHoRUR4v M g7frr#)rds r r!0TFIDFRetriever.from_documents..@s Qy!..!**!=ys#%)r,r.r-r)r*r2)r+ documentsr.r/r,r-s r from_documentsTFIDFRetriever.from_documents8s: Qy QR~~ i KQ  cSSKJn URRU/5nU"URU5R S5nUR 5UR*SSSS2Vs/sHo`RUPM nnU$s snf)Nr)cosine_similarity)r>) sklearn.metrics.pairwiser=r transformrreshapeargsortrr)selfquery run_managerr= query_vecresultsi return_docss r _get_relevant_documents&TFIDFRetriever._get_relevant_documentsEs ?OO-- G $D$4$4i@HH  .5__->wy-I$B$-OP-Oyy|-O PQs+Btfidf_vectorizerchSSKn[U5nURSSS9 UR UR XBS3- 5 [ XBS3- S5n[R"URUR4U5 SSS5 g![a [S5ef=f!,(df  g=f)NrBCould not import joblib, please install with `pip install joblib`.T)exist_okparents.joblib.pklwb) joblibr(rmkdirdumpropenpicklerr)rC folder_path file_namerTpathfs r save_localTFIDFRetriever.save_localSs    K  D$ /  DOOTk,A%AB$;d++T 2a KKD$4$45q 93 2 T  3 2sB .B# B # B1F)allow_dangerous_deserializationrZc:SSKnU(d [S5e[U5nUR XSS3- 5n[ XSS3- S5n[ R"U5upSSS5 U"UWW S9$![a [S5ef=f!,(df  N/=f) aLoad the retriever from local storage. Args: folder_path: Folder path to load from. allow_dangerous_deserialization: Whether to allow dangerous deserialization. Defaults to False. The deserialization relies on .joblib and .pkl files, which can be modified to deliver a malicious payload that results in execution of arbitrary code on your machine. You will need to set this to `True` to use deserialization. If you do this, make sure you trust the source of the file. file_name: File name to load from. Defaults to "tfidf_vectorizer". Returns: TFIDFRetriever: Loaded retriever. rNrNaThe de-serialization of this retriever is based on .joblib and .pkl files.Such files can be modified to deliver a malicious payload that results in execution of arbitrary code on your machine.You will need to set `allow_dangerous_deserialization` to `True` to load this retriever. If you do this, make sure you trust the source of the file, and you are responsible for validating the file came from a trusted source.rQrRrbr&)rTr( ValueErrorrloadrWrX) r+rYr_rZrTr[rr\rrs r load_localTFIDFRetriever.load_localis0   /.  K [[+W(=!=> $;d++T 2a!' A D3 jtMM9 T  .3 2sA3 B 3B  Br)NN) r,z Iterable[str]r-zOptional[Iterable[dict]]r.Optional[Dict[str, Any]]r/rreturnr)r8zIterable[Document]r.rfr/rrgr)rDstrrEr rgr)rL)rYrhrZrhrgNone)rYrhr_boolrZrhrgr)__name__ __module__ __qualname____firstlineno____doc__r__annotations__rrr model_config classmethodr2r9rJr]rd__static_attributes__rr;r rr sb J K AsJ( $L/315 XX,X/ X  X  XX, 26  %  /          *H   ",:::  :, 16+ 5N5N*. 5N  5N  5N5Nr;r) __future__rrXpathlibrtypingrrrrr langchain_core.callbacksr langchain_core.documentsr langchain_core.retrieversr pydanticr rrr;r r{s0" 66C-3RN]RNr;