tjZRddlZddlZddlmZddlmZmZddlmZddl m Z ddl m Z ddl mZddlmZdd lmZdd lmZdd lmZdd lmZejeZGd de eeZedgdZdeedeefdZ GddeZ!dS)N)Sequence)#AsyncCallbackManagerForRetrieverRunCallbackManagerForRetrieverRun)Document)BaseLanguageModel)BaseOutputParser)BasePromptTemplate)PromptTemplate) BaseRetriever)Runnable)override)LLMChainc>eZdZdZededeefdZdS)LineListOutputParserz"Output parser for a list of lines.textreturnc|d}ttd|S)N )stripsplitlistfilter)selfrliness f/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain_classic/retrievers/multi_query.pyparsezLineListOutputParser.parses5 ""4((F4''(((N)__name__ __module__ __qualname____doc__r strrrrrrrsJ,, )#)$s))))X)))rrquestionaYou are an AI language model assistant. Your task is to generate 3 different versions of the given user question to retrieve relevant documents from a vector database. By generating multiple perspectives on the user question, your goal is to help the user overcome some of the limitations of distance-based similarity search. Provide these alternative questions separated by newlines. Original question: {question})input_variablestemplate documentsrc:fdtDS)Nc2g|]\}}|d|v|S)Nr#).0idocr's r z%_unique_documents...s/ O O OFAsc2A26N6NC6N6N6Nr) enumerate)r's`r_unique_documentsr/-s% O O O Oi 22 O O OOrceZdZUdZeed<eed<dZeed<dZ e ed< dZ eed < e e d dfded ed ede d zd ed df dZde ded eefdZde ded ee fdZdee ded eefdZde ded eefdZde ded ee fdZdee ded eefdZdeed eefdZd S)MultiQueryRetrieverzGiven a query, use an LLM to write a set of queries. Retrieve docs for each query. Return the unique union of all retrieved docs. retriever llm_chainTverboser parser_keyFinclude_originalNllmpromptrcJt}||z|z}||||S)aRInitialize from llm using default template. Args: retriever: retriever to query documents from llm: llm for query generation using DEFAULT_QUERY_PROMPT prompt: The prompt which aims to generate several different versions of the given user query parser_key: DEPRECATED. `parser_key` is no longer used and should not be specified. include_original: Whether to include the original query in the list of generated queries. Returns: MultiQueryRetriever )r2r3r6)r)clsr2r7r8r5r6 output_parserr3s rfrom_llmzMultiQueryRetriever.from_llm?s?0-.. SL=0 s-    rquery run_managercK|||d{V}|jr|||||d{V}||S)Get relevant documents given a user query. Args: query: user query run_manager: the callback handler to use. Returns: Unique union of relevant documents from all generated queries N)agenerate_queriesr6appendaretrieve_documents unique_unionrr=r>queriesr's r_aget_relevant_documentsz,MultiQueryRetriever._aget_relevant_documents_s..ukBBBBBBBB   " NN5 ! ! !227KHHHHHHHH   +++rr$cK|jd|id|id{V}t|jtr|dn|}|jrt d||S)zGenerate queries based upon user input. Args: question: user query run_manager: the callback handler to use. Returns: List of LLM generated queries that are similar to the user input r$ callbacksconfigNrGenerated queries: %s)r3ainvoke get_child isinstancerr4loggerinforr$r>responsers rrAz%MultiQueryRetriever.agenerate_queriests//  "!6!6!8!890        %/t~x$H$HV  h < 8 KK/ 7 7 7 rrFcdKtjfd|Dd{V}d|DS)zRun all LLM generated queries. Args: queries: query list run_manager: the callback handler to use Returns: List of retrieved Documents c3xK|]4}j|diV5dS)rIrJN)r2rMrN)r*r=r>rs r z:MultiQueryRetriever.aretrieve_documents..sg  &&')>)>)@)@A'rNcg|] }|D]}| Sr#r#)r*docsr,s rr-z;MultiQueryRetriever.aretrieve_documents..s%???$??3????r)asynciogather)rrFr>document_listss` ` rrCz'MultiQueryRetriever.aretrieve_documentssx '~ %        @?????rc|||}|jr|||||}||S)r@)generate_queriesr6rBretrieve_documentsrDrEs r_get_relevant_documentsz+MultiQueryRetriever._get_relevant_documentss_''{;;   " NN5 ! ! !++G[AA   +++rc|jd|id|i}t|jtr|dn|}|jrt d||S)zGenerate queries based upon user input. Args: question: user query run_manager: run manager for callbacks Returns: List of LLM generated queries that are similar to the user input r$rIrJrrL)r3invokerNrOrr4rPrQrRs rr]z$MultiQueryRetriever.generate_queriess>((  "!6!6!8!89)  %/t~x$H$HV  h < 8 KK/ 7 7 7 rcg}|D]G}|j|d|i}||H|S)zRun all LLM generated queries. Args: queries: query list run_manager: run manager for callbacks Returns: List of retrieved Documents rIrJ)r2rarNextend)rrFr>r'r=rXs rr^z&MultiQueryRetriever.retrieve_documentssj  # #E>((#[%:%:%<%<=)D   T " " " "rr'c t|S)zGet unique Documents. Args: documents: List of retrieved Documents Returns: List of unique retrieved Documents )r/)rr's rrDz MultiQueryRetriever.unique_unions!+++r)rrr r!r __annotations__r r4boolr5r"r6 classmethodDEFAULT_QUERY_PROMPTrr r<rrrrGrArCrr_r]r^rDr#rrr1r11sN GTJO"d"""Q &:!%!&      #  $J        [ >,,9 , h ,,,,*9 c .@c@9@ h @@@@2,,4 , h ,,,,*4 c .c4 h . ,d8n ,h , , , , , ,rr1)"rYloggingcollections.abcrlangchain_core.callbacksrrlangchain_core.documentsrlangchain_core.language_modelsrlangchain_core.output_parsersrlangchain_core.promptsr langchain_core.prompts.promptr langchain_core.retrieversr langchain_core.runnablesr typing_extensionsr langchain_classic.chains.llmr getLoggerrrPrr"rrhr/r1r#rrrvs$$$$$$.-----<<<<<<::::::555555888888333333------&&&&&&111111  8 $ $)))))+DI6)))&~LF   P(!3PXPPPP,,,,,-,,,,,r