tj, dZddlZddlmZddlmZmZmZmZddl m Z m Z ddl m Z ddlmZmZmZddlmZmZmZdd lmZmZejeZd efd ZGd d e ZGdde ZGdde ZdS)z.Tools for interacting with a Power BI dataset.N) perf_counter)AnyDictOptionalTuple)AsyncCallbackManagerForToolRunCallbackManagerForToolRun)BaseTool) ConfigDictFieldmodel_validator)BAD_REQUEST_RESPONSEDEFAULT_FEWSHOT_EXAMPLESRETRY_RESPONSE)PowerBIDataset json_to_mdreturncL ddl}n#t$rtdwxYw|S)NrzCould not import tiktoken python package. This is needed in order to calculate get_token_ids. Please install it with `pip install tiktoken`.)tiktoken ImportError)rs d/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain_community/tools/powerbi/tool.py_import_tiktokenrsK      =    Os!c eZdZUdZdZeed<dZeed<dZe ed<e d Z e ed <e Zeeed <e ed Zeee fed <dZeed<dZeed<dZeeed<edZedededefdZdedeefdZ d#dedeede defdZ d#dedeede defdZ deee fde!eeee ffd Z"d!ede!e#effd"Z$dS)$QueryPowerBIToolz%Tool for querying a Power BI Dataset. query_powerbinamea Input to this tool is a detailed question about the dataset, output is a result from the dataset. It will try to answer the question using the dataset, and if it cannot, it will ask for clarification. Example Input: "How many rows are in table1?" descriptionN llm_chainTexcludepowerbiexamples)default_factoryr session_cachemax_iterationsioutput_token_limittiktoken_model_namearbitrary_types_allowedbefore)modevaluesrcp|d}|jjD] }|dvrtd|jj!|S)z8Make sure the LLM chain has the correct input variables.r) tool_inputtablesschemasr"zrLLM chain for QueryPowerBITool must have input variables ['tool_input', 'tables', 'schemas', 'examples'], found %s)promptinput_variables ValueError)clsr-rvars r"validate_llm_chain_input_variablesz3QueryPowerBITool.validate_llm_chain_input_variables9s] ;' #3  CIII I$4J  r/c2||jvrdS|j|S)zCheck if the input is present in the cache. If the value is a bad request, overwrite with the escalated version, if not present return None.N)r$)selfr/s r _check_cachezQueryPowerBITool._check_cacheHs% T/ / /4!*--r8 run_managerkwargsc ||x}rtd|||S td||j||j|j|j |r| nd}n1#t$r$}d||j |<|j |cYd}~Sd}~wwxYw|dkr||j |<|j |Std|t}|j|}t} td |td | |z d ||\} } | d | vrd |j |<|j |S|dd} | r;| |jkr0|t'j||| || dzS| r| nt+j| |j |<|j |S):Execute the query, return the results or an error message.Found cached result for %s: %s%Running PBI Query Tool with input: %sNr/r0r1r" callbacksError on call to LLM: I cannot answer thisz PBI Query: %scommandPBI Result: %sPBI Query duration: 0.6f TokenExpiredzCAuthentication token expired or invalid, please try reauthenticate. iterationsrr/queryerrorr/r<rLrO)r;loggerdebuginforpredictr!get_table_names get_schemasr" get_child Exceptionr$rrun _parse_outputgetr&_runrformatr r:r/r<r=cacherNexc start_time pbi_resultend_timeresultrOrLs rr^zQueryPowerBITool._runQs%%j11 15  LL9:u M M ML 2 KK? L L LN**%|3355 00225@J+//111d +EE 2 2 2-Kc-K-KD z *%j1 1 1 1 1 1 1 2 * * *-2D z *%j1 1 $e,,,!^^ \%%e%44 >> %z222 HHz,AHHHIII**:66   5!8!8U  z *%j1 1ZZ a00  Z$"55599)0)e(%>   JFF"6"=E"J"J"J :&!*--sBB;; C)C$C)$C)cK||x}r!td|||dS td||j||j|j|j |r| ndd{V}n1#t$r$}d||j |<|j |cYd}~Sd}~wwxYw|dkr||j |<|j |Std|t}|j| d{V}t} td |td | |z d ||\} } | d | vsd| vrd|j |<|j |S|dd} | rA| |jkr6|t'j||| || dzd{VS| r| nt+j| |j |<|j |S)r?r@z3, from cache, you have already asked this question.rANrBrDrEz PBI Query: %srFrHrIrJrK TokenErrorzkAuthentication token expired or invalid, please try to reauthenticate or check the scope of the credential.rLrrMrPrQrR)r;rSrTrUrapredictr!rWrXr"rYrZr$rarunr\r]r&_arunrr_rr`s rrkzQueryPowerBITool._aruns%%j11 15 Q LL9:u M M MPPP P 2 KK? L L L.11%|3355 00225@J+//111d 2EE 2 2 2-Kc-K-KD z *%j1 1 1 1 1 1 1 2 * * *-2D z *%j1 1 OU+++!^^ <,,U,;;;;;;;; >> %z222 HHz,AHHHIII**:66   .E"9"9\U=R=R}  z *%j1 1ZZ a00  Z$"555)0)e(%> $  JFF"6"=E"J"J"J :&!*--sB C C4C/)C4/C4rdcd|vr|ddddd}t|dkrtddSt|}||\}}|rd|d|jd d fS|d fSd |vrFd |d vr2d |d d vr"d |d d d ddfSd |d fSd |fS)z2Parse the output of the query to a markdown table.resultsrr0rowsz%0 records in result, query was valid.)Nz^0 rows returned, this might be correct, but please validate if all filter values were correct?z[Result too large, please try to be more specific or use the `TOPN` function. The result is z tokens long, the limit is z tokens.NrOz pbi.errordetailsdetail)lenrSrUr_result_too_larger')r:rdrnrftoo_longlengths rr\zQueryPowerBITool._parse_outputsE  " "i(+H5a8@D4yyA~~ CDDD %%F#55f== Hf wrxwwVZVmwww4<  j z'222G!4[!AAAZ0=iHKHUUUG,, ,Zr8rfc|jrrt}||j}t||}t d|||jk|fSdS)z!Tokenize the output of the query.zResult length: %s)Fr)r(rencoding_for_modelrqencoderSrUr')r:rf tiktoken_encodingrts rrrz"QueryPowerBITool._result_too_largest  # <(**I 33D4LMMH0011F KK+V 4 4 4D33V; ;xr8N)%__name__ __module__ __qualname____doc__rstr__annotations__rrrr r!rrr"rdictr$rr&intr'r(r model_configr classmethodr7r;r r^rrkrr\boolrrr8rrr$sm//D#K Is#eD111G^1116Hhsm666$)E$$M$M$MM4S>MMMNC"""")-#---: $L_(###      [$# .s.x}....<@4.4.4.784. 4. 4.4.4.4.rAE4.4.4.<=4. 4. 4.4.4.4.l sCx. x}hsm+ ,    <dCi0@r8rceZdZUdZdZeed<dZeed<edZ e ed<e d Z dd ed e ed efdZ dd ed e ed efdZd S)InfoPowerBIToolz2Tool for getting metadata about a PowerBI Dataset.schema_powerbirz Input to this tool is a comma-separated list of tables, output is the schema and sample rows for those tables. Be sure that the tables actually exist by calling list_tables_powerbi first! Example Input: "table1, table2, table3" rTrr!r)Nr/r<rc\|j|dS)z4Get the schema for tables in a comma-separated list., )r!get_table_infosplitr:r/r<s rr^zInfoPowerBITool._runs( |**:+;+;D+A+ABBBr8clK|j|dd{VS)Nr)r!aget_table_inforrs rrkzInfoPowerBITool._aruns> \11*2B2B42H2HIIIIIIIIIr8rzr{r|r}r~rrrrr r!rr rrr r^rrkrr8rrrs<< D#   K $eD111G^111: $L<@CCC78C CCCCAEJJJ<=J JJJJJJr8rceZdZUdZdZeed<dZeed<edZ e ed<e d Z dd e ed e ed efdZ dd e ed e ed efdZd S)ListPowerBIToolzTool for getting tables names.list_tables_powerbirzUInput is an empty string, output is a comma separated list of tables in the database.rTrr!r)Nr/r<rcZd|jSzGet the names of the tables.rjoinr!rWrs rr^zListPowerBITool._runs$ yy5577888r8c^Kd|jSrrrs rrkzListPowerBITool._aruns( yy5577888r8)NNrrr8rrrs((%D#%%%nKnnn#eD111G^111: $L %);?99SM9789 9999%)@D99SM9<=9 999999r8r) r~loggingtimertypingrrrrlangchain_core.callbacksrr langchain_core.toolsr pydanticr r r (langchain_community.tools.powerbi.promptrrr%langchain_community.utilities.powerbirr getLoggerr{rSrrrrrr8rrs44------------*)))))7777777777 MLLLLLLL  8 $ $ #    xDJJJJJhJJJ@99999h99999r8