tj<"ddlZddlmZmZmZmZmZddlmZm Z ddl m Z ddl m Z ddlmZmZddlmZdefd Zdefd Zd ed edefd ZGdde ZdS)N)AnyDictListOptionalcast) AgentAction AgentFinish)BaseCallbackHandler) BaseMessage)ChatGeneration LLMResult guard_importreturncDtdS)zImport the infino client.infinopy)r InfinoClientk/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain_community/callbacks/infino_callback.py import_infinor s  # # 0 0 2 22rc tdS)z6Import tiktoken for counting tokens for OpenAI models.tiktokenrrrrimport_tiktokenrs  # ##rstringopenai_model_namect}||}t||}|S)zCalculate num tokens for OpenAI with tiktoken package. Official documentation: https://github.com/openai/openai-cookbook/blob/main /examples/How_to_count_tokens_with_tiktoken.ipynb )rencoding_for_modellenencode)rrrencoding num_tokenss rget_num_tokensr#sB   H**+<==HX__V,,--J rc 8eZdZdZ d,deedeededdfdZ d-d ed ed eddfd Z de eefde ededdfdZ dededdfdZ dededdfdZdededdfdZde eefde eefdeddfdZde eefdeddfdZdededdfdZde eefdededdfdZdededefd Z d.d!ed"eed#eededdf d$Zdededdfd%Zd&ededdfd'Zd(ededdfd)Zde eefd*e e ededdfd+ZdS)/InfinoCallbackHandlerz%Callback Handler that logs to Infino.NFmodel_id model_versionverbosercrt|_||_||_||_d|_d|_dS)NFz gpt-3.5-turbo)rclientr&r'r(is_chat_openai_modelchat_openai_model_name)selfr&r'r(s r__init__zInfinoCallbackHandler.__init__%s;$oo   * $)!&5###rTkeyvalueis_tscdttj||d|j|jdi}|jrt d|d||r|j|dS|j|dS)aSend the key-value to Infino. Parameters: key (str): the key to send to Infino. value (Any): the value to send to Infino. is_ts (bool): if True, the value is part of a time series, else it is sent as a log message. datelabels)r&r'z Tracking z with Infino: N) inttimer&r'r(printr* append_ts append_log)r-r/r0r1payloads r_send_to_infinoz%InfinoCallbackHandler._send_to_infino3s C $$   M!%!3  < < :c:::: ; ; ;  , K ! !' * * * * * K " "7 + + + + +r serializedpromptskwargsc ~|D]}|d|dd|_tj|_dS)z=Log the prompts to Infino, and set start time and error flag.promptFr1rN)r;errorr6 start_time)r-r<r=r>r@s r on_llm_startz"InfinoCallbackHandler.on_llm_startSsO @ @F  6 ? ? ? ? )++rtokenc dS)z)Do nothing when a new token is generated.Nr)r-rEr>s ron_llm_new_tokenz&InfinoCallbackHandler.on_llm_new_tokene rresponsec tj|_|j|jz }|d||d|j|jD]$}|D]}|d|jd %|jt|jtri|jd}|Z|d}|d }|d } |d||d ||d | |j rMd d |D} t| |j } |d | dSdS)zz3InfinoCallbackHandler.on_llm_end..sP  S$~z::BJKK      rr)r6end_timerCr;rB generationstext llm_output isinstancerr+joinr#r,) r-rIr>durationr\rXrMrNrOrPmessagess r on_llm_endz InfinoCallbackHandler.on_llm_endis  =4?2 Y111 Wdj111$/ V VK) V V $$%6 u$UUUU V   +H: $/0C$D!$$_mDDD$$^\BBB$$%8:KLLL  $ Ixx  "-   H!/D,G!!!   !46G H H H H H I IrrBc d|_dS)zSet the error flag.N)rBr-rBr>s r on_llm_errorz"InfinoCallbackHandler.on_llm_errors  rinputsc dS)z!Do nothing when LLM chain starts.Nr)r-r<rhr>s ron_chain_startz$InfinoCallbackHandler.on_chain_starts  routputsc dS)zDo nothing when LLM chain ends.Nr)r-rkr>s r on_chain_endz"InfinoCallbackHandler.on_chain_endrHrc dS)zNeed to log the error.Nrrfs ron_chain_errorz$InfinoCallbackHandler.on_chain_errorrHr input_strc dS)zDo nothing when tool starts.Nr)r-r<rpr>s r on_tool_startz#InfinoCallbackHandler.on_tool_starts  ractionc dS)z.Do nothing when agent takes a specific action.Nr)r-rsr>s ron_agent_actionz%InfinoCallbackHandler.on_agent_actionrHroutputobservation_prefix llm_prefixc dS)zDo nothing when tool ends.Nr)r-rvrwrxr>s r on_tool_endz!InfinoCallbackHandler.on_tool_ends  rc dS)z&Do nothing when tool outputs an error.Nrrfs r on_tool_errorz#InfinoCallbackHandler.on_tool_errorrHrr]c dSz Do nothing.Nr)r-r]r>s ron_textzInfinoCallbackHandler.on_textrHrfinishc dSr~r)r-rr>s ron_agent_finishz%InfinoCallbackHandler.on_agent_finishrHrrbc z|d}|r|D]}|dkr d|_n|jr|d}|ru|d}|r^||_d}|D]<} dd| D} t | |j } || z }=|d ||jrtd |jd |jdd |D} |d| dd|_tj |_ dS)zRun when LLM starts running.id ChatOpenAITinvocation_params model_namerrQc3JK|]}tt|jVdSrSrrTrV)rWmsgs rrYz.s?227:Dck22222222rrZrNz=on_chat_model_start: is_chat_openai_model= z+, chat_openai_model_name=c3TK|]#}|D]}tt|jV$dSrSr)rWsublistrs rrYz.sS  '.g  ?BDck " "       rr@FrAN) getr+r,r`r#r;r(r7rBr6rC) r-r<rbr>valuesr0rrrN message_listmessage_stringr"r@s ron_chat_model_startz)InfinoCallbackHandler.on_chat_model_starts%%    L((04D-E)  $ I & +> ? ?   I.22<@@  I2J222**&4*.2.I&&& &3 ((-HHH <  H,HH*.*EHH     2:      XvU;;; )++r)NNF)T)NN)__name__ __module__ __qualname____doc__rrTboolr.rr;rrrDrGr rc BaseExceptionrgrjrmrorrrrurzr|rr rr rrrrr%r%"s//#''+ 6 63- 6 } 6 6  6 6 6 6$ ,, ,, ,  ,,,,@&cN&c& &  &&&&$ c S T    #I9#I#I#I#I#I#IJ-34 sCx. 26sCx. LO      DcN c d     M S T     cN          k S S    -1$(    %SM SM          = C D     C 3 4     k S T    8&cN8&tK()8& 8&  8&8&8&8&8&8&rr%)r6typingrrrrrlangchain_core.agentsrr langchain_core.callbacksr langchain_core.messagesr langchain_core.outputsr r langchain_core.utilsrrrrTr5r#r%rrrrs< 22222222222222::::::::888888//////<<<<<<<<------3s3333 $$$$$ 3 3 3    Y&Y&Y&Y&Y&/Y&Y&Y&Y&Y&r