tjG dZddlmZddlZddlmZmZmZmZm Z m Z m Z m Z m Z mZddlmZddlmZddlmZddlmZerdd lmZdd lmZdd lmZddlmZd Z d#dZ!d$dZ" d%d&dZ# d'd(dZ$d)dZ%Gdd e Z&Gd!d"eZ'dS)*zBA Tracer Implementation that records activity to Weights & Biases.) annotationsN) TYPE_CHECKINGAnyCallableDictListOptionalSequenceTuple TypedDictUnion)warn_deprecated)PydanticBaseModel) BaseTracer)Run)Settings)Trace)StrPathTrun_ioOptional[dict]returndictc|siSddlm}ddlm}i}|D]\}}t ||r||||<$t |t rz!_serialize_io..=s/RRRvq#&1&& RRR) google.protobuf.json_formatrgoogle.protobuf.messageritems isinstancerhasattrrr update enumerate)rrrserialized_inputskeyvalues r$ _serialize_ior1!s+  999999//////llnn++ U eW % % +%2]5%9%9 c " " 0 1 1 +5"344"%%'''ZZ\\ c " " % % %  $ $RR5AQAQRRR    &+ c " " r&runDict[str, Any]List[Dict[str, Any]]c(dfd |gS)zUtility to flatten a nest run object into a list of runs. :param run: The base run to flatten. :return: The flattened list of runs. child_runsr4rc|gSg}|D]K}|dg}||||L|S)zUtility to recursively flatten a list of child runs in a run. :param child_runs: The list of child runs to flatten. :return: The flattened list of runs. Nr6)popappendextend)r6resultitemflattens r$r=zflatten_run..flattenJsm  I / /D,33J MM$    MM''*-- . . . . r&)r6r4rr4)r2r=s @r$ flatten_runr?Ds3  7C5>>r&r>runs keep_keysTuple[str, ...]cJdfd }tt||S)zUtility to truncate a list of runs dictionaries to only keep the specified keys in each run. :param runs: The list of runs to truncate. :param keep_keys: The keys to keep in each run. :return: The truncated list of runs. r2r3rcNi}|D]}|vr||||<|S)zUtility to truncate a single run dictionary to only keep the specified keys. :param run: The run dictionary to truncate. :return: The truncated run dictionary )get)r2new_dictr/rAs r$truncate_singlez/truncate_run_iterative..truncate_singlegs=  - -Ci #  r&r2r3rr3listmap)r@rArGs ` r$truncate_run_iterativerL]s;       OT** + ++r& exact_keys partial_keysc~d fd ddfd dfd dfd }tt||S)aUtility to modify the serialized field of a list of runs dictionaries. removes any keys that match the exact_keys and any keys that contain any of the partial_keys. recursively moves the dictionaries under the kwargs key to the top level. changes the "id" field to a string "_kind" field that tells WBTraceTree how to visualize the run. promotes the "serialized" field to the top level. :param runs: The list of runs to modify. :param exact_keys: A tuple of keys to remove from the serialized field. :param partial_keys: A tuple of partial keys to remove from the serialized field. :return: The modified list of runs. objr3rc t|trJfd|D}|D]\}}|||<n#t|trfd|D}|S)zRecursively removes exact and partial keys from a dictionary. :param obj: The dictionary to remove keys from. :return: The modified dictionary. c\i|]'\}v tfdD$|(S)c3 K|]}|vV dSNr>)r!partialks r$ z`modify_serialized_iterative..remove_exact_and_partial_keys...s'EEWGqLEEEEEEr&)any)r!vrVrMrNs @r$r%zVmodify_serialized_iterative..remove_exact_and_partial_keys..sZAqJ&&EEEE EEEEE'1&&&r&c&g|] }|Sr>r>)r!xremove_exact_and_partial_keyss r$ zVmodify_serialized_iterative..remove_exact_and_partial_keys..s%AAA0033AAAr&)r*rr)rJ)rPrVrYrMrNr\s r$r\zBmodify_serialized_iterative..remove_exact_and_partial_keyss c4 BIIKKC   : :166q99A : T " " BAAAASAAAC r&Frootboolct|tr d|vr#t|dtr|d}d|vsd|vr|s|d}|s|dg}t|tr7|d|d<|dd|ddd|vr4|d}|D] \}}|||< |D]\}}|||<n#t|trfd|D}|S) aRecursively handles the id and kwargs fields of a dictionary. changes the id field to a string "_kind" field that tells WBTraceTree how to visualize the run. recursively moves the dictionaries under the kwargs key to the top level. :param obj: a run dictionary with id and kwargs fields. :param root: whether this is the root dictionary or the serialized dictionary. :return: The modified dictionary. dataidname_kindNkwargsc&g|] }|Sr>r>)r!r[handle_id_and_kwargss r$r]zMmodify_serialized_iterative..handle_id_and_kwargs..s%888q''**888r&)r*rrErJr8r))rPr^rerfrVrYrhs r$rhz9modify_serialized_iterative..handle_id_and_kwargssf c4  9}}CK!>!>}&k v}}d} . WWV__-EeT***#(9CLGGD$'''GGFD)))s?? WWX..F & ##1!"A  1 11--a00A 1 T " " 98888C888C r& serializedc8|d}|}|S)zTransforms the serialized field of a run dictionary to be compatible with WBTraceTree. :param serialized: The serialized field of a run dictionary. :return: The transformed serialized field. T)r^r>)rirhr\s r$transform_serializedz9modify_serialized_iterative..transform_serializeds0 *)*4@@@ 22:>> r&r2c|}|d}|D] \}}|||< |dd}|dd}|s|}||i}|S)zTransforms a run dictionary to be compatible with WBTraceTree. :param run: The run dictionary to transform. :return: The transformed run dictionary. rireNrc)r8r)rE) r2transformed_dictrirVrYrerc output_dictrks r$ transform_runz2modify_serialized_iterative..transform_runs 0/44%)),77 $$&& $ $DAq"# Q   $$Wd33##FD11 DI' r&)rPr3rr3F)rPr3r^r_rr3)rir3rr3rHrI)r@rMrNrorhr\rks `` @@@r$modify_serialized_iterativerqvs$$>, M4(( ) ))r&c B i}i |D]V}|D]?\}}|dd}|dd}||i||<|r| |<@W D]~\}}||} ||tt||| tt| tt||<t fd|D} | S)zBuilds a nested dictionary from a list of runs. :param runs: The list of runs to build the tree from. :return: The nested dictionary representing the langchain Run in a tree structure compatible with WBTraceTree. rbN parent_run_idc3*K|] \}}|v |VdSrTr>)r!id_valrachild_to_parents r$rWzbuild_tree..s:v_7T7T7T7T7T7Tr&)r)r8nextiter) r@ id_to_dataentityr/rarurschild_id parent_id parent_dict root_dictrvs @r$ build_treersU JO88 8 8ICXXdD))F HH_d;;M"%tJv  8*7'  8 /4466  ) + x d:h+?&@&@!A!A B Dk**++,T$z(7K2L2L-M-MNN!+!1!1!3!3I r&ceZdZUdZded<ded<ded<ded<ded <d ed <d ed <ded<ded<ded<ded<ded<ded<ded<ded<d ed<ded<d ed<d ed<d ed<d ed<d ed<ded <d!ed"<d#S)$ WandbRunArgszArguments for the WandbTracer.z Optional[str]job_typezOptional[StrPath]dirzUnion[Dict, str, None]configprojectrzzOptional[bool]reinitzOptional[Sequence]tagsgrouprcnotesz Optional[Union[dict, str, bool]]magiczOptional[List[str]]config_exclude_keysconfig_include_keys anonymousmodeallow_val_changezOptional[Union[bool, str]]resumeforce tensorboardsync_tensorboard monitor_gym save_coderbz'Union[WBSettings, Dict[str, Any], None]settingsN)__name__ __module__ __qualname____doc____annotations__r>r&r$rrs8((""""++++,,,,,,,,$$$$&&&&$$$$555555r&rcreZdZUdZdZded<dZded<defdfd ZddZ dddZ ddZ d dZ d!dZ xZS)" WandbTracerzCallback Handler that logs to Weights and Biases. This handler will log the model architecture and run traces to Weights and Biases. This will ensure that all LangChain activity is logged to W&B. NzOptional[WBRun]_runOptional[WandbRunArgs] _run_argsrun_args io_serializerrrfrrNonec .tjd i| ddl}ddlm}n"#t $r}t d|d}~wwxYw||_||_||_| |j du||_ tdddd dS) a Initializes the WandbTracer. Parameters: run_args: (dict, optional) Arguments to pass to `wandb.init()`. If not provided, `wandb.init()` will be called with no arguments. Please refer to the `wandb.init` for more details. io_serializer: callable A function that serializes the input and outputs of a run to store in wandb. Defaults to "_serialize_io" To use W&B to monitor all LangChain activity, add this tracer like any other LangChain callback: ``` from wandb.integration.langchain import WandbTracer tracer = WandbTracer() chain = LLMChain(llm, callbacks=[tracer]) # ...end of notebook / script: tracer.finish() ``` rN) trace_treezTCould not import wandb python package.Please install it with `pip install -U wandb`.)should_print_urlz0.3.8FaPlease use the `WeaveTracer` from the `weave` package instead of this.The `WeaveTracer` is a more flexible and powerful tool for logging and tracing your LangChain callables.Find more information at https://weave-docs.wandb.ai/guides/integrations/langchainzPlease instantiate the WeaveTracer from `weave.integrations.langchain import WeaveTracer` .For autologging simply use `weave.init()` and log all traces from your LangChain callables.)pendingmessage alternativer>) super__init__wandbwandb.sdk.data_typesr ImportError_wandb _trace_treer _ensure_runr2_io_serializerr)selfrrrfrre __class__s r$rzWandbTracer.__init__!s4 ""6"""  LLL 7 7 7 7 7 7 7   A    %! 59+<>>>+ e 1      s ' AAAc8|jdS)zpWaits for all asynchronous processes to finish and data to upload. Proxy for `wandb.finish()`. N)rfinish)rs r$rzWandbTracer.finishZs r&Frr_c6|jj(i|jpi}d|vrddi|d<|jjd i||jjX|r4|jjjj}|jd|d|jjddSdS) zlEnsures an active W&B run exists. If not, will start a new run with the provided run_args. NrsilentTz'Streaming LangChain activity to W&B at z `WandbTracer` is currently in beta. Please report any issues to https://github.com/wandb/wandb/issues with the tag `langchain`. langchain)repor>)rr2rinitrrun_urltermlog_label)rrrrs r$rzWandbTracer._ensure_runas ;? "7!527H))(0$'7$ DK  ( (x ( ( ( ;? & +/2: ###g### KO " " " 4 4 4 4 4 ' &r&r2rOptional[Dict[str, Any]]c\ tj|}t|}d}t||}d\}}t |||}t |}|S#t $r/}tr|j d|Yd}~dSd}~wwxYw)zUtility to process a run for wandb model_dict serialization. :param run: The run to process. :return: The convert model_dict to pass to WBTraceTree. )rbrcrirs)rA))lctypegraph)api_keyinputoutput)rMrNz$WARNING: Failed to serialize model: N) r loadsr?rLrqr ExceptionPRINT_WARNINGSr termerror) rr2ra processedrArMrNrrs r$process_model_dictzWandbTracer.process_model_dictzs  :chhjj))D#D))II /yINNNI( $J 4j|I **FM    R %%&PQ&P&PQQQ44444 sA/A22 B+<$B&&B+c d d fd |}|}| |||_jj||ddSdSdS) z+Logs a LangChain Run to W*B as a W&B Trace.Nr2'Run'parentOptional['Trace']rc dd} |jdvr|j}n-|jdkr d|jvrdnd}nd }||} j|j||jrd nd |j)t|jd znd |j )t|j d znd | |j  |j  }|j D]}||||S|||S#t$r/}t r jd|Yd }~d Sd }~wwxYw)am Create a trace for a given run and its child runs. Args: run (Run): The run for which to create a trace. parent (Optional[Trace]): The parent trace. If provided, the created trace is added as a child to the parent trace. Returns: The created trace. If an error occurs during the creation of the trace, None is returned. Raises: Exception: If an error occurs during the creation of the trace, no exception is raised and a warning is printed. rrrr3cftj|}|di}|d|d<|d|d<|d|d<|ddd|d <|S) aj Extract metadata from a given run. This function extracts metadata from a given run and returns it as a dictionary. Args: r (Run): The run from which to extract metadata. Returns: `dict` containing the extracted metadata. metadatarbrun_idrsr dotted_order.execution_order)r rrEcount)rrun_dict metadata_dicts r$get_metadata_dictzPWandbTracer._log_trace_from_run..create_trace..get_metadata_dicts :affhh// ( Z < < *2,,t*<*< h'19o1N1N o.(0 V(<(< f%3;<<"B44%**/0%$r&)llmtoolchainagentNerrorsuccessi)rckind status_code start_time_ms end_time_msrinputsoutputsz3WARNING: Failed to serialize trace for run due to: )rrrr3)run_typerclowerrrr start_timeint timestampend_timerrrr6 add_childrrrtermwarn) r2rrrrr child_runr create_tracers r$rz5WandbTracer._log_trace_from_run..create_traces( % % % %.& &>&@&@4&G"H"H"H|/!$CL$:$:$<$%%$$Z000!M   !K((QaQQttttt  sD"E*E E: $E55E:langchain_tracerT)r2rrrrr)rr _model_dictrr2log)rr2 run_trace model_dictrs` @r$_log_trace_from_runzWandbTracer._log_trace_from_runs 59Q Q Q Q Q Q Q Q f!L%% ,,S11  !i&;$.I ! ;? &9+@ MM+ , , , , , ' &+@+@r&rc0||dS)zPersist a run.N)r)rr2s r$ _persist_runzWandbTracer._persist_runs   %%%%%r&)rrrrrfrrr)rrrp)rr_rr)r2rrr)r2rrr)r2rrr)rrrrrrrr1rrrrrr __classcell__)rs@r$rrs !D    (,I,,,,,0"/7 7 7 7 7 7 7 r555552B\-\-\-\-|&&&&&&&&r&r)rrrr)r2r3rr4)r>)r@r4rArBrr4)r>r>)r@r4rMrBrNrBrr4)r@r4rr3)(r __future__rr typingrrrrrr r r r r langchain_core._apir&langchain_core.output_parsers.pydanticrlangchain_core.tracers.baserlangchain_core.tracers.schemasrrr WBSettingswandb.sdk.data_types.trace_treerwandb.sdk.lib.pathsrwandb.wandb_runWBRunrr1r?rLrqrrrr>r&r$r s(HH""""""                         0/////DDDDDD222222......-,,,,,,555555++++++,,,,,,    F4>@,,,,,6#%$&c*c*c*c*c*L<666669666:d&d&d&d&d&*d&d&d&d&d&r&