tjq+fddlZddlZddlZddlZddlZddlZddlZddlmZddl Z ddl m Z ddl mZgdZejaejZejZGddeZGddZeZd Zd Zd Zd Zd ZdZejdgdZ ejdddgZ!dS)N)Enum)_get_current_rpc_agent) RPCExecMode serialize deserialize PythonUDFRemoteExceptionceZdZdZdZdZdZdS)rsyncasync async_jitremoteN)__name__ __module__ __qualname__SYNCASYNC ASYNC_JITREMOTE\/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/rpc/internal.pyrrs" D EI FFFrrceZdZdZdZdZedZdZedZ dZ dZ ed Z d Z d Zd Zd S)_InternalRPCPicklera  This class provides serialize() and deserialize() interfaces to serialize data to be "binary string + tensor table" format So for RPC python UDF function and args, non tensor data will be serialized into regular binary string, tensor data will be put into thread local tensor tables, this serialization format is consistent with builtin operator and args using JIT pickler. This format will make tensor handling in C++ much easier, e.g. attach tensor to distributed autograd graph in C++ ctj|_|j|jt j<i|_dSN)copyregdispatch_tablecopy_dispatch_table_tensor_reducertorchTensor_class_reducer_dict)selfs r__init__z_InternalRPCPickler.__init__+s9&5::<<-1-AU\*#%   rc0||jvr ||j|<dSdSr)r$)r% obj_classreducers r_register_reducerz%_InternalRPCPickler._register_reducer2s+ D4 4 429D $Y / / / 5 4rc&tj|Sr)_thread_local_tensor_tables recv_tables)cls tensor_indexs r_tensor_receiverz$_InternalRPCPickler._tensor_receiver7s+6|DDrctj|ttjdz }tj|ffS)N)r, send_tablesappendlenrr0)r%tensorr/s rr!z#_InternalRPCPickler._tensor_reducer<s?#/66v>>>6BCCaG #4|oFFrcJtjj|Sr)distrpcPyRRef _deserialize)r.rref_fork_datas r_py_rref_receiverz%_InternalRPCPickler._py_rref_receiverBsx++N;;;rcH|}tj|ffSr) _serializerr=)r%py_rrefr<s r_py_rref_reducerz$_InternalRPCPickler._py_rref_reducerFs$ ++--#57HIIrc,||Sr)rA)r%rrefs r _rref_reducerz!_InternalRPCPickler._rref_reducerJs$$T***rcltj|}tj|}|S)z Given a serialized representation of a ScriptModule created with torch.jit.save, loads and returns the ScriptModule. )ioBytesIOr"jitload)r.script_module_serializedfms r_script_module_receiverz+_InternalRPCPickler._script_module_receiverMs, J/ 0 0 INN1  rctj}tj||t j|ffS)z, Serializes a ScriptModule. )rFrGr"rHsaverrMgetvalue)r% script_modulerKs r_script_module_reducerz*_InternalRPCPickler._script_module_reducerWs= JLL }a(((#;ajjll_MMrcttj}t|}|j|_|j|jt jj<|j |jt jj <t|tj jr|j|j|j<|jD]}|j||j|<t%t&dr t&j}nd}gt&_||t&j}| |t&_nt&`||fS)ze Serialize non tensor data into binary string, tensor data into tensor table r3N)rFrG_picklerr rrAr8r9r:rDRRef isinstancer"rH ScriptModulerR __class__r$hasattrr,r3dumprP)r%objrKp class_nameold_send_tablestensorss rrz_InternalRPCPickler.serialize_s JLL QKK/-1,A)+/*<' c591 2 2 J.2.IA S] +2 P PJ+/+CJ+OA Z ( ( . > > #9EOO"O24#/ s .9  &6E ' 3 3+7 g&&rc~ttdr tj}nd}|t_ tt j|}|}n?#t$r2}t|dz}t|}||_ Yd}~nd}~wwxYw| |t_nt`|S)zJ Deserialize binary string + tensor table to original obj r-Nz Default RPC pickler does not serialize function code. Ensure that UDFs are defined on both caller and callee modules.) rYr,r- _unpicklerrFrGrIAttributeErrorstr __cause__)r% binary_data tensor_tableold_recv_tables unpicklerrete except_strs rrz_InternalRPCPickler.deserializes . > > #9EOO"O2>#/ "2:k#:#:;;I..""CC   A  !,,CCMMMMMM   &6E ' 3 3+7 s5A(( B$2(BB$N)rrr__doc__r&r* classmethodr0r!r=rArDrMrRrrrrrrr s&&&::: EE[EGGG <<[<JJJ+++[NNN3'3'3'j#####rrc6t|Sr)_internal_rpc_picklerr)r[s rrrs * *3 / //rc8t||Sr)ror)rerfs rrrs , ,[, G GGrc t|tr||j|ji|j}n#t $r}dt dt|dtj }t|tj t|t|}Yd}~nd}~wwxYw|S)z This function is exclusively called from C++. See ``torch/csrc/distributed/rpc/python_rpc_handler.cpp``. Runs a Python UDF and returns its return value. Wraps any exception in ``RemoteException`` if the function raises. zOn z:  )fileN)rVrbfuncargskwargs Exceptionrget_worker_inforepr traceback format_excprintsysstderrr type) python_udfresultrjrks r _run_functionrs 6 j. 1 1   */GZ5FGG 666 3(**::<< 3 3Aww 3 3#.00 3 3  jsz**** T!WW556 Ms.1 CA?B??Cc2t|tr|jdd}d} ||}n5#t $r(}tdt|d||d}~wwxYw||dSdS)Nzutf-8unicode_escapez8Failed to create original exception type. Error msg was z' Original exception on remote side was ) rVr msgencodedecodeexception_type BaseException RuntimeErrorrc)r exception_msgexcrjs r_handle_exceptionrs&/** ))'2299:JKK  '' 66CC   J3q66JJ:GJJ   ?I ?sA B&#B  Bc .d|jd|d|d|d }|S)a Builds the key that RPC calls are profiled with using the autograd profiler. This will be the name of the corresponding Event recorded in the profiler. Args: exec_type (RPCExecMode): Type of RPC/RRef call func_name (str): Name of function being profiled. current_worker_name (str): Name of current worker. dst_worker_name (str): Name of the destination worker. Returns: String representing profiling key rpc_#( -> ))value) exec_type func_namecurrent_worker_namedst_worker_name profile_keys r_build_rpc_profiling_keyrs;" YyXXXX-@XXoXXX rc tjstdd|jdt |d|d|d }tj}tj|||S)ar This function should be called from RPC/RRef functions to create a RecordFunction object for profiling. This function also runs the before callbacks that start the profiling, though the user is responsible for running the appropriate callbacks when the function to be profiled finishes. Args: exec_type (RPCExecMode): Type of RPC/RRef call func_name (str): Name of function being profiled. current_worker_name (str): Name of current worker. dest_worker_name (str): Name of the destination worker. Returns: An instance of `torch.autograd._RecordFunction`. z$Autograd profiler should be enabled.rrrrr)r"autograd_profiler_enabledAssertionErrorrrc_RecordFunction_run_before_callbacks)rrrdest_worker_namerrfs r_start_record_functionrs > + + - -ECDDDhhh3y>>hhrs  <<<<<< V U U.io// >   $WWWWWWWWv,+--000HHH.$,0 #K ";0J0J0J K K (+():UDT