tj ddlmZddlZddlmZddlmZddlmZddl m Z m Z m Z ddl mZmZgdZed d ed ed e dede ddf dZed GddeZed  dd edeejdzddfdZed de defdZed d ede defdZdS)) NamedTupleN) compatibility)Graph) GraphModule)map_argNodeTarget) ShapePropTensorMetadata)replace_target_nodes_with size_bytesget_size_of_all_nodesget_tensor_metaget_size_of_nodeF)is_backward_compatible fx_moduleold_op old_targetnew_op new_targetreturnc, t}i |jjD]}|j|kr|j|krt |j fd}t |j fd}t|tstdt|t|tstdt|| |||||j |<|| fd |<||_dS)z Modifies all nodes in fx_module.graph.nodes which match the specified op code and target, and updates them to match the new op code and target. c|SNnval_maps `/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/fx/passes/graph_manipulation.pyz+replace_target_nodes_with..$s  c|Srrrs rr z+replace_target_nodes_with..%s GAJr!zExpected tuple, got zExpected dict, got c|Srrrs rr z+replace_target_nodes_with...s  r!N)rgraphnodesoptargetrargskwargs isinstancetupleAssertionErrortypedict create_nodename node_copy) rrrrr new_graphnoder(r)rs @rr r s2I "G% L L 7f   !:!:49&:&:&:&:;;DT[*>*>*>*>??FdE** J$%HDJJ%H%HIIIfd++ K$%I4<<%I%IJJJ%11 D&$)GDMM&//6J6J6J6JKKGDMMIOOOr!c$eZdZUeed<eed<dS)r output_size total_sizeN)__name__ __module__ __qualname__int__annotations__rr!rr r 2s%OOOOOr!r r(c|t|j||jjD]$}|jdkrnt |||_%dS)zGiven a fx graph module, update each node with its total size (weights + bias + output) and its output_size(output). For a non-module node, the total size is the output size. return total sizeNoutput)r propagater$r%r&rr )rr(r3s rrr8s` & )&--%<< 7h   E*9d;; Fr!r3cd|jd}|std|d|S)N tensor_metazNode zQ has no tensor metadata associated with it! Check that shape propagation has run.)metaget RuntimeError)r3r@s rrrJsM)-- ..K   5D 5 5 5   r!c0d}|jdkrat|}||j}|}|D]\}}||z }t |}|j} || z }|jr.tj g|j  } n-tj g|j  } | |z} | | z} t| | S)zGiven a node with node.dtype and node.shape, return its total size and its output size. total_size = weights + bias + output_size r call_module)dtype)r&r. named_modulesr'named_parametersnumelrshape is_quantizedtorch_empty_affine_quantizedrF element_sizetensorr ) rr3total_num_of_elemssubmodule_dict submodule parameters_namepr@ output_elemsize_per_elem_bytesr6r5s rrrWs)  w-i557788"4;/ //11 " , ,HE1 !'')) +  "$''K#))++K+%W#; k'   ,.. $l2[5FGGGTTVV$'99J% 3K k: . ..r!r)typingrrLtorch.fx._compatibilityrtorch.fx.graphrtorch.fx.graph_moduler torch.fx.noderrr torch.fx.passes.shape_propr r __all__strr r listTensorrrrrr!rrbs* 111111 ------//////////@@@@@@@@   e,,,             -, :e,,,-, e,,,>B   "&u|"4t";     -, "e,,, $ >   -, e,,,/ /4/J///-,///r!