tj& ddlZddlmZmZddlmZddlZddgZddlm Z ddl m Z ddl m Z dd lmZdd lmZGd de Zd ejjd eedejjfdZdS)N)MappingSequence)AnyCudaGraphsSupportpartition_cudagraphs)FakeTensorProp)CapabilityBasedPartitioner)OperatorSupport)CALLABLE_NODE_OPS)_pytreecZeZdZdeeejjfdejj de fdZ dS)r submodulesnodereturnc|jtvrdS|jtjjjjurdS|jtj urdSddtttfdtj fd}dtddffd }|jD]%}t!j|||j&t!j|||j S)NFTmetarc*d|vr|dn|dS)Nval fake_result)rs a/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/fx/passes/backends/cudagraphs.pymeta_fkz4CudaGraphsSupport.is_node_supported..meta_fk s"'4--4;;T-5H Htcht|tjr|jjdkrddSdSdS)NcudaT) isinstancetorchTensordevicetype)rfound_not_cudas r find_not_cudaz:CudaGraphsSupport.is_node_supported..find_not_cuda#s>!U\** &qx}/F/F!% & &/F/Fr)opr targetropsatenembedding_dense_backwarddefaultoperatorgetitemdictstrrrobjectall_input_nodespytree tree_map_r)selfrrrr#nr"s @ris_node_supportedz#CudaGraphsSupport.is_node_supporteds  7+ + +5 ;%).AI I I5 ;(* * *4 I$sCx. IU\ I I I I &V & & & & & & & % = =A  ]GGAFOO < < < < (:(:;;; "!!rN) __name__ __module__ __qualname__rr-rnnModulefxNodeboolr4rrrrrsR"!#ux"67"?Dx}" """"""rgminputsrct|j|t}t||d}|}||}|S)z Partition an FX graph into sub-GraphModules that can be validly run under CUDA graphs. For a subgraph to be runnable under CUDA, all of the operations must involve CUDA tensors only/ T)allows_single_node_partition)r propagaterr propose_partitionsfuse_partitions)r=r> supported_ops partitioner partitions fused_graphs rrr3sp!N2 &))%''M- MK//11J--j99K r)r*collections.abcrrtypingrr__all__ torch.fx.passes.fake_tensor_propr!torch.fx.passes.infra.partitionerr torch.fx.passes.operator_supportr torch.fx.passes.tools_commonr torch.utilsr r0rr: GraphModuler.rrrrrQs--------   6 7;;;;;;HHHHHH<<<<<<::::::)))))) " " " " " " " "F &.v&6 Xr