ktj(NddlmZddlZddlmZddlmZGddeZdS) ) annotationsN) ONNXModel)Fusionc@eZdZdfd Zdd Zdd ZddZddZxZS) FusionGelumodelrcNt|dddS)NGeluErf)super__init__)selfr __class__s j/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/onnxruntime/quantization/fusions/fusion_gelu.pyrzFusionGelu.__init__s% .....erf_nodeonnx.NodeProtoinput_name_to_nodesdict[str, list[onnx.NodeProto]]output_name_to_nodedict[str, onnx.NodeProto]c||||s.||||s||||r|jdddSdS)z Interface function that tries to fuse a node sequence containing an Erf node into a single Gelu node. com.microsoftrN)fuse_1fuse_2fuse_3r set_opset_import)rrrrs rfusezFusionGelu.fuses~ KK"57J K K <{{8%8:MNN <{{8%8:MNN < J ' ' ; ; ; ; ;  < Div -----> Erf --> Add --> Mul --> (B=1.4142...) (1) Pattern 2: +------------------------------------+ | | | v [root] --> Div -----> Erf --> Add --> Mul -->Mul --> (B=1.4142...) (1) (0.5) Note that constant input for Add and Mul could be first or second input: like either A=0.5 or B=0.5 is fine. rFrAddMulDivN -?MbP?delta?r nameinputsoutputsrToutputlenop_typehas_constant_input match_parentfind_constant_inputinputis_safe_to_fuse_nodesnodes_to_removeextendonnxhelper make_nodecreate_unique_node_namedomain nodes_to_addappend)rrrrchildren add_after_erf mul_after_erfdivsubgraph_inputanothermul_halfsubgraph_outputsubgraph_nodes fused_nodes rrzFusionGelu.fuse_1#s2 ?1 %8 8 85&xq'9: x==A  !!4!=!=5  &&}a88 5   "*= = =5&}';A'>? x==A  !!4!=!=5  %4GHH ;5  # #Cu # = = B B51$*1-1Ea1HHH!!a ]09 9 9*=+?+BCH8}}!!Xa[%8E%A%Au{H**8S99 u&oa0OO((wH[\\Hu**8S99 uX^33u+215Ox xP)).?:KM`buvv 5 ##N333[** 5577@P[jZk+  ,    ,,,trc|jd|vrdS||jd}t|dks|djdkrdS|d}||dsdS|jd|vrdS||jd}t|dks|djdkrdS|d}||dsdS|jd|vrdS||jd}t|dks|djdkrdS|d}||dd|}|dSd} ||d d dkr4||d d|} | dS|| d sdS|jd} | |jvrdS|||||g} | r| | || |jdg||sdS|j | tj d|| g|jdg} d| _|j| dS)a& This pattern is from Keras model Fuse Gelu with Erf into one node: +------------------------------------------+ | | | v [root] --> Div -----> Erf --> Add --> Mul -->Mul (B=1.4142...) (A=1) (A=0.5) Note that constant input for Add and Mul could be first or second input: like either A=0.5 or B=0.5 is fine. rFrr$r%r+r&Nr'r(r)Sqrtg@r r,rT)r1r2r3r4r5r6r7rAr8r9r:r;r<r=r>r?r@) rrrrrBrCrDmulrE sqrt_noderFrJrKs rrzFusionGelu.fuse_2zs" ?1 %8 8 85&xq'9: x==A  !!4!=!=5  &&}a88 5   "*= = =5&}';A'>? x==A  !!4!=!=5  &&}c:: 5   "*= = =5&}';A'>? x==A  !!4!=!=5qk%4GHH ;5  # #Cu # = = B B))#vq:MNNI u**9c:: u1  * *5x sK  -  ! !) , , ,)).3:a=/K^`stt 5 ##N333[** 5577@P[^[efg[hZi+  ,    ,,,trc|jd|vrdS||jd}t|dks|djdkrdS|d}||dsdS|jd|vrdS||jd}t|dks|djdkrdS|d}||dsdS||dd|}|dS||dd }|dkrdSd|z } |j| } |jd|vrdS||jd}t|dks|djdkrdS|d} | jd| ks| jd| ksdS||||| g} || | jdg||sdS|j | tj d | | g| jdg } d | _|j| dS)a? This pattern is from TensorFlow model Fuse Gelu with Erf into one node: +----------------------------------------------+ | | | v [root] --> Mul -----> Erf --> Add --> Mul -->Mul (A=0.7071067690849304) (B=1) (B=0.5) Note that constant input for Add and Mul could be first or second input: like either A=0.5 or B=0.5 is fine. rFrr$r%r+Ng`?r(r)r r,rTr0)rrrrrBrCrH first_muliroot_input_indexrFlast_mulrJrKs rrzFusionGelu.fuse_3s$ ?1 %8 8 85&xq'9: x==A  !!4!=!=5  &&}a88 5   "*= = =5&}';A'>? x==A  !!4!=!=5A;&&x55 5%%hq:MNN  5  $ $Y0B% $ P P q555q5")9: ?1 %8 8 85&xq'9: x==A  !!4!=!=5A;q!^33x~a7HN7Z7Z5#X}hQ))  _Q        5 ##N333[** 5577@P[c[jkl[mZn+  ,    ,,,tr)r r)rrrrrr)rrrrrrr!r") __name__ __module__ __qualname__rr rrr __classcell__)rs@rr r s//////<<<<"UUUUnJJJJXJJJJJJJJrr ) __future__rr; onnx_modelrfusionrr rrr]s #""""" """"""BBBBBBBBBBr