*flash_attention_forward..#s +{!8{szTensor query has shape with a zero dimension. FlashAttention does not support inputs with dim=0. Please check your input shapes or use SDPA instead._pre_quantization_dtypec3z# UH2n[U[RR5(dM.Uv M4 g7f)N) isinstancetorchnnLinear)rlayers rrr;s+j3C%zRWY^YaYaYhYhGi3Cs,; ; is_causal layer_idx) query_lengthr$r softmax_scalerruse_top_left_mask target_dtypeattn_implementationr%)getlogger warning_onceshapeany ValueError transposedtyper float32is_autocast_enabledget_autocast_gpu_dtypehasattrconfigrnextmodulesweightpoprr$_use_top_left_mask_attn_implementationr%) rr r r r r rrrkwargsseq_lenr) attn_outputs rflash_attention_forwardrAszz%u--K1H1T W kk!nG +u{{ +++ B  OOAq !E --1 C OOAq !EL {{emm#  $ $ & & 779L V]]$= > >!==@@Lj6>>3CjjqqwwL JJ{D!*     ""%,!"MM>>&-fk&B&B&"" K$  )gNNN)typingrr modeling_flash_attention_utilsrrutilsr get_logger__name__r,r<r!ModuleTensorfloatinttuplerArrBrrMs h   H %68#$(#D HHOOD <<D D << D U\\* D  De_DSMDe_D 5<< DrB