Ph@|dZddlZddlmZddlmZmZmZmZddl Z ddl m Z ddl m Z ddl mZmZmZdd lmZdd lmZdd lmZdd lmZmZmZmZdd lmZmZddlm Z ddl!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'ddl(m)Z)ddl*m+Z+m,Z,m-Z-e&j\e/Z0dSde jbde jddee3fdZ4 dTde jjde jdde jlde3fdZ7dTdZ8ee$dGdde"Z9ee$d Gd!d"e"Z:Gd#d$e jvZ< dUd%e jvd&e jbd'e jbd(e jbd)ee jbd*e=d+e=fd,Z>Gd-d.e jvZ?Gd/d0e jvZ@Gd1d2eZAGd3d4e jvZBGd5d6e jvZCGd7d8e jvZDGd9d:e jvZEGd;deZGGd?d@e jvZHe$GdAdBeZIGdCdDeIZJGdEdFeIZKe$dGGdHdIeIeZLGdJdKe jvZMe$dLGdMdNeIZNe$dOGdPdQeIeZOgdRZPy)VzPyTorch KOSMOS-2 model.N) dataclass)AnyCallableOptionalUnion)nn)ACT2FN)Cache DynamicCacheEncoderDecoderCache)GenerationMixin)FlashAttentionKwargs)GradientCheckpointingLayer)BaseModelOutput)BaseModelOutputWithPastAndCrossAttentionsBaseModelOutputWithPooling!CausalLMOutputWithCrossAttentions)ALL_ATTENTION_FUNCTIONSPreTrainedModel)Unpack) ModelOutputTransformersKwargsauto_docstringcan_return_tuplelogging torch_int)deprecate_kwarg) Kosmos2ConfigKosmos2TextConfigKosmos2VisionConfigmaskdtypetgt_lenc2|j\}}||n|}|ddddddfj|d||j|}d|z }|j|jtj t j |jS)z_ Expands attention_mask from `[bsz, seq_len]` to `[bsz, 1, tgt_seq_len, src_seq_len]`. Nr?)sizeexpandto masked_filltorchboolfinfomin)r#r$r%bszsrc_len expanded_mask inverted_masks f/var/www/html/saasai/venv/lib/python3.12/site-packages/transformers/models/kosmos2/modeling_kosmos2.py _expand_maskr5-s99;LC ,g'GD$)*11#q'7KNNuUM-'M  $ $]%5%5ejj%A5;;uCUCYCY ZZinput_ids_shapedevicepast_key_values_lengthc|\}}tj||ftj|j|}tj|j d|}|j ||dzj|j ddkd|j|}|dkDr0tjtj|||||gd}|ddddddfj|d|||zS)zB Make causal mask used for bi-directional self-attention. )r8rrr$r8dimN) r,fullr.r/aranger( masked_fill_viewr*catzerosr))r7r$r8r9r0r%r# mask_conds r4_make_causal_maskrF;s #LC ::w(%++e*<*@*@ PD TYYr]6:Ii9q="6"6tyy}a"HH!L 775>D!yy%++g/EU[abdhioqr dAq ! ( (a'DZ:Z [[r6c|j|j}tj|dj ||z|z}|j |zS)a Replace non-padding symbols with their position numbers. Position numbers begin at padding_idx+1. Padding symbols are ignored. This is modified from fairseq's `utils.make_positions`. Args: x: torch.Tensor x: Returns: torch.Tensor rr=)neintr,cumsumtype_aslong) input_ids padding_idxr9r#incremental_indicess r4"create_position_ids_from_input_idsrPMsW << $ ( ( *D <<!4<