tj-JdZddlmZddlmZddlmZmZeje Z edeGdd eZ edeGd d eZ edeGd d eZ gdZdS)zKOSMOS-2 model configuration)strict)PreTrainedConfig)auto_docstringloggingzmicrosoft/kosmos-2-patch14-224) checkpointc~eZdZUdZdZdgZddddZdZee d <d Z ee d <d Z ee d<d Z ee d<d Z ee d<dZee d<dZee d<dZeeze d<dZeeze d<dZeeze d<dZeeze d<dZee d<dZee d<dZee d<dZee d<dZee d<d Zed!ze d"<d#Zed!ze d$<d%Zeeezd!ze d&<d'Z ee d(<d!S))Kosmos2TextConfigkosmos_2_text_model text_configpast_key_valuesattention_heads embed_dimlayers)num_attention_heads hidden_sizenum_hidden_layersi vocab_sizeimax_position_embeddingsi ffn_dim geluactivation_functiong?dropoutattention_dropoutactivation_dropout layerdroph㈵>layer_norm_eps{Gz?init_stdTscale_embedding use_cachetie_word_embeddingsN pad_token_idr bos_token_id eos_token_idFadd_cross_attention)!__name__ __module__ __qualname__ model_typebase_config_keykeys_to_ignore_at_inference attribute_maprint__annotations__rrrrrrstrrfloatrrrr!r#r$boolr%r&r(r)r+listr,o/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/kosmos2/configuration_kosmos2.pyr r s'J#O#4"50"%M J#'S'''IsFCGSOS%%%%GUS[%(us{(((&) ))) Ius{    NE   He OT   It $$$$ L#*    L#*   +,L#S /D(,,, %%%%%%r;r ceZdZUdZdZdZeed<dZeed<dZ eed<d Z eed <d Z eed <d Z ee ezeeefzed<dZee ezeeefzed<dZeed<dZeed<dZeezed<dZeed<dZeed<dS)Kosmos2VisionConfigkosmos_2_vision_model vision_configiriintermediate_sizerrrr num_channels image_size patch_size quick_gelu hidden_actr r!rrr"initializer_rangeg?initializer_factorN)r-r.r/r0r1rr4r5rArrrCrEr9tuplerGrIr6r!r7rrJrKr:r;r<r>r>;s)J%OK!s!!!s!!!!L#47Jd3i%S/177746Jd3i%S/1666"J""" NE   %(us{(((#u### ######r;r>ceZdZUdZdZeedZdZe e zdze d<dZ e e zdze d<dZ ee d<d Zee d <fd ZxZS) Kosmos2Configaf latent_query_num (`int`, *optional*, defaults to 64): The number of latent query tokens that represent the image features used in the text decoder component. Example: ```python >>> from transformers import Kosmos2Config, Kosmos2Model >>> # Initializing a Kosmos-2 kosmos-2-patch14-224 style configuration >>> configuration = Kosmos2Config() >>> # Initializing a model (with random weights) from the kosmos-2-patch14-224 style configuration >>> model = Kosmos2Model(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```zkosmos-2)r r@Nr r@@latent_query_numTr&c |j.t|_tdn0t |jt rtdi|j|_|j.t|_tdn0t |jt rtdi|j|_tj di|dS)NzR`text_config` is `None`. initializing the `Kosmos2TextConfig` with default values.zV`vision_config` is `None`. initializing the `Kosmos2VisionConfig` with default values.r:) r r loggerinfo isinstancedictr@r>super __post_init__)selfkwargs __class__s r<rWzKosmos2Config.__post_init__ms   #022D  KKl m m m m ($ / / E0DD43CDDD    %!4!6!6D  KKp q q q q *D 1 1 K!4!J!Jt7I!J!JD '''''''r;)r-r.r/__doc__r0r r> sub_configsr rUrr5r@rPr4r&r8rW __classcell__)rZs@r<rNrNOs  &J"3FYZZK26K((4/66648M4**T1888c $$$$ ( ( ( ( ( ( ( ( (r;rN)rNr r>N)r[huggingface_hub.dataclassesrconfiguration_utilsrutilsrr get_loggerr-rRr r>rN__all__r:r;r<rcsa#"......333333,,,,,,,,  H % %;<<<&&&&&(&&=<&@;<<<$$$$$*$$=<$$;<<<)()()()()($)()(=<)(X H G Gr;