tjZdZddlmZddlmZddlmZmZddlm Z m Z ej e Z ed eGd d eZed eGd d eZed eGddeZgdZdS)zIdefics2 model configuration)strict)PreTrainedConfig)auto_docstringlogging)CONFIG_MAPPING AutoConfigzHuggingFaceM4/idefics2-8b) checkpointc eZdZUdZdZdZdZeed<dZ eed<dZ eed <dZ eed <d Z eed <d Z eeezeeefzed<dZeeezeeefzed<dZeed<dZeed<dZeezed<dZeed<dS)Idefics2VisionConfiga Example: ```python >>> from transformers.models.idefics2.modeling_idefics2 import Idefics2VisionTransformer >>> from transformers.models.idefics2.configuration_idefics2 import Idefics2VisionConfig >>> # Initializing a Idefics2VisionConfig with google/siglip-base-patch16-224 style configuration >>> configuration = Idefics2VisionConfig() >>> # Initializing a Idefics2VisionTransformer (with random weights) from the google/siglip-base-patch16-224 style configuration >>> model = Idefics2VisionTransformer(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```idefics2_vision vision_configi hidden_sizei intermediate_size num_hidden_layersnum_attention_headsr num_channels image_size patch_sizegelu_pytorch_tanh hidden_actư>layer_norm_epsattention_dropout{Gz?initializer_rangeN)__name__ __module__ __qualname____doc__ model_typebase_config_keyrint__annotations__rrrrrlisttuplerrstrrfloatrr!q/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/idefics2/configuration_idefics2.pyr r s   "#J%OK!s!!!s!!!!L#47Jd3i%S/177746Jd3i%S/1666)J))) NE   %(us{(((#u#####r/r ceZdZUdZdZdZeed<dZe ed<dZ e ed<d Z e ed <d Z e ed <d Ze ed<dZe ed<dZe ed<dZe e zed<dZe ed<dZdS)Idefics2PerceiverConfigaX resampler_n_latents (`int`, *optional*, defaults to 64): Number of latent embeddings to resample ("compress") the input sequence to (usually < 128). resampler_depth (`int`, *optional*, defaults to 3): Depth of the Perceiver Resampler (Transformer w/ cross attention). Should be shallow (<= 3). resampler_n_heads (`int`, *optional*, defaults to 16): Number of heads in each Transformer block (for multi-headed self-attention). resampler_head_dim (`int`, *optional*, defaults to 96): Dimensionality of each head projection in the Transformer block. idefics2_perceiversilurirr rms_norm_eps@resampler_n_latentsrresampler_depthresampler_n_heads`resampler_head_dimnum_key_value_headsrrr r!cd|j|jkrtd|jd|jdS)zOPart of `@strict`-powered validation. Validates the architecture of the config.znum_key_value_heads=z1 must be less than or equal to resampler_n_heads=N)r>r: ValueError)selfs r0validate_architecturez-Idefics2PerceiverConfig.validate_architectureXsQ  #d&< < <?t'???&*&<??  = rr!rBr.r/r0r2r2=s  &JJKL%!!!!OSs        %(us{(((#u###r/r2ceZdZUdZdZeeedZdZ e e d<dZ e e d<dZe e d <d Zeezd ze d <d Zeezd ze d <d Zeezd ze d <fdZxZS)Idefics2Configa perceiver_config (`IdeficsPerceiverConfig` or `dict`, *optional*): Custom perceiver config or dict Example: ```python >>> from transformers import Idefics2Model, Idefics2Config >>> # Initializing configuration >>> configuration = Idefics2Config() >>> # Initializing a model from the configuration >>> model = Idefics2Model(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```idefics2) text_configperceiver_configrT use_cachei}image_token_idFtie_word_embeddingsNrrGrFc |j.t|_tdn0t |jt rtd i|j|_|j.t|_tdn0t |jt rtd i|j|_t |jt rK|j dd|jd<t|jdd i|j|_n>|j7tdtdddd |_|jj |jj krF|jj |j_ |jj |j_ t d tjd i|dS) Nz7perciver_config is None, using default perceiver configz2vision_config is None, using default vision configr&mistralz.text_config is None, using default text configigh㈵>r)max_position_embeddingsr5 pad_token_idzPerceiver config has a different `hidden_size` than text config, which means default values were used. In your model's config on the hub, add `hidden_size` and `rms_norm_eps` keys under the `perceiver_config` dict. r.)rGr2loggerinfo isinstancedictrr rFgetr rr5 warning_oncesuper __post_init__)rAkwargs __class__s r0rVzIdefics2Config.__post_init__s  ($;$=$=D ! KKQ R R R R -t 4 4 U$;$T$Td>S$T$TD !   %!5!7!7D  KKL M M M M *D 1 1 L!5!K!K8J!K!KD  d& - - -1-=-A-A,PY-Z-ZD \ *-d.>|.LMaaPTP`aaD     % KKH I I I-i8(0!    D    '4+@+L L L040@0LD ! -151A1ND ! .   C    '''''''r/)r"r#r$r%r&r r2r sub_configsrHboolr)rIr(rJrrRrrGrFrV __classcell__)rXs@r0rDrDas   J!3-K It NC   %%%%48M4**T18887;d--4;;;26K((4/666!(!(!(!(!(!(!(!(!(r/rD)rDr2r N)r%huggingface_hub.dataclassesrconfiguration_utilsrutilsrrautor r get_loggerr"rOr r2rD__all__r.r/r0rbsz#"......333333,,,,,,,,--------  H % %6777$$$$$+$$87$D6777.87D6777?(?(?(?(?(%?(?(87?(D P O Or/