tjdZddlmZddlmZddlmZddlmZm Z e j e Z edeGd d eZ edeGd d eZd d gZd S)zchameleon model configuration)strict)PreTrainedConfig)RopeParameters)auto_docstringloggingzfacebook/chameleon-7b) checkpointceZdZUdZdZdZdZeed<dZ eed<dZ e ed <dZ eed <d Z eed <d Zeed<dZeed<dZeeeedfzed<dZeed<dZeedzed<dZeezed<dZeed<dZdS)ChameleonVQVAEConfiga resolution (`int`, *optional*, defaults to 512): Resolution of the input images. base_channels (`int`, *optional*, defaults to 128): Base channel count. channel_multiplier (`list[int]`, *optional*, defaults to `[1, 1, 2, 2, 4]`): Channel multipliers for each resolution. num_res_blocks (`int`, *optional*, defaults to 2): Number of residual blocks. attn_resolutions (`list[int]`, *optional*): Resolutions to apply attention. dropout (`float`, *optional*, defaults to 0.0): Dropout rate. attn_type (`str`, *optional*, defaults to `"vanilla"`): Attention type used in VQ-GAN encoder. Can be "vanilla" or None chameleon_vqgan vq_config embed_dimi num_embeddingsF double_latentlatent_channelsi resolutionr in_channels base_channels)rr.channel_multiplierrnum_res_blocksNattn_resolutionsdropoutvanilla attn_type{Gz?)__name__ __module__ __qualname____doc__ model_typebase_config_keyrint__annotations__rrboolrrrrrlisttuplerrrfloatr strinitializer_ranges/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/chameleon/configuration_chameleon.pyr r s"#J!OIsNCM4OSJKM36ES E#s(O3EEENC)-d3i$&---GUS[Isr1r ceZdZUdZdZdeiZdgZdZe e d<dZ e e d<d Z e e d <d Z e e d <d Ze e d <d Ze dze d<dZee d<dZe e d<dZee d<dZee d<dZee d<dZe dze d<dZe dze d<dZe ee zdze d<dZee d<dZeezdze d <dZ edze d!<d"Z!ee zdze d#<dZ"e dze d$<dZ#edze d%<dZ$ee%zdze d<dZ&edze d&<dZ'ee d'<fd(Z(xZ)S))ChameleonConfiga model_parallel_size (`int`, *optional*, defaults to 1): Number of shards used when training the model. This will be used in qk layernorm because the original Chameleon inference doesn't do reduction in those layers and each rank has its own biases. swin_norm (`bool`, *optional*, defaults to `False`): Use Swin Transformer normalization. vocabulary_map (`dict`, *optional*): A dictionary containing the vocabulary map from the tokenizer. Used to obtain tokens from the image inputs. ```python >>> from transformers import ChameleonModel, ChameleonConfig >>> # Initializing a chameleon chameleon-7b style configuration >>> configuration = ChameleonConfig() >>> # Initializing a model from the chameleon-7b style configuration >>> model = ChameleonModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` chameleonr past_key_valuesi vocab_sizei hidden_sizei+intermediate_size num_hidden_layersnum_attention_headsNnum_key_value_headssilu hidden_actmax_position_embeddingsr!r/gh㈵> rms_norm_epsT use_cache pad_token_idr bos_token_idr eos_token_idFtie_word_embeddingsrope_parametersattention_biasrattention_dropoutmodel_parallel_size swin_normvocabulary_mapmlp_biasc T|j.tdt|_n0t |jt rtdi|j|_|j|jdnd|_tj di|dS)NzJvq_config is None. initializing the ChameleonVQConfig with default values.zr0) r loggerinfor isinstancedictrLgetimage_token_idsuper __post_init__)selfkwargs __class__s r2rVzChameleonConfig.__post_init__vs > ! KKd e e e133DNN  - - D1CCDNCCDNDHDWDcd155i@@@im'''''''r1)*r"r#r$r%r&r sub_configskeys_to_ignore_at_inferencer7r(r)r8r9r;r<r=r?r.r@r/r-rArBr*rCrDrEr+rFrGrrRrHrIrJrKr rrLrMrV __classcell__)rYs@r2r4r4@s.J 45K#4"5JK"s"""s!!!!&(t(((J#'S'''#u###L%It#L#*### L#*   +,L#S /D(,,, %%%%48O^d*T1888"'ND4K''',/us{T)///&'t'''"Itd{"""04It&&-444"&ND4K&&&Hd ( ( ( ( ( ( ( ( (r1r4N)r%huggingface_hub.dataclassesrconfiguration_utilsrmodeling_rope_utilsrutilsrr get_loggerr"rOr r4__all__r0r1r2rcs"$#......333333111111,,,,,,,,  H % %2333!!!!!+!!43!H2333=(=(=(=(=(&=(=(43=(@ 4 5r1