tjJdZddlmZddlmZddlmZmZeje Z edeGdd eZ edeGd d eZ edeGd d eZ gdZdS)zBridgeTower model configuration)strict)PreTrainedConfig)auto_docstringloggingzBridgeTower/bridgetower-base) checkpointceZdZUdZdZdZdZeed<dZ eed<dZ eed <d Z ee eze eefzed <d Zee eze eefzed <dZeezed<dZeed<dZeed<dZeed<dZeed<dS)BridgeTowerVisionConfiga stop_gradient (`bool`, *optional*, defaults to `False`): Whether to stop gradient for training. share_layernorm (`bool`, *optional*, defaults to `True`): Whether LayerNorm layers are shared. remove_last_layer (`bool`, *optional*, defaults to `False`): Whether to remove the last layer from the vision encoder. Example: ```python >>> from transformers import BridgeTowerVisionConfig >>> # Initializing a BridgeTower BridgeTower/bridgetower-base style configuration for the vision model >>> configuration = BridgeTowerVisionConfig() >>> # Accessing the configuration >>> configuration ```bridgetower_vision_model vision_config hidden_size num_hidden_layersr num_channels patch_sizei  image_sizeinitializer_factorh㈵>layer_norm_epsF stop_gradientTshare_layernormremove_last_layerN)__name__ __module__ __qualname____doc__ model_typebase_config_keyrint__annotations__rrrlisttuplerrfloatrrboolrrw/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/bridgetower/configuration_bridgetower.pyr r s  (,J%OKsL#46Jd3i%S/166647Jd3i%S/1777&' '''!NE!!!M4 OT   #t#####r)r cNeZdZUdZdZdZdZeed<dZ eed<dZ eed <dZ eed <d Z e ezed <d Zeed<dZeed<dZe ezed<dZe ezed<dZeed<d Zeed<dZe ed<d Zedzed<dZedzed<dZeeezdzed<dZeed <d!Zeed"<d!Zeed#<dS)$BridgeTowerTextConfiga2 Example: ```python >>> from transformers import BridgeTowerTextConfig >>> # Initializing a BridgeTower BridgeTower/bridgetower-base style configuration for the text model >>> configuration = BridgeTowerTextConfig() >>> # Accessing the configuration >>> configuration ```bridgetower_text_model text_configiY vocab_sizer rrrnum_attention_headsrri intermediate_sizegelu hidden_actg?hidden_dropout_probattention_probs_dropout_probimax_position_embeddingstype_vocab_sizerrN pad_token_idr bos_token_id eos_token_idT use_cacheF is_decoderadd_cross_attention)rrrrr r!r/r"r#rrr0rr&r1r3strr4r5r6r7rr8r9r;r$r<r'r=r>r(r)r*r,r,?sq   *J#OJKs!!!!&' '''!s!!!J'****03 %#+333#&S&&&OS!NE!!! L#*    L#*   +,L#S /D(,,,ItJ %%%%%%r)r,ceZdZUdZdZeedZdZe e d<dZ e e d<dZ ee d <d Zeeze d <d Zee d <dZe e d<dZe e d<dZee d<dZee d<dZe e d<dZe e d<dZeezdze d<dZeezdze d<fdZxZS)BridgeTowerConfiga share_cross_modal_transformer_layers (`bool`, *optional*, defaults to `True`): Whether cross modal transformer layers are shared. share_link_tower_layers (`bool`, *optional*, defaults to `False`): Whether the bride/link tower layers are shared. link_tower_type (`str`, *optional*, defaults to `"add"`): Type of the bridge/link layer. init_layernorm_from_vision_encoder (`bool`, *optional*, defaults to `False`): Whether to init LayerNorm from the vision encoder. Example: ```python >>> from transformers import BridgeTowerModel, BridgeTowerConfig >>> # Initializing a BridgeTower BridgeTower/bridgetower-base style configuration >>> configuration = BridgeTowerConfig() >>> # Initializing a model from the BridgeTower/bridgetower-base style configuration >>> model = BridgeTowerModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` bridgetower)r.r T$share_cross_modal_transformer_layersr2r3r rrrrrFshare_link_tower_layersaddlink_tower_typerr0rtie_word_embeddings"init_layernorm_from_vision_encoderNr.r c &|dd}|dd}|j.t|_tdn0t |jt rtdi|j|_|j.t|_tdn0t |jt rtdi|j|_tj di|dS)Ntext_config_dictvision_config_dictzV`text_config` is `None`. initializing the `BridgeTowerTextConfig` with default values.zZ`vision_config` is `None`. initializing the `BridgeTowerVisionConfig` with default values.r() popr.r,loggerinfo isinstancedictr r super __post_init__)selfkwargs_ __class__s r*rSzBridgeTowerConfig.__post_init__s JJ)4 0 0 JJ+T 2 2   #466D  KKp q q q q ($ / / I4HHt7GHHD    %!8!:!:D  KKt u u u u *D 1 1 O!8!N!N4;M!N!ND '''''''r))rrrrr r,r sub_configsrCr'r#r3r?rr"rr&rrDrFr0rrHrIr.rQrr rS __classcell__)rWs@r*rArAfsJ  2J"7JabbK15($555JK&' '''!NE!!!$)T))) OS   !!!!s %%%%/4&44426K((4/66648M4**T1888(((((((((r)rA)rAr,r N)rhuggingface_hub.dataclassesrconfiguration_utilsrutilsrr get_loggerrrNr r,rA__all__r(r)r*r_sb&%......333333,,,,,,,,  H % %9:::!$!$!$!$!$.!$!$;:!$H9:::"&"&"&"&"&,"&"&;:"&J9:::<(<(<(<(<((<(<(;:<(~ T S Sr)