tjdZddlmZddlmZddlmZddlmZedeGd d eeZ d gZ d S) zFocalNet model configuration)strict)BackboneConfigMixin)PreTrainedConfig)auto_docstringzmicrosoft/focalnet-tiny) checkpointcreZdZUdZdZdZeeezeeefze d<dZ eeezeeefze d<dZ ee d<d Z ee d <d Z ee d <d Zeeeedfze d<dZeeeedfze d<dZeeeedfze d<dZeeeedfze d<dZee d<dZee d<dZeeze d<dZeeze d<d Zee d<dZee d <d Zee d!<d Zee d"<d Zee d#<d$Zee d%<d&Zee d'<d(Z ee d)<d*Z!eed*ze d+<d*Z"eed*ze d,<fd-Z#xZ$S).FocalNetConfiga use_conv_embed (`bool`, *optional*, defaults to `False`): Whether to use convolutional embedding. The authors noted that using convolutional embedding usually improve the performance, but it's not used by default. focal_levels (`list(int)`, *optional*, defaults to `[2, 2, 2, 2]`): Number of focal levels in each layer of the respective stages in the encoder. focal_windows (`list(int)`, *optional*, defaults to `[3, 3, 3, 3]`): Focal window size in each layer of the respective stages in the encoder. hidden_dropout_prob (`float`, *optional*, defaults to 0.0): The dropout probability for all fully connected layers in the embeddings and encoder. use_layerscale (`bool`, *optional*, defaults to `False`): Whether to use layer scale in the encoder. layerscale_value (`float`, *optional*, defaults to 0.0001): The initial value of the layer scale. use_post_layernorm (`bool`, *optional*, defaults to `False`): Whether to use post layer normalization in the encoder. use_post_layernorm_in_modulation (`bool`, *optional*, defaults to `False`): Whether to use post layer normalization in the modulation layer. normalize_modulator (`bool`, *optional*, defaults to `False`): Whether to normalize the modulator. encoder_stride (`int`, *optional*, defaults to 32): Factor to increase the spatial resolution by in the decoder head for masked image modeling. Example: ```python >>> from transformers import FocalNetConfig, FocalNetModel >>> # Initializing a FocalNet microsoft/focalnet-tiny style configuration >>> configuration = FocalNetConfig() >>> # Initializing a model (with random weights) from the microsoft/focalnet-tiny style configuration >>> model = FocalNetModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```focalnet image_size patch_sizer num_channels` embed_dimFuse_conv_embed)ir. hidden_sizes)rrdepths)rrrr focal_levels)rrrr focal_windowsgelu hidden_actg@ mlp_ratioghidden_dropout_probg?drop_path_rateuse_layerscaleg-C6?layerscale_valueuse_post_layernorm use_post_layernorm_in_modulationnormalize_modulatorg{Gz?initializer_rangegh㈵>layer_norm_eps encoder_strideN _out_features _out_indicesc (dgdtdt|jdzDz|_||dd|ddt jdi|dS)Nstemcg|]}d|S)stage).0idxs q/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/focalnet/configuration_focalnet.py z0FocalNetConfig.__post_init__..[s&_&_&_}s}}&_&_&_ out_indices out_features)r7r8r0)rangelenr stage_names"set_output_features_output_indicespopsuper __post_init__)selfkwargs __class__s r3r?zFocalNetConfig.__post_init__Zs"8&_&_aT[IYIY\]I]@^@^&_&_&__ // =$77fjjQ_aeFfFf 0    '''''''r5)%__name__ __module__ __qualname____doc__ model_typer intlisttuple__annotations__rrrrboolrrrrrstrrfloatrr r!r"r#r$r%r&r'r)r*r+r? __classcell__)rBs@r3r r sJ$ $ LJ47Jd3i%S/177745Jd3i%S/1555L#Is ND   0DL$s)eCHo-DDD*6FDIc3h '6660rUs#"......111111333333######4555F(F(F(F(F((*:F(F(65F(R  r5