tj< dZddlmZddlmZddlmZedeGdd eZd gZd S) zPvt model configuration)strict)PreTrainedConfig)auto_docstringzXrenya/pvt-tiny-224) checkpointc<eZdZUdZdZdZeeezeeefze d<dZ ee d<dZ ee d<d Z eeeed fze d <d Z eeeed fze d <dZeeeed fze d<dZeeeed fze d<dZeeeed fze d<dZeeeed fze d<dZeeeed fze d<dZee d<dZeeze d<dZeeze d<dZee d<dZeeze d<dZee d <d!Zee d"<d#Zee d$<d%S)& PvtConfiga num_encoder_blocks (`int`, *optional*, defaults to 4): The number of encoder blocks (i.e. stages in the Mix Transformer encoder). depths (`list[int]`, *optional*, defaults to `[2, 2, 2, 2]`): The number of layers in each encoder block. sequence_reduction_ratios (`list[int]`, *optional*, defaults to `[8, 4, 2, 1]`): Sequence reduction ratios in each encoder block. patch_sizes (`list[int]`, *optional*, defaults to `[4, 2, 2, 2]`): Patch size before each encoder block. strides (`list[int]`, *optional*, defaults to `[4, 2, 2, 2]`): Stride before each encoder block. num_attention_heads (`list[int]`, *optional*, defaults to `[1, 2, 5, 8]`): Number of attention heads for each attention layer in each block of the Transformer encoder. mlp_ratios (`list[int]`, *optional*, defaults to `[8, 8, 4, 4]`): Ratio of the size of the hidden layer compared to the size of the input layer of the Mix FFNs in the encoder blocks. num_labels ('int', *optional*, defaults to 1000): The number of classes. Example: ```python >>> from transformers import PvtModel, PvtConfig >>> # Initializing a PVT Xrenya/pvt-tiny-224 style configuration >>> configuration = PvtConfig() >>> # Initializing a model from the Xrenya/pvt-tiny-224 style configuration >>> model = PvtModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```pvt image_sizer num_channelsnum_encoder_blocks)rrr.depths)rrsequence_reduction_ratios)@i@i hidden_sizes)rrrr patch_sizesstrides)rrrnum_attention_heads)rrrr mlp_ratiosgelu hidden_actghidden_dropout_probattention_probs_dropout_probg{Gz?initializer_rangedrop_path_rategư>layer_norm_epsTqkv_biasi num_labelsN)__name__ __module__ __qualname____doc__ model_typer intlisttuple__annotations__r rrrrrrrrrstrrfloatr r!r"r#r$boolr%g/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/pvt/configuration_pvt.pyr r s   DJ47Jd3i%S/1777L#*6FDIc3h '666=ItCy5c?:III0CL$s)eCHo-CCC/;KcU38_,;;;+7GT#YsCx (7777CcU38_4CCC.:JS E#s(O+:::J'****03 %#+333#u###"%NECK%%% NE   HdJr3r N) r)huggingface_hub.dataclassesrconfiguration_utilsrutilsrr __all__r2r3r4r9s ......333333######011166666 66216r -r3