tj dZddlmZddlmZddlmZedeGdd eZd gZd S) zCANINE model configuration)strict)PreTrainedConfig)auto_docstringzgoogle/canine-s) checkpointcReZdZUdZdZdZeed<dZeed<dZ eed<dZ eed <d Z e ed <d Z eezed <d Zeezed<dZeed<dZeed<dZeed<dZeed<dZedzed<dZedzed<dZeeezdzed<dZeed<dZeed <d!Zeed"<dZeed#<d$Zeed%<dS)& CanineConfiga. downsampling_rate (`int`, *optional*, defaults to 4): The rate at which to downsample the original character sequence length before applying the deep Transformer encoder. upsampling_kernel_size (`int`, *optional*, defaults to 4): The kernel size (i.e. the number of characters in each window) of the convolutional projection layer when projecting back from `hidden_size`*2 to `hidden_size`. num_hash_functions (`int`, *optional*, defaults to 8): The number of hash functions to use. Each hash function has its own embedding matrix. num_hash_buckets (`int`, *optional*, defaults to 16384): The number of hash buckets to use. local_transformer_stride (`int`, *optional*, defaults to 128): The stride of the local attention of the first shallow Transformer encoder. Defaults to 128 for good TPU/XLA memory alignment. Example: ```python >>> from transformers import CanineConfig, CanineModel >>> # Initializing a CANINE google/canine-s style configuration >>> configuration = CanineConfig() >>> # Initializing a model (with random weights) from the google/canine-s style configuration >>> model = CanineModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```caninei hidden_size num_hidden_layersnum_attention_headsi intermediate_sizegelu hidden_actg?hidden_dropout_probattention_probs_dropout_probi@max_position_embeddingstype_vocab_sizeg{Gz?initializer_rangeg-q=layer_norm_epsrN pad_token_idi bos_token_idi eos_token_iddownsampling_rateupsampling_kernel_sizenum_hash_functionsnum_hash_bucketslocal_transformer_stride)__name__ __module__ __qualname____doc__ model_typer int__annotations__r rrrstrrfloatrrrrrrrrlistrrr r!r#m/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/models/canine/configuration_canine.pyr r s|  <JKs!!!!!s!!!J'****03 %#+333#(S(((OS#u###!NE!!! L#*   %L#*%%%+1L#S /D(111s"#C###!c!!!$'c'''''r/r N) r'huggingface_hub.dataclassesrconfiguration_utilsrutilsrr __all__r.r/r0r5s! ......333333######,---3(3(3(3(3(#3(3(.-3(l  r/