PhNdZddlmZmZGddedZGddeZdgZy ) z Processor class for Bros. )ProcessingKwargsProcessorMixinc &eZdZddddddddddiZy)BrosProcessorKwargs text_kwargsTF)add_special_tokenspaddingstridereturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverboseN)__name__ __module__ __qualname__ _defaultsb/var/www/html/saasai/venv/lib/python3.12/site-packages/transformers/models/bros/processing_bros.pyrrs)"&).*/&+"   IrrF)totalc2eZdZdZdgZdZeZdfd ZxZ S) BrosProcessora Constructs a Bros processor which wraps a BERT tokenizer. [`BrosProcessor`] offers all the functionalities of [`BertTokenizerFast`]. See the docstring of [`~BrosProcessor.__call__`] and [`~BrosProcessor.decode`] for more information. Args: tokenizer (`BertTokenizerFast`, *optional*): An instance of ['BertTokenizerFast`]. The tokenizer is a required input. tokenizer) BertTokenizerBertTokenizerFastc >| tdt| |y)Nz"You need to specify a `tokenizer`.) ValueErrorsuper__init__)selfrkwargs __class__s rr!zBrosProcessor.__init__5s"  AB B #r)N) rrr__doc__ attributestokenizer_classrvalid_processor_kwargsr! __classcell__)r$s@rrr%s& Jr,s5A *% $N$.  r