@UVF
v22
$C '55<<> 9j$ /: = ? )).9K{''{// "
s
C
CCc X \ rS rSrSrS r\\" \5 S 5 5 r \
SS j5 r Sr g)
AutoProcessor a
This is a generic processor class that will be instantiated as one of the processor classes of the library when
created with the [`AutoProcessor.from_pretrained`] class method.
This class cannot be instantiated directly using `__init__()` (throws an error).
c [ S5 e)Nz}AutoProcessor is designed to be instantiated using the `AutoProcessor.from_pretrained(pretrained_model_name_or_path)` method.)OSError)selfs r __init__AutoProcessor.__init__ s
_
c UR SS5 nUb< [ R " S[ 5 UR S5 b [ S5 eX2S' UR SS5 nUR SS5 nSUS ' SnSn[ R " [ 5 R Vs0 sH oU; d M
XU _M n nU R S
S
S
S .5 [ U[ 40 U D6n
U
bI [ R " U40 UD6u pU R S S5 nS
U R S0 5 ; a U S S
nUGc [ U[ 40 U D6n
U
bI [ R " U40 UD6u pU R S S5 nS
U R S0 5 ; a U S S
nU
c] [ U[" 40 U D6n
U
bI [$ R& " U40 UD6u pU R S S5 nS
U R S0 5 ; a U S S
nU
c` [ U[ 40 U D6n
U
bL UcI [( R* " U40 UD6u pU R S S5 nS
U R S0 5 ; a U S S
nUcm [ U[, 40 U D6nUbY [/ USS9 n[0 R2 " U5 n SSS5 W R S S5 nS
U R S0 5 ; a U S S
nUck [5 U[6 5 ( d [8 R: " U4SU0UD6n[= US S5 n[? US5 ( a S
UR@ ; a UR@ S
nUb [C U5 nUSLnUSL=( d [E U5 [F ; nU( a+ SU; a URI S5 S nOSn[K XQUUU5 nU( aJ U( aC [M Xq40 UD6nUR SS5 n URO 5 UR: " U4SU0UD6$ Ub UR: " U4SU0UD6$ [E U5 [F ; a# [F [E U5 R: " U40 UD6$ [P R: " U4SU0UD6$ s snf ! , ( d f GN= f! [R aZ [T R: " U4SU0UD6s $ ! [R a Of = f [V R: " U4SU0UD6s $ ! [R a Of = ff = f[ SU S35 e)a7
Instantiate one of the processor classes of the library from a pretrained model vocabulary.
The processor class to instantiate is selected based on the `model_type` property of the config object (either
passed as an argument or loaded from `pretrained_model_name_or_path` if possible):
List options
Params:
pretrained_model_name_or_path (`str` or `os.PathLike`):
This can be either:
- a string, the *model id* of a pretrained feature_extractor hosted inside a model repo on
huggingface.co.
- a path to a *directory* containing a processor files saved using the `save_pretrained()` method,
e.g., `./my_model_directory/`.
cache_dir (`str` or `os.PathLike`, *optional*):
Path to a directory in which a downloaded pretrained model feature extractor should be cached if the
standard cache should not be used.
force_download (`bool`, *optional*, defaults to `False`):
Whether or not to force to (re-)download the feature extractor files and override the cached versions
if they exist.
resume_download:
Deprecated and ignored. All downloads are now resumed by default when possible.
Will be removed in v5 of Transformers.
proxies (`dict[str, str]`, *optional*):
A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128',
'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request.
token (`str` or *bool*, *optional*):
The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated
when running `hf auth login` (stored in `~/.huggingface`).
revision (`str`, *optional*, defaults to `"main"`):
The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a
git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any
identifier allowed by git.
return_unused_kwargs (`bool`, *optional*, defaults to `False`):
If `False`, then this function returns just the final feature extractor object. If `True`, then this
functions returns a `Tuple(feature_extractor, unused_kwargs)` where *unused_kwargs* is a dictionary
consisting of the key/value pairs whose keys are not feature extractor attributes: i.e., the part of
`kwargs` which has not been used to update `feature_extractor` and is otherwise ignored.
trust_remote_code (`bool`, *optional*, defaults to `False`):
Whether or not to allow for custom models defined on the Hub in their own modeling files. This option
should only be set to `True` for repositories you trust and in which you have read the code, as it will
execute code present on the Hub on your local machine.
kwargs (`dict[str, Any]`, *optional*):
The values in kwargs of any keys which are feature extractor attributes will be used to override the
loaded values. Behavior concerning key/value pairs whose keys are *not* feature extractor attributes is
controlled by the `return_unused_kwargs` keyword parameter.
Passing `token=True` is required when you want to use a private model.
Examples:
```python
>>> from transformers import AutoProcessor
>>> # Download processor from huggingface.co and cache.
>>> processor = AutoProcessor.from_pretrained("facebook/wav2vec2-base-960h")
>>> # If processor files are in a directory (e.g. processor was saved using *save_pretrained('./test/saved_model/')*)
>>> # processor = AutoProcessor.from_pretrained("./test/saved_model/")
```use_auth_tokenNzrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.tokenzV`token` and `use_auth_token` are both specified. Please set only the argument `token`.configtrust_remote_codeT
_from_autoF) _raise_exceptions_for_gated_repo%_raise_exceptions_for_missing_entries'_raise_exceptions_for_connection_errorsprocessor_classr auto_mapzutf-8)encodingz--r
code_revisionz!Unrecognized processing class in z. Can't instantiate a processor, a tokenizer, an image processor or a feature extractor for this model. Make sure the repository contains the files of at least one of those processing classes.),popwarningswarn
FutureWarningget
ValueErrorinspect signaturer
parametersupdater
r
get_processor_dictr r get_image_processor_dictr r get_video_processor_dictr get_feature_extractor_dictr openjsonload
isinstancer r from_pretrainedr r r r typer splitr r register_for_auto_classr Exceptionr r )cls pretrained_model_name_or_pathkwargsr r r r processor_auto_mapkeycached_file_kwargsprocessor_config_file config_dict_preprocessor_config_filetokenizer_config_filereaderhas_remote_codehas_local_code
upstream_repos r r AutoProcessor.from_pretrained s J $4d; % MM E
zz'". l -7OHd+ "JJ':D A #| ! ;B:K:KK:X:c:c u:c3ntgt .c#; .:c u!!499>;@
!,,I> p]o p , + > >?\ g`f gNK )oo.? FO +//*b"AA%0%<_%M" "'2-/E(I[( $ (3!5!N!NOl!wpv!w "-//2CT"J"kooj"&EE)4Z)@ )Q& (/+613G,K],( ,7%7%P%P5&9?&NK '2oo6G&NO&+//*b*II-8-D_-U* (/+613I,M_,( ,7Oq A
$
9!.Racp! 0 ;" EK O
?D1A 3 3 5"22-ARV\
("22-ARV\
&\ .
.$T&\2BBC`kdjk k 00-ARV\
e vz CBp
)991EVZ`
+;;1EVZ`
/0M/N OE
E
sl %Q
1 Q
3Q1Q!
Q !
S,RS
RSRSR30S3
S=S SSc , [ R XUS9 g)z
Register a new processor for this class.
Args:
config_class ([`PretrainedConfig`]):
The configuration corresponding to the model to register.
processor_class ([`ProcessorMixin`]): The processor to register.
)exist_okN)r register) config_classr r s r r AutoProcessor.register s ""<8"Tr N)F)
r
__module__ __qualname____firstlineno____doc__r classmethodr r r staticmethodr __static_attributes__r! r r r r sH
&'>?`
@ `
D U Ur r r )2r% r r r r collectionsr configuration_utilsr dynamic_module_utilsr r feature_extraction_utilsr image_processing_utilsr processing_utilsr
tokenization_utilsr utilsr r
r r r video_processing_utilsr auto_factoryr configuration_autor r r r feature_extraction_autor image_processing_autor tokenization_autor
get_loggerr loggerr r strr r __all__r! r r r; s # 4 \ > : . 7 g g 8 * : 5 ,
H %%df P %%9;RS # 0|U |U~
0r