tjdZddlmZddlmZddlmZddlmZm Z ddl m Z m Z dd l mZmZdd lmZmZee ed Zee ed ZejeZGd d ZGddZddZddZddZdS)z0Auto exporter factory for HuggingFace exporters.) annotations)logging) HfExporter)ExportConfigMixin ExportFormat) DynamoConfigDynamoExporter)ExecutorchConfigExecutorchExporter) OnnxConfig OnnxExporter) executorchdynamoonnxc*eZdZdZeddZdS)AutoExportConfigz The Auto-HF export config class that takes care of automatically dispatching to the correct export config given an export config stored in a dictionary. export_config_dictdictc T|d}|tdt|tr|j}n|}|t vr9td|dt t t |}||S)N export_formatzHexport_config_dict must contain key 'export_format' set to exporter namezUnknown exporter type, got z - supported exporters are: ) get ValueError isinstancer valueAUTO_EXPORT_CONFIG_MAPPINGlistkeys from_dict)clsrrname target_clss Y/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/exporters/auto.pyr zAutoExportConfig.from_dict0s*..??  ghh h m\ 2 2 ! &DD D 1 1 1ydyyPTUoUtUtUvUvPwPwyy 05 ##$6777N)rr)__name__ __module__ __qualname____doc__ classmethodr r%r$rr*s> 888[888r%rcZeZdZdZeddZeddZedd Zd S)AutoHfExporterz The Auto-HF expoerter class that takes care of automatically instantiating to the correct `HfExporter` given the `ExportConfig`. export_configExportConfigMixin | dictreturnrc Bt|tr|n|}||s(t d|dt t d|d}t|tr|jn|}t |di|S)NzUnsupported export config: z. Registered exporters: .rr+) rrto_dictsupports_export_formatrsortedAUTO_EXPORTER_MAPPINGr r)r!r.kwargsrrr"s r$ from_configzAutoHfExporter.from_configLs9C=Rc8d8dw]22444jw))*<== J.@JJ)/0E)F)FJJJ  +?; &0 &M&M`}""S`$T*44V444r%HfExporter | Nonec  td)uC Load an exporter instance from a pretrained model/checkpoint that ships an export config. **Not implemented yet** — placeholder for a first-class "export recipe" workflow. The idea: model owners publish an ``export_config.json`` (or an ``export_config`` field in ``config.json``) alongside their weights on the Hub. That file captures the settings the owner has already validated for their architecture — the target format (``dynamo`` / ``onnx`` / ``executorch``), exact dynamic-shape specs (e.g. ``text_ids`` dynamic to 4096, image tiles fixed at 448, ``batch=1`` for edge deployment), ``strict`` flag, ONNX opset, prefill vs. decode layout, ExecuTorch backend choice, and any other knob that today lives as tribal knowledge in a README or a private notebook. Consumers then get the owner-validated export in one call:: exporter = AutoHfExporter.from_pretrained("org/model-name") program = exporter.export(model, inputs) Composes with the [`register_export_input_preparer`] registry: the owner supplies the shape spec via ``export_config.json``, transformers supplies the data-dependent precomputations (``cu_seqlens``, vision position ids, window indices, …) for that architecture. Together they cover the two hard parts of exporting new models — knowing the right shape contract and preparing the right inputs — so downstream users don't re-derive either from scratch (and don't break in production when they get it wrong). zAutoHfExporter.from_pretrained is not implemented yet. Load/export configs explicitly and call AutoHfExporter.from_config(...) instead.)NotImplementedError)r!pretrained_model_name_or_pathr7s r$from_pretrainedzAutoHfExporter.from_pretrainedZs6" _   r%rrboolc B|d}|2tdttddSt |t r|jn|}|tv}|tv}|sY|sWtd|dtttttzddS|s#td|d |d dS|s#td|d |d dSd S) aReturn True if the provided dict describes an ``export_format`` that has both a registered config class and a registered exporter class. Warns with an actionable message when the format is missing entirely, unknown, or only half-registered.rNuBNo 'export_format' key in export config — supported values are: z . Skipping.FzUnknown export format u — supported values are: zExport format z[ has a registered exporter but no config class. Register one via ``@register_export_config(z)``. Skipping.zV has a registered config class but no exporter. Register one via ``@register_exporter(T) rloggerwarningr5r6rr rrset)r export_fmtr" has_config has_exporters r$r4z%AutoHfExporter.supports_export_formatzs (++O<<   NN>/00>>>   5#-j,#G#GWzZ77 44  ,  NNeee#344s;U7V7VVWWeee   5  NNUUU>BUUU   5  NNPPP9=PPP   5tr%N)r.r/r0r)r0r9)rrr0r>) r&r'r(r)r*r8r= staticmethodr4r+r%r$r-r-Fs~  5 5 5[ 5   [ >"""\"""r%r-r"strcfd}|S)Nctvrtddt|tst d|t<|S)Nz Exporter '0' is already registered and will be overwritten.zExporter must extend HfExporter)r6r@rA issubclassr TypeErrorr!r"s r$register_exporter_fnz/register_exporter..register_exporter_fns^ ( ( ( NN^^^^ _ _ _#z** ?=>> >&)d# r%r+)r"rNs` r$register_exporterrOs$ r%cfd}|S)Nctvrtddt|tst d|t<|S)NzExport config 'rJz+Export config must extend ExportConfigMixin)rr@rArKrrLrMs r$register_export_config_fnz9register_export_config..register_export_config_fns` - - - NNcTccc d d d#011 KIJJ J+."4( r%r+)r"rRs` r$register_export_configrSs$ %$r%r0rc6t|S)N)r-r8)r.s r$get_hf_exporterrUs  % %m 4 44r%N)r"rG)r0r)r) __future__rutilsrbaserconfigsrr exporter_dynamor r exporter_executorchr r exporter_onnxrrr6r get_loggerr&r@rr-rOrSrUr+r%r$r^s76""""""4444444499999999EEEEEEEE33333333% #   H % %888888888WWWWWWWWt      % % % %555555r%