J?r? S3SK@JArAJBrBJCrCJDrD S3S KEJFrFJGrGJHrHJIrIJJrJJKrKJLrLJMrMJNrNJOrOJPrPJQrQJRrRJSrSJTrTJUrUJVrVJWrWJXrXJYrYJZrZJ[r[J\r\J]r]J^r^J_r_J`r`JaraJbrbJcrcJdrdJereJfrfJgrgJhrhJiriJjrjJkrkJlrlJmrmJnrn S3S9KoJprpJqrqJrrrJsrsJtrt S3S:KuJvrv S3S;KwJxrx S3SK}J~r~Jr \"S-5(d\"5eS3S?KJrJrJr \"S05(d\"5eS3S@KJr gASSAKr\"\\"5SB\\SC9\GR\'gA!\a GNf=f!\a GNf=f!\a GNf=f!\a Nf=f!\a N|f=f!\a gAf=f)D) TYPE_CHECKING)OptionalDependencyNotAvailable _LazyModuleis_torch_availableis_torch_greater_or_equalaqlmreplace_with_aqlm_linearawq)fuse_awq_modulespost_init_awq_exllama_modulespost_init_awq_ipex_modulesreplace_quantization_scalesreplace_with_awq_linearbitnet) BitLinear pack_weightsreplace_with_bitnet_linearunpack_weights bitsandbytes)dequantize_and_replaceget_keys_to_not_convertreplace_8bit_linearreplace_with_bnb_linear set_module_8bit_tensor_to_device%set_module_quantized_tensor_to_device!validate_bnb_backend_availability deepspeed) HfDeepSpeedConfigHfTrainerDeepSpeedConfigdeepspeed_configdeepspeed_initdeepspeed_load_checkpointdeepspeed_optim_schedis_deepspeed_availableis_deepspeed_zero3_enabledset_hf_deepspeed_configunset_hf_deepspeed_configeetqreplace_with_eetq_linear fbgemm_fp8)FbgemmFp8LinearFbgemmFp8Llama4TextExpertsreplace_with_fbgemm_fp8_linearfinegrained_fp8 FP8Linearreplace_with_fp8_linearfsdpis_fsdp_managed_moduleggml)GGUF_CONFIG_MAPPINGGGUF_TOKENIZER_MAPPING_gguf_parse_valueload_dequant_gguf_tensor load_ggufhiggs) HiggsLineardequantize_higgsquantize_with_higgsreplace_with_higgs_linearhqqprepare_for_hqq_linear hub_kernels)LayerRepositoryregister_kernel_mappingreplace_kernel_forward_from_hubuse_kernel_forward_from_hubintegration_utils))INTEGRATION_TO_CALLBACKAzureMLCallbackClearMLCallbackCodeCarbonCallback CometCallbackDagsHubCallbackDVCLiveCallback FlyteCallbackMLflowCallbackNeptuneCallbackNeptuneMissingConfigurationSwanLabCallbackTensorBoardCallbackTrackioCallback WandbCallback$get_available_reporting_integrations#get_reporting_integration_callbacks hp_paramsis_azureml_availableis_clearml_availableis_codecarbon_availableis_comet_availableis_dagshub_availableis_dvclive_available is_flyte_deck_standard_availableis_flytekit_availableis_mlflow_availableis_neptune_availableis_optuna_availableis_ray_availableis_ray_tune_availableis_sigopt_availableis_swanlab_availableis_tensorboard_availableis_trackio_availableis_wandb_available rewrite_logsrun_hp_search_optunarun_hp_search_rayrun_hp_search_sigoptrun_hp_search_wandbmxfp4)Mxfp4GptOssExpertsconvert_moe_packed_tensors dequantizeload_and_swizzle_mxfp4quantize_to_mxfp4replace_with_mxfp4_linearpeftPeftAdapterMixinquantoreplace_with_quanto_layersreplace_with_spqr_linearreplace_with_vptq_linear)spqrvptq$TorchExportableModuleWithStaticCacheconvert_and_export_with_cache executorchz2.3)shard_and_distribute_moduleALL_PARALLEL_STYLES!translate_to_torch_parallel_styletensor_parallelz2.5make_flex_block_causal_maskflex_attention)r )r*)r0r1)r3)r@)rqrsrtrurv)rx)rz)r{)r|)rr)rrr)rN__file__) module_spec)typingrutilsrrrr_import_structurer r r r r rrrrrrrrrrrrrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4r5r6r7r8r9r:r;r<r=r>r?r@rArBrCrDrErFrGrHrIrJrKrLrMrNrOrPrQrRrSrTrUrVrWrXrYrZr[r\r]r^r_r`rarbrcrdrerfrgrhrirjrkrlrmrnrorprqrsrtrurvrwrxryrzr}r{r~r|rrrrrrrrrsys__name__globals__spec__modulesZ/var/www/html/shao/venv/lib/python3.13/site-packages/transformers/integrations/__init__.pyrs!nns ' (s  s ss0 1sH ' (IsJeKsL %>?MsN % &OsP  Qs^ _sj $ %kslmsx*ysN Os^  _s` +,asb( ( ' (esj    ,.. /''l#  $U + +,.. , ,'(  $U + +,.. , &+&'.    /ggC,ed+ ***********V'2..d!##02 2$ d  (//02 20   @(//02 20 @'')J2GIZhpqCKKS&  &  &  p *    *    *   sl,II#%I0I=6J JI I #I-,I-0I:9I:=JJ JJJJ