ktjkdZddlZddlZddlZddlmZdZ ddeejzej zdeejzd e d e d e d edzd e de de edzde edzde e eefdzde de fdZedkr_eZeejejejejejejejejejejejej dSdS)z@Provide entry point to preprocess ONNX model especially for QNN.N)qnnctjd}|dddd|dd dd |d d d |dd d|dd|ddtd|dd d|dd d|dddd |d!ddd" |d#d$d%tdd&'|d(d d)|S)*zParse cmdline arguments.z#Arguments for QNN model preprocess.) descriptionz--input_model_pathz-iTzPath to the input ONNX model.)requiredhelpz--output_model_pathz-ozPath to the output ONNX model.z--save_as_external_data store_truez;Whether the output model would be saved with external data.)actionrz--all_tensors_to_one_filezgWhether to save all external data in one file or save each tensor to a file named with the tensor name.z--external_data_locationzbFilename of the external file where all tensors are saved. The path is relative to the model path.)rz--external_data_size_thresholdzQTensors with data size larger than this threshold are converted to external data.)defaulttyperz!--external_data_convert_attributezKWhether to save all tensors, including attribute tensors, to external data.z--fuse_layernormzLWhether to fuse matched sequences into LayerNormalization nodes if possible.z--inputs_to_make_channel_last+Nz=List of graph input names to be transposed into channel-last.)nargsr rz--outputs_to_make_channel_lastz>List of graph output names to be transposed into channel-last.z--dynamic_input_shapesappendzdModel input name and desired static shape in comma seprated format, for example: 'input' 1,3,256,256)rr r r rz --exclude_initializer_from_inputzBWhether to exclude initializer from input if model.ir_version >= 4)argparseArgumentParser add_argumentintstr parse_args)parsers ^/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/onnxruntime/tools/qnn/preprocess.py_parse_argumentsrs  $1V W W WF ,dTHghhh -tdIijjj ! J  # v  " q (  `   + Z  [ ' L  ( M     s  * Q     Fr model_input model_outputfuse_layernormsave_as_external_dataall_tensors_to_one_fileexternal_data_locationexternal_data_size_thresholdexternal_data_convert_attributeinputs_to_make_channel_lastoutputs_to_make_channel_lastdynamic_input_shapesexclude_initializer_from_inputreturnc Btj|||||||||| | |  S)a<Preprocess ONNX model for QNN. Args: model_input: A path or ONNX ModelProto specifiying the model to be preprocessed. model_output: A path specifying where the preprocessed model to be saved. fuse_layernorm: A bool specifying whether to fuse the matched sequence into a single LayerNormalization node. Defaults to False. save_as_external_data: A bool specifying whether to save model with external data. Defaults to False. all_tensors_to_one_file: A bool specifying whether to save all external data in one file or save each tensor to a file named with the tensor name. This argument is effective only when `save_as_external_data` is True. Defaults to False. external_data_location: A str specifying where to save the external data. The path is relative to the model path. This argument is effective only when `save_as_external_data` is True. Defaults to the model name. external_data_size_threshold: An int specifying the threshold of data size for tensors be saved as external data. This argument is effective only when `save_as_external_data` is True. Defaults to 1024. external_data_convert_attribute: A bool specifying whether to save all tensors including attributes as external data. This argument is effective only when `save_as_external_data` is True. Defaults to False. inputs_to_make_channel_last: A list of strs specifying graph input names to be transposed into channel-last. Defaults to None. outputs_to_make_channel_last: A list of strs specifying graph output names to be transposed into channel-last. Defaults to None. dynamic_input_shapes: A list of tuples specifying model input name to and its static shape in comma seprated format, for example: [('input', '1,3,256,256')]. Defaults to None. exclude_initializer_from_input: A bool specifying whether to exclude initializer from input. Defaults to False. Returns: A bool indicating whether the model is modified. rrrr r!r"r#r$r%r&)rqnn_preprocess_model) rrrrrr r!r"r#r$r%r&s rr*r*\sCT  #%3 75%A(G$?%A1'E    r__main__r)) FFFNr FNNNF)__doc__rpathlibonnx,onnxruntime.quantization.execution_providersrrrPath ModelProtoboolrlisttupler*__name__argsinput_model_pathoutput_model_pathrrrr r!r"r#r$r%r&rrr:s GF <<<<<<III^!"'$))-(,,148599=+077w|#do57 $77 7 " 7  $J 7#&7&*7"&cT!17#'s)d"27uS#X/$67%)7 7777t z    D  *"8 $ <#:%)%F(,(L$($D%)%F!6'+'J      r