tjddlmZddlZddlmZddlmZgdZGddejZGdd ejZ Gd d ejZ dS) )AnyN)nn)QConfig) QuantStub DeQuantStub QuantWrappercTeZdZdZddedzffd ZdejdejfdZxZ S) raQuantize stub module, before calibration, this is same as an observer, it will be swapped as `nnq.Quantize` in `convert`. Args: qconfig: quantization configuration for the tensor, if qconfig is not provided, we will get qconfig from parent modules Nqconfigc^t|r ||_dSdSNsuper__init__r selfr __class__s Y/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/ao/quantization/stubs.pyrzQuantStub.__init__6   #"DLLL # #xreturnc|Sr rrs rforwardzQuantStub.forwardrr ) __name__ __module__ __qualname____doc__rrtorchTensorr __classcell__rs@rrr s}##$###### %,rrcTeZdZdZddedzffd ZdejdejfdZxZ S) raDequantize stub module, before calibration, this is same as identity, this will be swapped as `nnq.DeQuantize` in `convert`. Args: qconfig: quantization configuration for the tensor, if qconfig is not provided, we will get qconfig from parent modules Nr c^t|r ||_dSdSr r rs rrzDeQuantStub.__init__&rrrrc|Sr rrs rrzDeQuantStub.forward+rrr ) rrrr rrr!r"rr#r$s@rrrs}##d ###### %,rrceZdZUdZeed<eed<ejed<dejffd Z de j de j fdZ xZ S) raA wrapper class that wraps the input module, adds QuantStub and DeQuantStub and surround the call to module with call to quant and dequant modules. This is used by the `quantization` utility functions to add the quant and dequant modules, before `convert` function `QuantStub` will just be observer, it observes the input tensor, after `convert`, `QuantStub` will be swapped to `nnq.Quantize` which does actual quantization. Similarly for `DeQuantStub`. quantdequantmodulecVtt|dd}|dt ||dt ||d|||jdS)Nr r)r*r+)rrgetattr add_modulerrtraintraining)rr+r rs rrzQuantWrapper.__init__?s &)T22 7!3!3444  ;w#7#7888 &))) 6?#####rXrc||}||}||Sr )r)r+r*)rr1s rrzQuantWrapper.forwardGs0 JJqMM KKNN||Ar)rrrr r__annotations__rrModulerr!r"rr#r$s@rrr/s     I$ry$$$$$$%,rr) typingrr!rtorch.ao.quantizationr__all__r4rrrrrrr8s )))))) 7 6 6 $")$29r