tj UddlZddlmcmZddlmZddlmZgZe e e d<ej j GddZdS)N)Tensor)2_scripted_functional_optimizer_deprecation_warning__all__ceZdZ ddeededeeefd ed ed ed ed efdZdeedzfdZ dS)_FunctionalAdamaxMbP?g?g+?:0yE>Fparamslrbetaseps weight_decayforeachmaximize_allow_empty_param_listc tdd|kstd|d|kstd|d|dcxkrdksntd|dd|d cxkrdksntd |d d|kstd ||||d|d |d |_||_||_t jtt j ttt j ffi|_ t|dkr|std d|i|_ dS)N) stacklevelr zInvalid learning rate: zInvalid epsilon value: rg?z#Invalid beta parameter at index 0: z#Invalid beta parameter at index 1: zInvalid weight_decay value: )r rbeta1beta2rz%optimizer got an empty parameter listr )r ValueErrordefaultsrrtorchjitannotatedictrstrstatelen param_group) selfr r rrrrrrs g/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/optim/functional_adamax.py__init__z_FunctionalAdamax.__init__s ;aHHHHbyy;r;;<< <czz: '                      sA#H55H9<H9)rr r r FFF) __name__ __module__ __qualname__listrfloattupleboolr&r*r'r%rrs %1!(-'.'.V '. '.UE\" '.  '.  '.'.'."&'.'.'.'.R8d6D=1888888r'r)rtorch.optim._functionaloptim _functionalr6r,torch.distributed.optim._deprecation_warningrrrBr __annotations__rscriptrrFr'r%rMs ######### cbbbbbbbbbbr'