tjUddlZddlmcmZddlmZddlmZgZe e e d<ej j GddZdS)N)Tensor)2_scripted_functional_optimizer_deprecation_warning__all__ceZdZ ddeededeeefdeeefd ed ed efd Zd eedzfdZ dS)_FunctionalRprop{Gz?g?g333333?gư>2Fparamslretas step_sizesforeachmaximize_allow_empty_param_listcztdd|i|_||_||_||_||_t |dkr|stdd|i|_tj ttj tttj ffi|_dS)N) stacklevelr rz%optimizer got an empty parameter listr )rdefaultsrrrrlen ValueError param_grouptorchjitannotatedictrstrstate)selfr r rrrrrs f/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/optim/functional_rprop.py__init__z_FunctionalRprop.__init__s ;aHHHH "   $   v;;!  $; DEE E%f-Y''U\4U\@Q;R-R(SUWXX gradientsNc*|jd}g}g}g}g}g}|jd}|j\} } |j\} } t |t |kr6t ddt |dzdt |zd} t ||D]\}}|| tj|z} | || |||j vrii|j |<|j |}tj d|d <tj |tj |d <tj|||d <|j |}| |d | |d | |d tj5t!j|||||| | | | |j|j| ddddS#1swxYwYdS)Nr r zEthe gradients passed in does not equal to the size of the parameters!zParams length: z. zGradients length: Fgstep) memory_formatprev step_size) step_size_min step_size_maxetaminusetaplusrr has_complex)rrrrrrzipr is_complexappendrtensor zeros_likepreserve_format full_likeno_gradFrproprr)r r$r params_with_gradgradsprevsr state_stepsr r,r-r*r+r.paramgradientrs r!r&z_FunctionalRprop.step5s!(+  ]4  I''+$ } v;;#i.. ( (W3CKK33347s9~~778   "6955 2 2OE8#u/666  ''... X&&& **(*DJu% Ju-E$)L$5$5E&M$)$4U-B%%%E&M*/2)F)FE+& 5) U6]+++!!% "4555""5=111 ]__   G ++! '                      s+HH H )rr r FFF) __name__ __module__ __qualname__listrfloattupleboolr"r&r#r!rrs $.*4(-YYV Y YE5L! Y %,' Y  YY"&YYYY85d6D=1555555r#r)rtorch.optim._functionaloptim _functionalr7r,torch.distributed.optim._deprecation_warningrrrBr__annotations__rscriptrrFr#r!rMs ######### cRRRRRRRRRRr#