tj-UddlZddlmcmZddlmZddlmZgZe e e d<ej j GddZdS)N)Tensor)2_scripted_functional_optimizer_deprecation_warning__all__c|eZdZ ddeededed ed ed ed ed ededefdZdeedzfdZdS)_FunctionalRMSprop{Gz?Gz?:0yE>Fparamslralphaeps weight_decaymomentumcenteredforeachmaximize_allow_empty_param_listc ttd|||||d|_||_||_| |_t |dkr| st dd|i|_tj ttj tttj ffi|_dS)N) stacklevel)r rrrrrz%optimizer got an empty parameter listr )rdefaultsrrrlen ValueError param_grouptorchjitannotatedictrstrstate) selfr r rrrrrrrrs h/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributed/optim/functional_rmsprop.py__init__z_FunctionalRMSprop.__init__s ;aHHHH(    !    v;;!  $; DEE E%f-Y''U\4U\@Q;R-R(SUWXX gradientsNcD|jd}g}g}g}g}g}g}|jd} |jd} |jd} |jd} |jd} t|t|kr6tddt|d zd t|zd }t ||D]}\}}|t|t j|z}||||||jvri|j|<|j|}t j d |d <t j |t j |d<| dkr#t j |t j |d<|j r#t j |t j |d<|j|}||d| dkr||d|j r||d||d t j 5tj||||||| | | | | |j |j|j|ddddS#1swxYwYdS)Nr r rrrrzEthe gradients passed in does not equal to the size of the parameters!zParams length: z. zGradients length: Fr step) memory_format square_avgrmomentum_buffergrad_avg) r rrrrrrr has_complex)rrrrzipr is_complexappendr"tensor zeros_likepreserve_formatrno_gradFrmsproprr)r#r'r params_with_gradgrads square_avgs grad_avgsmomentum_buffer_list state_stepsr rrrrr.paramgradientr"s r$r)z_FunctionalRMSprop.step;s)!(+  ! ]4  g&mE"=,}^4 v;;#i.. ( (W3CKK33347s9~~778   "6955 2 2OE8#u/666  ''... X&&& **(*DJu% Ju-E$)L$5$5E&M*/*:U-B+++E,' !||383C!1F444/0},1,<!1F---j) 5)""5#6777a<<(//6G0HIII=8$$U:%6777""5=111 ]__   I $)! '                      s3JJJ) rr r r r FFFF) __name__ __module__ __qualname__listrfloatboolr%r)r&r$rrs !(- Y YV  Y  Y Y  Y  Y Y Y Y Y"& Y Y Y YDFd6D=1FFFFFFr&r)rtorch.optim._functionaloptim _functionalr6r,torch.distributed.optim._deprecation_warningrrrCr!__annotations__rscriptrrFr&r$rMs ######### ciiiiiiiiiir&