tj*UddlmZmZddlmZddlmZmZmZm Z m Z ddl Z ddl m cmZddl mZmZddlmZddlmZmZmZmZdZeeed <gd Zd eezd eed ffdZdeeezdedzdedzd efdZ deded efdZ!d+dede"d efdZ#ded efdZ$d+dede"d efdZ%e ddZ&e d d!Z'Gd"d#ee&e'fZ(Gd$d%e(e&e'fe)Z*d,d&ed'ed efd(Z+d,d)ed'ed efd*Z,dS)-)CallableSequence)update_wrapper)AnyFinalGenericoverloadTypeVarN)SymIntTensoris_tensor_like)_dtype_NumberDeviceNumbergox?euler_constant) broadcast_alllogits_to_probs clamp_probsprobs_to_logits lazy_propertytril_matrix_to_vecvec_to_tril_matrixvaluesreturn.ctd|Dstdtd|Dsyttj|D]9}t |tjrt|j|jn:fd|D}tj |Stj |S)a Given a list of values (possibly containing numbers), returns a list where each value is broadcasted based on the following rules: - `torch.*Tensor` instances are broadcasted as per :ref:`broadcasting-semantics`. - Number instances (scalars) are upcast to tensors having the same size and type as the first tensor passed to `values`. If all the values are scalars, then they are upcasted to scalar Tensors. Args: values (list of `Number`, `torch.*Tensor` or objects implementing __torch_function__) Raises: ValueError: if any of the values is not a `Number` instance, a `torch.*Tensor` instance, or an instance implementing __torch_function__ c3^K|](}t|pt|tV)dSN)r isinstancer.0vs W/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torch/distributions/utils.py z broadcast_all..,s9KKq~a  :Jq'$:$:KKKKKKziInput arguments must all be instances of Number, torch.Tensor or objects implementing __torch_function__.c34K|]}t|VdSrr r!s r$r%z broadcast_all..1s*11Q~a  111111r&)dtyper(devicecVg|]%}t|r|ntj|fi&S)rtorchtensor)r"r#optionss r$ z!broadcast_all..7sI   GH"" BAA Q(B(B'(B(B   r&) all ValueErrordictr-get_default_dtyper r r(r*broadcast_tensors)rvalue new_valuesr/s @r$rrs" KKFKKK K K  G    11&111 1 1 4"&U-D-F-F"G"G"G  E%.. U[FFF     LR   & 33  "F ++r&shaper(r*ctjr?tjtj|||tj|||Stj|||S)Nr))r-_C_get_tracing_statenormalzerosonesemptynormal_)r8r(r*s r$_standard_normalrA>s{  x""$$ | KU6 : : : JuE& 9 9 9    ;uE& 9 9 9 A A C CCr&r6dimc|dkr|S|jd| dz}||dS)z Sum out ``dim`` many rightmost dimensions of a given tensor. Args: value (Tensor): A tensor of ``.dim()`` at least ``dim``. dim (int): The number of rightmost dims to sum out. rN)rD)r8reshapesum)r6rBrequired_shapes r$_sum_rightmostrHLsI axx [3$'%/N == ( ( , ,R 0 00r&Flogits is_binarycZ|rtj|Stj|dS)a Converts a tensor of logits into probabilities. Note that for the binary case, each value denotes log odds, whereas for the multi-dimensional case, the values along the last dimension denote the log probabilities (possibly unnormalized) of the events. rD)rB)r-sigmoidFsoftmax)rIrJs r$rrZs1%}V$$$ 9V $ $ $$r&probscrtj|jj}||d|z S)aClamps the probabilities to be in the open interval `(0, 1)`. The probabilities would be clamped between `eps` and `1 - eps`, and `eps` would be the smallest representable positive number for the input data type. Args: probs (Tensor): A tensor of probabilities. Returns: Tensor: The clamped probabilities. Examples: >>> probs = torch.tensor([0.0, 0.5, 1.0]) >>> clamp_probs(probs) tensor([1.1921e-07, 5.0000e-01, 1.0000e+00]) >>> probs = torch.tensor([0.0, 0.5, 1.0], dtype=torch.float64) >>> clamp_probs(probs) tensor([2.2204e-16, 5.0000e-01, 1.0000e+00], dtype=torch.float64) )minmax)r-finfor(epsclamp)rOrUs r$rrfs2, +ek " " &C ;;3AG; , ,,r&ct|}|r*tj|tj| z Stj|S)a$ Converts a tensor of probabilities into logits. For the binary case, this denotes the probability of occurrence of the event indexed by `1`. For the multi-dimensional case, the values along the last dimension denote the probabilities of occurrence of each of the events. )rr-loglog1p)rOrJ ps_clampeds r$rrsKU##J@y$$u{J;'?'??? 9Z  r&TT) contravariantR) covariantceZdZdZdeegefddfdZe d ddde ddfd Z ed dede defd Z d dedzde dd fd Z dS)rz Used as a decorator for lazy loading of class attributes. This uses a non-data descriptor that calls the wrapped method to compute the property on first call; thereafter replacing the wrapped method into an instance attribute. wrappedrNc4||_t||dSr)r`rselfr`s r$__init__zlazy_property.__init__s)0 tW%%%%%r&instanceobj_typez!_lazy_property_and_property[T, R]cdSrr,rcrerfs r$__get__zlazy_property.__get__s /2cr&cdSrr,rhs r$rizlazy_property.__get__s?Bsr&z%R | _lazy_property_and_property[T, R]c|t|jStj5||}dddn #1swxYwYt ||jj||Sr)_lazy_property_and_propertyr`r- enable_gradsetattr__name__)rcrerfr6s r$rizlazy_property.__get__s  .t|<< <    + +LL**E + + + + + + + + + + + + + + +$,/777 sA  AAr) ro __module__ __qualname____doc__rr[r]rdr rrir,r&r$rrs&!a 0&T&&&&.2222(+2 ,222X2BBBSBABBBXB37D,/ 0r&rc4eZdZdZdeegefddfdZdS)rlzWe want lazy properties to look like multiple things. * property when Sphinx autodoc looks * lazy_property when Distribution validate_args looks r`rNc<t||dSr)propertyrdrbs r$rdz$_lazy_property_and_property.__init__s$(((((r&)rorprqrrrr[r]rdr,r&r$rlrlsK )!a 0)T))))))r&rlmatdiagc :|jd}tjs*|| ks||krt d|d| d|dz dtj||j}||dd|dzzk}|d|f}|S) z Convert a `D x D` matrix or a batch of matrices into a (batched) vector which comprises of lower triangular elements from the matrix in row order. rDzdiag (z) provided is outside [z, rQz].r*.)r8r-r:r;r2aranger*view)rvrwnrz tril_maskvecs r$rrs " A 8 & & ( (PdaRii4199N$NNrNNQUNNNOOO \!CJ / / /FR++tax88I c9n C Jr&r~cdd|zz dd|zzdzd|jdzzdt|z|dzzzdzzdz }tj|jj}tjs7t||z |kr!td|jddd zt|tj r!t| nt|}| |jd dtj||fz}tj||j }||dd|dzzk}||d |f<|S) z Convert a vector or a batch of vectors into a batched `D x D` lower triangular matrix containing elements from the vector in row order. rQrDg?zThe size of last dimension is z which cannot be expressed as z3the lower triangular part of a square D x D matrix.Nry.)r8absr-rTr(rUr:r;roundr2r r item new_zerosSizerzr*r{)r~rwr|rUrvrzr}s r$rrsv a$h, DLQ SYr]!2 2QT]dQh5O OTW W X  A +ci $C 8 & & ( ( eAhhlS.@.@ ZSYr] Z Z ZC D   &a66DaffhhE!HHA -- #2#QF););; < rs.........$$$$$$99999999999999  ******777777777777 6e 555    ,6F? ,uVS[/A , , , ,F D C&L ! D D= D TM D D D D D 1& 1s 1v 1 1 1 1 % %F %t % % % % %-v-&----4 ! !6 !d !v ! ! ! ! GCt$$$ GC4   GAqDM>)))))-1"5x)))  F # f    F#fr&