tjBBjddlmZddlZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z m Z ddlmZddlmZddlmZmZmZmZddlmZmZdd lmZerdd lmZdd lmZm Z m!Z!m"Z"ee#$j%Z&e&j%Z'Gd d e Z(dZ)dDdZ*edZ+edZ,dEdZ-dFdZ.ej/dGd!Z0ej1dHd$Z2dId'Z3Gd(d)Z4 dJdKd.Z5 dLdMd4Z6dNd8Z7dOd:Z8dPd?Z9Gd@dAZ:GdBdCee+Z;dS)Q) annotationsN) is_dataclass)autoEnum)Pathpformat)AnyGeneric TYPE_CHECKINGTypeVar) assert_neverSelf) CodeTemplate) Namespace)CallableIterableIteratorSequenceceZdZeZeZeZeZeZeZ dS)TargetN) __name__ __module__ __qualname__r DEFINITION DECLARATION REGISTRATIONANONYMOUS_DEFINITIONNAMESPACED_DEFINITIONNAMESPACED_DECLARATIONL/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/torchgen/utils.pyrr%sUJ$&&K466L466 DFF!TVVr"rz(^|\W){}($|\W)schemastrreturntuple[str, list[str]]ctjd|}|td||\}}}||dfS)Nz(\w+)(\.\w+)?\((.*)\)zUnsupported function schema: , )rematch RuntimeErrorgroupssplit)r$mname_paramss r#split_name_paramsr38sZ )622AyC6CCDDDhhjjOD!V d## ##r"TSfuncCallable[[T], S | None]xs Iterable[T] Iterator[S]c#6K|D]}||}||VdSNr!)r6r8xrs r#mapMayber?Hs;  DGG =GGGr"Callable[[T], Sequence[S]]c#6K|D]}||Ed{VdSr<r!)r6r8r=s r# concatMaprBPsB 477r"msg_fnCallable[[], str]Iterator[None]c#K dVdS#t$rX}|}tj|d}|jr|jdd|n|}|f|jddz|_d}~wwxYw)Nz r ) Exceptiontextwrapindentargs)rCemsgs r#contextrOXs  fhhoc4(('(v6##c###3!&*$ s A,AA''A, template_fnrc*tj|Sr<)r from_file)rPs r#_read_templaterSes  !+ . ..r"sintctj|dd}t|dS)Nlatin1F)usedforsecuritylittle) byteorder)hashlibsha1encodedigestrU from_bytes)rTr\s r#string_stable_hashr`ksD <**E B B B I I K KD >>$(> 3 33r"czeZdZd'dZed(d Zd)dZd*dZd+dZd,dZ ddd-d"Z ddd.d#Z d/d%Z d0d&Z dS)1 FileManager install_dir str | Path template_dirdry_runboolr&Nonect||_t||_t|_||_dSr<)rrcresetfilesrf)selfrcrerfs r#__init__zFileManager.__init__ts:  ,, .. #  r"frozenset[str]c>td|jDS)Nc6h|]}|Sr!as_posix.0files r# z(FileManager.filenames..s AAAd$--//AAAr") frozensetrkrls r# filenameszFileManager.filenamess!AAdjAAABBBr"filenamecontentsr%ct|}d} |d}n#t$rYnwxYw||kr5|jdd||ddSdS)Nzutf-8)encodingT)parentsexist_ok)r read_textOSErrorparentmkdir write_text)rlrzr{ru old_contentss r#_write_if_changedzFileManager._write_if_changedsH~~#'  >>7>;;LL    D  | # # K  dT  : : : OOHwO 7 7 7 7 7 $ #s * 77rP env_callable"Callable[[], str | dict[str, Any]]c*t|rtd||j|z }|}t |t rd|vrt dz } ttjdj p| }n+#ttf$r| }YnwxYw | t}n#t $r |j}YnwxYwi|ddd|d|zi}t%|}||} t)jdd | t(j St |t.r|St1|dS) Nztemplate_fn must be relative: generated_commentzgen.py__main__@z generated by z from z (""")\n+ # match triple quotes ( (\s*@.+\n)* # match decorators if any \s*(class|def) # match class/function definition ) z\g<1>\n\n\g<2>)flags)r is_absoluteAssertionErrorre isinstancedict TORCHGEN_ROOTsysmodules__file__absoluteKeyErrorAttributeError relative_to REPO_ROOTrr ValueErrorr0rS substituter*subVERBOSEr%r) rlrPr template_pathenvgenerator_default generatorgenerator_pathtemplatesubstitute_outs r#substitute_with_templatez$FileManager.substitute_with_templates    ( ( * * Q !O+!O!OPP P)K7 lnn c4 ' "#--$1H$<!= $ J/8M>    ! ! K !Ix!I!IJJ J(* 4:   !?!?!?@@ @ t| K!::');N  " "D> " J J J J J  K Kr"c4||||dSr<)r)rlrzrs r#writezFileManager.writes"   8\BBBBBr"N)base_envitemsr9key_fnCallable[[T], str]#Callable[[T], dict[str, list[str]]] num_shardsrUrdict[str, Any] | None sharded_keysset[str]c @|||||||||dS)N)rrrrr)write_sharded_with_template)rlrzrrrrrrs r# write_shardedzFileManager.write_shardedsC ((   %!% ) r"c\t|} | rtd|ddi} dt|D} | g| z} || D]|D]X} | D]S| vrHt | t std| | <Ng| <TYdfd }|jrd }|D]H}||} t| |z}||}|| |||| |I| D]@d}| | | j ||fd A|j |j| | j dz dS)Nrshard_id Everythingcg|] }dd|i S)rr1r!)rtis r# z;FileManager.write_sharded_with_template..s0( ( ( &'ZQ !( ( ( r"z'sharded keys in base_env must be a listintodict[str, list[str]]from_r&rhc|D]+\}}|vrtd|||xx|z cc<,dS)Nzundeclared sharded key )rr)rrkvrs r# merge_envz:FileManager.write_sharded_with_template..merge_envsa   1L((()F1)F)FGGGQ1   r"r!cSr<r!)shardsr#z9FileManager.write_sharded_with_template../sr")rrrrr&rh)rrrrangeupdaterlistcopyrfr`r with_stemstemrkdiscardrc)rlrzrPrrrrrrru everythingshards all_shardskeyritemsidrrrs ` @r#rz'FileManager.write_sharded_with_templatesMH~~      K !Ix!I!IJJ J&0,%? ( ( +0+<+<( ( ( !\F*  # ' ' X&&&& $ $C# $ $%<<%eCj$77X,-VWWW!&s!2!2E#JJ!#E#JJ  $       < E ' 'D&,,C$S))J6C,t$$C IfSk3 ' ' ' Ij# & & & &  EZ(H  $ $$)7X7788      4+dnn =U=U=U.V.VVWWWWWr" variable_namecdd|gdt|jDdR}|||dS)zSWrite a file containing the list of all outputs which are generated by this script.rGzset(c3FK|]}d|dVdS)z ""Nrqrss r# z,FileManager.write_outputs..<s6LL,$--//,,,LLLLLLr")N)joinsortedrkr)rlrrzcontents r# write_outputszFileManager.write_outputs5sp)) ML 9K9KLLL         x11111r"ctj|jtjt S)z This needs to be deterministic. The template dir is an absolute path that varies across builds. So, just use the path relative to this file, which will point to the codegen source but will be stable. )ospathrelpathredirnamerrxs r#template_dir_for_commentsz%FileManager.template_dir_for_commentsBs+ wt0"'//(2K2KLLLr")rcrdrerdrfrgr&rh)r&rn)rzrdr{r%r&rh)rPrdrrr&r%)rzrdrPrdrrr&rh)rzrdrrr&rh)rzrdrr9rrrrrrUrrrrr&rh)rzrdrPrdrr9rrrrrrUrrrrr&rh)rr%rzrdr&rhr&r%)rrrrmpropertyryrrrrrrrrr!r"r#rbrbss     CCCXC 8 8 8 83333jKKKK(CCCC+/      >+/=X=X=X=X=X=X~ 2 2 2 2MMMMMMr"rboptionsrrcstr | Path | Nonectj|jd}|r|n|j}t |||jS)N templates)rcrerf)rrr source_pathrcrbrf)rrcres r#make_file_managerrLsO7<< 3[AAL!,E++'2EK !   r"Pobjr rKwidthc$t|||Sr<r)rrKrs r#dataclass_reprrZs 3 & &&r"attrdict[Any, Any] curr_indentc D||dzz }g}|D]n\}}t|}t|r"t||||t |znt|}||d|ot ||||ddS)Nz: {})rreprrr lenappend_format) rrKrr dict_reprrrk_reprv_strs r# _format_dictrbs 6A:KI //1aA GAvukCKK&? @ @ @a  F--e--.... 9fe[#s C CCr"&list[Any] | set[Any] | tuple[Any, ...]cdzz fd|D}t|trdnd\}}t|||S)NrHcpg|]2}t|rt|nt|3Sr!)rr r)rtlrrKrs r#rz _format_list..}sM 3?q//N65+...tAwwr")[])(r)rrr)rrKrr list_reprstartends ``` r# _format_listr vs} 6A:KI *$55E:JE3 9fe[% E EEr" fields_str list[str]r r cd\}}tt||krd}d|z}d|z}d|||} ||| |S)N)rrG r))rrr) r rKrrr r  delimitercurr_indent_str indent_strbodys r#rrs|"(I 4  %%  +vJ , ,? , , 1 1* = =D ,Z , ,s , ,,r"ceZdZdZ ddd Ze ddd ZeddZeddZ eddZ dddZ dS)NamespaceHelperaA helper for constructing the namespace open and close strings for a nested set of namespaces. e.g. for namespace_str torch::lazy, prologue: namespace torch { namespace lazy { epilogue: } // namespace lazy } // namespace torch r namespace_strr% entity_name max_levelrUr&rhcV|d}t||krtd|d|d||_dd|D|_ddt |D|_||_||_ dS)N::z"Codegen doesn't support more than z# level(s) of custom namespace. Got .rGcg|]}d|d S)z namespace z {r!rtns r#rz,NamespaceHelper.__init__..s$#P#P#PA$7$7$7$7#P#P#Pr"cg|]}d|S)z} // namespace r!r s r#rz,NamespaceHelper.__init__..s! F F F # # # F F Fr") r.rrcpp_namespace_r prologue_reversed epilogue_ namespaces_ entity_name_)rlrrrcpp_namespacess r#rmzNamespaceHelper.__init__s',,T22 ~   * * :Y::)6::: ,#P#P#P#P#PQQ F FXn-E-E F F F  *'r"namespaced_entityc|d}|d}d|dd}t|||S)zq Generate helper from nested namespaces as long as class/function name. E.g.: "torch::lazy::add" rN)rrr)r.rr)r*rnamesrrs r#from_namespaced_entityz&NamespaceHelper.from_namespaced_entitysW"''--Bi  %*-- '[I    r"c|jSr<)r$rxs r#prologuezNamespaceHelper.prologue ~r"c|jSr<)r&rxs r#epiloguezNamespaceHelper.epiloguer1r"c|jSr<)r(rxs r#rzNamespaceHelper.entity_names   r"defaultc"|jr|jn|S)z Return the namespace string from joining all the namespaces by "::" (hence no leading "::"). Return default if namespace string is empty. )r#)rlr5s r#get_cpp_namespacez!NamespaceHelper.get_cpp_namespaces '+&9Ft""wFr"N)rr)rr%rr%rrUr&rh)r)r*r%rrUr&rr)r)r5r%r&r%) rrr__doc__rm staticmethodr.rr0r3rr7r!r"r#rrs    (((((*     \  XX!!!X!GGGGGGGr"rc|eZdZUded<dddZdd ZddZd dZd!dZd"dZ e d#dZ d$dZ d%dZ d&dZdS)' OrderedSetz dict[T, None]storageNiterableIterable[T] | Noner&rhcZ| i|_dSt||_dSr<)r<rfromkeys)rlr=s r#rmzOrderedSet.__init__s*  DLLL==22DLLLr"rr4rgc||jvSr<r<rlrs r# __contains__zOrderedSet.__contains__st|##r" Iterator[T]cNt|jSr<)iterr<keysrxs r#__iter__zOrderedSet.__iter__sDL%%''(((r"r OrderedSet[T]cD|j|jdSr<)r<r)rlrs r#rzOrderedSet.updates  EM*****r"cd|j|<dSr<rBrCs r#rzOrderedSet.adds! Tr"c^t}|j|_|Sr<)r;r<r)rlrets r#rzOrderedSet.copys%'\\l''))  r"rLc~|d}|ddD]}|||S)NrrH)rr)rLrNrTs r#unionzOrderedSet.unions@1gllnnabb  A JJqMMMM r"otherc8t||Sr<)r;rPrlrQs r#__or__zOrderedSet.__or__se,,,r"rc0|||Sr<)rrSs r#__ior__zOrderedSet.__ior__s E r"objectct|tr|j|jkSt|j|kSr<)rr;r<rjrHrSs r#__eq__zOrderedSet.__eq__sD eZ ( ( 5<5=0 0t|((**++u4 4r"r<)r=r>r&rh)rr4r&rg)r&rE)rrJr&rh)rr4r&rh)r&rJ)rLrJr&rJ)rQrJr&rJ)rQrJr&r)rQrWr&rg)rrr__annotations__rmrDrIrrrr9rPrTrVrYr!r"r#r;r;s33333 $$$$))))++++"""" \ ----555555r"r;)r$r%r&r')r6r7r8r9r&r:)r6r@r8r9r&r:)rCrDr&rE)rPr%r&r)rTr%r&rUr<)rrrcrr&rb)rr)rr rKrUrrUr&r%) rrrKrUrrUrrUr&r%) rrrKrUrrUrrUr&r%)r rrKrUrrUrrUr r%r r%r&r%)< __future__r contextlib functoolsr[rr*rrJ dataclassesrenumrrpathlibrpprintr typingr r r r typing_extensionsrrtorchgen.code_templaterargparsercollections.abcrrrrrrrrrr IDENT_REGEXr3r4r5r?rBcontextmanagerrOcacherSr`rbrrrr rrr;r!r"r#rjso"""""" $$$$$$77777777777700000000//////G""""""FFFFFFFFFFFFX''))0   $ $ $ $ $T $ $ $ $$$$ GCLL GCLL      //// 4444UMUMUMUMUMUMUMUMv&*      '''''DDDD( F F F F----&DGDGDGDGDGDGDGDGN,5,5,5,5,5,5,5,5,5,5r"