@hcSSKJr SSKrSSKJrJrJrJr SSKJ r J r "SS\ 5r S Sjr "SS \ 5r g) ) annotationsN)AnyLiteralOptionalUnion)Language TextSplittercP^\rSrSrSrSSU4SjjjrSSjrSrU=r$) CharacterTextSplitter z(Splitting text that looks at characters.c >>[TU]"S0UD6 XlX lg)Create a new TextSplitter.N)super__init__ _separator_is_separator_regex)self separatoris_separator_regexkwargs __class__s Z/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_text_splitters/character.pyrCharacterTextSplitter.__init__ s  "6"##5 ch^TR(a TRO[R"TR5n[ XTR S9nSnTR=(a [ U4SjU55nSnTR (dU(d TRnTRX65$)z=Split into chunks without re-inserting lookaround separators.keep_separator)z(?=z(?# UH nTRRU5v M" g7f)N)r startswith).0prs r 3CharacterTextSplitter.split_text..%s'9 3FaDOO & &q ) )3Fs'*)rrreescape_split_text_with_regex_keep_separatorany _merge_splits)rtext sep_patternsplitslookaround_prefixes is_lookaround merge_seps` r split_text CharacterTextSplitter.split_texts $77DOORYYt=W  ( d.B.B  =00 S9 3F9 6  $$ I!!&44r)rr) F)rstrrboolrrreturnNoner,r5r7 list[str]) __name__ __module__ __qualname____firstlineno____doc__rr2__static_attributes__ __classcell__rs@rr r sH2 #( 6 6! 6 6  6 655rr cU(aU(a[R"SUS3U5nUS:Xa3[S[U5S- S5Vs/sHoCUX4S--PM snO/[S[U5S5Vs/sHoCUX4S--PM snn[U5S-S:XaXSSS- nUS:Xa /UQUSPOUS/UQnO"[R"X5nO [ U5nUVs/sH ofS:wdM UPM sn$s snfs snfs snf) N()endrr%)r&splitrangelenlist)r,rr_splitsir.ss rr(r(4s) hh9+Q/6G"U*8=QG q@PRS7TU7T!!*w1u~-7TU[TU]"SSU0UD6 U=(d /SQUlX0lg)rr)r4  r%Nr)rr _separatorsr)r separatorsrrrrs rr'RecursiveCharacterTextSplitter.__init__Vs. AA&A%@)@#5 rc0/nUSn/n[U5H^upgUR(aUO[R"U5nUS:XaUn O*[R"X5(dMUUnX&S-Sn O UR(aUO[R"U5n[ XUR S9n /n UR (aSOUnU Hn URU 5UR:aU RU 5 M5U (a$URX5n URU 5 /n U(dURU 5 MzURX5n URU 5 M U (a"URX5n URU 5 U$)z&Split incoming text and return chunks.rIr%rGNr) enumeraterr&r'searchr(r)_length_function _chunk_sizeappendr+extend _split_text)rr,rX final_chunksrnew_separatorsrO_srr. _good_splitsrP merged_text other_infos rra*RecursiveCharacterTextSplitter._split_textbse rN z*EA#77RYYr]JRx yy** !+EG!4+#'":":Y )@T ' T-A-A   //RY A$$Q'$*:*::##A&"&"4"4\"NK '' 4#%L% ''*!%!1!1!!DJ '' 3 ,,\FK    ,rc8URXR5$)zSplit the input text into smaller chunks based on predefined separators. Args: text (str): The input text to be split. Returns: List[str]: A list of text chunks obtained after splitting. )rarW)rr,s rr2)RecursiveCharacterTextSplitter.split_texts&6&677rc :URU5nU"SUSS.UD6$)aReturn an instance of this class based on a specific language. This method initializes the text splitter with language-specific separators. Args: language (Language): The language to configure the text splitter for. **kwargs (Any): Additional keyword arguments to customize the splitter. Returns: RecursiveCharacterTextSplitter: An instance of the text splitter configured for the specified language. T)rXrr)get_separators_for_language)clslanguagerrXs r from_language,RecursiveCharacterTextSplitter.from_languages) 44X> LjTLVLLrcU[R[R4;a/SQ$U[R:Xa/SQ$U[R:Xa/SQ$U[R :Xa/SQ$U[R :Xa/SQ$U[R:Xa/SQ$U[R:Xa/SQ$U[R:Xa/SQ$U[R:Xa/S Q$U[R:Xa/S Q$U[R:Xa/S Q$U[R:Xa/S Q$U[R:Xa/S Q$U[R:Xa/SQ$U[R :Xa/SQ$U[R":Xa/SQ$U[R$:Xa/SQ$U[R&:Xa/SQ$U[R(:Xa/SQ$U[R*:Xa/SQ$U[R,:Xa/SQ$U[R.:Xa/SQ$U[R0:Xa/SQ$U[R2:Xa/SQ$U[R4:Xa*SnSUS3SUS3SUS3SUS3SUS3S S!S"S#S$S%S&S'S(S)S*S+S,/$U[R6;aS-US.3n[9U5eS-US/[;[53n[9U5e)0zRetrieve a list of separators specific to the given language. Args: language (Language): The language for which to get the separators. Returns: List[str]: A list of separators appropriate for the specified language. ) class z void z int z float z double  if  for  while  switch  case r4rUrVr%)  func  var  const  type rsrtrvrwr4rUrVr%)rr public protected private  static rsrtrurvrwr4rUrVr%)rrr|r}r~z internal z companion z fun  val ryrsrtruz when rw else r4rUrVr%) function rz let ryrrrsrtrurvrw default r4rUrVr%) enum interface z namespace r{rrrrzrryrsrtrurvrwrr4rUrVr%) rrrrs foreach ru do rvrwr4rUrVr%) z message z service rz option  import z syntax r4rUrVr%)rr def z def r4rUrVr%)z =+ z -+ z \*+ z .. * r4rUrVr%) rrrrs unless rurtrz begin z rescue r4rUrVr%)rz defp z defmodule z defprotocol z defmacro z defmacrop rsrrurwz cond z with rtrr4rUrVr%) z fn rzrrsrurtz loop  match rzr4rUrVr%)rrz object rrryrsrtrurrwr4rUrVr%)rxrr struct rrsrtrurrvrwr4rUrVr%) z #{1,6} z``` z \*\*\*+ z ---+ z ___+ r4rUrVr%)z \\chapter{z \\section{z \\subsection{z \\subsubsection{z \\begin{enumerate}z \\begin{itemize}z \\begin{description}z \\begin{list}z \\begin{quote}z \\begin{quotation}z \\begin{verse}z \\begin{verbatim}z \\begin{align}z$$$rVr%)z x &## H x|| # : x~~ % > x|| #  x'' '%% L x** * . x,, ,?Cse7+se<0se#ABse8,se8,#%+ 0 x22 2hZ'?@CS/ !z!GXGW X or)rrW)NTF) rXzOptional[list[str]]r$Union[bool, Literal['start', 'end']]rr6rrr7r8)r,r5rXr:r7r:r9)rnrrrr7rR)rnrr7r:)r;r<r=r>r?rrar2 classmethodro staticmethodrlr@rArBs@rrRrROs+/?C#( 6' 6= 6! 6  6  6 6(T 8MM+.M 'MM$V V rrR)r,r5rr5rrr7r:) __future__rr&typingrrrrlangchain_text_splitters.baserr r r(rRrrrrsT" 00@(5L(5V* **2V**6r \r r