o svXj @sVdZddlmZddlmZddlmZmZddlm Z Gddde Z d d d Z dS) z SQL Lexer)tokens) SQL_REGEX) text_type file_types)consumec@seZdZdZedddZdS)Lexerz?Lexer Empty class. Leaving for backwards-compatibility Nccst|tr |}t|trn,t|tr3|r||}nz|d}Wnty2|d}Yn wtdt |t |}|D]>\}}t D]1\}}|||}|sTqHt|t j rb||fVn t|rm||Vt|||dnt j|fVqBdS)a Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. Split ``text`` into (tokentype, text) pairs. ``stack`` is the initial stack (default: ``['root']``) zutf-8zunicode-escapez+Expected text or file-like object, got {!r}N) isinstancerreadrbytesdecodeUnicodeDecodeError TypeErrorformattype enumeraterr _TokenTypegroupcallablerendError)textencodingiterableposcharrexmatchactionmrK/var/www/html/myproject/venv/lib/python3.10/site-packages/sqlparse/lexer.py get_tokenss>           zLexer.get_tokensN)__name__ __module__ __qualname____doc__ staticmethodr!rrrr rsrNcCst||S)zTokenize sql. Tokenize *sql* using the :class:`Lexer` and return a 2-tuple stream of ``(token type, value)`` items. )rr!)sqlrrrr tokenizeLsr)r") r&sqlparsersqlparse.keywordsrsqlparse.compatrrsqlparse.utilsrobjectrr)rrrr s   6