jNVddlZddlmZddlmZmZddlmZddlm Z Gdde Z y)N)Path)ListUnion)Document) BaseLoaderc8eZdZdZdeeeffdZdee fdZ y) CoNLLULoaderzLoad `CoNLL-U` files. file_pathc||_y)zInitialize with a file path.N)r )selfr s u/var/www/html/Fitness-lenito-AI-main/venv/lib/python3.12/site-packages/langchain_community/document_loaders/conllu.py__init__zCoNLLULoader.__init__ s "returnct|jd5}ttj|d}|Dcgc]}t |dkDs|}}dddd}t D]2\}}|dd k(s|t |dz k(r ||dz }(||dd zz }4d t|ji}t|| gScc}w#1swYuxYw) zLoad from a file path.utf8)encoding ) delimiterN z SpaceAfter=No source) page_contentmetadata) openr listcsvreaderlen enumeratestrr)r ftsvlinelinestextirs r loadzCoNLLULoader.loads $..6 2aszz!t45C'*;cdSY]TcE; 3  'GAtAw/)Q#e*q.-@QQ# % (c$..12dX>??< 3 2s"%C CCC C  CN) __name__ __module__ __qualname____doc__rr#rrrrr*rr r r s,#%T "2#@d8n@rr ) rpathlibrtypingrrlangchain_core.documentsr)langchain_community.document_loaders.baserr r/rr r4s" -@@:@r