tj VddlZddlmZmZmZmZmZddlmZm Z GddeZ dS)N)AnyListOptionalSequenceUnion)BaseDocumentTransformerDocumentc eZdZdZ ddeeeeefdeeeeefdeded e d df d Z d e e d e d e e fd Z dS)MarkdownifyTransformeramConverts HTML documents to Markdown format with customizable options for handling links, images, other tags and heading styles using the markdownify library. Arguments: strip: A list of tags to strip. This option can't be used with the convert option. convert: A list of tags to convert. This option can't be used with the strip option. autolinks: A boolean indicating whether the "automatic link" style should be used when a a tag's contents match its href. Defaults to True. heading_style: Defines how headings should be converted. Accepted values are ATX, ATX_CLOSED, SETEXT, and UNDERLINED (which is an alias for SETEXT). Defaults to ATX. kwargs: Additional options to pass to markdownify. Example: .. code-block:: python from langchain_community.document_transformers import MarkdownifyTransformer markdownify = MarkdownifyTransformer() docs_transform = markdownify.transform_documents(docs) More configuration options can be found at the markdownify GitHub page: https://github.com/matthewwithanm/python-markdownify NTATXstripconvert autolinks heading_stylekwargsreturnc t|tr|gn||_t|tr|gn||_||_||_||_dS)N) isinstancestrr rrradditional_options)selfr rrrrs s/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/langchain_community/document_transformers/markdownify.py__init__zMarkdownifyTransformer.__init__sY!+5# 6 6AeWWE $.w$<$<Iyy' "*"( documentsc  ddlm}n#t$rtdwxYwg}|D]}|d |j|j|j|j|jd|jdd}tj dd|}| t||j |S) Nr) markdownifyz`markdownify package not found, please install it with `pip install markdownify`)htmlr rrr  z\n\s*\nz )metadata)r ImportError page_contentr rrrrreplaceresubappendr r!)rrrrconverted_documentsdocmarkdown_contentcleaned_markdowns rtransform_documentsz*MarkdownifyTransformer.transform_documents*s   / / / / / / /   =   !  C )* L"n"&"4  - %%  "vj&:JKK   & &)CLAAA    #"s #)NNTr )__name__ __module__ __qualname____doc__rrrrboolrrrr r-r"rrr r s,2637" ) )c49n-. )%T#Y/0 ) )  )  )  ) ) ) )"#H%"#"# (  "#"#"#"#"#"#rr ) r&typingrrrrrlangchain_core.documentsrr r r"rrr5s 77777777777777FFFFFFFFE#E#E#E#E#4E#E#E#E#E#r