dhSSKrSSKrSSKJr SSKJrJrJr SSK J r SSK J r \R"\5r"SS\ 5rg)N)Path)DictIteratorUnion)Document) BaseLoaderc r\rSrSrSrS S\\\4S\\S4S\\S4S\SS4 S jjr S\ \ 4S jr S r g) BSHTMLLoader a __ModuleName__ document loader integration Setup: Install ``langchain-community`` and ``bs4``. .. code-block:: bash pip install -U langchain-community bs4 Instantiate: .. code-block:: python from langchain_community.document_loaders import BSHTMLLoader loader = BSHTMLLoader( file_path="./example_data/fake-content.html", ) Lazy load: .. code-block:: python docs = [] docs_lazy = loader.lazy_load() # async variant: # docs_lazy = await loader.alazy_load() for doc in docs_lazy: docs.append(doc) print(docs[0].page_content[:100]) print(docs[0].metadata) .. code-block:: python Test Title My First Heading My first paragraph. {'source': './example_data/fake-content.html', 'title': 'Test Title'} Async load: .. code-block:: python docs = await loader.aload() print(docs[0].page_content[:100]) print(docs[0].metadata) .. code-block:: python Test Title My First Heading My first paragraph. {'source': './example_data/fake-content.html', 'title': 'Test Title'} N file_path open_encoding bs_kwargsget_text_separatorreturncSSKnXlX lUc3[R R S5(d [S5eSS0nX0lX@lg![a [S5ef=f)aqinitialize with path, and optionally, file encoding to use, and any kwargs to pass to the BeautifulSoup object. Args: file_path: The path to the file to load. open_encoding: The encoding to use when opening the file. bs_kwargs: Any kwargs to pass to the BeautifulSoup object. get_text_separator: The separator to use when calling get_text on the soup. rNzUbeautifulsoup4 package not found, please install it with `pip install beautifulsoup4`lxmlzBy default BSHTMLLoader uses the 'lxml' package. Please either install it with `pip install -U lxml` or pass in init arg `bs_kwargs={'features': '...'}` to overwrite the default BeautifulSoup kwargs.features) bs4 ImportErrorr r importlibutil find_specrr)selfr r rrrs d/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/document_loaders/html_bs.py__init__BSHTMLLoader.__init__Ss~   #*  >>++F33!, $V,I""4% /  s AA+c## SSKJn [URSURS9nU"U40UR D6nSSS5 WR UR5nUR(a [URR5nOSn[UR5US.n[XFS9v g!,(df  N=f7f) z)Load HTML document into document objects.r) BeautifulSoupr)encodingN)sourcetitle) page_contentmetadata) rropenr r rget_textrr#strstringr)rrfsouptextr#r%s r lazy_loadBSHTMLLoader.lazy_loadys% $..#0B0B Cq 5dnn5DD}}T445 :: ))*EE$..)1 D<<D Cs&CB6A:C6 CC)rr rr )NNr!)__name__ __module__ __qualname____firstlineno____doc__rr(rdictrrrr-__static_attributes__rr r svCP+/'+"$ $5d#$5S$Y'$5t$ $5  $5  $5L=8H-=r7r )importlib.utilrloggingpathlibrtypingrrrlangchain_core.documentsr)langchain_community.document_loaders.baser getLoggerr/loggerr r6r7rr@s8((-@   8 $~=:~=r7