dh(SSKrSSKrSSKJr SSKJrJrJrJr SSK J r SSK J r SSK Jr SSKJr SSKJr "S S \5r\S :Xa7\"S S SS9r\R-5r\"S\"\5S\R435 gg)N)Path)AnyListOptionalTuple)unquote)Document)DirectoryLoader) PyPDFLoader) WebBaseLoadercJ^\rSrSrSrSS\S\S\S\\\\4S\\ S \S \4U4S jjjr SS jr S \ \ 4SjrS\S \4SjrS\S \ \ 4SjrS\S \ \4SjrS\ \S S4SjrS \ \ 4SjrS\S \ \4SjrS\S S4SjrS\S \4SjrS\S \4SjrSrU=r$)BlackboardLoaderaLoad a `Blackboard` course. This loader is not compatible with all Blackboard courses. It is only compatible with courses that use the new Blackboard interface. To use this loader, you must have the BbRouter cookie. You can get this cookie by logging into the course and then copying the value of the BbRouter cookie from the browser's developer tools. Example: .. code-block:: python from langchain_community.document_loaders import BlackboardLoader loader = BlackboardLoader( blackboard_course_url="https://blackboard.example.com/webapps/blackboard/execute/announcement?method=search&context=course_entry&course_id=_123456_1", bbrouter="expires:12345...", ) documents = loader.load() Nblackboard_course_urlbbrouterload_all_recursively basic_authcookiescontinue_on_failure show_progresscV>[TU]UUUS9 URS5SUlUbX@R lUc0nURSU05 UR RRU5 X0l UR5 g![a [ S5ef=f)aInitialize with blackboard course url. The BbRouter cookie is required for most blackboard courses. Args: blackboard_course_url: Blackboard course url. bbrouter: BbRouter cookie. load_all_recursively: If True, load all documents recursively. basic_auth: Basic auth credentials. cookies: Cookies. continue_on_failure: whether to continue loading the sitemap if an error occurs loading a url, emitting a warning instead of raising an exception. Setting this to True makes the loader more robust, but also may result in missing data. Default: False show_progress: whether to show a progress bar while loading. Default: True Raises: ValueError: If blackboard course url is invalid. ) web_pathsrrz/webapps/blackboardrzpInvalid blackboard course url. Please provide a url that starts with https:///webapps/blackboardNBbRouter) super__init__splitbase_url IndexErrorsessionauthupdaterr check_bs4) selfrrrrrrr __class__s g/var/www/html/shao/venv/lib/python3.13/site-packages/langchain_community/document_loaders/blackboard.pyrBlackboardLoader.__init__$s: , 3'   1778MNqQDM  ! *LL  ?G H-. ##G,$8!  >  s BB(returnc@SSKng![a [S5ef=f)zdCheck if BeautifulSoup4 is installed. Raises: ImportError: If BeautifulSoup4 is not installed. rNzeBeautifulSoup4 is required for BlackboardLoader. Please install it with `pip install beautifulsoup4`.)bs4 ImportError)r#r)s r%r"BlackboardLoader.check_bs4Ys,    G  scPUR(aUR5nURU5UlUR U5n/nUHtnUR U-n[ SU35 URU5n[R"[5 URURU55 SSS5 Mv U$[ SUR35 UR5nURU5UlURU5$!,(df  M=f)zBLoad data into Document objects. Returns: List of Documents. zFetching documents from N)rscrape_get_folder_path folder_path _get_pathsrprint_scrape contextlibsuppress ValueErrorextend_get_documentsweb_path)r# soup_inforelative_paths documentspathurls r%loadBlackboardLoader.loadgs  $ $ I#44Y?D !__Y7NI&mmd*067 LL- ((4$$T%8%8%CD54 '   ,T]]O< = I#44Y?D &&y1 154s !D D% soupcURSSS05nUc [S5eURR5n[ U5R SS5R SS5R SS5R S S5R S S5R S S5R S S5R S S5n[ S5U- n[U5$)zvGet the folder path to save the Documents in. Args: soup: BeautifulSoup4 soup object. Returns: Folder path. spanidcrumb_1zNo course name found. _/:,?'!".)findr5textstriprreplacerstr)r#r@ course_namecourse_name_cleanr/s r%r.!BlackboardLoader._get_folder_pathsiiy(9:  45 5!&&,,.  K WS#  WS#  WS#  WS#  WS#  WS#  WS#  WS#  3i"33 ;cjURU5nURU5 UR5nU$)z|Fetch content from page and return Documents. Args: soup: BeautifulSoup4 soup object. Returns: List of documents. )_get_attachments_download_attachments_load_documents)r#r@ attachmentsr;s r%r7BlackboardLoader._get_documentss6++D1  "";/((* rWcBSSKJnJn URSSS05nUc [ S5e/nUR SSS05HZnUR S5HBnUR S 5nUcMURS 5(aM1URU5 MD M\ U$) zqGet all attachments from a page. Args: soup: BeautifulSoup4 soup object. Returns: List of attachments. r) BeautifulSoupTagulclass contentListzNo content list found.r\ahref#) r)r_r`rOr5find_allget startswithappend) r#r@r_r` content_listr\ attachmentlinkres r%rY!BlackboardLoader._get_attachmentss +yy'?@  56 6 &//w 6NOJ"++C0xx'#DOOC,@,@&&t, 1PrWr\c~[UR5RSSS9 UHnURU5 M g)zGDownload all attachments. Args: attachments: List of attachments. T)parentsexist_okN)rr/mkdirdownload)r#r\rls r%rZ&BlackboardLoader._download_attachmentss8 T  $$TD$A%J MM* %&rWcX[URS[S9nUR5nU$)zCLoad all documents in the folder. Returns: List of documents. z*.pdf)r<glob loader_cls)r r/r r>)r#loaderr;s r%r[ BlackboardLoader._load_documentss0!!!"  KKM rWc/nURSSS05nUc [S5eURS5HBnURS5nUcMUR S5(dM1UR U5 MD U$)z%Get all relative paths in the navbar.rarb courseMenuzNo course menu found.rdrerG)rOr5rgrhrirj)r#r@r: course_menurmres r%r0BlackboardLoader._get_pathss{iiw &=>  45 5((-D88F#DDOOC$8$8%%d+.rWr<c6URRURU-SS9nURUR5n[ [ UR5U- S5nURUR5 SSS5 g!,(df  g=f)z@Download a file from an url. Args: path: Path to the file. T)allow_redirectswbN) rrhrparse_filenamer=openrr/writecontent)r#r<responsefilenamefs r%rsBlackboardLoader.downloadst<<##DMMD$8$#O&&x||4 $t''(83T :a GGH$$ %; : :s %B  Br=c[U5=n(aURS:Xa UR$URU5$)zlParse the filename from an url. Args: url: Url to parse the filename from. Returns: The filename. .pdf)rsuffixname_parse_filename_from_url)r#r=url_paths r%rBlackboardLoader.parse_filenames9S !H !x&'@== 005 5rWc[R"SU5nU(aURS5nO[SU35eSU;a[SU35eUR S5SS-n[ U5nUR SS5nU$) zParse the filename from an url. Args: url: Url to parse the filename from. Returns: The filename. Raises: ValueError: If the filename could not be parsed. zfilename%2A%3DUTF-8%27%27(.+)zCould not parse filename from rzIncorrect file type: rz%20rE)researchgroupr5rrrR)r#r=filename_matchesrs r%r)BlackboardLoader._parse_filename_from_url s99%EsK '--a0H=cUCD D  !4XJ?@ @>>&)!,v58$##E3/rW)rr/r)TNNFT)r'N)__name__ __module__ __qualname____firstlineno____doc__rSboolrrdictrr"rr r>rr.r7rYrZr[r0rsrr__static_attributes__ __classcell__)r$s@r%rrsK2&*04"&$)"3"33# 3 U38_- 3 $ 3"333j 2d8n20 S S < 3 4> ST#Y8 &c &t &h" s tCy  &S &T & 6# 6# 6CCrWr__main__zhttps:///webapps/blackboard/content/listContent.jsp?course_id=__1&content_id=__1&mode=resetzT)rzLoaded z pages of PDFs from )r3rpathlibrtypingrrrr urllib.parserlangchain_core.documentsr .langchain_community.document_loaders.directoryr (langchain_community.document_loaders.pdfr -langchain_community.document_loaders.web_baser rrrxr>r;r1lenr8rWr%rs -- -J@GT}Tn z  C &! F I GC N##77H IJrW