mdi SSKrSSKJrJr SSKrSSKJrJrJr SSK J r SSK J r SSK r SSKJrJr SSKrSSKrSSKr"SS\ 5rSS \4S jjr"S S 5rS r\S:Xa\"5 gg)N)ConfidentialClientApplicationPublicClientApplication)ListDictOptional) HTMLParser)unescape)datetimetimezonecD^\rSrSrSrU4SjrSrSrSrSr Sr U=r $) HTMLTextExtractor zExtract text from HTML contentc>>[TU]5 /UlSUlgN)super__init__text current_tag)self __class__s /var/www/html/troy/fetch.pyrHTMLTextExtractor.__init__s  cTXlUS:XaURRS5 gg)Nbr )rrappend)rtagattrss rhandle_starttag!HTMLTextExtractor.handle_starttags& $; II  T " rcTUS;aURRS5 SUlg)N)pdivtrlir)rrr)rrs r handle_endtagHTMLTextExtractor.handle_endtags% * * II  T "rc:URRU5 gr)rr)rdatas r handle_dataHTMLTextExtractor.handle_datas rcTSRUR5R5$)N)joinrstrip)rs rget_textHTMLTextExtractor.get_text!swwtyy!''))r)rr) __name__ __module__ __qualname____firstlineno____doc__rr r'r+r1__static_attributes__ __classcell__)rs@rr r s$( #  **rr log_filecSn[RRU5(d[R"U5 [RR X5n[ R "[ RSS[ R"U5[ R"5/S9 [ R"[5nURS5 URS5 URSU35 URS5 U$)z< Set up logging configuration Logs to both file and console logsz)%(asctime)s - %(levelname)s - %(message)sz%Y-%m-%d %H:%M:%S)levelformatdatefmthandlers<============================================================z2Email Checker Script Started (Microsoft Graph API)z Log file: ) ospathexistsmakedirsr/logging basicConfigINFO FileHandler StreamHandler getLoggerr3info)r:log_dirlog_pathloggers r setup_loggingrP%s G 77>>' " " Gww||G.H ll:#    )  ! ! #   x (F KK KKDE KK*XJ'( KK Mrc\rSrSrS S\S\S\S\S\\4 SjjrS rS \S \4S jrS!S \ S \\4Sjjr S"S\S\S\\ S\ 4Sjjr S\ S\4Sjr S\S\ \\44SjrS#S\S\S\ S\S\\S\\ 4 SjjrSrg)$ EmailCheckerDN email_address client_id client_secret tenant_id authoritycXlX lX0lX@lU=(d SU3UlSUlSUl[R"[5Ul S/Ul U(a[U5S:XaURS5S:XaURRS5 URRS 5 URRS 5 URRS 5 URRS 5 gUS ;a7URRS5 URRS5 gg)a Initialize email checker using Microsoft Graph API Args: email_address: Your email address (user principal name) client_id: Azure AD Application (Client) ID client_secret: Azure AD Application Client Secret (the VALUE, not the Secret ID!) tenant_id: Azure AD Tenant ID (or 'common' for multi-tenant) authority: Optional custom authority URL (defaults to https://login.microsoftonline.com/{tenant_id}) z"https://login.microsoftonline.com/z https://graph.microsoft.com/v1.0Nz$https://graph.microsoft.com/.default$-uc⚠️ WARNING: Your CLIENT_SECRET looks like a Secret ID (UUID format) instead of a Secret Value!z? Secret IDs look like: '46804c3d-9b84-40b4-8972-d0b493ffa4d1'zU Secret Values look like: '0eB8Q~zpWLgBaBjbuSEdCcWw0PqebXY...' (long random string)z2 Please use the Secret VALUE, not the Secret ID!zF See GET_SECRET.md for instructions on how to get the correct value.)YOUR_SECRET_VALUE_HEREr.NuZ❌ ERROR: CLIENT_SECRET is not set! Please update fetch.py with your actual secret value.z& See GET_SECRET.md for instructions.)rTrUrVrWrXgraph_endpoint access_tokenrFrKr3rOscopelencountwarningerror)rrTrUrVrWrXs rrEmailChecker.__init__Es+"*""V(J9+&V@ ''1 <=  S/25-:M:Mc:RVW:W KK  !F G KK   a b KK   w x KK   T U KK   h i B B KK  z { KK  F GCrcURRS5 URRSUR35 URRSUR35 URRS5 [ URUR URSS9nURRS5 URRS5 URRS UR 35 URUR S 9nURRS 5 S U;a&US UlURRS 5 gURSURSS55nURS/5nURRSU35 URRSU35 URRSU35 S[U5;dS[U5R5;aURRS5 g S[U5;dS[U5R5;aURRS5 g S[U5;aURRS5 g S[U5;aURRS5 g ![RRaCnURRS!U35 URRS"5 S#nAg S#nAf[RR aCnURRS$U35 URRS%5 S#nAg S#nAf["a'nURRS&U3SS'9 S#nAg S#nAff=f)(z.Get access token using client credentials flowz6Attempting to authenticate with Microsoft Graph API... Authority: Client ID: z)Creating ConfidentialClientApplication...)rUclient_credentialrXtimeoutz2ConfidentialClientApplication created successfullyz#Calling acquire_token_for_client...zScopes: )scopesz'acquire_token_for_client call completedr_"Successfully obtained access tokenTerror_descriptionrd Unknown error error_codesFailed to obtain access token: z Error code: zFull error details: AADSTS7000215invalid_client_secretz8Invalid client secret. Please verify your CLIENT_SECRET. AADSTS700016invalid_clientz0Invalid client ID. Please verify your CLIENT_ID. AADSTS90002z0Invalid tenant ID. Please verify your TENANT_ID. AADSTS65005zdApplication does not have required permissions. Please grant Mail.Read permission and admin consent.FzTimeout during authentication: zKThe authentication request timed out. Please check your network connection.Nz(Connection error during authentication: z\Could not connect to Microsoft authentication service. Please check your network connection.Error during authentication: exc_info)rOrLrXrUrrVr`acquire_token_for_clientr_getrdstrlowerrequests exceptionsTimeoutConnectionError Exception)rappresultrd error_codees rget_access_tokenEmailChecker.get_access_tokenfs' QR ;t~~&678 ;t~~&678 DE1 /.."&"4"4.. C KK  Q R KK  B C KK  x |4 5111DF KK  F G'$*>$:!   !EF #6 7O8\]#ZZ r:  !!$CE7"KL !!L "=> !!$8"AB#c&k15LPSTYPZP`P`Pb5bKK%%&`a$s6{26F#e*JZJZJ\6\KK%%&XY  #c&k1KK%%&XY#c&k1KK%%'MN""**  KK   ?sC D KK  k l""22  KK   HL M KK  | }  KK   =aSAD  Q sKC'K$0CK$AK$*K$9*K$$O9M!O!9N O,OOusernamepasswordc*URRS5 URRSUR35 URRSUR35 [ URURS9nUR UUS/S9nSU;a&USUlURRS5 g URS URS S 55nURRS U35 URRSU35 S[U5;dS[U5;aURRS5 g![a'nURRSU3S S9 SnAgSnAff=f)z Alternative: Get access token using Resource Owner Password Credentials (ROPC) flow Note: This requires username and password, and may not work if MFA is enabled z4Attempting to authenticate with username/password...rgrh)rUrXz%https://graph.microsoft.com/Mail.Read)rrrlr_rmTrnrdrorqzError details: AADSTS50076MFAzTMulti-factor authentication is required. Please use client credentials flow instead.FrxryN) rOrLrXrUr"acquire_token_by_username_passwordr_r|rdr}r)rrrrrrdrs rget_access_token_with_password+EmailChecker.get_access_token_with_passwordsn OP ;t~~&678 ;t~~&678 )....C ;;!!?@<F '$*>$:!   !EF #6 7O8\] !!$CE7"KL !!OF8"<= CK/5CK3GKK%%&|}  KK   =aSAD  Q s -AE! BE!! F+F  F use_passwordcU(a?U(dURRS5 gURURU5$UR 5$)z Connect to Microsoft Graph API Args: use_password: If True, use username/password flow. If False, use client credentials flow. password: Required if use_password is True z7Password is required when using password authenticationF)rOrdrrTr)rrrs rconnectEmailChecker.connectsH  !!"[\66t7I7I8T T((* *rendpointmethodparams retry_on_401cLUR(dURRS5 gURU3nSUR3SS.nUS:Xa[R "XVUS9nO;US:Xa[R "XVUS 9nOURRS U35 gUR5 UR5$![RRGanURRS :XGaU(GaURRS 5 UR5(GaWURRS 5 SUR3US'US:Xa[R "XVUS9nOUS:Xa[R "XVUS 9nWR5 UR5sSnA$![RRayn URRSU 35 [!U RS5(a2URRSU RR"35 Sn A SnAgSn A f[$a+n URRSU 3SS9 Sn A SnAgSn A ff=fURRS5 [!URS5(a2URRSURR"35 SnAgURRSU35 [!URS5(a2URRSURR"35 SnAgSnAf[$a'nURRSU3SS9 SnAgSnAff=f)a  Make a request to Microsoft Graph API Args: endpoint: Graph API endpoint (e.g., "/users/{email}/messages") method: HTTP method (GET, POST, etc.) params: Query parameters retry_on_401: If True, automatically re-authenticate and retry on 401 errors z0No access token available. Call connect() first.NzBearer zapplication/json) Authorizationz Content-TypeGET)headersrPOST)rjsonzUnsupported HTTP method: izRReceived 401 Unauthorized - token may be expired. Attempting to re-authenticate...z1Re-authentication successful. Retrying request...rzHTTP error on retry: rz Response: zError on retry: Tryz/Re-authentication failed. Cannot retry request.z HTTP error: z Error making Graph API request: )r_rOrdr^rr|postraise_for_statusrr HTTPErrorresponse status_codercrrLhasattrrr) rrrrrurlrrrretry_es rmake_graph_requestEmailChecker.make_graph_requests  KK  P Q$$%hZ0&t'8'8&9:.  0 #<<VL6!#==FK !!$=fX"FG  % % '==? """,,! zz%%, ##$xy<<>>KK$$%XY189J9J8K/LGO,$!U?'/||CQW'XH#v-'/}}SPV'WH 113'}}.#..88$ )),A'*KL"7#3#3V<< KK-- 7;K;K;P;P:Q.RS#t$$ )),# UHocMUTS:wdMSv M g7f)Nrr).0vdetailss r 5EmailChecker.extract_email_details..s%h)9AaqT[\fTgOgaa)9s    z Extracted z fields from email body)research IGNORECASEgroupr0rOdebugrcsubr~matchsumvaluesrL)rr name_match phone_match email_match address_matchrdatetime_matchrdt_split dropoff_matchdropoffpassenger_match number_match pickup_matchpickupextracted_countrs @rextract_email_details"EmailChecker.extract_email_details:s!%$( $  6YYbmmD (..q1779GFO KK   00AB C KK   H Iii 0$ F *00399;GG  KK   1''2B1CD E KK   I Jii Y[_acanano *00399;GG  KK   1''2B1CD E KK   I J "4dBMMJ #))!,224GffVS'2G!(GI  KK   3GI4F3GH I KK   K L#?r}}U &,,Q/557I K/'0 $ !!$;GK2D2DQ2G2M2M2O./ !!$DWMcEdDe"fg KK   X Yyy!Fbmm\ !''*002F||~,.4*+ !!$@I[A\@]"^_ KK   T Uh)9hh :o%66MNOr sender_emailfolder unread_onlytop from_datec UR(dURRS5 /$/nSnU(an[U5S:XaUS3nO#UnUR S5(d SU;aUS-nUR SU35 URR SUS US 35 U(aUR S 5 U(aS RU5OSnS URSUS3n USSS.n U(aXS'URR SU35 U(aURR SUS35 U(aURR S5 URR SUS35 URXS9n U (dURRS5 /$U RS/5n URR S[U 5S35 U(aURR SU35 /n S nS nU GHnURS!05nURS"05RS#S$5R5nUUR5:waUS%- nMaU(GaU(Ga URS&S$5nU(aURSS'5nURSS'5n[R"U5n[R"U5nURcUR[ R"S(9nURcUR[ R"S(9nUU:a*US%- nURR%S)US*US 35 GM_OURR)S.5 GM~U R U5 GM URR S/[U 5S0US135 US :aURR S2US335 US :aURR S2US435 /n[+U S%5GHunnURS5S65nURR S7US8[U 5S9US 35 URS:S;5nURS!05nURS"05RS#S<5nURS"05RS=S$5nURS&S$5nURR S>U35 URR S?US@USA35 URR SBU35 URS URSCU3SDSE0S9nU(aFURSE5(a0URSE5USE'URR%SF5 OURR)SG5 URR%SJ5 UR-U5n URR%SK[U 5SL35 U (a"URR SMU SSN35 OURR)SO5 URR SP5 UR/U 5n!UUU(aUS@USA3OUUU U!SQ.n"UR U"5 URR SR5 URR SSU35 URR STU35 URR SUUS@USA35 URR SVU35 URR SW5 URR SXU!RS=SY535 URR SZU!RS[SY535 URR S\U!RS]SY535 URR S^U!RS#SY535 U!RS_5(a.URR S`U!RS_535 O\URR SaU!RSbSY535 URR ScU!RSdSY535 URR SeU!RSfSY535 URR SgU!RShSY535 URR SiU!RSjSY535 URR SR5 [1SkSR35 [1SSU35 [1STU35 [1SUUS@USA35 [1SVU35 [1SW5 [1SXU!RS=SY535 [1SZU!RS[SY535 [1S\U!RS]SY535 [1S^U!RS#SY535 U!RS_5(a[1S`U!RS_535 O<[1SaU!RSbSY535 [1ScU!RSdSY535 [1SeU!RSfSY535 [1SgU!RShSY535 [1SiU!RSjSY535 [1SRSk35 GM URR Sl[U5Sm35 U$![&a.nURR)S+US,US-35 SnAG MeSnAff=f![&a*nURR)SHUSI35 SnAGNSnAff=f![&a)nURRSnU3SoSp9 /sSnA$SnAff=f)qa Check emails from a specific sender using Microsoft Graph API Args: sender_email: Email address to search for folder: Email folder to search (default: inbox) unread_only: If True, only check unread emails top: Maximum number of emails to retrieve (default: 100) from_date: Filter emails from this date onwards (format: "YYYY-MM-DD" or "YYYY-MM-DDTHH:MM:SSZ") Example: "2025-12-16" or "2025-12-16T00:00:00Z" Returns: List of dictionaries containing email details z(Not authenticated. Call connect() first.N z T00:00:00ZZ+zreceivedDateTime ge zFiltering emails from z onwards (ISO: )zisRead eq falsez and z/users/z /mailFolders/z /messagesz,id,subject,from,receivedDateTime,body,isReadzreceivedDateTime desc)z$top$selectz$orderbyz$filterzSearching for emails in folder zDate filter: from z onwardsz Filtering for UNREAD emails onlyzWill filter by sender 'z' in Python after fetching)rz(Failed to retrieve emails from Graph APIvaluez Retrieved z email(s) from Graph APIz;Python-side date filter will be applied: emails must be >= rfrom emailAddressrr.rreceivedDateTimez+00:00)tzinfozFiltering out email from z (before zCould not parse date z: z. Skipping email.zHEmail has no receivedDateTime but date filter is active. Skipping email.zFound z email(s) from z after filteringz Filtered out z email(s) by senderz email(s) by dateidunknownzProcessing email /z (ID: subjectz No SubjectUnknownrzEmail Subject: z Email From: z <>z Email Date: z /messages/rrzFetched full message bodyz7Could not fetch full message body, using body from listz"Error fetching full message body: z, using body from listzExtracting email body...zEmail body length: z charactersz&Email body preview (first 500 chars): izEmail body is empty!z-Extracting booking details from email body...)rrrrrextracted_detailsrAz Email ID: z Subject: zFrom: zDate: z Extracted Booking Details:z Name: zN/Az Phone: rz Email: rz Address: rz Date & Time: z Date: rz Time: rz Pick Up Location: rz Drop Off Location: rz Number of Passengers: rrzSuccessfully processed z email(s)zError checking emails: Try)r_rOrdraendswithrrLr/rTrr|r~replacer fromisoformatrr utcrrrc enumeraterrprint)#rrrrrr filter_parts from_date_iso filter_queryrr response_data emails_data emails_foundfiltered_by_date_countfiltered_by_sender_countr from_info from_addr received_dateemail_date_strfilter_date_str email_date filter_daterprocessed_emailsidxemail_idr from_namer full_messagerr email_infos# rcheck_emails_from_sender%EmailChecker.check_emails_from_senders" "  KK  H II^ L My>R''0k$vhG H   #5i[!IJ   !CD KK  6|nD^_ `!33H3LM  !!"LM '++GR8K KK  z#k*:);;ST U   #^_l^m!noL%& "'( $) &NN626 %MM."=AA)RPVVX  2 2 44,1,$.NN3Er$JM$%.;-B-B3-QN.;.C.CC.RO)1)?)?)OJ*2*@*@*QK *008-7-?-?x||-?-T *119.9.A.A.A.V  *K7 6! ; 6 $ 1 14Mj\Ybcnboop2q r ( 8 ++,vw ##J/S*V KK  vc,&7%8 ~Uef g'!+   =1I0JJ]!^_%)   =1G0HHY!Z[ " #,\1#=Z%>>$ :   #4SE3|;L:MVT\S]]^!_`%..LA&NN626 %MM."=AA)YW %MM."=AA&"M !~~&8"=   ?7)!<=   < {"YKq!IJ   <v!67 h#'#:#:!$"4"4!5ZzJ )62$;$L $ (8(8(@(@-9-=-=f-E 6* ))*EF ++,ef  !!"<=**:6 !!$7D {+"NOKK$$'NtTXUXzl%[\KK''(>?   !PQ44T:#& '++gu"=!>?@ '++gu"=!>?@ GKK 5$A#BCD;;{++OGKK ,D+EFGHW[[%?$@ABHW[[%?$@AB,W[[9KU-S,TUV-gkk:Mu.U-VWX0=SUZ1[0\]^m$E$>H KK  6s;K7L6MYW X# #o )% KK//2G VXYZX[[l0mn$%^!hKK''*LQCOe(fgghT  KK   7s;d  KI sFo7C1o)Cm:GoA.n on U0o n"n<ono n?n:4o:n??o o5 o0*o50o5) r_rXrUrVrTr^rOr`rWr)FN)rNT)scheduling@usetwine.cominboxFdN)r3r4r5r6r}rrrrboolrrrranyrintrrr8rrrrRrRDs!<@HcHcH#HH,4SMHB8t%s%c%N+D+HSM+ D3DDXVZ^DrvDL!!#!:z#z$sCx.zxr2siG ''"' * *0C>e e PGT zFr