o tBh4@sdZddlmZddlZddlZddlZddlZddlZddlZddl m Z dZ dZ dZ dZd ZeeZd d Zefd d ZefddZd'ddZddZddZddZddZddZddZdd Zd!d"Zd#d$ZGd%d&d&e Z!dS)(z4Shared utilities used by both downloads and uploads.)absolute_importN)commonrangez content-rangezCurrently using crcmod in pure python form. This is a slow implementation. Python 3 has a faster implementation, `google-crc32c`, which will be used if it is installed.z x-goog-hashzNo {checksum_type} checksum was returned from the service while downloading {} (which happens for composite objects), so client-side content integrity checking is not being performed.cCdS)zSimple default callback.Nrrrv/var/www/html/riverr-enterprise-integrations-main/venv/lib/python3.10/site-packages/google/resumable_media/_helpers.py do_nothing-rcCs,||}||vr|t|d|||S)aChecks that a specific header is in a headers dictionary. Args: response (object): An HTTP response object, expected to have a ``headers`` attribute that is a ``Mapping[str, str]``. name (str): The name of a required header. get_headers (Callable[Any, Mapping[str, str]]): Helper to get headers from an HTTP response. callback (Optional[Callable]): A callback that takes no arguments, to be executed when an exception is being raised. Returns: str: The desired header. Raises: ~google.resumable_media.common.InvalidResponse: If the header is missing. z$Response headers must contain headerrInvalidResponse)responsename get_headerscallbackheadersrrrheader_required1srcCs2||}||vr|tj|d|dg|R|S)a`Require a response has a status code among a list. Args: response (object): The HTTP response object. status_codes (tuple): The acceptable status codes. get_status_code (Callable[Any, int]): Helper to get a status code from a response. callback (Optional[Callable]): A callback that takes no arguments, to be executed when an exception is being raised. Returns: int: The status code. Raises: ~google.resumable_media.common.InvalidResponse: If the status code is not one of the values in ``status_codes``. zRequest failed with status codezExpected one ofr )r status_codesget_status_coder status_coderrrrequire_status_codeNsr@cCs0||}||kr |}tdd}||d|fS)aCalculate the amount of time to wait before a retry attempt. Wait time grows exponentially with the number of attempts, until ``max_sleep``. A random amount of jitter (between 0 and 1 seconds) is added to spread out retry attempts from different clients. Args: base_wait (float): The "base" wait time (i.e. without any jitter) that will be multiplied until it reaches the maximum sleep. max_sleep (float): Maximum value that a sleep time is allowed to be. multiplier (float): Multiplier to apply to the base wait. Returns: Tuple[float, float]: The new base wait time as well as the wait time to be applied (with a random amount of jitter between 0 and 1 seconds added). rigMbP?)randomrandint) base_wait max_sleep multiplier new_base_wait jitter_msrrrcalculate_retry_waitms  rc Csd}d}t|j|j}zt}Wn tyd}Ynw d}z|}Wn|y9} z| }WYd} ~ nd} ~ ww||tjvrC|S|||sO|rM||St||j |j\}} |d7}|| 7}t | q)a[Attempts to retry a call to ``func`` until success. Expects ``func`` to return an HTTP response and uses ``get_status_code`` to check if the response is retry-able. Will retry until :meth:`~.RetryStrategy.retry_allowed` (on the current ``retry_strategy``) returns :data:`False`. Uses :func:`calculate_retry_wait` to double the wait time (with jitter) after each attempt. Args: func (Callable): A callable that takes no arguments and produces an HTTP response which will be checked as retry-able. get_status_code (Callable[Any, int]): Helper to get a status code from a response. retry_strategy (~google.resumable_media.common.RetryStrategy): The strategy to use if the request fails and must be retried. Returns: object: The return value of ``func``. grrTN) float initial_delayr_get_connection_error_classes ImportErrorr RETRYABLE retry_allowedrrtimesleep) funcrretry_strategy total_sleep num_retriesrconnection_error_exceptionserrorr e wait_timerrrwait_and_retrys:      r0c Cs`z ddl}|}W|Sty/zddl}|jd}tWY|Sty.tdww)zGet crc32c object Attempt to use the Google-CRC32c package. If it isn't available, try to use CRCMod. CRCMod might be using a 'slow' varietal. If so, warn... rNzcrc-32cz3Failed to import either `google-crc32c` or `crcmod`) google_crc32cChecksumr#crcmod predefinedCrc_is_fast_crcmod)r1crc_objr3rrr_get_crc32c_objects     r8cCs:tdttdgd}t|dd}|stjttdd|S)Nz crcmod.crcmod_usingExtensionrF) stacklevel) __import__globalslocalsgetattrwarningswarn_SLOW_CRC32C_WARNINGRuntimeWarning) nested_crcmodfast_crcrrrr6s r6cCs|dkrdS|S)Nmd5md5Hashr checksum_typerrr_get_metadata_keysrJcCst|}|dS)zConvert a checksum object into a digest encoded for an HTTP header. Args: bytes: A checksum digest bytestring. Returns: str: A base64 string representation of the input. zutf-8)base64 b64encodedecode)digest_bytestringencoded_digestrrrprepare_checksum_digests rPcCs|dvrtd|dvrF||}t|t||d}|dur3tj||d}t|t }||fS|dkr?t }||fSt }||fSd}t }||fS)aGet the expected checksum and checksum object for the download response. Args: response (~requests.Response): The HTTP response object. get_headers (callable: response->dict): returns response headers. media_url (str): The URL containing the media to be downloaded. checksum_type Optional(str): The checksum type to read from the headers, exactly as it will appear in the headers (case-sensitive). Must be "md5", "crc32c" or None. Returns: Tuple (Optional[str], object): The expected checksum of the response, if it can be detected from the ``X-Goog-Hash`` header, and the appropriate checksum object for the expected checksum. )rFcrc32cN4checksum must be ``'md5'``, ``'crc32c'`` or ``None``)rFrQ)checksum_labelNrHrF) ValueError_parse_checksum_headerget _HASH_HEADER_MISSING_CHECKSUMformatupper_LOGGERinfo_DoNothingHashhashlibrFr8)r r media_urlrIrexpected_checksummsgchecksum_objectrrr_get_expected_checksums,   rccCs|durdSg}|dD]}|dd\}}||kr"||q t|dkr+dSt|dkr5|dSt|d|||)aDParses the checksum header from an ``X-Goog-Hash`` value. .. _header reference: https://cloud.google.com/storage/docs/ xml-api/reference-headers#xgooghash Expects ``header_value`` (if not :data:`None`) to be in one of the three following formats: * ``crc32c=n03x6A==`` * ``md5=Ojk9c3dhfxgoKVVHYwFbHQ==`` * ``crc32c=n03x6A==,md5=Ojk9c3dhfxgoKVVHYwFbHQ==`` See the `header reference`_ for more information. Args: header_value (Optional[str]): The ``X-Goog-Hash`` header from a download response. response (~requests.Response): The HTTP response object. checksum_label (str): The label of the header value to read, as in the examples above. Typically "md5" or "crc32c" Returns: Optional[str]: The expected checksum of the response, if it can be detected from the ``X-Goog-Hash`` header; otherwise, None. Raises: ~google.resumable_media.common.InvalidResponse: If there are multiple checksums of the requested type in ``header_value``. N,=rrz.X-Goog-Hash header had multiple ``{}`` values.)splitlstripappendlenrr rY) header_valuer rSmatcheschecksumr valuerrrrU-s$    rUcCs2|dkrtS|dkrtS|durdStd)z~Respond with a checksum object for a supported type, if not None. Raises ValueError if checksum_type is unsupported. rFrQNrR)r^rFr8rTrHrrr_get_checksum_objectbsrncCsddl}|jj|jjfS)aGet the exception error classes. Requests is a soft dependency here so that multiple transport layers can be added in the future. This code is in a separate function here so that the test framework can override its behavior to simulate requests being unavailable.rN)requests.exceptions exceptionsConnectionErrorChunkedEncodingError)requestsrrrr"qsr"c@seZdZdZddZdS)r]zDo-nothing hash object. Intended as a stand-in for ``hashlib.md5`` or a crc32c checksum implementation in cases where it isn't necessary to compute the hash. cCr)zDo-nothing ``update`` method. Intended to match the interface of ``hashlib.md5`` and other checksums. Args: unused_chunk (bytes): A chunk of data. Nr)self unused_chunkrrrupdater z_DoNothingHash.updateN)__name__ __module__ __qualname____doc__rvrrrrr]s r])r)"rz __future__rrKr^loggingrr&r@google.resumable_mediar RANGE_HEADERCONTENT_RANGE_HEADERrBrWrX getLoggerrwr[rrrrr0r8r6rJrPrcrUrnr"objectr]rrrrs<      @*5