o sh@sUddlmZmZmZmZddlmZmZddlm Z ddl m Z m Z ddl mZe r8ddlmZdd lmZeed efZeed <ed eed ZedeeedZdedeeefddZGdddeZdS))AnySequence TypedDictUnion) TypeAliasoverload) is_pil_image)is_vision_availablerequires_backends)Pipeline)Image load_imagez Image.Image ImagePairKeypointxyMatchkeypoint_image_0keypoint_image_1scoreimagesreturncs`d}ddt|tr,t|dkrtfdd|Dr|gStfdd|Dr,|St|)N)z-Input images must be a one of the following :z - A pair of images.z - A list of pairs of images.cSst|pt|tS)z"images is a PIL Image or a string.)r isinstancestr)imager f/var/www/html/alpaca_bot/venv/lib/python3.10/site-packages/transformers/pipelines/keypoint_matching.py_is_valid_image+sz-validate_image_pairs.._is_valid_imagerc3|]}|VqdSNr .0rr"r r! 0z'validate_image_pairs..c3s<|]}t|tot|dkotfdd|DVqdS)rc3r#r$r r%r'r r!r(5r)z1validate_image_pairs...N)rrlenall)r& image_pairr'r r!r(2s  )rrr*r+ ValueError)r error_messager r'r!validate_image_pairs$s " r/c seZdZdZdZdZdZdZfddZdddZ e dd e d e d e d eefddZe dd ee d e d e d eeefddZ dd eee e fd e d e d eeeeeefffdd ZdddZddZdd eefddZZS)KeypointMatchingPipelinez Keypoint matching pipeline using any `AutoModelForKeypointMatching`. This pipeline matches keypoints between two images. FTcs2tj|i|t|d|jdkrtddS)NvisionptzBKeypoint matching pipeline only supports PyTorch (framework='pt').)super__init__r frameworkr-)selfargskwargs __class__r r!r4Fs   z!KeypointMatchingPipeline.__init__NcCs2i}|dur ||d<i}|dur||d<|i|fS)Ntimeout thresholdr )r6r<r;preprocess_paramspostprocess_paramsr r r!_sanitize_parametersLs z-KeypointMatchingPipeline._sanitize_parametersinputsr<r8rcKdSr$r r6rAr<r8r r r!__call__Uz!KeypointMatchingPipeline.__call__cKrBr$r rCr r r!rDXrEc sH|durtdt|}tj|fd|i|}t|dkr"|dS|S)a Find matches between keypoints in two images. Args: inputs (`str`, `list[str]`, `PIL.Image` or `list[PIL.Image]`): The pipeline handles three types of images: - A string containing a http link pointing to an image - A string containing a local path to an image - An image loaded in PIL directly The pipeline accepts either a single pair of images or a batch of image pairs, which must then be passed as a string. Images in a batch must all be in the same format: all as http links, all as local paths, or all as PIL images. threshold (`float`, *optional*, defaults to 0.0): The threshold to use for keypoint matching. Keypoints matched with a lower matching score will be filtered out. A value of 0 means that all matched keypoints will be returned. kwargs: `timeout (`float`, *optional*, defaults to None)` The maximum time in seconds to wait for fetching images from the web. If None, no timeout is set and the call may block forever. Return: Union[list[Match], list[list[Match]]]: A list of matches or a list if a single image pair is provided, or of lists of matches if a batch of image pairs is provided. Each match is a dictionary containing the following keys: - **keypoint_image_0** (`Keypoint`): The keypoint in the first image (x, y coordinates). - **keypoint_image_1** (`Keypoint`): The keypoint in the second image (x, y coordinates). - **score** (`float`): The matching score between the two keypoints. NzFCannot call the keypoint-matching pipeline without an inputs argument!r<r r)r-r/r3rDr*)r6rAr<r8formatted_inputsoutputsr9r r!rD[s' csJfdd|D}|j||jd}||j}dd|D}||d}|S)Ncsg|]}t|dqS)r;rr%rHr r! sz7KeypointMatchingPipeline.preprocess..)rreturn_tensorscSsg|]}|jqSr )sizer%r r r!rIs) model_inputs target_sizes)image_processorr5to torch_dtype)r6rr;rLrMpreprocess_outputsr rHr! preprocesss   z#KeypointMatchingPipeline.preprocesscCs,|d}|jdi|}||dgd}|S)NrLrM) model_outputsrMr )model)r6rQrLrSforward_outputsr r r!_forwardsz!KeypointMatchingPipeline._forwardc Cs|d}|d}|jj|||d}|d}g}t|d|d|dD]-\}}} t|d|dd }t|d|dd }|t||| d q#t|d d d d}|S)NrSrM)rMr<r keypoints0 keypoints1matching_scoresr rrcSs|dS)Nrr )rr r r!sz6KeypointMatchingPipeline.postprocess..T)keyreverse)rNpost_process_keypoint_matchingzipritemappendrsorted) r6rUr<rSrMpostprocess_outputs pair_resultkp_0kp_1rr r r! postprocesss"z$KeypointMatchingPipeline.postprocess)NN)r@r$)__name__ __module__ __qualname____doc___load_processor_load_image_processor_load_feature_extractor_load_tokenizerr4r?rrfloatrlistrrDrrRrVrf __classcell__r r r9r!r0<s2   "* /r0N)typingrrrrtyping_extensionsrr image_utilsr utilsr r baser PILrrrr__annotations__rorrr/r0r r r r!s