hL dZddlmZmZmZddlmZmZmZddl Z ddl Z ddl m Z ddlmZmZmZmZdd lmZe jeZed d d Zeddd Zeddd eddd eddd fZd*dZdZ d+dZddddded d!ed"d#fddd$d%Z d,d&Z d'dddded d!ed"d#fdd(d)Z!dS)-zLabeled Faces in the Wild (LFW) dataset This dataset is a collection of JPEG pictures of famous people collected over the internet, all details are available on the official website: http://vis-www.cs.umass.edu/lfw/ )listdirmakedirsremove)joinexistsisdirN)Memory) get_data_home _fetch_remoteRemoteFileMetadata load_descr)Bunchzlfw.tgzz.https://ndownloader.figshare.com/files/5976018@055f7d9c632d7370e6fb4afc7468d40f970c34a80d4c6f50ffec63f5a8d536c0)filenameurlchecksumzlfw-funneled.tgzz.https://ndownloader.figshare.com/files/5976015@b47c8422c8cded889dc5a13418c4bc2abbda121092b3533a83306f90d900100apairsDevTrain.txtz.https://ndownloader.figshare.com/files/5976012@1d454dada7dfeca0e7eab6f65dc4e97a6312d44cf142207be28d688be92aabfapairsDevTest.txtz.https://ndownloader.figshare.com/files/5976009@7cb06600ea8b2814ac26e946201cdb304296262aad67d046a16a7ec85d0ff87c pairs.txtz.https://ndownloader.figshare.com/files/5976006@ea42330c62c92989f9d7c03237ed5d591365e89b3e649747777b70e692dc1592Tcrt|}t|d}t|st|tD]l}t||j}t|sF|r2t d|jt||Ztd|zm|rt|d}t}nt|d}t}t|st||j}t|sF|r2t d|jt||ntd|zd d l } t d || |d | t#|||fS)z0Helper function to download any missing LFW data) data_homelfw_homezDownloading LFW metadata: %s)dirnamez %s is missing lfw_funneledlfwz!Downloading LFW data (~200MB): %srNz$Decompressing the data archive to %szr:gz)path)r rrrTARGETSrloggerinforr IOErrorFUNNELED_ARCHIVEARCHIVEtarfiledebugopen extractallr) rfunneleddownload_if_missingrtargettarget_filepathdata_folder_patharchive archive_pathr)s Q/var/www/html/Sam_Eipo/venv/lib/python3.11/site-packages/sklearn/datasets/_lfw.py_check_fetch_lfwr5Js 222IIz**H (  AAx99o&& A" A :FJGGGfh77777o?@@@  A.99"%00 " # # Hg&677 l## >" > ?MMMgx88888o <=== ;=MNNN \6**5585DDD| % %%cd ddlm}n#t$rtdwxYwtddtddf}||}n't dt ||D}|\}}|j|jz |jpdz}|j|jz |jpdz} |3t|}t||z}t|| z} t|} |s$tj | || ftj} n$tj | || d ftj} t|D]\} } | d zdkrt d | dz| || }||j|j|j|jf}||| |f}tj|tj}|jdkrt/d | z|d z}|s|d}|| | df<| S)zInternally used to load imagesr)ImagezThe Python Imaging Library (PIL) is required to load data from jpeg files. Please refer to https://pillow.readthedocs.io/en/stable/installation.html for installing PIL.Nc3$K|] \}}|p|V dS)N).0sdss r4 z_load_imgs..s*GG51bqwBGGGGGGr6r dtypeizLoading face #%05d / %05dzLFailed to read the image file %s, Please make sure that libjpeg is installedgo@r)axis.)PILr8 ImportErrorslicetuplezipstopstartstepfloatintlennpzerosfloat32 enumerater$r*r+cropresizeasarrayndim RuntimeErrormean) file_pathsslice_colorrTr8 default_sliceh_slicew_slicehwn_facesfacesi file_pathpil_imgfaces r4 _load_imgsrgust      "    1c]]E!SMM2M ~GGC ,F,FGGGGGGW  %7<+<1=A  %7<+<1=A v  OO  OO*ooG ?'1a ;;;'1a+2:>>>"*-- 9 t8q== LL4a!eW E E E**Y'',, ]GM7< F    nnaV,,Gz'444 9>>=?HI    %99!9$$Daf Ls #Fcgg}}tt|D]}t||ts"fdttD}t |} | |krD|dd}||g| z||t |} | dkrtd|ztj |} tj | |} t||||} tj | }tj d|| || |} } | | | fS)z~Perform the actual data loading for the lfw people dataset This operation is meant to be cached by a joblib wrapper. c0g|]}t|Sr;)r)r<f folder_paths r4 z%_fetch_lfw_people..s#LLL!k1%%LLLr6_ rz*min_faces_per_person=%d is too restrictive*)sortedrrrrNreplaceextend ValueErrorrOunique searchsortedrgarangerandom RandomStateshuffle)r1rZr[rTmin_faces_per_person person_namesrY person_namepaths n_picturesra target_namesr/rbindicesrks @r4_fetch_lfw_peoplers "2*Lg&67788 % % +[99 [!!  LLLLvgk6J6J/K/KLLLZZ - - -%--c377K    : ; ; ;   e $ $ $*ooG!|| 8;O O   9\**L _\< 8 8F z65& 9 9Ei  GI"%%g...'NF7O6E &, &&r6g?FN)rr-rTrzr[rZr. return_X_yczt|||\}} td|t|dd} | t } | | ||||\} } }| t| d}td}|r|| fSt|| | || S) a Load the Labeled Faces in the Wild (LFW) people dataset (classification). Download it if necessary. ================= ======================= Classes 5749 Samples total 13233 Dimensionality 5828 Features real, between 0 and 255 ================= ======================= Read more in the :ref:`User Guide `. Parameters ---------- data_home : str, default=None Specify another download and cache folder for the datasets. By default all scikit-learn data is stored in '~/scikit_learn_data' subfolders. funneled : bool, default=True Download and use the funneled variant of the dataset. resize : float or None, default=0.5 Ratio used to resize the each face picture. If `None`, no resizing is performed. min_faces_per_person : int, default=None The extracted dataset will only retain pictures of people that have at least `min_faces_per_person` different pictures. color : bool, default=False Keep the 3 RGB channels instead of averaging them to a single gray level channel. If color is True the shape of the data has one more dimension than the shape with color = False. slice_ : tuple of slice, default=(slice(70, 195), slice(78, 172)) Provide a custom 2D slice (height, width) to extract the 'interesting' part of the jpeg files and avoid use statistical correlation from the background. download_if_missing : bool, default=True If False, raise a IOError if the data is not locally available instead of trying to download the data from the source site. return_X_y : bool, default=False If True, returns ``(dataset.data, dataset.target)`` instead of a Bunch object. See below for more information about the `dataset.data` and `dataset.target` object. .. versionadded:: 0.20 Returns ------- dataset : :class:`~sklearn.utils.Bunch` Dictionary-like object, with the following attributes. data : numpy array of shape (13233, 2914) Each row corresponds to a ravelled face image of original size 62 x 47 pixels. Changing the ``slice_`` or resize parameters will change the shape of the output. images : numpy array of shape (13233, 62, 47) Each row is a face image corresponding to one of the 5749 people in the dataset. Changing the ``slice_`` or resize parameters will change the shape of the output. target : numpy array of shape (13233,) Labels associated to each face image. Those labels range from 0-5748 and correspond to the person IDs. target_names : numpy array of shape (5749,) Names of all persons in the dataset. Position in array corresponds to the person ID in the target array. DESCR : str Description of the Labeled Faces in the Wild (LFW) dataset. (data, target) : tuple if ``return_X_y`` is True A tuple of two ndarray. The first containing a 2D array of shape (n_samples, n_features) with each row representing one sample and each column representing the features. The second ndarray of shape (n_samples,) containing the target samples. .. versionadded:: 0.20 rr-r.z Loading LFW people faces from %srlocationcompressverbose)rTrzr[rZlfw.rst)dataimagesr/rDESCR) r5r$r*r cacherreshaperNrr)rr-rTrzr[rZr.rrr1m load_funcrbr/rXfdescrs r4fetch_lfw_peoplers|"2hDW"""H LL3X>>> 1a888A)**I#,)1 ###E6<  c%jj"%%A  " "F&y  uV,f   r6c t|d5}d|D}dddn #1swxYwYd|D}t|}tj|t} t } t |D]{\} } t| dkrFd| | <| dt | ddz f| dt | d dz ff} npt| d krFd| | <| dt | ddz f| d t | ddz ff} ntd | dz| fzt | D]\}\}} t||}n.#t$r!t|t|d }YnwxYwt tt|}t|||}| |}t| |||}t |j}|d}|dd |d|d z||_|| tjd dgfS)z}Perform the actual data loading for the LFW pairs dataset This operation is meant to be cached by a joblib wrapper. rbcg|];}|d.ws:LLL2ryy{{((**0066LLLr6Nc8g|]}t|dk|S)r)rN)r<sls r4rlz$_fetch_lfw_pairs..xs#:::c"ggkk"kkkr6r@rBr rrzinvalid line %d: %rzUTF-8zDifferent personsz Same person)r+rNrOrPrMlistrRrsr TypeErrorstrrprappendrgshapepopinsertarray)index_file_pathr1rZr[rT index_file split_lines pair_specsn_pairsr/rYrc componentspairjnameidx person_folder filenamesrdpairsrras r4_fetch_lfw_pairsrms ot $ $M LLLLL MMMMMMMMMMMMMMM::{:::J*ooGXgS ) ) )FJ":..)) : z??a  F1IAJqM 2 2Q 67AJqM 2 2Q 67DD__ ! !F1IAJqM 2 2Q 67AJqM 2 2Q 67DD 2a!eZ5HHII I'oo ) )NA{c K $%5t < <  K K K $%5s47I7I J J  KVGM$:$:;;<`. Parameters ---------- subset : {'train', 'test', '10_folds'}, default='train' Select the dataset to load: 'train' for the development training set, 'test' for the development test set, and '10_folds' for the official evaluation set that is meant to be used with a 10-folds cross validation. data_home : str, default=None Specify another download and cache folder for the datasets. By default all scikit-learn data is stored in '~/scikit_learn_data' subfolders. funneled : bool, default=True Download and use the funneled variant of the dataset. resize : float, default=0.5 Ratio used to resize the each face picture. color : bool, default=False Keep the 3 RGB channels instead of averaging them to a single gray level channel. If color is True the shape of the data has one more dimension than the shape with color = False. slice_ : tuple of slice, default=(slice(70, 195), slice(78, 172)) Provide a custom 2D slice (height, width) to extract the 'interesting' part of the jpeg files and avoid use statistical correlation from the background. download_if_missing : bool, default=True If False, raise a IOError if the data is not locally available instead of trying to download the data from the source site. Returns ------- data : :class:`~sklearn.utils.Bunch` Dictionary-like object, with the following attributes. data : ndarray of shape (2200, 5828). Shape depends on ``subset``. Each row corresponds to 2 ravel'd face images of original size 62 x 47 pixels. Changing the ``slice_``, ``resize`` or ``subset`` parameters will change the shape of the output. pairs : ndarray of shape (2200, 2, 62, 47). Shape depends on ``subset`` Each row has 2 face images corresponding to same or different person from the dataset containing 5749 people. Changing the ``slice_``, ``resize`` or ``subset`` parameters will change the shape of the output. target : numpy array of shape (2200,). Shape depends on ``subset``. Labels associated to each pair of images. The two label values being different persons or the same person. target_names : numpy array of shape (2,) Explains the target values of the target array. 0 corresponds to "Different person", 1 corresponds to "same person". DESCR : str Description of the Labeled Faces in the Wild (LFW) dataset. rzLoading %s LFW pairs from %srrrrrr)rtest10_foldszsubset='z' is invalid: should be one of )rTr[rZrr)rrr/rr)r5r$r*r rrrsrrpkeysrrrrrN)rrr-rTr[rZr.rr1rrlabel_filenamesrrr/rrs r4fetch_lfw_pairsrsYt"2hDW"""H LL/BBB 1a888A())I%"O _$$jvvtF?#7#7#9#9::;;; =   8_V%<==O#,))&f###E6< " "F  ]]3u::r * *!    r6)NTT)NFNr)NFN)"__doc__osrrros.pathrrrloggingnumpyrOjoblibr _baser r r rutilsr getLogger__name__r$r(r'r#r5rgrrFrrrr;r6r4rs)(((((((((''''''''''   8 $ $   8 O   &% 8 O$ <S # <S  <S 2(&(&(&(&VBBBVST('('('('Z    E"cNNEE"cNN +{{{{{HIM1I1I1I1Il     E"cNNEE"cNN +r6