OhDSSKrSSKrSSKrSSKrSSKJr SSKrSSKrSSKJ r SSK r SSK r SSK r SSKrSSKJr "SS5r"SS5rS \R&\R(SSS S S SSS SSS 4Sjrg)N) ThreadPool)Queue) get_invlistcn\rSrSrSrSSjrSrSrSrSr Sr S r S r S r S rS rSrSrSrg)BigBatchSearcherz Object that manages all the data related to the computation except the actual within-bucket matching and the organization of the computation (parallel or not) c X@l/UlX lXlXPl[ R "UR5n[ R"[U5X6S9Ul S/S-Ul [R"5=Ul Ulg)N)keep_maxr)verbosetictocxqindex use_float16faissis_similarity_metric metric_type ResultHeaplenrht_accutime t_displayt0)selfrrkr rr s V/var/www/html/shao/venv/lib/python3.13/site-packages/faiss/contrib/big_batch_search.py__init__BigBatchSearcher.__init__so   &--e.?.?@""3r7AAcAg #'99;.c8[R"5UlgN)r t_accu_t0rs r start_t_accuBigBatchSearcher.start_t_accu0sr crURU==[R"5UR- - ss'gr")rrr#)rns r stop_t_accuBigBatchSearcher.stop_t_accu3s# A$))+66r ctU[R"54UlURS:a [USSS9 gg)Nr Tendflush)rr r print)rnames rticBigBatchSearcher.tic6s1TYY[) <>C+??  IIK$'' ! #wis!DJJ$4$4#56 KKN3/x As7KLKKN3'uT[[^C,@A{{1~c*+ As+,%%a 0@0@.@!A#.Fq.HIJK))+,  .* r cURS5 Sn[UR5n[R"X R R 4SS9n[SX!5H\n[X$U-5nUR RRURXEUR R 5upgXsXE&M^ UR5 X0l g)Nzcoarse quantizationiint32)dtyper) r2rrnpemptyrnproberangemin quantizersearchr7q_assign)rbsnqrUi0i1q_dis_i q_assign_is rcoarse_quantization$BigBatchSearcher.coarse_quantizationWs &'  \88R!2!237C2"BRb!B"&**"6"6"="= 1 1#3 G)RO #   r cURS5 URnUS- n[R"URURR S-SS9UlURR5UlURS:a[SUR S5 UR SSUlU?UR5 g)Nz bucket sortr:)nbucketntrz number of -1s:) r2rUrmatrix_bucket_sort_inplacerrC bucket_limsravel query_idsr r0r7)rrUs rreorder_assignBigBatchSearcher.reorder_assignes ==A  ;; MM4::#3#3a#7B@,,. <>"(wwx    //55a88D YY[$U^^Q7    #::)rradd_result_subsetr)rroDrrIrs radd_results_to_heap$BigBatchSearcher.add_results_to_heapsW 9  YY[ 9A A !!(q1 A$))+**r cURRURRURR4$r")rshaperrPrCr$s rsizes_in_checkpoint$BigBatchSearcher.sizes_in_checkpoints+ tzz00$**2B2BCCr c.US-n[US5n[R"UR5UURR URR 4S.US5 SSS5 [R"X15 g!,(df  N%=f)Nz.tmpwb)sizes completedr) openpickledumprrryrzosreplace)rfnamertmpnamefs rwrite_checkpoint!BigBatchSearcher.write_checkpointsr&. '4 A KK!557!*7799dggii0b  ! 7"! s AB Bc2[US5n[R"U5nSSS5 WSUR5:XdeUSSURR SS&USSURR SS&US$!,(df  Nj=f)Nrbrrrr:r)rrloadrrryrz)rrrckps rread_checkpoint BigBatchSearcher.read_checkpoints % !++a.C7|t7799994y| ! 4y| ! ;  s B B) rcrrUrerrrr#rr rr rN)rF)__name__ __module__ __qualname____firstlineno____doc__rr%r)r2r7rIr\rfrur{rrr__static_attributes__r rrrsQ /$%7. %* ! .8 +D # r rcV\rSrSrSrS\R \R4SjrSr Sr g) BlockComputerzcomputation within one bucket knn_functioncXlUR[R:Xa2[R"UR UR 5nSnSnGO`UR[R:Xa[R"UR URRURRUR 5nURUl URRnSUl URnOUR[R:Xa{[R "UR UR"R$UR 5nUR"UlUR"RnSUl URnO['SURS35eXPlUS:XaSOUUlXplX lX0lX@lg)Nc$URS5$)Nfloat32)view)xs r(BlockComputer.__init__..s AFF9$5r FTz index type z not supportedr)r __class__r IndexIVFFlat IndexFlatdr IndexIVFPQIndexPQpqMnbitsdecode is_trainedrjIndexIVFScalarQuantizerIndexScalarQuantizersqqtype RuntimeError index_helprmmethodpairwise_distancesknn)rrrrrrrmrjs rrBlockComputer.__init__s] ??e00 0%2C2CDJ5KK __ 0 0 0UXX^^U5F5FHJ!HHJM$--..K$(J !++K __ = = =33):):TYY!^LAt [[G #  & &t__-B-B C%(]DOO "??))$2DAt [[0 0'';'GAAt [[N *88DL+LLDA!t r )rjrmrrrrrN) rrrrrrrrrrrrr rrrs%) "$77 !Fr rrFr:i rc  ^^^ ^1^2^3TRnUS;deURn[U5U-[R"S5R -n[U5T-[R"S5R [R"S5R --nUU-U-nUS:a*[ R"SUSUSUS US US - S S 3 5 [TUTUUS9m1[TUUUS9m2T2RT1l T2RT1l U cT1R5 OU T1l T1R5 Uc TRn[!5nU bX4STR4:Xde["R$R'U 5(aM[ R"SU 35 T1R)U 5n[ R"S[U535 O[ R"S5 US:Xa[+X5HnT1R-U5 T1R/U5unnnn0"5nT2R3UUUT5unnT1R4S==[0R0"5U- - ss'T1R7UUUU5 M GOUS:XaU1U4SjnT1R/U5n Sn![9S5n"[+X5HnT1R-U5 U"R;UU!US-45n#U unnnnT1R=5 T2R3UUUT5unnT1R?S5 UUUU4n!T1R=5 U#RA5n T1R?S5 M T1R6"U!6 U"RC5 GOSm3U34Sjn$S"U14Sjjn%U2U U4Sjn&[ES5n'[ES5n(U$"U&T ST [!5U(U'5n)U$"U%U UUUU'S5n*[0R0"5n+[ R"S5 U(RA5n,U,(dGO"U,un-n.n/n0nnnnU-U:XaSS- T1R4S==U0- ss'T1R4S==U.- ss'T1R4S==U/- ss'[ R"SU-35 T1R7UUUU5 [ R"SU-35 URGU-5 T1R-U-5 U bY[0R0"5U+- U :a=[ R"S 5 T1RIU U5 [0R0"5n+GMQU*RK5 U)RK5 T1RMS!5 T1RNRQ5 T1RS5 T1RNRTT1RNRV4$)#aG Search queries xq in the IVF index, with a search function that collects batches of query vectors per inverted list. This can be faster than the regular search indexes. Supports IVFFlat, IVFPQ and IVFScalarQuantizer. Supports three computation methods: method = "index": build a flat index and populate it separately for each index method = "pairwise_distances": decompress codes and compute all pairwise distances for the queries and index and add result to heap method = "knn_function": decompress codes and compute knn results for the queries threaded=0: sequential execution threaded=1: prefetch next bucket while computing the current one threaded=2: prefetch prefetch_threads buckets at a time. compute_threads>1: the knn function will get an additional thread_no that tells which worker should handle this. In threaded mode, the computation is tiled with the bucket perparation and the writeback of results (useful to maximize GPU utilization). use_float16: convert all matrices to float16 (faster for GPU gemm) q_assign: override coarse assignment, should be a matrix of size nq * nprobe checkpointing (only for threaded > 1): checkpoint: file where the checkpoints are stored checkpoint_freq: when to perform checkpoinging. Should be a multiple of threaded start_list, end_list: process only a subset of invlists )rrrrLint64rrzmemory: queries z assign z result z total z = i@r5z GiB)r r)rrrNzrecovering checkpoint: z already completed: z$no checkpoint: starting from scratchr;r:cl>UbTR"U6 UTR:aTRU5$g)zSperform the addition for the previous bucket and prefetch the next (if applicable) N)r{rCru)to_addrGbbsrs radd_results_and_prefetch2big_batch_search..add_results_and_prefetchas:!''05;;))!,,r r?c [U5n[X#5Vs/sHnX;dM URUXU4S9PM n nU Hn U R5 M UR 5 UR 5 SSS5 UR S5 gs snf!,(df  N%=f! [R"5 [R"5 e=f)N)args) rrQ apply_asyncgetclosejoinput traceback print_exc_threadinterrupt_main) task pool_size start_taskend_taskr output_queue input_queuepooliresrs rtask_manager_thread-big_batch_search..task_manager_thread~s  *d"'z!</"=A- =4++{;,="=/ !!JJLIIK+  &/+* ##%&&(s7 B(BBB;B8B(B B%!B((-Cc`>[R"TUS9nSUlUR5 U$)N)targetrT) threadingThreaddaemonstart)r task_managerrs rr&big_batch_search..task_managers5$++*L#'L      r c>[R"SU35 TRU5up4pVURXXEU45 [R"SU35 g! [R "5 [ R"5 e=f)NzPrepare start: z Prepare end: )logginginforurrrrr)task_idrrrorprrrsrs r prepare_task&big_batch_search..prepare_tasksz  wi89141C1CG1L.  'TT!JK }WI67 ##%&&(s AA-B c h>[R"SU35 Sn[R"5n[R"SU35 UR5n[R"5U- nUcUR S5 OUupxpn [R"SUSU35 [R"5nTS:aTR XU TUS9upOTR XU T5up[R"5U- n[R"SUSU35 [R"5nUR XvX>XX45 [R"5U- nGMK[R"S U35 g! [ R"5 [R"5 e=f) NzCompute start: rzCompute input: task zCompute work: task z , centroid r:) thread_idzCompute output: task z Compute end: ) rrrrrrrrrr)rrr t_wait_outr input_value t_wait_incentroidrorprrrsryrz t_computecompcomputation_threadsrs r compute_task&big_batch_search..compute_tasks  wi89 BLL#7y!AB"-//"3K $ b 0I"*#-?J$>>J"gk "" ((9  & & 'GJ&0G{ {m8J<@YggYc'U2CC1H N  r1 C  -   D&&CO&&CO ! ;;I%!U[[)9999 77>>* % % LL2:,? @++J7I LL1#i.1AB C LL? @1}z,A JJqM-0-?-?-B *HdHd))+C$$T41=DAq JJqMTYY[3. .M  # #Ha1 = - Q - ..z:!}z,A JJqM"&"2"2(61q5/#; -> *HdHd    $$T41=DAq OOA q(A-F     3 7 7 9  OOA - (  4  ! F$)8 %a+    E ! $  ,      $  yy{  LL- .)--/ESX PHiY!Xq8#A JJqMY &M JJqMY &M JJqMZ 'M LL:8*E F  # #Ha1 = LL8 C D MM( # JJx %99;-?LL!56((Y?#'99;L+. !!#!!#GGOFFOOGGI 6688SVVXX r )rrrrmultiprocessing.poolrrrqueuerrrDnumpyrNrfaiss.contrib.inspect_toolsrrrrrrrr rrs  + 3X X v55t 33 IIYr