tj@ d dl Z d dlZd dlZd dlmZmZ d dlmZ ddl m
Z
ddl m Z m
Z
ed Zdedz ded efd
Zd Zdd
Zd Z G d d Z G d de Z G d de
ZdS ) N)OptionalTypeVar )TrainerCallback)IntervalStrategy
has_length_Txmsgreturnc ( | t | | S N) RuntimeError)r
r s Y/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/utils/notebook.py_requirer s y3 H c z t | } | dz | dz dz | dz }}}|dk r | d|dd|dn|dd|dS )z$Format `t` (in seconds) to (h):mm:ssi < r :02d)int)thmss r format_timer # sm AA4i!r'R R!qA%&!VVa ! !! ! ! !! ! ! ! !A1C1C1CA1C1C1CCr , c & d| d| d| d| d| d S )Nz
)valuetotalprefixlabelwidths r html_progress_barr% * s[
', =B
r c d}|dz
}| d D ] }|d| dz
} |dz
}| dd D ]B}|d z
}|D ]3}t |t r|d
nt | }|d | d z
}4|d
z
}C|dz
}|S )z*Put the texts in `items` in an HTML table.z%
z*
r z
| z |
z
Nz
z.6fz
| z |
z
z
)
isinstancefloatstr)items html_codeilineelts r text_to_html_tabler0 5 s n>n5n5n !## A% 9;;L ,t >D t'''-1->%$JZBZ-[**-1*
""
+/(z !JJLLL+7+/+EV[I[+\( OOE " " " #DO )DN*28RVW8W8W !
#C(9D\>>DJ>>>DJJ
%
-Y\YYDJYYTEV9W9WYYDJJ e Zd ZdZd fd Zd Zd Zd
dZd Z xZ S ) r6 a
An object tracking the updates of an ongoing training with progress bars and a nice table reporting metrics.
Args:
num_steps (`int`): The number of steps during training. column_names (`list[str]`, *optional*):
The list of column names for the metrics table (will be inferred from the first call to
[`~utils.notebook.NotebookTrainingTracker.write_line`] if not set).
Nc p t | |d n|g| _ d | _ d S r )superrA inner_table child_bar)r@ num_steps column_names __class__s r rA z NotebookTrainingTracker.__init__ s9
####/#744l^ r c t | j | j | j | j | j | _ | j "| xj t | j z
c_ | j | xj | j j z
c_ | j
4t j t j
| j d | _
d S | j
t j
| j d S r^ )r% r r! r" r# r$ r, rl r0 rm r< r` r[ ra rS rb s r r[ z NotebookTrainingTracker.display s *4:tz4;PTPZ\`\fgg ' NN 01A B B BNN > % NNdn 6 6NN ; ,ty '@'@TRRRDKKK K ty 8 8 9 9 9 9 9r c | j It t g| _ dS | j d }D ]}||vr| | || j d< t | j dk r| j d }| j d d }|d | k r(| j fd|D dS |D ]$}|vr || | |< %fd|D | j d< dS | j fd|D dS )z
Write the values in the inner table.
Args:
values (`dict[str, float]`): The values to display.
Nr r' c < g | ]} |d S )zNo Log)get.0cvaluess r
z6NotebookTrainingTracker.write_line.. s' ,V,V,VVZZ8-D-D,V,V,Vr c g | ]
}| S r r )rw rx
new_valuess r rz z6NotebookTrainingTracker.write_line.. s +K+K+KaJqM+K+K+Kr c g | ]
}| S r r rv s r rz z6NotebookTrainingTracker.write_line.. s (D(D(Dq(D(D(Dr )rl listkeysry appendrZ index)r@ ry columnskey last_values first_columnrx r| s ` @r
write_linez"NotebookTrainingTracker.write_line s # $V[[]] 3 3T&--//5J5J KD &q)G
(
(g%%NN3'''")D Q 4#$$q(( " .r 2 # / 21 5 q>VL%999$++,V,V,V,Vg,V,V,VWWWWW "(J $ J J J..,7
a8H8H,IJqM+K+K+K+K7+K+K+KD$R((( ''(D(D(D(DG(D(D(DEEEEEr r c @ t ||| | | _ | j S )a
Add a child progress bar displayed under the table of metrics. The child progress bar is returned (so it can be
easily updated).
Args:
total (`int`): The number of iterations for the child progress bar.
prefix (`str`, *optional*): A prefix to write on the left of the progress bar.
width (`int`, *optional*, defaults to 300): The width (in pixels) of the progress bar.
)r" r5 r$ )r2 rm )r@ r! r" r$ s r add_childz!NotebookTrainingTracker.add_child s% -U6$V[\\\~ r c < d| _ | dS )z0
Closes the child progress bar.
N)rm r[ rb s r remove_childz$NotebookTrainingTracker.remove_child! s r r )Nr )
rd re rf rg rA r[ r r r
__classcell__)rp s @r r6 r6 s
: : : F F F> r r6 c H e Zd ZdZd Zd Zd Zd dZd Zd dZ d d Z
d
Z dS ) NotebookProgressCallbackz
A [`TrainerCallback`] that displays the progress of training or evaluation, optimized for Jupyter Notebooks or
Google colab.
c 0 d | _ d | _ d| _ d S )NF)training_trackerprediction_bar_force_next_updaterb s r rA z!NotebookProgressCallback.__init__/ s $ ""' r c |j t j k rdnd| _ d| _ d| _ | j gdgz }|j t j k r| d t |j | | _
d S )NEpochStepr
Training LossValidation Loss)
eval_strategyr EPOCHr
training_losslast_logNOr r6 max_stepsr )r@ argsstatecontrolkwargsro s r on_train_beginz'NotebookProgressCallback.on_train_begin4 s '+'9=M=S'S'SGGY_
)*o->> !1!4 4 4 1 2 2 2 7 V V r c t |j |j k rt |j n|j d}t | j d }| |j dz d| d|j | j d| _ d S )NrX z0on_train_begin must be called before on_step_endr' Epoch rW r; rB F)r epochr r rS global_stepnum_train_epochsr )r@ r r r r r tts r on_step_endz$NotebookProgressCallback.on_step_end= s $' $4$4 $C$CEK EKI]I]
d+-_
`
`
!=U==U%;== 0
#( r Nc f t | sd S | j q| j -| j t | | _ n!t t | | _ | j d d S | j | j j dz d S )Nr' )r r r r rZ r2 rS r )r@ r r r eval_dataloaderr s r on_prediction_stepz+NotebookProgressCallback.on_prediction_stepG s /** F &$0&*&;&E&Ec/FZFZ&[&[##&9#o:N:N&O&O# & &q ) ) ) ) ) & &t':'@1'D E E E E Er c T | j | j d | _ d S r )r rP )r@ r r r r s r
on_predictz#NotebookProgressCallback.on_predictS s. * % % ' ' ' "r c |j t j k rDd|v rBt | j d }d|d i}|j |d< | | d S d S d S )Nlossz+on_train_begin must be called before on_logr r )r r r r r r r )r@ r r r logsr r ry s r on_logz NotebookProgressCallback.on_logX sm !1!4 4 44 $/1^__B%tF|4F " .F6N MM& ! ! ! ! ! 5 4 r c |j t j k rdnd| _ ddd}t |j D ]}d|v r
|d |d< n| j dk rt
|j |d< n
|j |d< |i }d}|D ]-} | d rt j d d
| }.| d d }
| d d }
| | d
d }
| | dd }
| | dd }
| | dd }
|
D ]N\ } } | d } d d | dd D }
|
dk rd}
| ||
< O| j 8| j }| | | d| _ nst) j t) j t/ t1 | t1 | g d | _ d S )Nr r zNo log)r r r r eval_lossz\_loss$r8
total_flosr _runtime_samples_per_second_steps_per_second_model_preparation_time_rU c 6 g | ]}| S r )
capitalize)rw parts r rz z8NotebookProgressCallback.on_evaluate.. s" F F F4T__ . . F F Fr r' Lossr T) r r r r reversed log_historyr r r endswithresubpopr+ splitjoinr r r r r` r[ ra r0 r~ r ry r )r@ r r r metricsr ry logmetric_key_prefixkr vsplitsnamer s r on_evaluatez$NotebookProgressCallback.on_evaluatea s (,'9=M=S'S'SGGY_#+IIE -.. C}}*-f+' ' ' !%+ . .F7OO " .F6N ?G " > >Azz'""
>$&F:r1$=$=! KK d + + KK & & KK,666 = = KK,AAA4 H H KK,??? F F KK,EEEt L LMMOO DAqWWS\\F88 F F6!"": F F FGGDv~~( F4LL ,&B MM& ! ! ! OO &*D # #
L#5tFKKMM7J7JDQWQ^Q^Q`Q`LaLa6b#c#cdd e e e "r c t | j d }| |j dt |j d|j d d | _ d S )Nz1on_train_begin must be called before on_train_endr rW Tr )r r rS r r r r )r@ r r r r r s r on_train_endz%NotebookProgressCallback.on_train_end si
d+-`
a
a
HS - -HH0FHH
!% r r ) rd re rf rg rA r r r r r r r r r r r r ) s
( ( (
W W W( ( (
F
F
F
F# # #
" " " ".# .# .# .#`% % % % %r r )r )r= r rD typingr r IPython.displayr[ r` trainer_callbackr
trainer_utilsr r r r* r r r% r0 r2 r6 r r r r r s
$ $ $ $ $ $ $ $ . . . . . . 8 8 8 8 8 8 8 8
WT]]
T
D D D "R. R. R. R. R. R. R. R.jK K K K K 1 K K K\o% o% o% o% o% o% o% o% o% o%r