tjY:^ddlmZddlZddlmZmZddlmZddlm Z m Z ddl m Z e rddl mZe jeZeZGdd eZeGd d Zd#dZd$dZd$dZd%dZd&dZd'dZd(dZGddedZd)d ZGd!d"Z dS)*) annotationsN)IterableSequence) dataclass) TYPE_CHECKINGAny)logging)PreTrainedConfigceZdZdZdS)%AmbiguousGlobalPerLayerAttributeErrorzMRaised when a per-layer attribute is read from a heterogeneous global config.N)__name__ __module__ __qualname____doc__y/var/www/html/CA-Chatbot/venv/lib/python3.11/site-packages/transformers/integrations/heterogeneity/configuration_utils.pyr r #sWWWWrr c.eZdZUded<ded<ded<dS)_HeterogeneitySpecdict[int, dict[str, Any]]per_layer_overridesset[str]per_layer_attributesexplicit_per_layer_attributesN)r rr__annotations__rrrrr's62222""""++++++rrlayer_overridesdict[str, Any]returnchtj|}d|vr|d}t|tst|t st dt|}td|Dst d|rt||d<|S)Nskipz&`skip` must be an iterable of strings.c3@K|]}t|tVdSN) isinstancestr).0items r z-_normalize_layer_overrides..7s,::T:dC((::::::rz!`skip` must contain only strings.) copydeepcopypopr#r$r TypeErrorsetallsorted)r normalizedr s r_normalize_layer_overridesr0.s//J ~~f%% dC  F 4(B(B FDEE E4yy::T::::: A?@@ @  .!'Jv  rconfigr rrNonecj|sdS|jfd|D}|rtdd|ddS)Nc,g|]}|dks|k|S)rr)r% layer_idxnum_hidden_layerss r z+_validate_layer_indices..Es3)a--9XiKiKi KiKiKirzG`per_layer_config` keys must be integer layer indices in the range [0, z); got .)r6 ValueError)r1rinvalid_layer_indicesr6s @r_validate_layer_indicesr;@s 0#6  ,Vg , ,( , , ,     rchg}t|jD]}||i}|d|dd}|d|dd}|||||rt d|ddS)Nsliding_windowattention_chunk_sizezkThe following layers have the mutually exclusive `sliding_window` and `attention_chunk_size` both defined: z. To fix this, either remove a conflicting attribute from the global config,or set it to `None` in `per_layer_config` for the problematic layers.)ranger6get)_getattr_without_heterogeneous_validationappendr9)r1rproblematic_indicesr5rr=r>s r1_validate_sliding_window_and_attention_chunk_sizerDOs6344 2 2 -11)R@@(,, fNNO_aeff   /22 "  < <=SUY Z Z    %*>*J  & &y 1 1 1  U" U U U     rrct}|D]}|||d|S)Nr )r,valuesupdatediscard)rrrs r_get_per_layer_attributesrIisX%(UU.557755##O4444  ((( rct|}t}|D]}t||jkr+||s||E|D]2}||vr,||s||n3|r tdt|d|D]W}||s| |}|D]}||vr|||kr||=Xt| D] \}}|s||= t|}t|||} | S)Nz&The following attributes are missing: zS Please define them globally, or provide them for every layer in `per_layer_config`)rrr) rIr,lenr6)_hasattr_without_heterogeneous_validationaddrFr9r.rAlistitemsr) r1rr"missing_required_global_attributesattrr global_valuer5rheterogeneity_specs r,_modify_config_and_create_heterogeneity_specrTrs%>>Q$R$R!*-&-   " # #v'? ? ?CCDII =266t<<<#6#=#=#?#?  ..!KKDQQE:>>tDDDE/ *  vV<^5_5_ v v v   .**??EE  GGMM 299;; * *O&&?4+@L+P+P#D) * '++>+D+D+F+F&G&G//" ? /#I.45HII+/1&C rper_layer_configdict[int | str, dict[str, Any]]cd|D}t||t||t|||_dS)aRegister per-layer configuration overrides on a model config. In a heterogeneous model, individual layers can differ from the global config (e.g., different ``intermediate_size``, ``num_key_value_heads``, or entire sub-layers skipped via the ``skip`` attribute). This function validates the overrides and stores a ``_HeterogeneitySpec`` on ``config._heterogeneity_spec``. At model-init time, ``apply_heterogeneous_modeling`` reads this spec to patch each layer with its resolved config. Args: config: The global model config to modify in-place. per_layer_config: Mapping from layer index to a dictionary of attribute overrides. Only layers that differ from the global config need to be included. cNi|]"\}}t|t|#Sr)intr0)r%r5rs r z/_apply_heterogeneous_config..s=&&& &I I2?CC&&&rN)rOr;rDrT_heterogeneity_spec)r1rUnormalized_per_layer_overridess r_apply_heterogeneous_configr]sj*&&*:*@*@*B*B&&&" F$BCCC5f>\]]]!MfVt!u!uFrctj|}|jdd|dg|_|D]\}}|dkr t ||||S)Nr[r )r(__dict__r*r@r rOsetattr)r1r output_configrQvalues r_get_layer_configrcsIf%%M4d;;;(,,VR88M&,,..,, e 6>>  tU++++ rc&eZdZd dZddZdd Zd S)_PerLayerConfigViewr1r rr2c||_dSr")_config)selfr1s r__init__z_PerLayerConfigView.__init__s  rrYc|jjSr")rgr6rhs r__len__z_PerLayerConfigView.__len__s |--rr5 int | slice)PreTrainedConfig | list[PreTrainedConfig]ct|tr5fdt|t DS|dkr|t z }|dks|t krt djj}tj|j |iS)Nc g|] }| Srr)r%irhs rr7z3_PerLayerConfigView.__getitem__..sJJJDGJJJrrzlist index out of range) r#slicer?indicesrK IndexErrorrgr[rcrr@)rhr5rSs` r __getitem__z_PerLayerConfigView.__getitem__s i ' ' KJJJJUI,=,=c$ii,H,H%IJJJ J q== T "I q==IT22677 7!\= L  2 6 6y" E E   rN)r1r rr2)rrY)r5rmrrn)r rrrirlrurrrreresP....       rrec|j}i}t|jD]\}tj|j|i}|jD]}||vr||||<|r|||<]|Sr") r[r?r6r(r)rr@rrA)r1rSexplicit_per_layer_overridesr5rrQs r!_get_explicit_per_layer_overridesrxs3#% 6344FF -(:(N(R(RS\^`(a(abb&D _ _D?**(.(X(XY](^(^%  F6E ( 3 ''rc*eZdZdZdfd Zed dZed!d Zejd"dZed#dZ ed dZ e jd$dZ ed dZ e jd$dZ d%dZ d&dZ efd'fd Zd(dZxZS))HeterogeneousConfigMixina_Mixin for heterogeneous per-layer config behavior. This mixin owns heterogeneity-specific state and rules. ``PreTrainedConfig`` assigns the ``per_layer_config`` property in the post-init phase and calls hook methods where heterogeneity needs to participate in the config lifecycle: attribute access, key iteration, and serialization. keyr$rrc ttdd}|a||jvrXtdst d|d|d|dt d|d t|S) Nr_r['allow_global_per_layer_attribute_access'z' is a per-layer attribute and may vary across layers. Access it via the individual layer configs instead (e.g. config.per_layer_config[i].z/). To read the global config value from config.z anyway, set `allow_global_per_layer_attribute_access` to `True` on the config. Warning: only do this if the caller can safely handle heterogeneous configs; code that assumes a homogeneous model may use the global value incorrectly.z5Reading global config value for per-layer attribute `z` on a heterogeneous config. Only do this if the caller can safely handle heterogeneous configs; code that assumes a homogeneous model may use the global value incorrectly.)super__getattribute__r@rr logger warning_once)rhr{rS __class__s rrz)HeterogeneousConfigMixin.__getattribute__s#WW55jAAEEF[\\  )(===ww//0YZZ?UCUULOUU"%UUU##BCBBB ww'',,,rboolc"t|dSNr[)hasattrrks ris_heterogeneousz)HeterogeneousConfigMixin.is_heterogeneousst2333r!Sequence[PreTrainedConfig] | Nonec2|jsdSt|Sr")rrerks rrUz)HeterogeneousConfigMixin.per_layer_configs $ 4"4(((rrU&dict[int | str, dict[str, Any]] | Noner2cd||jdddSt||dSr)r_r*r])rhrUs rrUz)HeterogeneousConfigMixin.per_layer_config$s=  # M  3T : : : F#D*:;;;;;rset[str] | Nonec,|jsdS|jjSr")rr[rrks rrz-HeterogeneousConfigMixin.per_layer_attributes,s$ 4'<s?D ;<<.XsM%%%.II$$Z00$-2P2P%%%rrUr[) rrrxr[rrKr$maxrrOr*)rhrrrs @r$_update_heterogeneous_to_dict_outputz=HeterogeneousConfigMixin._update_heterogeneous_to_dict_outputLs$  F  3 O"CD"I"I  "&":"N   'S%8%=%=%?%?!@!@AABBJ%%%%2E2K2K2M2M%%%A ! ! %'A ! #T*****rdefaultc |dkrJ|tdvr'td|} t|S#t$r|tur|cYSwxYw)N attribute_map)rrAttributeError _SENTINEL)rhr{rrs rrAzBHeterogeneousConfigMixin._getattr_without_heterogeneous_validationas / ! !cUWW-E-Eo-V-V&V&V''**?;;C@C 77++C00 0   )##NNN s A44B  B cV ||n#t$rYdSwxYwdS)NFT)rAr)rhr{s rrLzBHeterogeneousConfigMixin._hasattr_without_heterogeneous_validationlsE   : :3 ? ? ? ?   55 ts  &&)r{r$rr)rr)rr)rUrrr2)rr)rbrrr2)rrrr)rrrr2)r{r$rrrr)r{r$rr)r rrrrpropertyrrUsetterrr}rrrrrArL __classcell__)rs@rrzrzs------.444X4)))X) <<<<===X= SSSXS-3III43IOOOXO)/EEE0/E++++*R[       rrz)rrrr)r1r rrrr2)rrrr)r1r rrrr)r1r rUrVrr2)r1r rrrr )r1r rr)! __future__rr(collections.abcrr dataclassesrtypingrrtransformers.utilsr transformersr get_loggerr robjectr RuntimeErrorr rr0r;rDrIrTr]rcrerxrzrrrrs) #""""" ........!!!!!!%%%%%%%%&&&&&&.------  H % % FHH XXXXXLXXX ,,,,,,, , $         4    ----`vvvv@"     (#56   .(((("vvvvvvvvvvr