ZjB%SrSSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK J r J r SSK JrJrJr SSKJrJrJr SSKJrJr SSKJr SS KJrJr SS KJrJrJ r SSK!r"S S K#J$r$ S SK%J&r&J'r'J(r( \(a SSK)r)SSK)J*r* \$RV"\,5r-Sr.\'"5(aSr.\/"5r0S\1S'SMSjr2Sr3\&"5(aSr3SNSjr4SOSjr5Sr6SPSjr7SPSjr8SPSjr9SPSjr:SPSjr;Sr<SQSRSjjr=Sr>SPS jr?SSSTS!jjr@SUS"jrAS#rBS$rCSVS%jrD"S&S'\ 5rESWS(jrFSXSYS)jjrG"S*S+\H\5rI"S,S-\I5rJ"S.S/\I5rK"S0S15rLS2rMS3rNSZS[S4jjrOSXS5jrPS6rQSXS7jrRS8rSS9rTS:rUS;rVSXS\S<jjrW"S=S>\ SS?9rXS]S@jrYS^SAjrZS_SBjr[S`SCjr\SDr]SEr^SFr_"SGSH\5r`SISJSKS\a44SLjrbg)az Generic utilities ) annotationsN) OrderedDictUserDict)CallableIterableMutableMapping)AbstractContextManager ExitStack nullcontext)fields is_dataclass)Enum)partialwraps) TYPE_CHECKINGAny TypedDict)logging)is_mlx_availableis_torch_availableis_torch_fx_proxy)nnFTzset[type[Any]]_registered_model_output_typesc ,[(dgSSKnURR5(agU[;agSSKJs Jn URU[[[US9URSUR3S9 [RU5 g)Nr) output_type.)serialized_type_name)_is_torch_availabletorchcompiler is_compilingrtorch.utils._pytreeutils_pytreeregister_pytree_node_model_output_flattenr_model_output_unflatten __module____name__add)rr! torch_pytrees k/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/utils/generic.py"_register_model_output_pytree_noder/8s    ~~""$$44..%%'[A + 6 67q9M9M8NO & #&&{3c\UR5nUS;agUS;ag[SU<35e)zConvert a string representation of truth to true (1) or false (0). True values are 'y', 'yes', 't', 'true', 'on', and '1'; false values are 'n', 'no', 'f', 'false', 'off', and '0'. Raises ValueError if 'val' is anything else. >1tyonyestruer>0fnnoofffalserzinvalid truth value )lower ValueError)vals r. strtoboolrAWs: ))+C 22 33 +C73 44r0c[[U55nURS5(agURS5(agURS5(agg)z Tries to guess the framework of an object `x` from its repr (brittle but will help in `is_tensor` to try the frameworks in a smart order, without the need to import the frameworks). z 2 2 3r0c[[[S.n[U5nUc/OU/nUS:waUR S5 UR UVs/sHoDUS4;dM UPM sn5 UVs0sHoDX_M sn$s snfs snf)z Returns an (ordered since we are in Python 3.7+) dictionary framework to test function, which places the framework we can guess from the repr first, then Numpy, then the others. )rCrDrErD)is_torch_tensoris_numpy_array is_mlx_arrayrKappendextend)rIframework_to_testpreferred_framework frameworksr9s r._get_frameworks_and_test_funcrUss  4A6*29L8MJd"$"3\"3QATVZ@[7[q"3\]-7 8Z # #Z 88] 8s A=A=,Bc[U5nUR5HnU"U5(dM g [U5(agg)zs Tests if `x` is a `torch.Tensor`, `np.ndarray` or `mlx.array` in the order defined by `infer_framework_from_repr` TF)rUvaluesr)rIframework_to_test_func test_funcs r. is_tensorrZsA ;1=+224 Q<<5  r0c6[U[R5$)z' Tests if `x` is a numpy array or not. ) isinstancerDndarrayrIs r.rNrNs a $$r0cL[(dgSSKn[XR5$)zU Tests if `x` is a torch tensor or not. Safe to call even if torch is not installed. FrN)r r!r\TensorrIr!s r.rMrM   a &&r0cL[(dgSSKn[XR5$)zU Tests if `x` is a torch device or not. Safe to call even if torch is not installed. FrN)r r!r\deviceras r.is_torch_devicererbr0c[(dgSSKn[U[5(a[ X5(a [ X5nOg[XR 5$)zT Tests if `x` is a torch dtype or not. Safe to call even if torch is not installed. FrN)r r!r\rFhasattrgetattrdtyperas r.is_torch_dtyperjsD  !S 5  !A a %%r0c[U5(ag[U5(ag[U[[[ [ R45(ag[U[[45(a[U5S:Xag[US5$g)z9 Check if a value is array-like (includes ragged arrays) TrF) rNrMr\intfloatboolrDnumberlisttuplelen_is_tensor_or_array_like)values r.rsrssneu%#udBII677%$'' u:?'a11 r0c[(d [S5eSSKnUS:Xa [5$UR"U5(dU(aUR "XX#S9$[5$)an Context manager that only autocasts if: - `autocast` is already enabled in this context - Or this call to `maybe_autocast` has `enabled=True` This prevents `autocast` being added to the graph when it is effectively a no-op. Which makes graph splitting in `torch.compile` more flexible as it removes the requirement that partition IDs be monotonically increasing. z2`maybe_autocast` requires PyTorch to be installed.rNmeta)rienabled cache_enabled)r ImportErrorr!r is_autocast_enabledautocast) device_typerirwrxr!s r.maybe_autocastr}sU  NOOf}   --~~kee}r0c8SSKJn [XR5$)Nr)mlx.corecorer\array)rImxs r._is_mlxrs a ""r0c2[(dS$[U5$)zR Tests if `x` is a mlx array or not. Safe to call even when mlx is not installed. F)_is_mlx_availablerr^s r.rOrOs*)59wqz9r0cUbUb [S5eUb URnOUnUcgUb%[R"S[ U5-U5SL$SU;$)a@ Checks whether some flavor of flash attention is requested or not. Optionally, checks for a specific version of flash attention. This is checked against one of the two arguments, i.e. either the `config` or the directly passed value `requested_attention_implementation`. Otherwise, an error will be raised (ambiguity). The different versions of flash attention are usually - Implementations based on the original flash attention repo: https://github.com/Dao-AILab/flash-attention - Kernels implementations such as: https://huggingface.co/kernels-community/vllm-flash-attn3 NzRequested attention implementation is ambiguous: Please pass either the config or the name of the attention implementation, not both.Fz .*flash.*flash)r?_attn_implementationrematchrF)config"requested_attention_implementationversion checked_attention_implementations r.is_flash_attention_requestedrs}@L c  +1+F+F(+M((/xx s7|35UV^bbb 6 66r0cPUcgURS5nXRS54$)z Split the optional `paged|` prefix from an attention implementation string. Note that `None` means using the default attention implementation, which is either torch's native `sdpa` or `eager` (if `sdpa` is not implemented for that model). )FNzpaged|)rH removeprefix)implementationis_pageds r.split_attention_implementationr)s1 ((2H 00: ::r0c[U[[45(aU$[U[[45(a/UR 5VVs0sHupU[ U5_M snn$[U[[45(a>[SU55(a [U5$UVs/sHn[ U5PM sn$SSS.n[U5nUR 5HupgU"U5(dMXF"U5s $ [U[R5(aUR5$U$s snnfs snf)zH Convert a PyTorch tensor, Numpy array or python list to a python list. c3l# UH*n[U[[[R45v M, g7fN)r\rlrmrDro).0rIs r. to_py_obj..@s%Cs!z!c5"))455ss24c"UR5$rtolistobjs r.to_py_obj..G #**,r0c"UR5$rrrs r.rrHrr0rCrD)r\rlrmdictritems to_py_objrprqallrUrDror)rkvoframework_to_py_objrX frameworkrYs r.rr6s#U|$$ C$) * *,/IIK8KDA9Q<K88 C$ ' ' CsC C C9 '**c ! c**'& ;3? 6 < < > S>>&1#6 6!? #ryy!!zz| 19+s D6)D<cSSS.n[U[[45(a/UR5VVs0sHup#U[ U5_M snn$[U[ [ 45(a[R"U5$[U5nUR5HupVU"U5(dMX"U5s $ U$s snnf)zH Convert a PyTorch tensor, Numpy array or python list to a Numpy array. cZUR5R5R5$r)detachcpunumpyrs r.rto_numpy..^s#**,**,224r0cU$rrs r.rr_s#r0r) r\rrrto_numpyrprqrDrrU)rframework_to_numpyrrrXrrYs r.rrXs 5 #h'((+.99;7;418A;;77 C$ ' 'xx};3? 6 < < > S>>%05 5!? J8sCc[USS9nUR5nSSS5 [R"W5nU$!,(df  N&=f![Ra [ SUS35ef=f)zeA helper to load safe config files and raise a proper error message if it wasn't serialized correctlyzutf-8)encodingNz"It looks like the config file at 'z' is not a valid JSON file.)openreadjsonloadsJSONDecodeErrorOSError) json_filereadertext config_dicts r.safe_load_json_filerpsqc )g .&;;=D/jj&   / .   c:9+E`abbcs A=A A A$A2c^\rSrSrSrSSjrU4SjrU4SjrSrSr Sr S r S r U4S jr U4S jrU4S jrSSjrSrU=r$) ModelOutputi{a Base class for all model outputs as dataclass. Has a `__getitem__` that allows indexing by integer or slice (like a tuple) or strings (like a dictionary) that will ignore the `None` attributes. Otherwise behaves like a regular python dictionary. You can't unpack a `ModelOutput` directly. Use the [`~utils.ModelOutput.to_tuple`] method to convert it to a tuple before. c[U5 g)zRegister subclasses as pytree nodes. This is necessary to synchronize gradients when using `torch.nn.parallel.DistributedDataParallel` with `static_graph=True` with modules that output `ModelOutput` subclasses. N)r/)clss r.__init_subclass__ModelOutput.__init_subclass__s +3/r0c>[TU]"U0UD6 [[U55 UR[ :gnU(a@[ U5(d/[URSURRS35egg)Nrz` is not a dataclass. This is a subclass of ModelOutput and so must use the @dataclass decorator.) super__init__r/rG __class__rr TypeErrorr*r+)selfargskwargsis_modeloutput_subclassrs r.rModelOutput.__init__s{ $)&)*4:6 #'..K"? "<+=+=??#1T^^%<%<$=>__ ,> "r0c>^[[T55 [T5n[U5(d"[ TR R S35e[SUSS55(d"[ TR R S35e[TUSR5n[U4SjUSS55nU(GaB[U5(Gd1[U[5(aUR5nSnO[U5nSnU(a[!TUSRS5 ["T T]IUSR5 ['W5Hupg[U[([*45(a'[U5S :wd[US[,5(d*US:XaUTUSR'O[ S US 35e g[!TUSUS5 UScMUSTUS'M gUbUTUSR'ggUH-n[TUR5n U cMU TUR'M/ g![a S nGN>f=f) zUCheck the ModelOutput dataclass. Only occurs if @dataclass decorator has been used. z has no fields.c3<# UHoRSLv M g7fr)default)rfields r.r,ModelOutput.__post_init__..sG6FU==D(6FsrNz. should not have more than one required field.rc3T># UHn[TUR5SLv M g7frrhnamerrrs r.rrs##dSc%GD%**$=$EScs%(TFrzCannot set key/value for z&. It needs to be a tuple (key, value).)r/rGr rrr?rr+rrhrrZr\rriterrsetattrr __delitem__ enumeraterprqrF) r class_fields first_fieldother_fields_are_noneiteratorfirst_field_iteratoridxelementrrrs ` r. __post_init__ModelOutput.__post_init__s6 +4:6d| <   7 78HI IGl126FGGG 7 788fgh hdLO$8$89 ##dS_`a`bSc#d d ;)?)?+t,,&,,.'+$1#K0H+/( $l1o22D9#LO$8$89$-h$7LC%ge}==WQRARZdelmneoqtZuZu!89DDa!5!56#-";G9Dj k#D'!*gaj9qz-+21:WQZ(%8(-8\!_))*)&D%**-='(D$&5!1+0(1s H?? IIcH[SURRS35e)Nz$You cannot use ``__delitem__`` on a instance. Exceptionrr+rrrs r.rModelOutput.__delitem__s#>t~~?V?V>WWabccr0cH[SURRS35e)Nz#You cannot use ``setdefault`` on a rrrs r. setdefaultModelOutput.setdefaults#=dnn>U>U=VV`abbr0cH[SURRS35e)NzYou cannot use ``pop`` on a rrrs r.popModelOutput.pops"6t~~7N7N6OzZ[[r0cH[SURRS35e)NzYou cannot use ``update`` on a rrrs r.updateModelOutput.updates#9$..:Q:Q9RR\]^^r0c[U[5(a[UR55nX!$UR 5U$r)r\rFrrto_tuple)rr inner_dicts r. __getitem__ModelOutput.__getitem__s8 a  djjl+J= ==?1% %r0c>[U5Vs1sHo3RiM nnX;aUb[TU] X5 [TU]X5 gs snfr)r rr __setitem__ __setattr__)rrrtr field_namesrs r.rModelOutput.__setattr__sG/5d|<|ezz| <  5#4 G  , D( =sA cB>[TU]X5 [TU] X5 gr)rrr)rkeyrtrs r.rModelOutput.__setitem__s C' C'r0c>^[T5(d[TT] 5$[TT] 5tpn[U4Sj[ T555nX/UQ7$)Nc3P># UHn[TUR5v M g7frrrs r.r)ModelOutput.__reduce__..sIL5WT5::..Ls#&)r r __reduce__rqr )rcallable_args remainingrrs` r.r ModelOutput.__reduce__sPD!!7%' '&+g&8&:#)IF4LII) ))r0cJ^[U4SjTR555$)zQ Convert self to a tuple containing all the attributes/keys that are not `None`. c3.># UH nTUv M g7frr)rrrs r.r'ModelOutput.to_tuple..s2kT!Wks)rqkeysrs`r.rModelOutput.to_tuples2diik222r0r)returnNone)rrq)r+r* __qualname____firstlineno____doc__rrrrrrrrrrr r__static_attributes__ __classcell__)rs@r.rr{sN 0 6)pdc\_&)( *33r0rcf[UR55[UR554$r)rprWr)outputs r.r(r(s#   $v{{}"5 55r0c 6U"S0[[X55D6$)Nr)rzip)rWcontextrs r.r)r) s  4c'23 44r0c(\rSrSrSr\S5rSrg) ExplicitEnumiz; Enum with more explicit error message for missing values. c ~[USURS[URR 5535e)Nz is not a valid z, please select one of )r?r+rp_value2member_map_r)rrts r. _missing_ExplicitEnum._missing_s?g%cll^3J4PSPfPfPkPkPmKnJo p  r0rN)r+r*rrr classmethodr%rrr0r.r"r"s  r0r"c$\rSrSrSrSrSrSrSrg)PaddingStrategyizz Possible values for the `padding` argument in [`PreTrainedTokenizerBase.__call__`]. Useful for tab-completion in an IDE. longest max_length do_not_padrN) r+r*rrrLONGEST MAX_LENGTH DO_NOT_PADrrr0r.r)r)s GJJr0r)c$\rSrSrSrSrSrSrSrg) TensorTypei*z Possible values for the `return_tensors` argument in [`PreTrainedTokenizerBase.__call__`]. Useful for tab-completion in an IDE. rCrDrErN) r+r*rrrPYTORCHNUMPYMLXrrr0r.r1r1*s G E Cr0r1c.\rSrSrSrSSjrSrSrSrg) ContextManagersi5z Wrapper for `contextlib.ExitStack` which enters a collection of context managers. Adaptation of `ContextManagers` in the `fastcore` library. c.Xl[5Ulgr)context_managersr stack)rr8s r.rContextManagers.__init__;s 0[ r0c`URHnURRU5 M gr)r8r9 enter_context)rcontext_managers r. __enter__ContextManagers.__enter__?s$#44O JJ $ $_ 5 5r0c<URR"U0UD6 gr)r9__exit__rs r.rAContextManagers.__exit__Cs T,V,r0)r8r9N)r8zlist[AbstractContextManager]) r+r*rrrrr>rArrr0r.r6r65s !6-r0r6c[R"UR5nURH)nUS:XdM URURSLdM) g g)zb Check if a given model can return loss. Args: model_class (`type`): The class of the model. return_lossTF)inspect signatureforward parametersr) model_classrFps r.can_return_lossrKGsR!!+"5"56I  ! ! )"6"6q"9"A"AT"I" r0cURn[R"UR5nSU;a+URVs/sHnSU;dUS;dMUPM sn$URVs/sH nSU;dM UPM sn$s snfs snf)za Find the labels used by a given model. Args: model_class (`type`): The class of the model. QuestionAnsweringlabel)start_positions end_positions)r+rErFrGrH)rI model_namerFrJs r. find_labelsrRWs%%J!!+"5"56Ij($//m/a7a<1HlCl/mm$//@/a7a</@@n@sBB, B:Bc0SSjn[U"XU55$)z/Flatten a nested dict into a single level dict.c3# UR5Hkup4U(a[U5U-[U5-OUnU(a7[U[5(a"[ XEUS9R5ShvN MfXT4v Mm gN7f)N) delimiter)rrFr\r flatten_dict)d parent_keyrUrrrs r. _flatten_dict#flatten_dict.._flatten_dictjsgGGIDA:D#j/I-A6!CZ>22')DJJLLLf MsA0B2B3Br)r)rWrXrUrYs r.rVrVgs  aY7 88r0c[U5(a[R"XS9$[U5(aUc UR$UR "U6$[ S[U5S35e)z4 Framework-agnostic version of transpose operation. )axesz"Type not supported for transpose: r)rNrD transposerMTpermuter?rG)rr^s r.r_r_us^e||E--   ,uww@EMM4,@@=d5k]!LMMr0c[U5(a[R"X5$[U5(aUR"U6$[ S[ U5S35e)z2 Framework-agnostic version of reshape operation. z Type not supported for reshape: r)rNrDreshaperMr?rG)rnewshapes r.rcrcsQezz%**   }}h'';DK=JKKr0c[U5(a[R"XS9$[U5(a"UcUR5$URUS9$[ S[ U5S35e)z2 Framework-agnostic version of squeeze operation. )axisdimz Type not supported for squeeze: r)rNrDsqueezerMr?rGrrfs r.ririsbezz%++   "&,u}}KEMMdM4KK;DK=JKKr0c[U5(a[R"X5$[U5(aUR US9$[ S[ U5S35e)z6 Framework-agnostic version of expand_dims operation. rgz$Type not supported for expand_dims: r)rNrD expand_dimsrM unsqueezer?rGrjs r.rlrlsSe~~e**   4((?U }ANOOr0c[U5(a[R"U5$[U5(aUR 5$[ S[ U5S35e)z/ Framework-agnostic version of size operation. z$Type not supported for tensor_size: r)rNrDsizerMnumelr?rG)rs r. tensor_sizerqsMewwu~   {{}?U }ANOOr0c[(d [U5$SSKnURR 5(a5[ XR 5(aURUR5$[U5$)zc Casts an input to a torch int64 tensor if we are in a tracing context, otherwise to a Python int. rN) r rlr!jit is_tracingr\r`toint64ras r. torch_intrwsU  1v  % 4 4 6 6:a;V;V144 b\_`a\bbr0c[(d [U5$SSKnURR 5(a5[ XR 5(aURUR5$[U5$)zg Casts an input to a torch float32 tensor if we are in a tracing context, otherwise to a Python float. rN) r rlr!rsrtr\r`rufloat32ras r. torch_floatrzsU  1v "'))"6"6"8"8Z<<=X=X144 d^abc^ddr0c@^U=(d /n[U5mU4SjnU$)a Decorator to filter out named arguments that are not in the function signature. This decorator ensures that only the keyword arguments that match the function's signature, or are specified in the `extra` list, are passed to the function. Any additional keyword arguments are filtered out and a warning is issued. Parameters: extra (`Optional[list]`, *optional*): A list of extra keyword argument names that are allowed even if they are not in the function's signature. Returns: Callable: A decorator that wraps the function and filters out invalid keyword arguments. Example usage: ```python @filter_out_non_signature_kwargs(extra=["allowed_extra_arg"]) def my_function(arg1, arg2, **kwargs): print(arg1, arg2, kwargs) my_function(arg1=1, arg2=2, allowed_extra_arg=3, invalid_arg=4) # This will print: 1 2 {"allowed_extra_arg": 3} # And issue a warning: "The following named arguments are not valid for `my_function` and were ignored: 'invalid_arg'" ``` c>^^^^[R"T5n[URR 55nUR T5mSU;mSU;mSTl[T5UUUU4Sj5nU$)NrrTc>0n0nUR5HupEUT ;aXRU'MXSU'M U(aUVs/sH nSUS3PM nnSRU5nT (aUSRRS-nOT (aUSRS-nOSn[R "SUTRSU3[ SS 9 T"U0UD6$s snf) N'z, rrr\z1The following named arguments are not valid for `z` and were ignored: r) stacklevel)rjoinrr+warningswarn UserWarning) rr valid_kwargsinvalid_kwargsrrinvalid_kwargs_names cls_prefixfuncis_class_methodis_instance_methodvalid_kwargs_to_passs r.wrapperCfilter_out_non_signature_kwargs..decorator..wrappersLN ,,&'O()1% ' :H'I.Q!A3a.$'I'+yy1E'F$&!%a!2!2!;!;c!AJ$!%a!1!1C!7J!#J G |TXTaTaSbc**>)?A .. .%(JsC)rErFsetrHrunion _filter_out_non_signature_kwargsr)rsigfunction_named_argsrrrrextra_params_to_passs` @@@r. decorator2filter_out_non_signature_kwargs..decorators}%!#.."5"5"782889MN$'::#6615- t /  />r0)r)extrarrs @r.filter_out_non_signature_kwargsrs&6 KREu:,\ r0c~\rSrSr%SrS\S'S\S'S\S'S\S'S \S 'S \S 'S \S 'S \S'S \S'S\S'Srg)TransformersKwargsia) Keyword arguments to be passed to the forward pass of a `PreTrainedModel`. Attributes: num_items_in_batch (`Optional[torch.Tensor]`, *optional*): Number of items in the batch. It is recommended to pass it when you are doing gradient accumulation. output_hidden_states (`Optional[bool]`, *optional*): Most of the models support outputting all hidden states computed during the forward pass. output_attentions (`Optional[bool]`, *optional*): Turn this on to return the intermediary attention scores. output_router_logits (`Optional[bool]`, *optional*): For MoE models, this allows returning the router logits to compute the loss. cu_seq_lens_q (`torch.LongTensor`, *optional*) Gets cumulative sequence length for query state. cu_seq_lens_k (`torch.LongTensor`, *optional*) Gets cumulative sequence length for key state. max_length_q (`int`, *optional*): Maximum sequence length for query state. max_length_k (`int`, *optional*): Maximum sequence length for key state. position_ids (`torch.LongTensor`, *optional*) Indices of positions of each input sequence tokens. is_causal (`bool`, *optional*) Can be set to False to enable bi-directional attention, i.e. use decoder Attention modules as encoders. ztorch.Tensor | Nonenum_items_in_batch bool | Noneoutput_hidden_statesoutput_attentionsoutput_router_logitsztorch.LongTensor | None cu_seq_lens_q cu_seq_lens_k int | None max_length_q max_length_k position_ids is_causalrN)r+r*rrr__annotations__rrr0r.rrsE4,+%%""%%****))r0r)totalc SU;$)z3Checks whether a config dict is a timm config dict.pretrained_cfgr)rs r.is_timm_config_dictr?s { **r0cUcg[U5n[RRU5n[RR U5nU(aKUR S5(a5[ U5n[R"U5nSSS5 [W5$U(a[RR[RRUS55(aS[ [RRUS55n[R"U5nSSS5 [W5$g!,(df  N=f!,(df  N+=f)z9 Checks whether a checkpoint is a timm model checkpoint. NFz.jsonz config.json) rFospathisfileisdirendswithrrloadrexistsr)pretrained_model_pathis_fileis_dirr9rs r.is_timm_local_checkpointrDs$ 56ggnn23G WW]]0 1F(11':: ' (A))A,K)";//"''...C]!STT "'',,4mD E))A,KF";// ) ( F Es6D=E= E  Ecb[XU5 UR5Hn[X1U5 M g)z- Set a value to a module and all submodules. N)rchildrenset_attribute_for_modules)modulerrt submodules r.rr`s) F__& !)%8'r0c~[X5(a [X5 UR5Hn[X!5 M g)z2 Delete a value from a module and all submodules. N)rgdelattrrdel_attribute_from_modules)rrrs r.rris0 v__& "92'r0c0^[T5U4Sj5nU$)z Decorator to wrap model method, to call output.to_tuple() if return_dict=False passed as a kwarg or return_dict=False is set in the config. Note: output.to_tuple() convert output to tuple skipping all `None` values. c>[US5(aURROSnURSU5nUbUnT"U/UQ70UD6nU(d%[ U[ 5(dUR 5nU$)NrT return_dict)rgrrrr\rqr)rrrrreturn_dict_passedrrs r.r!can_return_tuple..wrapper~sp18x1H1Hdkk--d #ZZ {C  ),Kd,T,V,:fe#<#<__&F r0rrrs` r.can_return_tuplerus" 4[ Nr0c0^[T5U4Sj5nU$)z Decorator using config field (if they exist) as default value for some args and kwargs. Precedence is always given to the args/kwargs that are explicitly passed. c>/SQnUGH3nSnUT RR;a(T RRRU5S- nUb[U5U:a XbXnO.UR U5bX$nO[ UR US5nUcMUS:XaB[ USS5(a/UR(aU(a[RS5 SnO!US:XaSS /nXg;a[S US US 35eUb,[U5U:a[U5nXaU'[U5nGM/XbU'GM6 UR S [ UR S S55nUbG[UR S 5n U (aUR Rn XR lXS 'UR SS5(aDSSKJn U "XR SS5UR S55 T "U/UQ70UD6n SSS5 O T "U/UQ70UD6n Ub&W (aW UR lW $UR ?W $!,(df  N9=f!Ub&W (aW UR lfUR ?ff=f)N) use_cachevision_feature_layervision_feature_select_strategyvision_aspect_ratiorrgradient_checkpointingFzX`use_cache=True` is incompatible with gradient checkpointing. Setting `use_cache=False`.rrfullz%`Unexpected select feature strategy: z. Please select from rrdebug_ior)model_addition_debugger_context debug_io_dir model_debug prune_layers)__code__ co_varnamesindexrrgetrhrtraininglogger warning_oncer?rprqrgrmodel_debugging_utilsr)rrrargs_with_config_defaultsarg_name arg_index arg_valuevalid_strategiesris_causal_in_configis_causal_original_valuerrrs r.r+merge_with_config_defaults..wrappersu% ! 2HI4==444 MM55;;HEI $TY)>4?C^ O H%1", #DKK4@ ${*t%=uEE$--\e++v%* !AA(16':$ 8(CI;Ncdtcuuvw(SY-B:D&/O ;D'08$A2FJJ{GDKKd,ST  ")$++{"C "+/;;+@+@($-KK !"+;  .zz*e,,S4**^]CVZZP^E_"$888F d4T4V4$&,DDKK)  - $&,DDKK) - %s%2AI7 II II+Jrrs` r.merge_with_config_defaultsrs%  4[FFP Nr0cB[RS5 [U5$)NzZThe `check_model_inputs` decorator is deprecated in favor of `merge_with_config_defaults`.)rrr)rs r.check_model_inputsrs tu %d ++r0c^\rSrSrSr0rSrSrSrSr Sr Sr \ S S j5r SS jrS rg )GeneralInterfaceiz Dict-like object keeping track of a class-wide mapping, as well as a local one. Allows to have library-wide modifications through the class mapping, as well as local modifications in a single file with the local mapping. c0Ulgr_local_mappingrs r.rGeneralInterface.__init__s  r0c\XR;aURU$URU$r)r_global_mappingrrs r.rGeneralInterface.__getitem__s0 %% %&&s+ +##C((r0c<URRX05 gr)rr)rrrts r.rGeneralInterface.__setitem__s ""C<0r0cURU grrrs r.rGeneralInterface.__delitem__s    $r0cH[0UREURE5$r)rrrrs r.__iter__GeneralInterface.__iter__s$Ct++Ct/B/BCDDr0c~[URR5URR5-5$r)rrrrrrs r.__len__GeneralInterface.__len__s04'',,.1D1D1I1I1KKLLr0c<URRX05 gr)rr)rrrts r.registerGeneralInterface.registers ""C<0r0c4[UR55$r)rprrs r. valid_keysGeneralInterface.valid_keys sDIIK  r0rN)rrFrtr)r list[str])r+r*rrrrrrrrrrr'rrrrr0r.rrsGO!) 1%EM11!r0rg?g>@c$^^^^^UUUUU4SjnU$)ae Decorator that retries a function call with exponential backoff. Args: max_retries (`int`, *optional*, defaults to 5): Maximum number of retry attempts. initial_delay (`float`, *optional*, defaults to 1.0): Initial delay in seconds before the first retry. max_delay (`float`, *optional*, defaults to 30.0): Maximum delay in seconds between retries. jitter (`bool`, *optional*, defaults to `True`): Whether to add random jitter to the delay. exceptions (`tuple`, *optional*, defaults to `(Exception,)`): Tuple of exception types to catch and retry on. c<>^[T5UUUUUU4Sj5nU$)Nc>Tn[ST S-5H nT"U0UD6s $ g!TanUT :Xae[UT 5nT (aU[R"SS5-n[R STR SUST SUSUS S 3 5 [R"U5 [US -T 5nSnAMSnAff=f) Nrg?g333333?[z ] attempt /z failed: z Retrying in z.1fzs...r) rangeminrandomuniformrinfor+timesleep) rrdelayattemptexc sleep_for exceptionsr initial_delayjitter max_delay max_retriess r.r)retry..decorator..wrapper's!E K!O460005" 6+- #E9 5I!V^^C%== KKDMM?*WIQ{m9UXTYZ''0oT;JJy) 95E 6s$B>B B99B>r)rrrrrrrs` r.rretry..decorator&s% t 6 6  6*r0r)rrrrrrs````` r.retryrs.2 r0)rztype[ModelOutput]rr)rrl)r str | None)rrn)NTN)r|rFriztorch.dtype | Nonerwrnrxr)NNN)rrrrrrn)rrrztuple[bool, str | None])rrF)rrrztuple[list[Any], list[str]]r)rWz Iterable[Any]r rrztype[ModelOutput] | Nonerrr[)rWrrXrFrUrF)rz list | None)rzdict[str, Any]rrn)rrFrrn)r nn.ModulerrFrtr)rrrrF)cr __future__rrErrr rr r collectionsrrcollections.abcrrr contextlibr r r dataclassesr r enumr functoolsrrtypingrrrrrDr%r import_utilsrrrr!r get_loggerr+rr rrrr/rrArKrUrZrNrMrerjrsr}rrOrrrrrrr(r)rFr"r)r1r6rKrRrVr_rcrirlrqrwrzrrrrrrrrrrrrrr0r.r's\# ->>EE,$00QQ   H %14642 5 9&"% ' '&",!%!%   :# :_c!75?!7Q[!7 !7H ;D0I3+I3X6-15 5 5*5 5  3  l--$  A 9 N L L P P c eL^$%$N+ 89 3.Oj, &!~&!T | 0r0