Zj}KF%SSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r SSK JrJr SSKJr S S KJr \R("\5rSS KJrJrJrJrJr SS KJr SS KJr SSKJ!r! SSKJ#r$ Sr%\RLROSS5RQ5r)Sr*\)\;r+S\,4SjrS\,4Sjr#S\"SSS90S\"SSS90\RZ\"SSS90\RZ\"SSS90\RZ\"S S!S90\RZ\"S"S!S90\RZ\"SSS90S#.S\"S$S%S90\R\\"S&S'S9\RZ\"S&S'S90\RZ\"S(S'S90\RZ\"S&S'S90\RZ\"S&S)S90S*.S\RZ\R^-\"S+S,S S-900S\RZ\R^-\"S+S.S S-900S\RZ\R^-\"S+S/S S-900S\RZ\R^-\"S+S0S S-900S\RZ\R^-\"S+S1S S-900S\RZ\R^-\"S+S2S S-900S3. r0\1\,\1\\,-\\1\\4-44\2S4'\!b;\RZ\!"S5S6S790\R\\!"S5S6S79\RZ\!"S5S6S790S8.\0S9'S:r3S^S;jr4SCS SD.SES SD.SES SD.SFS SD.SGS SD.SHSISJ.SK.r5\1\,\1\,\,44\2SL'0r6\1\,\ S-4\2SM'SN\,S-SO\74SPjr8S_SN\,SQ\S-SR\7SO\ S-4SSjjr9\64ST\,SU\1\,\ S-44SVjjr:S`ST\,SW\,S-SX\;\,-S-SR\7SO\ 4 SYjjrSZ\<\\-4S[jr=Sq>\S\5r?/S]Qr@g!\"a Sr!GNf=f!\"a Sr%GNf=f!\"a Sr*Sr+S<rS=r#"S>S?5rS@rSArSBr4Nf=f)aN)Callable)contextmanager) ModuleType)version)ENV_VARS_TRUE_VALUESlogging)is_kernels_available)flash_attention_forward)DeviceLayerRepositoryModeregister_kernel_mappingreplace_kernel_forward_from_hub) get_kernel)use_kernel_forward_from_hub)FuncRepository)use_kernel_func_from_hubTFUSE_HUB_KERNELSYES layer_namecl[(a [U5$[RS[35 S$)NFkernels hub usage is disabled through the environment USE_HUB_KERNELS=cU$Nclss v/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/integrations/hub_kernels.py-use_kernel_forward_from_hub..Fss)_kernels_enabled$_kernels_use_kernel_forward_from_hublogger warning_once_TRANSFORMERS_USE_HUB_KERNELS)rs r rr?s5  7 C C   XYvXwx # "r# func_namec[(a[(a [U5$[(d[R S5 S$[R S[ 35 S$)Nzwuse_kernel_func_from_hub is not available in the installed kernels version. Please upgrade kernels to use this feature.rcU$rrfuncs r r!*use_kernel_func_from_hub..Usr#)r$_has_use_kernel_func_from_hub!_kernels_use_kernel_func_from_hubr&r'r()r)s r rrHs_   = =4Y? ?00##B% $##\]z\{|% $r#cudaz!kernels-community/deformable-detrMultiScaleDeformableAttention)repo_idrzkernels-community/moe Llama4TextMoezkernels-community/liger_kernels LigerRMSNormzkernels-community/rmsnormRMSNormzkernels-community/mlx_rmsnorm)r1rocmxpumpsnpuzmedmekk/triton-llama-mlpTritonLlamaMLPzkernels-community/megablocksMegaBlocksMoeMLPzahadnagy/megablocksCPUMegaBlocksMoeMLP)r1r7r8cpuzkernels-community/activationFastGELU)r3rr QuickGELUNewGELUSiluGeluGeluTanh) r2r4r6MLPr<r?r@rASiLUGeLUrD_KERNEL_MAPPINGzkernels-community/rotaryapply_rotary_transformers)r3r))r8r1rotary_pos_embcb^TU;=(d# [U4SjUR555$)Nc3j># UH(n[U[5=(a [UT5v M* g7fr) isinstancedicthas_key).0vkeys r has_key..s([PZ1z!T2Fwq#FPZs03)anyvalues)drRs `r rOrOs'ax[3[PQPXPXPZ[[[r#cUc[n[US5(a[SS9(d [S5e[ U5 g)Nr8z0.10.2) MIN_VERSIONzfkernels uses an incompatible version. Please install the latest version with `pip install -U kernels`.)rHrOr ImportErrorr)mappings r $register_kernel_mapping_transformersr\s; ?%G 7E " "+?H+Ux  (r#c SnU$)NcU$rrrs r decorator.use_kernel_forward_from_hub..decoratorsJr#rargskwargsr_s r rrs r#c SnU$)NcU$rrr,s r r_+use_kernel_func_from_hub..decoratorsKr#rras r rrs r#c\rSrSrSrSrg)ri c[S5e)NzNLayerRepository requires `kernels` to be installed. Run `pip install kernels`. RuntimeError)selfrbrcs r __init__LayerRepository.__init__ sop pr#rN)__name__ __module__ __qualname____firstlineno__rl__static_attributes__rr#r rr s qr#rc[S5e)Nz^replace_kernel_forward_from_hub requires `kernels` to be installed. Run `pip install kernels`.rirbrcs r rrs l  r#c[S5e)NzVregister_kernel_mapping requires `kernels` to be installed. Run `pip install kernels`.rirts r rrssttr#c[S5e)Nzcregister_kernel_mapping_transformers requires `kernels` to be installed. Run `pip install kernels`.rirts r r\r\s q  r#zkernels-community/causal-conv1d)r3rzkernels-community/mamba-ssmz!kernels-community/finegrained-fp8zkernels-community/deep-gemmzkernels-community/sonic-moez ep-support)r3revision)z causal-conv1dz mamba-ssmzfalcon_mamba-ssmzfinegrained-fp8z deep-gemmz sonic-moe_HUB_KERNEL_MAPPING_KERNEL_MODULE_MAPPINGattn_implementationreturncJUSL=(a [R"SU5SL$)zJCheck whether `attn_implementation` matches a kernel pattern from the hub.Nz'^[^/:]+/[^/:]+(?:@[^/:]+)?(?::[^/:]+)?$)research)rzs r is_kernelr*s- 4' c II@BU V^b br#attention_wrapperallow_all_kernelscSSKJn SSKJn SU;aUR S5SOUn[ U5(dg[ (d [S5eSU;a$UR S5upgUR5nOUnSnUR5nURS 5uphn UR5nU (aU R5OSn [XiUS 9n [U S5(a Uc[nUn OUb [X5n UR!UW 5 UR!XS5 U $![an [S US U S 35eSn A ff=f)a Load and register the kernel associated to `attn_implementation`. Args: attn_implementation: A string, usually a kernel repo like "kernels-community/flash-mla". attn_wrapper: a callable for the wrapper around the attention implementation. In `transformers` we have a wrapper around the `flash_attn_var_len` call, and the same goes for `sdpa` and `eager`. They just prepare the arguments properly. This is mostly used for continious batching, where we want the `paged` wrapper, which calls the paged cache. allow_all_kernels (`bool`, optional): Whether to load kernels from unverified hub repos, if it is a custom kernel outside of the `kernels-community` hub repository. r)ALL_MASK_ATTENTION_FUNCTIONS)ALL_ATTENTION_FUNCTIONS|r N`kernels` is either not installed or uses an incompatible version. Please install the latest version with `pip install -U kernels`.:@)rwrz-An error occurred while trying to load from 'z': .flash_attn_varlen_funcflash_attention_2) masking_utilsrmodeling_utilsrsplitr_kernels_availablerZstrip partitionr Exception ValueErrorhasattrr getattrregister) rzrrrractual_attn_namer3 kernel_name_revkernelekernel_functions r load_and_register_attn_kernelr2sg =8  - %--c37/**5  '!//0F TI"))"E  ' ( (-@-B-B ,"00O3DF'- $ $(G  =! (#'G :  9 (#'G 4  9 ( '"&  ' ,'+$    ,s=A D##E E#E 6 E E  EEE21E2rwrc^SSKJn [(d [S5eUR S5SnUS:waU(d [ S5eSX@S .n[ RRS 5n[R"U5[R"S 5:a [XX&S 9$[XUS 9$)Nr) __version__r/rzkernels-communityziYou need to specify `allow_all_kernels=True` to use kernels outside of the `kernels-community` repository transformers) frameworkrr3kernelsz0.10.4)rwr user_agentr) rrrZrrrmetadatar pkg_versionparseget_kernel_hub)rrwrrr repo_parentrkernels_versions r rrs    -  ##C(+K))2C w   .+^J((00;O)[->->x-HHkgeekgNNr# module_namescD^[T[5(aT/mU4SjnU$)a3 This decorator attaches the target function within the module as a plain attribute (not as a submodule). Keep in mind that this registration is only meant for `kernelize` to recognize its target modules (i.e. function exchanged for a weightless `nn.Module` with the same forward) to then exchange to the kernel variation (in-place) if the conditions are met. We cache each of these function-based registrations: After proper registration and exchange it is removed from the module's `_modules` dict as it does not really act as `nn.Module` but a base function. c<>^URmUU4SjnXlU$)Nc>T"U/UQ70UD6 URRS05nTHNn[USS5=(d! [USS5=(d [USS5nUc[SU<35eXCU'MP g)N_hidden_kernelsrnkernel_layer_namer)z)Could not infer kernel function name for )__dict__ setdefaultrr)rkrbrchidden_kernelsfnnamer orig_inits r new_init8use_kernelized_func..decorator..new_inits d ,T ,V ,"]]556GLN"B D16r#6=6r;5 <$'PQSPV%WXX(*t$#r#)rl)rrrrs @r r_&use_kernelized_func..decoratorsLL  *"  r#)rMr)rr_s` r use_kernelized_funcrs&,))$~ . r#c#,# SqSv Sqg!Sqf=f7f)z Context manager used to adjust the value of the global `ALLOW_HUB_KERNELS`. This is needed, as this argument cannot be forwarded directly to the `__init__` of the models, where we set the attention implementation. TNF)ALLOW_ALL_KERNELSrr#r allow_all_hub_kernelsrs!"  "Es ) rrrrr\rrrrr)NF)NNF)Aimportlib.metadatarosr}collections.abcr contextlibrtypesr packagingrrutilsrr utils.import_utilsr flash_attentionr get_loggerrnr&rr rrrrrrrr%rrZrr0r/environrupperr(rr$str INFERENCETRAINING TORCH_COMPILErHrN__annotations__rOr\rxryboolrrrintlistrrr__all__rr#r rs $%,154   H %}  * .Y(,%%'JJNN3De$L$R$R$T!48LL## %C %" O;:*  O/* =-!=-!7(!;(!=-!5  D O2+  :1 :1! 11!:1!:4!/ > !3!33_:)6  !3!33_:*6  !3!33_:(6  !3!33_:vWX6  !3!33_:vWX6  !3!33_:z[\6 wBeOT#tFSL/DI^D_2_$_``aBJ!6B]!  ~6B] 6B]!  - () \)^"CqQ:qI$AaP#FSTU:qI: U 2T#tCH~-.8:S*t"33493:$di::19D:\`:$:zPf, #, S*t:K5K0L, b $# OODjO3Y O O  O:$d8nx&?$P " " O  .(-%.D!   qq u =! sU M:(M/M+7H=M:M($M:'M((M:+M73M:6M77M::#N N