Nj> $SSKrSSKJr SSKJrJr SSKrSSKJ r SSK J r /SQr "SS\RR5rSS \RRS \S \S \\RR&\RR&44S jjrS\RRS\S \4SjrSS\\R,R.\RR4S\\\RR&/\4S\S \4Sjjrg)N)Callable)OptionalUnion)map_arg) split_module)FoldedGraphModuleget_unique_attr_name_in_modulesplit_const_subgraphsc ^\rSrSrSrS S\R RS\RRS\ \RRS\ \ S\ 4 U4Sjjjr U4S jr S rS rU=r$) ras FoldedGraphModule is a GraphModule which also contains another `const_subgraph_module` representing a subgraph which has all const attr inputs and which can be run once before running the main standard `graph`. The `const_output_names` are the ordered list names of attrs which represent what each respective output from the const_subgraph should be set on which attrs. rootgraphconst_subgraphfx_const_folded_attrs_namedevice_for_folded_attrsc>[TU]X5 UcSO[RR X5UlSUlX@lXPlg)NF) super__init__torchfx GraphModuleconst_subgraph_modulehas_folding_been_runrr)selfr rrrr __class__s q/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/torch/fx/experimental/const_fold.pyrFoldedGraphModule.__init__sO %% %%d; " %*!*D''>$c`>UR(dUR5 [TU] "U6$N)r run_foldingr__call__)rargskwargsrs rr"FoldedGraphModule.__call__.s(((    w&&rc^TRb TRcgTR(a [S5eSTlTR5nU4Sjn[ U[ 5(a5[ RRUVs/sH o2"U5PM sn5OU"U5n[TTRU5 gs snf)NzFolding has already been runTcX>[RR[U[5(dUR 5R 5O-[R"U/5RTRS9[U[R5(aURS9$SS9$)N)deviceF) requires_grad) rnn Parameter isinstanceintdetachcloneTensortorr))irs r _create_param4FoldedGraphModule.run_folding.._create_paramEs88%%!!S))   "\\1#&))1M1M)N1;Au||1L1Laoo & SX & r) rrrAssertionErrorr,tuplerr* ParameterListsetattr)r folded_attrsr3r2paramss` rr!FoldedGraphModule.run_folding3s  & & ...6   $ $ !?@ @$(! 113  ,.. HH " "l#KlM!$4l#K L|,  d55v> $LsC)rrrr)NNcuda)__name__ __module__ __qualname____firstlineno____doc__rr*ModulerGraphrstrrr"r!__static_attributes__ __classcell__)rs@rrrs}4848'- ?hhoo?xx~~?!0 ? %-SM ? "% ??$' ??rrgminline_mod_namerun_dcereturnc"^[UR55Un[U[RR 5(d[ S[U535eSnURRH)nURS:XdMURU:XdM'Un O Uc[ SU35eURnURn0mSnU4Sjn URRGHn U RS:Xa,U RU;aXzROXhTU 'US- nM@U RS :XGa7U RSn [X5n /n [U [ ["45(aqSSKnUR&Vs/sHVnURS :XdMURUR(LdM0[URS[*5(dMTUPMX n nUR-U 5 U HunURSn[U[*5(d[ S [U535eUR-U U5 URR/U5 U UTU'Mw GMURR1U5 URR3X5nSSS5 WTU 'GM URR/U5 U(aURR55 T$s snf!,(df  N[=f) z Given `gm` and some graph module which is called with target name `inline_mod_name`, this helper will inline all of the nodes from that called graph module into `gm`. Returns a mapping from subgraph nodes to the newly created/mapped nodes in gm. zExpected GraphModule, got N call_modulez$Could not find call_module node for rcP>TUnURR5UlU$r )metacopy)nodenew_nodereplacement_mappings rreplacement_fn&_inline_module..replacement_fnrs$&t, ( r placeholderoutput call_functionzExpected int index, got )dict named_modulesr,rrrr5typernodesoptargetr#r$namerlistr6operatorusersgetitemr-replace_all_uses_with erase_nodeinserting_before node_copyeliminate_dead_code)rGrHrI inline_modcall_mod_node_to_replacerP call_mod_argscall_mod_kwargsph_countrS inline_nodeoutputsoutput_replacements getitem_usersrauseridxrQrRs @r_inline_modulertUsb&&()/:J j%(("6"6 7 79$z:J9KLMM# 77m # (F'+ $  'COCTUVV-11M.55O>@H "''-- >>] *##6 0 01", , MH  >>X %!&&q)G")'"B 24M-e}==!9 > >! >ww/1 x'7'77#499Q<5  >! % : :;N O&iil!#s++(+CDI;)OPP**+>s+CD##D),?,D#D) &  XX & &'? @xx))+FHA+3K(Y.bHH01 $$& A!*A @s$K;K;9 K;K;L L mod_tracedr_cB[R"SSU5nUSR5(aSU3n[X5(aY[R"SU5nUcUS-nO'UR SS5up4US[ U5S-3n[X5(aMYU$)zH Make sure the name is unique (in a module) and can represents an attr. z[^0-9a-zA-Z_]+_rz (.*)_(\d+)$_1rV)resubisdigithasattrmatchgroupr-)rur_r~basenums rr r s 66"C .D Aw4&z * # #. =$;D Aq)IDV1SX\N+D * # # Krmoduleskip_folding_node_fnrc  ^^SSKn[U[RR5(d [RR U5nOUnS[RRS[ 4U4Sjjm[5mSnURRGHFnURS;aMURS:wa+[UR5RT5(dMQU(aU"U5(aMgUR5(aM~[URRS S5UR 5(aMURS :Xa[UR#UR$5=n(a9[U[RR5(aT"U5(aGM TR'U5 URS:wdGMDS nGMI U(d[)XDR5$S [RR*4U4S jjn[-X@U5n SupU R.[1XS5pU (aU RRO/H>nURS :XdM[3XR$[1XR$55 M@ U RRH>nURS :XdM[3XR$[1XR$55 M@ SnU RRH3nURS :XdMUR$U :XdM'UR4n O Uc [7S5e[RR XR5nSnURRGH5nURS:Xa[UR4S[85nM3URS:waMEU[;U5:aUS[;U5S35eUUnUS- nURS:wa[7SUR35eURR=U5 URR?UR$5nSSS5 UR@RC5Wl UREU5 URRGU5 GM8 S[I5;a [7S5e[KUS5n[3U UW(a[RLRO5O[RLRQ55 U RRHnURS :XdMUR$U :XdM'URR=U5 URR?U5nSSS5 UR@RC5Wl UREU5 O [SX5(a [UX5 U RRW5 [)U U RURUU5$!,(df  GN=f!,(df  N=f)a2 Looks through `module` for any nodes that have all constant attribute inputs and separates them out into their own constant subgraph, and returns a FoldedGraphModule which runs that constant subgraph on the first run to set attributes on the module prior to running the non-constant portion of the graph. rNrrJc>[U[RR5(d [ S5eUR R HnURS:XaUR5(a gURS:XdM<URUR5=n(dM`[U[RR5(dMT"U5s $ g)zP Return True if a GraphModule type subgraph contains any impure op, else False. zDcaller should only pass GraphModule to subgraph_has_impure_ops checkrXTrLF) r,rrrr5rr\r] is_impure get_submoduler^)rrP submodule_subgraph_has_impure_opss rr7split_const_subgraphs.._subgraph_has_impure_opss&%(("6"677 V LL&&Dww/)dnn.>.>=("("6"6t{{"CCYCy%((*>*>??/ ::'rF>rWrUget_attr fill_valuerLTrPc>UT;aS$S$)NrrV)rP const_nodess r mod_partition,split_const_subgraphs..mod_partitionsK'q.Q.r)submod_0submod_1z,Could not find call_module node for const_gmrWrUzPlaceholder index z out of range for args (len=)rVzExpected get_attr, got multiple_outputsz multiple_outputs not set in loop_FX_CONST_FOLDED_ATTRS),sympyr,rrrsymbolic_traceboolsetrr\r]all_input_nodesissubsetrr$getExprrr^addrNoderrgetattrr8r#r5r6lenrfrrNrOrdrelocalsr r*r7r+r}rtrh)rrrrrufound_const_foldingrP target_modrsplitconst_mod_namenon_const_mod_nameconst_gm non_const_gmcall_const_gm_args root_const_gmph_idxrin_noderQrr9rrs @@rr r s fehh22 3 3XX,,V4  )=)=$,'*eK  && 77/ /  77j T-A-A)B)K)K * *   $8$>$>  >>    dkkoolD95:: F F  GG} $)77 DDD:uxx';';<<(44   77j "& M'R  -=-=>>/EHHMM/ ] ;E)?&N"^^WUPT-Ul -9 ""((b@ 77m # E;; kk(J KA$$ 77m # E;;++(F G% !! 77m #{{n,%)YY" " !KLLHH((?M F##)) 77h )$))A,>   77m #  S+, , $VH-./03 %V,!  :: # #:7::,!GH H  1 1$ 7$**33GNNCH8 (  ""8,&&t,'*()?@@ "@,"  "$4 %((:L:L:N  !! 77m # ~(E,,T2#zz223MN 3 $  0L   & &| 4  "u))u1 KK##%   "  I8 7,32s&Y(Y* Y' * Y8 )T)Ncpu)rzcollections.abcrtypingrrtorch.fxr torch.fx.nodertorch.fx.passes.split_moduler__all__rrrrDrrYrrtr r*rBr rrrrs $"!5 @?,,@?HEIW W/2W=AW %((-- &'Wtuxx/C/C3SV,GK#(H %((//588#7#77 8H"8UXX]]OT,A#BCH!H Hr