Nj@ %SSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSKJ r J r SSK J r JrJr SSKrSSKJs Jr SSKJrJrJrJrJrJrJrJr SSKJr \(aSSKJr \R@"\!5r"\R$RG\!S5r$\%"5r&S \'S '\(\)-\*-S-r+/S Qr,SS K-J.r/ S r0"SS5r1"SS5r2"SS\2\*5r30S\Rh_S\Rj_S\Rl_S\Rn_S\Rn_S\Rp_S\Rr_S\Rt_S\Rv_S\Rx_S\Rz_S\R|_S S!_S"\R~_S#\R_S$\R_S%\R_0S&\R_S'\R_S(\R_S)\R_S*\R_S+\R_S,\R_S-\R_S.\R_S/\R_S0\R_S1\_S2\_S3\_S4\_S5\_S6\R_ES7\R0ErM1S8krNS9rOS:rP\PHKrQS;\Q3rRS<\R3rS\T"\1\R\O"\Q55 \U"\\S5\M\R'\NRm\R5 \,R\R5 MM S 1rW\N\W-rX1S=krY1S>krZS1r[\Y\[-r\1S?kr]SS)1r^SS)S@SA.r_1SBkr`\PHrQS;\Q3rR\`Rm\R5 M 1SCkra1SDkrbSErcSFrdSGreSHrfSIrgSJrhSKriSLrjSMrkSNrlSOrmSwSPjrnSQroSRrpSSrq0S\Rl_S0\R_S&\R_S%\f_S-\g_S,\h_S\i_S\o_S)\j_S*\p_S+\q_S6\c_S7\d_S\e_S#\k_S/\l_rrSTrsSUrtSVruSWrvSXrwSYrxSZryS[rzS\r{S]r|S^r}S_r~S`r\ GR\!rSar\PH(rQSb\Q3r\"\Q5r\=\l\l!\T"\\\5 M* CCQCScrSxSdjrSerSfr0\rE0S5\GR_S\Rh_S\w_S'\x_S\y_S$\z_S"\{_S\|_S\t_S\u_S1\_S\v_S(\R_S4\}_S3\~_S2\_S\_E\\Sg.Er\PHrQS;\Q3rR\U"\Sb\Q35\\R'M CQCRCPCShrSirSjrSkrSlrSmrSnrSor\\\\\\Sp.rSqrSrrSsrStrSur\GR55Hurr\"\\5 M \GR55Hurr\"\\5 M Svr\HTr\\Y;a \"\\5 M\\];a \"\\5 M%\\[;d\\Z;a \"\\5 \"\\5 \\_;dMK\"\\5 MV CCg)y) annotationsN) lru_cacheupdate_wrapper)Optional TYPE_CHECKINGUnion) sym_floatsym_itesym_maxsym_minsym_notSymBoolSymFloatSymInt)dtrace_structured)ShapeEnvsym_nodeobject_NO_HINT)SymNodemethod_to_operator magic_methods DynamicInt) py_sym_typesc`U[La[$U[La[$U[La[ $U$N)boolrintrfloatr)ts o/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/torch/fx/experimental/sym_node.py _to_symtyper"As+DyCx Ez Hc\rSrSr%SrSrS\S'S^S_SjjrS`SjrSaS jr SbS jr \ S 5r \ S 5r S rScSjrSrSrSrSrSrSrSrSrSrSrSrSrSrSrSdSjrSeSjrSeSjr ScSeS jjr!SeS!jr"SeS"jr#SeS#jr$SeS$jr%SeS%jr&SeS&jr'SeS'jr(SeS(jr)SeS)jr*SeS*jr+SeS+jr,SeS,jr-SeS-jr.SeS.jr/SeS/jr0SeS0jr1SeS1jr2SeS2jr3SeS3jr4SeS4jr5SeS5jr6SeS6jr7SeS7jr8SeS8jr9SeS9jr:SeS:jr;SeS;jrSeS>jr?SeS?jr@SeS@jrASeSAjrBSeSBjrCSeSCjrDSeSDjrESErFSFrGSGrHSHrISIrJSJrKSeSKjrLSLrMSMrNSNrOSeSOjrPSfSPjrQSQrRSRrSSSrTSTrUSUrVSVrWSWrXSXrYSYrZSZr[S[r\S\r]S]r^g)grNz This is a type erased SymInt/SymFloat which we use to do actual operations. End users don't touch this. Magic methods are NOT defined on this object. Fr_optimized_summationNc0^UTlUTlUTlUTlU4SjnU[LaSnOUb[ U5ULd1[ U5[ U5Ld[SUS[ U535eTR(aETRR(a*U"5n XI:wa[USU STRS35eOU"5nUTl UTl TR=(a TRRn U =(a UTl g)Nc>SSKJn U"TR5(agTRR TRSS9nUb([ U[ 5(dTRU5OUnU$)Nr)has_free_unbacked_symbolsT) compute_hint)%torch.fx.experimental.symbolic_shapesr)expr shape_env_maybe_evaluate_static isinstanceSymTypespytype)r)hintselfs r!r*&SymNode.__init__..compute_hints` W)33>>88QU8VD0:40J0Jt{{4(PTKr#zCannot create SymNode of type z with incompatible hint of type z != z (for )) _exprr-r1r&rtyper"AssertionError_translation_validation_enabledr,_hintconstantfx_node) r3r,r-r1r2r;r<optimized_summationr* computed_hinttx_validation_ens ` r!__init__SymNode.__init__]s " $7!:  8 D  J&(DJ+f:M,M$4h>tDzlL~~$.."P"P!- ((D6m_F499+UV)WXX>D ;C NN Mt~~MM (3G r#c[URXRURURUR 5$r)rr6r1r:r;r<)r3r-s r!with_shape_envSymNode.with_shape_envs. JJ ;; DMM4<<  r#c4URUR:H=(ay URUR:H=(aY URUR:H=(a9 URUR:H=(a URUR:H$r)r6r1r:r;r<r3others r! _value_eqSymNode._value_eqsq JJ%++ % . u||+ . ekk) . / .  -  r#c[URURURURUR 45$r)hashr6r1r:r;r<r3s r! _value_hashSymNode._value_hashs,TZZdjj$--VWWr#cLURRUR5$r)r-replacer6rLs r!r, SymNode.exprs~~%%djj11r#cUR$rr:rLs r!r2 SymNode.hints zzr#cURSL$rrSrLs r!has_hintSymNode.has_hintszz%%r#cSSKJn URcUb{U"UR5nURRVs0sH$nUXC;aUOUR R U_M& nn[URRU55$UR RUR5$UR$s snf)Nrfree_unbacked_symbols) r+rZr:r, free_symbolsr-backed_var_to_valrxreplace size_hint)r3fallbackrZunbacked_symbolss replacementss r! require_hintSymNode.require_hintsO :: #$9#C "YY33  4, 99!<=4   499--l;<<>>++DII6 6zz s+CcdURR(a[UR5$gr)r, is_numberrrLs r! maybe_as_intSymNode.maybe_as_ints 99  tyy> !r#cSSKn[URUR5(a[ UR5$gNr)sympyr/r,Floatrr3rks r!maybe_as_floatSymNode.maybe_as_floats, dii - -# #r#ctSSKnURURLagURURLagg)NrTF)rkr,truefalserms r! maybe_as_boolSymNode.maybe_as_bools. 99 " YY%++ %r#c&UR[L$r)r1rrLs r!is_intSymNode.is_ints{{c!!r#c&UR[L$r)r1rrLs r!is_floatSymNode.is_floats{{e##r#c&UR[L$r)r1rrLs r!is_boolSymNode.is_bool s{{d""r#cURSL=(aE [UR[5=(a$ URRR 5$r)r:r/rnode is_nested_intrLs r!rSymNode.is_nested_int sA JJd " 04::v. 0 --/ r#c [U5[La[S[U535eSSKn[ UR U5UR [XUS9$)NExpected int, got rr;r<)r7rr8rkrIntegerr-r3numrks r!wrap_intSymNode.wrap_intsN 9C  #5d3i[!AB B MM# SPS  r#c [U5[La[S[U535eSSKn[ UR U5UR [XUS9$)NzExpected float, got rr)r7rr8rkrrlr-rs r! wrap_floatSymNode.wrap_floatsN 9E ! #7S {!CD D KK dnneSPS  r#c [U5[La[S[U535eSSKn[ U(a UR O UR UR[UUUS9$)NzExpected bool, got rr)r7rr8rkrrqrrr-rs r! wrap_boolSymNode.wrap_bool&sW 9D  #6tCyk!BC CEJJ5;; NN     r#cU$rrLs r!clone SymNode.clone4s r#cUR$r)r,rLs r!str SymNode.str7s))r#c"UR5$rrrLs r!__str__SymNode.__str__:sxxzr#cSURSURSUR3/nURbUR SUR35 UR bUR SUR 35 UR bUR SUR 35 SRU5S-$) NzSymNode(z , shape_env=z , pytype=zhint=z constant=zfx_node=z, r5)r6r-r1r:appendr;r<join)r3reps r!__repr__SymNode.__repr__=stzzl,t~~.>i } U  :: ! JJtzzl+ , == $ JJ4==/2 3 << # JJ$,,0 1yy~##r#c"UR5$rrrLs r! _graph_reprSymNode._graph_reprIsxxzr#c"UR5$r)_absrLs r!abs SymNode.absOyy{r#c"UR5$r)_posrLs r!pos SymNode.posRrr#c$URU5$r)_round)r3ndigitss r!round SymNode.roundUs{{7##r#c"UR5$r)_truncrLs r!trunc SymNode.truncX{{}r#c$URU5$r)_addrFs r!add SymNode.add[yyr#c$URU5$r)_subrFs r!sub SymNode.sub^rr#c$URU5$r)_mulrFs r!mul SymNode.mularr#c$URU5$r)_modrFs r!mod SymNode.moddrr#c$URU5$r) _float_powrFs r! float_powSymNode.float_powgsu%%r#c$URU5$r)_pow_by_naturalrFs r!pow_by_naturalSymNode.pow_by_naturaljs##E**r#c$URU5$r)_and_rFs r!and_ SymNode.and_mszz%  r#c$URU5$r)_or_rFs r!or_ SymNode.or_prr#c$URU5$r)_float_truedivrFs r! float_truedivSymNode.float_truedivss""5))r#c$URU5$r) _int_truedivrFs r! int_truedivSymNode.int_truedivv  ''r#c$URU5$r) _int_floordivrFs r! int_floordivSymNode.int_floordivy!!%((r#c$URU5$r)_lshiftrFs r!lshiftSymNode.lshift|||E""r#c$URU5$r)_rshiftrFs r!rshiftSymNode.rshiftrr#c"UR5$r)_sym_notrLs r!r SymNode.sym_not}}r#c$URU5$r)_eqrFs r!eq SymNode.eqxxr#c$URU5$r)_nerFs r!ne SymNode.nerr#c$URU5$r)_gtrFs r!gt SymNode.gtrr#c$URU5$r)_ltrFs r!lt SymNode.ltrr#c$URU5$r)_lerFs r!le SymNode.lerr#c$URU5$r)_gerFs r!ge SymNode.gerr#c"UR5$r)_floorrLs r!floor SymNode.floorrr#c"UR5$r) _is_integerrLs r! is_integerSymNode.is_integers!!r#c"UR5$r) _sym_floatrLs r!r SymNode.sym_floats  r#c"UR5$r)_sym_intrLs r!sym_intSymNode.sym_intrr#c"UR5$r)_ceilrLs r!ceil SymNode.ceilszz|r#c"UR5$r)_negrLs r!neg SymNode.negrr#c$URU5$r)_sym_minrFs r!r SymNode.sym_min}}U##r#c$URU5$r)_sym_maxrFs r!r SymNode.sym_maxr&r#c$URX5$r)_sym_ite)r3then_valelse_vals r!r SymNode.sym_ites}}X00r#c$URX5$r)_is_contiguousr3sizesstridess r! is_contiguousSymNode.is_contiguouss""522r#c$URX5$r)_is_channels_last_contiguous_2dr1s r!is_channels_last_contiguous_2d&SymNode.is_channels_last_contiguous_2d33ECCr#c$URX5$r)_is_channels_last_contiguous_3dr1s r!is_channels_last_contiguous_3d&SymNode.is_channels_last_contiguous_3dr:r#c$URX5$r)_is_channels_last_strides_2dr1s r!is_channels_last_strides_2d#SymNode.is_channels_last_strides_2d00@@r#c$URX5$r)_is_channels_last_strides_3dr1s r!is_channels_last_strides_3d#SymNode.is_channels_last_strides_3drCr#c$URX5$r)'_is_non_overlapping_and_dense_indicatorr1s r!&is_non_overlapping_and_dense_indicator.SymNode.is_non_overlapping_and_dense_indicators;;EKKr#c$URU5$r)rrFs r!sym_orSymNode.sym_orrr#c$URU5$r)rrFs r!sym_andSymNode.sym_andrr#c$URU5$r) _bitwise_andrFs r! bitwise_andSymNode.bitwise_andrr#c$URU5$r) _bitwise_orrFs r! bitwise_orSymNode.bitwise_ors&&r#c$URU5$r) _bitwise_xorrFs r! bitwise_xorSymNode.bitwise_xorrr#c$URU5$r)rrFs r!truedivSymNode.truedivrr#c$URU5$r)rrFs r!floordivSymNode.floordivrr#c$URU5$r)rrFs r!pow SymNode.pows~~e$$r#cVURX5R[US55$)N)rJrto_noder1s r!is_non_overlapping_and_dense$SymNode.is_non_overlapping_and_denses*::5JMM D!   r#c&URSS5$Nr) guard_intrLs r!int_ SymNode.int_s~~b!$$r#c &SSKnSSKJnJn U"5(a3[ UU"[ R [SU554055$UVs/sHoURPM nnUR"U6n/nSn UH-nURc O*URUR5 M/ [U5n URR[ R [SU5545up[XpR[ XS9$s snf)Nrget_proxy_modehandle_sym_dispatchc38# UHn[U5v M g7fr) wrap_node.0as r! "SymNode.sym_sum..s6A9Q<<c38# UHoRv M g7frr<rxs r!r{r| s!:T))Tr}r)rk"torch.fx.experimental.proxy_tensorrtruritorchsym_sumtupler,Addr2rsumr-_create_fx_call_functionrr) r3argsrkrtrurzexprsout size_hintsout_hintr<_s r!rSymNode.sym_sums   #MM6668 "&&A&ii Avv~   aff % :H^^<< MME!:T!::<  sNNCKK#'sDc8URRX5$r)r-evaluate_sym_node)r3size_obliviouss r!evaluateSymNode.evaluates~~//EEr#cUR5n[U5$![a [R SU5 ef=f)NzFailed to convert to int: %s)rr Exceptionlogwarningr3fileliners r!roSymNode.guard_ints> MMO q6M  KK6 :   "?cUR5n[U5$![a [R SU5 ef=f)NzFailed to convert to float: %s)rrrrrrs r! guard_floatSymNode.guard_floats> MMO 8O  KK8! <  rcUR5n[U5$![a [R SU5 ef=f)NFailed to convert to bool: %srrrrrrs r! guard_boolSymNode.guard_bool)s> MMO 7N  KK7 ;  rc&SSKJn UR5(aCU"UR5(d,URR (dUR X5$URRURUSU3URS9$)NrrY:r) r+rZrVr,r-+prefer_deferred_runtime_asserts_over_guardsrguard_or_defer_runtime_assertr<)r3rrrZs r! expect_trueSymNode.expect_true3swO MMOO)$))44NNNN??4. . ~~;; II$q'<  r#cpSSKJn UR5(d [S5eU"[ U55$)Nr)statically_known_trueExpected bool type)r+rr|r8r)r3rrrs r!rSymNode.statically_known_trueEs+O||~~ !56 6$WT]33r#cURSS9n[U5$![a [R SU5 ef=f)a Like guard_bool, but if we encounter unbacked symbols, if those symbols are size-like, we will treat them as >= 2 for the purposes of the analysis. This CHANGES the runtime semantics, but all size-oblivious sites have been audited to ensure that the runtime semantics don't change in a material way. Acceptable runtime semantic changes are, e.g., squeeze() no longer dropping an unbacked one size, or a tensor reporting as non-contiguous even if it's contiguous if it would have been reported contiguous due to being empty. T)rrrrs r!guard_size_obliviousSymNode.guard_size_obliviousLsC MMM . 7N  KK7 ;  s ">cpSSKJn UR5(d [S5eU"[ U55$)Nr)guard_or_falser)r+rr|r8r)r3rrrs r!rSymNode.guard_or_false`s+H||~~ !56 6gdm,,r#cpSSKJn UR5(d [S5eU"[ U55$)Nr) guard_or_truer)r+rr|r8r)r3rrrs r!rSymNode.guard_or_truegs+G||~~ !56 6WT]++r#c&URSS5$rm)rrLs r!bool_ SymNode.bool_nsr1%%r#cg)NTrrLs r! is_symbolicSymNode.is_symbolicqr#cgrrrLs r! nested_intSymNode.nested_inttrr#cg)NFrrLs r! is_constantSymNode.is_constantwsr#)r6r:r&r;r<r1r-)NNF)r2z!Optional[Union[int, float, bool]])r-rreturnr)rGrrr)rrr)rz builtins.str)rr)F)___name__ __module__ __qualname____firstlineno____doc__r&__annotations__r@rCrHrMpropertyr,r2rVrcrgrnrsrvryr|rrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrr rrr rrr!r r r r4r8r=rArFrJrMrPrTrXr\r_rbrerjrprrrorrrrrrrrrrr__static_attributes__rr#r!rrNs"'$&!S4 0 S4j  X22&4"$#      $ $    &+! *()##"!$$13DDAAL ('()(% %#LJF $4(-,&r#rc(^\rSrSrU4SjrSrU=r$)_DynamicScalari{cN>U[La [S5e[TU] "U/UQ76$)Nz9_DynamicScalar is an abstract base class, use DynamicInt.)r TypeErrorsuper__new__)clsr __class__s r!r_DynamicScalar.__new__|s+ . WX Xws*T**r#r)rrrrrr __classcell__rs@r!rr{s ++r#rc>^\rSrSrSrU4SjrSrSrSrSr U=r $)riz User API for marking dynamic integers in `torch.compile`. Intended to be compatible with both compile and eager mode. Example usage:: fn = torch.compile(f) x = DynamicInt(4) fn(x) # compiles x as a dynamic integer input; returns f(4) c>[U[5(d[S[U535e[TU]U[U55nU$)Nr)r/rr8r7rr)rvalobjrs r!rDynamicInt.__new__s@#s## #5d3i[!AB Bgoc3s8, r#c"SURS3$)Nz DynamicInt(r5)realrLs r!rDynamicInt.__repr__sTYYKq))r#c2[URU-5$rrrrFs r! __floordiv__DynamicInt.__floordiv__s$))u,--r#c0[XR-5$rrrFs r! __rfloordiv__DynamicInt.__rfloordiv__s%99,--r#r) rrrrrrrrrrrrs@r!rrs!  *...r#rrrrandrTrrrrrr rrc"UR5$r)rxs r!rs ALLNr#rrrrrrr!orrXr\rrrrrr r r r r rr> rr!rrrrrr r c^U4SjnU$)Nc,>[UST35"5$)N_sym_)getattr)r3names r!fn_get_sym_node_fn..fnstuTF^,..r#rrrs` r!_get_sym_node_fnrs/ Ir#) sqrtcoscoshsinsinhtantanhasinacosatanlog2sym_r>rrr r >rrr>rrsym_log2rxor)rTrXr\>rr rr>rrrr> rr rrrrrrr rrjcSSKJn U"X5$)Nr) FloatTrueDiv)torch.utils._sympy.functionsr)rzbrs r!_sympy_float_truedivr "9  r#cSSKJn U"X5$)Nr) IntTrueDiv)rr )rzrr s r!_sympy_int_truedivr (s7 a r#cSSKJn U"X5$)Nr)FloorDiv)rr)rzrrs r!_sympy_floordivr.5 A>r#cvSSKJnJn UR(aUR(aU"X5$U"X5$)NrMod PythonMod)rrris_nonnegative)rzrrrs r! _sympy_modr4s*;A,,1yr#cSSKJn U"X5$)Nr) PowByNatural)rr)rzrrs r!_sympy_pow_by_naturalr=r r#cSSKJn U"X5$)Nr)FloatPow)rr)rzrrs r!_sympy_float_powrCrr#c,SSKnURX5$rj)rkAndrzrrks r! _sympy_andr!Is 99Q?r#c,SSKnURX5$rj)rkOrr s r! _sympy_orr$O 88A>r#cSSKJn U"X5$)Nr)LShift)rr')rzrr's r! _sympy_lshiftr(U3 !<r#cSSKJn U"X5$)Nr)RShift)rr+)rzrr+s r! _sympy_rshiftr,[r)r#cb[U5S:XaU/$SSKJnJn U"US5U"U5:aX/-$U"US5U"U5:aU/U-$S[U5S- pTXE::a:XE-S-nUR XU5nUS:XagUS:aUS-nOUS- nXE::aM:UR XA5 U$)zg If new_arg is found in ordered_args None is returned, else the new ordered_args with new_arg inserted r) _args_sortkeyBasicrhN)lensympy.core.basicr.r/compareinsert) ordered_argsnew_argsort_keyr/lowhighmidcompare_results r!_binary_search_insert_argr=as  <AyA R !HW$55i'' Q 8G#44y<''3|$q( +za|'8'B Q  a 'C7D +% r#c^ SSKm SSKJn U 4SjnSSKJn X&"U5-nX6"U5-nU(GaU(Ga U"UR S5U"UR S5:aU"UR UR -5$U"UR S5U"UR S5:aU"UR UR -5$[ UR 5S::a\[ UR 5S::aC[UR 5nUR Hn[Xx5nUbM O UbU"U5$U(a;UR(a*[[UR 5U5nUbU"U5$U(a;UR(a*[[UR 5U5nUbU"U5$T RX5n U"U 5U 4$)a Custom optimization for Add used to optimize incremental binary summations of certain properties. The idea is when we know the expression is a summation of unique symbols all we need to know is the correct order of symbols, and no other optimizations are needed. We pass evaluate=false, with the correct order of args and save the following. 1. Avoid running other optimizations when the Add is constructed. 2. Manually figure out the order of the args for the new expression in log(n) comparisons instead of nLog(n) (comparing terms is expensive and shows in the profiles). The function returns a tuple of (1) a boolean that indicates whether the output is a summation of unique symbols, (2) the result sympy expression. rN)r.c\>Uc [S5eTRRUSS9nSU4$)Nzordered_args is NoneT)is_commutative)r8r _from_args)r6resultrks r!make_optimized&_optimized_add..make_optimizeds:   !78 8 %%l4%Hf~r#)_is_symbols_binary_summationr0r1) rkr3r.rrE_argsr2listr= is_symbolr) lhsrhslhs_is_optimized_summationrhs_is_optimized_summationsortkeyrCrEnew_argsrzrBrks @r!_optimized_addrOs9J">s"CC">s"CC!&@ 399R= !GCIIaL$9 9!#))cii"78 8 399Q< 7399R=#9 9!#))cii"78 8 syy>Q 3syy>Q#6CIIHYY4XA# #%h//"cmm,T#))_cB  !(+ +"cmm,T#))_cB  !(+ + YYs F ( 0& 99r#cSSKJn U"X5$)Nr)BitwiseFn_bitwise_and)rrQ)rzrrQs r!rSrSB  &&r#cSSKJn U"X5$)Nr)BitwiseFn_bitwise_or)rrT)rzrrTs r!rWrWsA  %%r#cSSKJn U"X5$)Nr)BitwiseFn_bitwise_xor)rrV)rzrrVs r!r[r[rRr#cSSKn[XR5(aqURn[ U5S:XaV[USUR 5(a8USR (a$URUS5nUSU:XaXCS-$[XR 5(aXRU5:Xd[XR5(aURU5$U"U5$)Nrr1rh)rkr/Mulrr2rlrr)rzrrkaacoefs r!_floor_ceil_helperr[s!YY VV r7aSSKn[URRRST35"U5$)NrOpaqueUnaryFn_)rrutils_sympy functions)rzrrs r!r_get_sym_math_fn..fnMs/+u{{))33~dV5LMaPPr#rrs` r!_get_sym_math_fnrLsQ Ir#_sympy_c,SSKnURU5$rj)rkAbs)rzrks r! _sympy_absr^s 99Q<r#c8SSKJnJn UcU"U5$U"X5$)Nr) RoundDecimal RoundToInt)rrr)numberrrrs r! _sympy_roundrds E&!!F,,r#cSSKJn U"U5$Nr)ToFloat)rr)rzrs r!_sympy_sym_floatrms4 1:r#cdSSKnSSKJn URU"UR U55U5$r)rkrrrgr)rzrkrs r!_sympy_is_integerrus&4 88GEKKN+Q //r#)rrc ^[U5n[X[[US- SS555$)Nrhr0)r2sympy_is_contiguous_genericrGrange)r2r3dims r!sympy_is_contiguousrs* e*C &utE#'2re >g >>r#)r4r8r=rArFrJc"[U[5(a UR$[U5[LaUR U5$[U5[ LaURU5$[U5[LaURU5$[$r) r/r0rr7rrrrrrNotImplemented)r3rs r!ririsq#x  xx cd ~~c"" cc }}S!! ce s##r#c:[U[5(aURb UR$UR5(a [ U5$UR 5(a [ U5$UR5(a [U5$[SU35e)Nzunrecognized return type ) r/rr;rvrryrr|rr8rs r!rwrwst!W!**"8zzxxzzay { qz8<==r#c[U$r)METHOD_TO_OPERATOR)methods r!rr s f %%r#c^^[S5"T5mT[;aTS3nOTnS SjnU4SjnUUU4Sj5nUUU4Sj5nT[;a[[SU3U5 gTS:XaUU4Sjn[[SU3U5 gTS :XaS UU4S jjn[[SU3U5 g[[SU3U5 g) NrcTSSKnURRURRURR R U/nSSKnUVs1sHn[R"U5iM snURRR5-S1-$s snf)Nrz) r_dynamo eval_framerfx experimentalrtorch._dynamo.guardsinspectgetfileguardsuninteresting_files)rmodsrs r!r-_make_node_magic..uninteresting_files,s MM $ $ MM   HH ! ! * *    $*. .AW__Q  .mm""668 9l  .s B%cN>^[R"T5SUU4Sjj5nU$)Nc>^^^Uc T"U5mOT"X5m[RRR(a#UbX/mOU/mSU4Sjjm[ SUUUU4SjS9 T$)Nc">SSKnURbg[U5[T5:Xag[URUR UR 45(agURURUR4;ag[U5$rj) rkr;idr/r,rrlrqrr)rrkrBs r!get_idM_make_node_magic..capture_provenance..wrapper..get_idJso ((4#HF3##HMMEMM5;;3OPP#!5::u{{*CC#h<'r#expression_createdc >T[T5[T5TVs/sHn[U5PM snTVs/sHnT"U5cMT"U5PM sn[R"S5[R"S5S.$s snfs snf)Nr)rrB result_id arguments argument_ids user_stackstack)rr structuredget_user_stackget_framework_stack)rzirrrrBs r!rO_make_node_magic..capture_provenance..wrapper..Zs{"("%f+%'Z6?%@ic!fi%@/8)/8!F1IIF1Iy)'1&?&?&B!+!?!?!B )&A)sB B  B ) metadata_fn)rz Optional[int])r_logging _internalGET_DTRACE_STRUCTUREDr)r3rGrrrBrrs @@@r!wrapper=_make_node_magic..capture_provenance..wrapper>s_}DD~~''==$!% I!%I ("( ! Mr#r) functoolswraps)rrrs` r!capture_provenance,_make_node_magic..capture_provenance=s&  (  ( Tr#c >SSKJnJn [T5n[nUR b*UR bU"UR UR 5nU"5(a'[ X"U[U5[U54055$[U[5(d[S[U535eSnTS:XaSSK J nJn URn UR R"(d)U R%UR 5R&S:acUR R"(d)U R%UR 5R&S:aU"UR UR 5n GOU"UR UR 5n GOTS:Xa:[)UR UR UR*UR*5upjGOlTS;GaGSSKn SS KJn Jn UR R4=(a U "UR U R65nUR R4=(a U "UR U R65nU(aUR R8(d"U(aUR R8(aeU R:U R<U R>U R@U RBU RDS.TnU"UR UR SS 9n O %s)r<r=)0rrtrurrr2rirwr/rr8r7rrrr-r,r bound_sympylowerrOr&rktorch.utils._sympy.symbolrrrH UNBACKED_INTrfrgrjrvrmrsrprrr sym_node_logdebugalways_float_magic_methodsralways_bool_magic_methodsrr1r0rr<)r3rGrtruoprr=rrr-rrkrrlhs_is_unbackedrhs_is_unbacked rel_classr1r<rrBfuncrs r!binary_magic_impl+_make_node_magic..binary_magic_implks   '# 99 UZZ%;$))UZZ0H   )"y %@P.QSUV %)) #9$u+!GH H#= G!NN II,, ,,TYY7==BJJ-- ,,UZZ8>>!Cdii4C#DIIuzz:C5-;IIJJ--.. .*$c ??J#'))"5"5#.IIt00;#(**"6"6#>JJ 1 1<$ (<(<# (;(;$hh#hh#hh#hh#hh#hh !!I$DIIuzzEJCtyy%**5C499ejj1 +VTYY CP / /F 0 0F [[E !U\\U%:F[[F  ($x22h'H^^<< u}}-   NN   3   W  KK3VTYY S  s,4B?Q5Q>QD/QQ"Q8Q:c >SSKJnJn [T 5nU"5(a[ X"U[ U54055$UR nT S:XdT S:XaURRU5nT "U5n[RST XE5 [nURbU"UR5nT [ ;a["nO.T [$;a[&nOT [(;a[*nO UR,nURR/X0R045up[3XPRXvUS9$![a [RST U5 ef=f)Nrrsrceilingzfailed to eval %s(%s)z %s %s -> %sr)rrtrurrirwr,r-_simplify_floor_divrrrrrrr2always_int_magic_methodsrrrrrr1rr<r) r3rtrurr,rrr1r<rrrs r!unary_magic_impl*_make_node_magic..unary_magic_impls,   '   4!4R)D/9KR!PQ Qyy W ) 3>>55d;D t*C =$:# 99 $))}H - -F 0 0F 1 1F[[F^^<  s 2D22#Er c >SSKJnJn UR(a URO URnU"5(a6[ UU"[ [ U5[ U5[ U54055$T "URURUR5nURR[ URURUR45upx[X`RURXWS9$![a9 [RST URURUR5 ef=f)Nrrszfailed to eval %s(%s, %s, %s)r)rrtrur2rir rwr,rrrr-rr<rr1) pred_node then_node else_nodertrurrr<rrrs r! sym_ite_impl&_make_node_magic..sym_ite_impls  *3y~~Y^^H'%i0%i0%i0    9>>9>>9>>J#,,EE)++Y->-> @Q@QRJG(()*:*:H   3NNNNNN  s 6(DAErc (>SSKJnJn [RnU"5(a[ X"U[ U5U4055$URnT "XQ5nUc[nO URnSnURbU"URU5nUR/n UbU RU5 UR R#U[%U 55up['X`R XxU S9$![a [RST XQ5 ef=f)Nrrsz!failed to eval %s(%s, ndigits=%s)r)rrtrubuiltinsrrirwr,rrrrr1r2r<rr-rrr)r3rrtrurr,rr1rrr<rrrs r! round_impl$_make_node_magic..round_impl;s  B-b9T?G2LbQ99D 4) Hyy$dii1LL>D" G$@@U4[QJG3'R R1  ?W s C..#D)rzset[str]r)r2magic_methods_on_operator_with_trailing_underscore unary_methodssetattrr) rr method_attrrrrrr r s `` r!_make_node_magicr$s S>$ D CCl   ",\yyv"O"OH1[M*,<= 9 & P 1[M*L9 7 ' S' SR 1[M*J71[M*,=>r#c^^UU4Sjn[[ST3U5 UU4Sjn[[R[ T5(d#[[R[ TU5 gg)Nc N>SSKJnJn [[R [ T5nU"5(aJ[UU"UUVs/sHn[U5PM snUVs/sHn[U5PM sn4055$UVs/sHofRPM nnUVs/sHofRPM nnT"Xx5n /n Sn UH-nURc O\U RUR5 M/ /n UH-nURc O'U RUR5 M/ U"X5n TRS5(a[ n O["n [%XR&X5$s snfs snfs snfs snf![a [RSTXx5 ef=f)Nrrsr _indicator)rrtrursysmodulesrrirwr,rrrr2rendswithrrrr-)r3r2r3rtrurra size_exprs stride_exprsrrr stride_hintsr1rrs r!sizes_strides_impl4_make_node_sizes_strides..sizes_strides_implls S[[*F 3   #,12EqilE274S7aYq\74ST ',,effe ,(/01 0 z0C  Avv~   aff % L66>##AFF+ j7 ??< ( (FFsNNF==E34S-0  KK3VZ V  s$E-E2E7 E<8F#F$rc D>SSKnSSKJn [R"X5Hn[ U[ 5(dM[[URT5"UVs/sHn[URU5PM snUVs/sHn[URU5PM sn55s $ TS:XaU"X5$[T"UVs/sHoBRU5PM snUVs/sHoBRU5PM sn55$s snfs snfs snfs snf)Nr)!eval_is_non_overlapping_and_denserJ) rkr+r  itertoolschainr/rrwrrrirsympify)r2r3rkr rzrrrs r!sizes_strides_user4_make_node_sizes_strides..sizes_strides_users 0A!V$$ AFFF+5:;U+U;5<=W+W=1 = =4UD D/45u!]]1%u5/67w!]]1%w7 <=67s D D D )D)rrhasattrrrr)rrrr$s`` r!_make_node_sizes_stridesr'isV.>` Gq\#56 6 3;;x(& 1 1 H%v/AB 2r#c,^^ ^ ^ ^ ^T[;aST3m OTm SSjm Sm T[;aSm OSm U4SjmU U UU U 4SjnU U UU U U4SjnU U UU U U4S jnS nT[;aU"US TS 3U5 gT[;a [ UT5nU"UT[ X&55 gTS :XaU U 4S jnU"US TS 3U5 gTS:XaSU U U4SjjnU"US TS 3U5 gTn T[ ;a [ Tn U"US U S 3U5 T[;aU"USU S 3U5 gg)Nrc [U[[[45(aU$[U[5(aUR R SS5$[U[5(aUR RSS5$[S5e)Nrnrz*expect to be called with constant SymBools) r/rrrrrrorrr8rs r! get_constant&_make_user_magic..get_constantso a#ud+ , ,H a 66##B* * a ! !66$$R+ +IJJr#c[U[[[45(ag[U[[ [ 45(aURR5$g)NTF) r/rrrrrrrrrs r!r%_make_user_magic..is_constantsC a#ud+ , , a&(G4 5 566%%' 'r#c[U[5(a-[URR [ U555$U$)z;Implements True+True=2, which works in python but not sympy)r/rrrrrrs r!promote!_make_user_magic..promotes0!W%%affooc!f566Hr#cU$rrrs r!r/r0sHr#c,>TS;aX4$[U[[R45n[U[[R45nU(dU(a:U(d[R"U5nU(d[R"U5nX4$)N)rrrrrrrr r rrrrrr )r/rrrr )r3rGf_selff_otherrs r!promote2"_make_user_magic..promote2su   $; D5%.."9:UUENN$;< Wt,.{r#c>T"U5nT"U5(a[T5"T"U55$[[URT5"55$r)rrwrr)r3r*rrrr/s r!r*_make_user_magic..unary_magic_impl0sEt} t  &v. T0BC CK8:;;r#c >[U[[[[[ [ 45(d[$[RSTX5 T"U5nT"U5nT "X5upT"U5(a[T5"T"U5U5$T"U5(aT"U5n[URU5nU[La[$[[URT5"U55nT"U5(aT"U5$U$)NzMAGIC %s %s %s)r/rrrrrrrrrrrirrwr r3rG other_noderetr*rrrr/r5s r!r+_make_user_magic..binary_magic_impl6s%#udFHg!NOO! !+VTAt}t+  t  &v. T0BEJ J u   'ETYY.  '! ! ;7 CD$/$4$4|C =#=r#c >[U[[[[[ [ 45(d[$T"U5nT"U5nT "X5upT"U5(a[T5"UT"U55$T"U5(aT"U5n[URU5nU[La[$[[UT5"UR55nT"U5(aT"U5$U$r) r/rrrrrrrrrirrwrr:s r!rbinary_magic_impl,_make_user_magic..rbinary_magic_implGs%#udFHg!NOO! !t}t+  t  &v.|D7IJ J u   'ETYY.  '! ! K8CD$/$4$4|C =#=r#cb^[UTU5 U4SjnU[La[[TU5 gg)z Registers the SymNode magic method on SymInt/Float/Bool, and optionally registers a corresponding wrapped method on DynamicInt. c>UVs/sH&n[U[5(a UROUPM( nn[[T5"U6n[U[5(a [U[ 5(d [U5$U$s snfr)r/rrrrr)rrrattrs r!dynamic_int_impl<_make_user_magic..setattrs..dynamic_int_implaskHLM1jJ77AFFQ>DM#t$d+C#s##JsD,A,A!#&J Ns-A?N)rrr) user_typerC symnode_implrDs ` r!setattrs"_make_user_magic..setattrsWs2  4.    J&6 7 r#__r c>URn[X15n[X25nU[Ld U[La[$[U[5(a/[U[5(aUR UR :Xd [ S5e[[URT5"XE55nURR5(aT"U5$U$)Nz9then_node and else_node must be SymNodes with same pytype) rrirr/rr1r8rwrr) predr,r-rrrr<r*rs r!sym_ite_magic_impl,_make_user_magic..sym_ite_magic_implrs I 4I 4IN*i>.I%%9g..y'22$$ (8(88$OGDII{;IQRC(+(<(<(>(><$ GC Gr#rc>T"U5(a[R"T"U5U5$[[URT5"U55$r)r rrwrr)r3rr*rrs r!round_magic_impl*_make_user_magic..round_magic_impls?4  ~~l4&8'BBWTYY7@A Ar#__r)rz2Union[SymInt, int, SymFloat, float, SymBool, bool]r)rbool_becomes_int_magic_methodsunary_magic_methodsunary_nonmagic_methodsrr bitwise_opsreflectable_magic_methods)rrFrrr?rHorigrMrP method_namer*rrr/r5s` @@@@@r!_make_user_magicrZsPCCVHo  KB//  !T<< >>">> 8($$bO-=> ) )y&)FN3C$JK 9  H" bO-?@ 7  B B bO-=> [ %f-Kb R02CD . . Y#k]" 57I J /r#)FFr) __future__rr rrr!loggingmathoperatorrrrtypingrrrrtorch._logging.structuredrrr r r r r rrrtorch._loggingrr+r getLoggerrrgetArtifactLoggerrrrrrrrHintType__all__ torch.typesrr0r"rrrrrrrrrrrrbr rrrrrrrr!rrrerrrr_rrTr math_op_namesrsym_name priv_sym_namerrrrUronly_bool_magic_methodsrSalso_bool_magic_methodsbool_magic_methodsonly_float_magic_methodsrrVrrrr r rrrrr!r$r(r,r=rOrSrWr[rWr[r^rbrerhrkrnrqrtrwrzrrrcurrent_modulerpriv_sympy_namerrrrrrinvertrrrrrrrrrsizes_strides_methodsrirwrrr'itemsrrrZrr#r!rssA#  /11 ..   -> !~~//*E 8& %<#  $ K1 jjZ++..:$ 8<<$ 8<<$ 8<<$ 8== $ 8== $  DII $ (++$ TZZ$ TZZ$H%%$ (++$ (++$*$ (++$ hoo$  (++!$" 8<<#$$ 8<<%$& (++'$( 8<<)$* (,,+$,(,,-$.8<w?$@wA$BwC$DX%%E$F8##G$L    DdV}HzNM GX/56#*5-#@x H% NN8 $&<< >!6&,/FFJ7U 0EH% PPS?)&J&J#D#D.[   >&B?J TCn"'')LFDVT"**//1LFDVT*2LK^F (() ))* ((F6T,T)VV$ [ * r#