Njf%SSKJr SSKrSSKrSSKrSSKrSSKrSSKJr SSKJ r J r SSK J r SSK r SSKJrJr \ (aSSKJrJr \ "S5rSS jqSSS jjrSS jrSS jrSS jrSSjrSSjr/qS\S'SSjrSSSjjrg)) annotationsN)AbstractContextManager)Any TYPE_CHECKING)TypeVar)profileProfilerActivity)CallableSequence_Rcg)Nrq/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/torch/_functorch/benchmark_utils.py synchronizersrc bUcS/nUS/:wa=[RR5(a[RRqUc0nUc0nU [R"S5 [ S5Hn U"U40UD6 [5 M [R"S5 [ R"5n [ U5Hn U"U40UD6 [5 M [ R"5n SSS5 W W - n [SSU0UD6n U [5 [R"S5 [ U5Hn U"U40UD6 [5 M SSS5 SSS5 W RU5 U $!,(df  N=f!,(df  N:=f!,(df  NC=f)a Output the chrome trace of running f(input_, **kwargs_for_f) with [optimize_ctx] [num_runs] times to [trace_filename]. [activities] are the activities that the profiler will record, e.g. ProfilerActivity.CUDA. Return total runtime without the profiler Outputs to trace_filename Ncudacpui9 activitiesr) torchr is_availabler manual_seedrangetime perf_counterrexport_chrome_trace)finput_trace_filename optimize_ctxrnum_runsdevices kwargs_for_fkwargs_for_profiler_t0t1timingprofs rdump_chrome_tracer+sd*(5'ejj5577jj,,  "   $qA f % % M $    xA f % % M!    "WF  >J >*= >$  M   d #8_&)L) % ? ^, M- \ ? >s2B!E>F AFF > F  F F  F.c[U5n[R"U5nSSS5 WSnU$!,(df  N=f)N traceEvents)openjsonload)filenamerdataeventss rget_chrome_trace_eventsr4Us4 h1yy|  - F M s 2 AchSU;=(a' US[;=(a SU;=(a USS:H$)NpidphX)gpu_pidsevents ris_gpu_compute_eventr<\s@   %LH $  EM  $K3  rc/nUH&n[U5(dMURU5 M( [U[R"S5S9$)Nts)key)r<appendsortedoperator itemgetter)r3sorted_gpu_eventsr;s rget_sorted_gpu_eventsrEfsI.0#E**   ' #)<)dur)lenmax)rDr;current_end_timetotal_duration start_timeend_times r get_durationrOos " a ET{U5\15\N"12&t&67 ;u-'#h.CQ*GG/: ' rc|SSjn[U5n/nUH#nU"U5(dMURU5 M% U$)NcSU;=(a5 SUS;=(d& SUS;=(d SUS;=(d SUS;$)Nnamegemmconvcutlasswgradrr:s ris_mm_conv_event7get_sorted_gpu_mm_conv_events..is_mm_conv_event~sT eFm # (v& (E&M) (%-'  rr;zdict[str, Any]returnbool)rEr@)r3rW gpu_events sorted_eventsr;s rget_sorted_gpu_mm_conv_eventsr^}sF 'v.J*,M&& U# rz list[Any]r9c[U5n/qUH<nSU;aM USS:XdMSUSS;dM$[RUS5 M> US-n[U5n[ U5U- n[ U5n[ U5U- nXW4$)a Process the chrome traces outputs by the pytorch profiler to compute GPU Utilization and percent of times spent on matmul and convolution Args: filename(str): Name of chrome traces file produced by pytorch profiler total_length(float): total length of the process without profiler in second Return: tuple: (GPU Utilization, percent of time spent on matmul and convolution) rRprocess_labelsGPUargslabelsr6g.A)r4r9r@rErOr^)r1 total_lengthr3r;rD utilizationsorted_gpu_mm_conv_eventsmm_conv_utilizations rcompute_utilizationrhs%X .FH    =, ,%-:Q1Q OOE%L )   #%L-f501L@K =f E&'@ALP  ++rc h[RRU5nU(d$[R"U5 [ SU-5 Uc[ R "5n[RRX$S-5n[UUUU[R/US/S9n[Xx5upX4$)au Benchmark the GPU Utilization and percent of time spent on matmul and convolution operations of running f(input_, **kwargs_for_f) with [optimize_ctx] [num_runs] times. It will produce a chrome trace file in trace_folder/trace_file_name.json Example: ``` def f(a): return a.sum() a = torch.rand(2**20, device="cuda") utilization, mm_conv_utilization = benchmark_utilization( f, a, "tmp", trace_file_name="tmp_chrome_trace" ) ``` Args: f: function to benchmark input_: input to :attr:`f` trace_folder: name of the folder to store the chrome trace optimize_ctx: the context in which f will run trace_file_name: name of the dumped chrome trace file, default to "tmp_chrome_trace" num_runs: number of times to run f, excluding the warm-up runs, default to 1. Return: tuple: (GPU Utilization, percent of time spent on matmul and convolution) zcreate folder z.jsonr)r"r#) ospathexistsmakedirsprint contextlib nullcontextjoinr+r CUDArh) rr trace_folderr!trace_file_namer"isExistchrome_trace_file_namerdrergs rbenchmark_utilizationrwsVggnn\*G  L! -.!--/ WW\\,'8QR$    L(;($K  ++r)rZNone)rHNNN)rCallable[[tuple[Any, ...]], _R]rtuple[Any, ...]r strr!zAbstractContextManager[Any]rzSequence[ProfilerActivity]r"intr#zlist[str] | Noner$dict[str, Any] | Noner%r}rZfloat)r1r{rZlist[dict[str, Any]]rY)r3rrZr)rDrrZr|)r1r{rdr~rZtuple[float, float])Ntmp_chrome_tracerH)rryrrzrsr{r!z"AbstractContextManager[Any] | Nonertr{r"r|rZr) __future__rror/rBrjrrtypingrrtyping_extensionsrrtorch.profilerrr collections.abcr r r rr+r4r<rErOr^r9__annotations__rhrwrrrrs8"  -%% 42 T]  $*.157&7 77. 7 + 7  77(7/7 7tD $),L8<- A,&A, A,A,5 A,  A,  A,A,r