Zj!dSrSSKJr SSKJr SSKJr \"SS9\"SS \555rS /rg ) z PatchTSMixer model configuration)strict)PreTrainedConfig)auto_docstringzibm/patchtsmixer-etth1-pretrain) checkpointcp^\rSrSr%SrSrSSS.rSr\\ S'S r \\ S 'S r \\ S 'S r \\ S 'Sr \\ S'S r\\ S'Sr\\ S'Sr\\ S'Sr\\-\ S'Sr\\ S'Sr\\ S'Sr\\ S'Sr\\ S'S r\\ S'Sr\\ S'Sr\\ S 'S!r\\-S"-\ S#'S$r\\ S%'S&r\\ S''S(r\\ S)'S*r \\ S+'S,r!\\ S-'S.r"\#\\$\S/4-\-S"-\ S0'S1r%\\ S2'Sr&\\ S3'Sr'\\ S4'S"r(\#\S"-\ S5'Sr)\\-\ S6'S7r*\\ S8'S9r+\\ S:'S"r,\#S"-\ S;'Sr-\\ S<'S"r.\#S"-\ S='S>r/\S"-\ S?'U4S@jr0SAr1U=r2$)BPatchTSMixerConfiga{ context_length (`int`, *optional*, defaults to 32): The context/history length for the input sequence. patch_length (`int`, *optional*, defaults to 8): The patch length for the input sequence. patch_stride (`int`, *optional*, defaults to 8): Determines the overlap between two consecutive patches. Set it to patch_length (or greater), if we want non-overlapping patches. num_parallel_samples (`int`, *optional*, defaults to 100): The number of samples to generate in parallel for probabilistic forecast. expansion_factor (`int`, *optional*, defaults to 2): Expansion factor to use inside MLP. Recommended range is 2-5. Larger value indicates more complex model. mode (`str`, *optional*, defaults to `"common_channel"`): Mixer Mode. Determines how to process the channels. Allowed values: "common_channel", "mix_channel". In "common_channel" mode, we follow Channel-independent modelling with no explicit channel-mixing. Channel mixing happens in an implicit manner via shared weights across channels. (preferred first approach) In "mix_channel" mode, we follow explicit channel-mixing in addition to patch and feature mixer. (preferred approach when channel correlations are very important to model) gated_attn (`bool`, *optional*, defaults to `True`): Enable Gated Attention. norm_mlp (`str`, *optional*, defaults to `"LayerNorm"`): Normalization layer (BatchNorm or LayerNorm). self_attn (`bool`, *optional*, defaults to `False`): Enable Tiny self attention across patches. This can be enabled when the output of Vanilla PatchTSMixer with gated attention is not satisfactory. Enabling this leads to explicit pair-wise attention and modelling across patches. self_attn_heads (`int`, *optional*, defaults to 1): Number of self-attention heads. Works only when `self_attn` is set to `True`. use_positional_encoding (`bool`, *optional*, defaults to `False`): Enable the use of positional embedding for the tiny self-attention layers. Works only when `self_attn` is set to `True`. positional_encoding_type (`str`, *optional*, defaults to `"sincos"`): Positional encodings. Options `"random"` and `"sincos"` are supported. Works only when `use_positional_encoding` is set to `True` scaling (`string` or `bool`, *optional*, defaults to `"std"`): Whether to scale the input targets via "mean" scaler, "std" scaler or no scaler if `None`. If `True`, the scaler is set to "mean". loss (`string`, *optional*, defaults to `"mse"`): The loss function for the model corresponding to the `distribution_output` head. For parametric distributions it is the negative log likelihood ("nll") and for point estimates it is the mean squared error "mse". norm_eps (`float`, *optional*, defaults to 1e-05): A value added to the denominator for numerical stability of normalization. mask_type (`str`, *optional*, defaults to `"random"`): Type of masking to use for Masked Pretraining mode. Allowed values are "random", "forecast". In Random masking, points are masked randomly. In Forecast masking, points are masked towards the end. random_mask_ratio (`float`, *optional*, defaults to 0.5): Masking ratio to use when `mask_type` is `random`. Higher value indicates more masking. num_forecast_mask_patches (`int` or `list`, *optional*, defaults to `[2]`): Number of patches to be masked at the end of each batch sample. If it is an integer, all the samples in the batch will have the same number of masked patches. If it is a list, samples in the batch will be randomly masked by numbers defined in the list. This argument is only used for forecast pretraining. mask_value (`float`, *optional*, defaults to `0.0`): Mask value to use. masked_loss (`bool`, *optional*, defaults to `True`): Whether to compute pretraining loss only at the masked portions, or on the entire output. channel_consistent_masking (`bool`, *optional*, defaults to `True`): When true, masking will be same across all channels of a timeseries. Otherwise, masking positions will vary across channels. unmasked_channel_indices (`list`, *optional*): Channels that are not masked during pretraining. head_dropout (`float`, *optional*, defaults to 0.2): The dropout probability the `PatchTSMixer` head. distribution_output (`string`, *optional*, defaults to `"student_t"`): The distribution emission head for the model when loss is "nll". Could be either "student_t", "normal" or "negative_binomial". prediction_length (`int`, *optional*, defaults to 16): Number of time steps to forecast for a forecasting task. Also known as the Forecast Horizon. prediction_channel_indices (`list`, *optional*): List of channel indices to forecast. If None, forecast all channels. Target data is expected to have all channels and we explicitly filter the channels in prediction and target before loss computation. num_targets (`int`, *optional*, defaults to 3): Number of targets (dimensionality of the regressed variable) for a regression task. output_range (`list`, *optional*): Output range to restrict for the regression task. Defaults to None. head_aggregation (`str`, *optional*, defaults to `"max_pool"`): Aggregation mode to enable for classification or regression task. Allowed values are `None`, "use_last", "max_pool", "avg_pool". Example: ```python >>> from transformers import PatchTSMixerConfig, PatchTSMixerModel >>> # Initializing a default PatchTSMixer configuration >>> configuration = PatchTSMixerConfig() >>> # Randomly initializing a model (with random weights) from the configuration >>> model = PatchTSMixerModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ``` patchtsmixerd_model num_layers) hidden_sizenum_hidden_layers context_length patch_lengthnum_input_channels patch_stridednum_parallel_samplesexpansion_factorrg?dropoutcommon_channelmodeT gated_attn LayerNormnorm_mlpF self_attnself_attn_headsuse_positional_encodingsincospositional_encoding_typestdNscalingmselossg{Gz?init_stdgh㈵>norm_epsrandom mask_typeg?random_mask_ratio)r.num_forecast_mask_patchesr mask_value masked_losschannel_consistent_maskingunmasked_channel_indices head_dropout student_tdistribution_outputprediction_lengthprediction_channel_indices num_targets output_rangemax_poolhead_aggregationc >[URUR5UR- UR-S-UlSUl[ TU]"S0UD6 g)NrT)maxrrr num_patches patch_lastsuper __post_init__)selfkwargs __class__s ڌ/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/models/patchtsmixer/configuration_patchtsmixer.pyrD PatchTSMixerConfig.__post_init__sR 3 3T5F5FG$J[J[[`d`q`qqtuu '')rArB)3__name__ __module__ __qualname____firstlineno____doc__ model_type attribute_maprint__annotations__rrrrr rr rfloatrstrrboolr r!r"r#r%r'r)r*r+r-r.r/listtupler0r1r2r3r4r6r8r9r:r;r=rD__static_attributes__ __classcell__)rGs@rHr r s\ | J )M NCL#L# ###GScJGUS[ D# JHcItOS$)T)$,c,!&GS4Z$ &D#HeHeIs"u"JNtCy5c?:S@4GNJK'++15d3i$.5 #L%#+#**s.2t 2K $L$+$#-cDj-((rJr N) rOhuggingface_hub.dataclassesrconfiguration_utilsrutilsrr __all__r?rJrHr_sK'.3#<=K()K(>K(\ rJ