Zjm dSrSSKJr SSKJr SSKJr \"SS9\"SS \555rS /rg ) zYOSO model configuration)strict)PreTrainedConfig)auto_docstringzuw-madison/yoso-4096) checkpointc\rSrSr%SrSrSr\\S'Sr \\S'Sr \\S 'Sr \\S 'S r \\S 'S r \\S'Sr\\-\S'Sr\\-\S'Sr\\S'Sr\\S'Sr\\S'Sr\\S'Sr\\S'Sr\\S'Sr\\S'S r\S -\S!'Sr\\S"'Sr\\S#'Sr\S -\S$'S%r\S -\S&'S'r\\ \-S -\S('S)r!\\S*'Sr"\\S+'S,r#g )- YosoConfigaY use_expectation (`bool`, *optional*, defaults to `True`): Whether or not to use YOSO Expectation. Overrides any effect of num_hash. hash_code_len (`int`, *optional*, defaults to 9): The length of hashes generated by the hash functions. num_hash (`int`, *optional*, defaults to 64): Number of hash functions used in [`YosoSelfAttention`]. conv_window (`int`, *optional*): Kernel size of depth-wise convolution. use_fast_hash (`bool`, *optional*, defaults to `False`): Whether or not to use custom cuda kernels which perform fast random projection via hadamard transform. lsh_backward (`bool`, *optional*, defaults to `True`): Whether or not to perform backpropagation using Locality Sensitive Hashing. Example: ```python >>> from transformers import YosoConfig, YosoModel >>> # Initializing a YOSO uw-madison/yoso-4096 style configuration >>> configuration = YosoConfig() >>> # Initializing a model (with random weights) from the uw-madison/yoso-4096 style configuration >>> model = YosoModel(configuration) >>> # Accessing the model configuration >>> configuration = model.config ```yosoiY vocab_sizei hidden_size num_hidden_layersnum_attention_headsi intermediate_sizegelu hidden_actg?hidden_dropout_probattention_probs_dropout_probimax_position_embeddingstype_vocab_sizeg{Gz?initializer_rangeg-q=layer_norm_epsTuse_expectation hash_code_len@num_hashN conv_window use_fast_hash lsh_backward pad_token_idr bos_token_id eos_token_idFadd_cross_attentiontie_word_embeddings)$__name__ __module__ __qualname____firstlineno____doc__ model_typer int__annotations__r rrrrstrrfloatrrrrrrboolrrr r!r"r#r$r&listr'r(__static_attributes__r)|/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/models/yoso/configuration_yoso.pyr r s :JJKs!!!s!J'**03 %#+3#'S'OS#u#!NE! OT M3Hc"Kt"M4L$ L#*  L#* +,L#S /D(, %% $$r7r N) r.huggingface_hub.dataclassesrconfiguration_utilsrutilsrr __all__r)r7r8r=sG.3#126%!6%36%r .r7