ZjR2SSKJrJr SSKJrJrJr SSKJr SSK J r J r SSK J r Jr SSKJrJr SSKJrJr \"5(aSS Kr\R,"\5r"S S \ S S 9r"SS\5rS/rg ))OptionalUnion) IMAGE_TOKENPaliGemmaProcessorbuild_string_from_input) BatchFeature) ImageInputmake_flat_list_of_images)ProcessingKwargsUnpack)PreTokenizedInput TextInput)is_torch_availableloggingNc.\rSrSrSS0SSS.SS0S .rS rg ) ColPaliProcessorKwargs!paddinglongestchannels_firstT) data_formatdo_convert_rgbreturn_tensorspt) text_kwargs images_kwargs common_kwargsN)__name__ __module__ __qualname____firstlineno__ _defaults__static_attributes__r|/root/GenerationalWealth/GenerationalWealth/venv/lib/python3.13/site-packages/transformers/models/colpali/modular_colpali.pyrr!s, y ," +D1 Ir&rF)totalc R^\rSrSrSS\S\4U4Sjjjr\S\4Sj5rSS\S-S \ \ -\ \ -\ \ -S \ \ S\4S jjrSS\S-S \ \ S\4S jjrS \ \ \ -S \ \ S\4S jrSS\S\ S4S\S\ S4S\S\SS\S\4SS4 SjjrSrU=r$)ColPaliProcessor.Nvisual_prompt_prefix query_prefixc:>X@lXPl[TU] XUS9 g)z visual_prompt_prefix (`str`, *optional*, defaults to `"Describe the image."`): A string that gets tokenized and prepended to the image tokens. query_prefix (`str`, *optional*, defaults to `"Question: "`): A prefix to be used for the query. )image_processor tokenizer chat_templateN)r,r-super__init__)selfr/r0r1r,r- __class__s r'r3ColPaliProcessor.__init__/s$%9!( ]jkr&returnc.URR$)zr Return the query augmentation token. Query augmentation buffers are used as reasoning buffers during inference. )r0 pad_token)r4s r'query_augmentation_token)ColPaliProcessor.query_augmentation_tokenAs~~'''r&imagestextkwargsc UR"[4SURR0UD6nUSR SS5nSnUcUc [ S5eUbUb [ S5eUGb|UR RU5n[U5nUR/[U5-nUVs/sHoR RU5PM nn[Xq5V V s/sHTup[U URRUR[ [#U [$5(a [U 5OSS 9PMV n n n UR "U40US D6S n USR'S S5bUSS ==UR- ss'UR"U 4S U0USD6n 0U ES U 0EnU(a.U SR)U SS:HS5nUR+SU05 [-US9$Ub[#U[.5(aU/nO8[#U[$5(a[#US[.5(d [ S5eUcUR0S-n/nUH@nURRUR2-U-U-S-nUR5U5 MB USR'S S5USS 'UR"U4S U0USD6nU$gs snfs sn n f)a Returns: [`BatchFeature`]: A [`BatchFeature`] with the following fields: - **input_ids** -- List of token ids to be fed to a model. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model (when `return_attention_mask=True` or if *"attention_mask"* is in `self.model_input_names` and if `text` is not `None`). - **pixel_values** -- Pixel values to be fed to a model. Returned when `images` is not `None`. tokenizer_init_kwargsrsuffixNTz&Either text or images must be providedz5Only one of text or images can be processed at a time)prompt bos_token image_seq_len image_token num_imagesr pixel_values max_lengthreturn_token_type_ids input_idstoken_type_idsrilabels)dataz*Text must be a string or a list of strings  2) _merge_kwargsrr0 init_kwargspop ValueErrorr/ fetch_imagesr r,len process_imageziprrDimage_seq_lengthr isinstancelistget masked_fillupdater strr:r-append)r4r<r=r> output_kwargsrArJ texts_docimagerC image_list input_stringsrHinputs return_datarM texts_queryquery batch_querys r'__call__ColPaliProcessor.__call__Js# ** " "&.."<"<  }-11(DA $ F-f5F223c&kAIMSTVE**88?VFT+.i*@ +A&F(!"nn66"&"7"7 +2S>SS:^^&; .F CVB^\BK$ ,88@P9QUV9VX\]""Hf#56[1 1  $$$v t,,DGS1I1I !MNN~66;%'K0043D3DDuLvUX\\""5):G}9U9Y9YZfhj9kM- ( 6..&; .K  -AU s .$K "AKc *UR"SSU0UD6$)av Prepare for the model one or several image(s). This method is a wrapper around the `__call__` method of the ColPaliProcessor's [`ColPaliProcessor.__call__`]. This method forwards the `images` and `kwargs` arguments to the image processor. Args: images (`PIL.Image.Image`, `np.ndarray`, `torch.Tensor`, `list[PIL.Image.Image]`, `list[np.ndarray]`, `list[torch.Tensor]`): The image or batch of images to be prepared. Each image can be a PIL image, NumPy array or PyTorch tensor. In case of a NumPy array/PyTorch tensor, each image should be of shape (C, H, W), where C is a number of channels, H and W are image height and width. return_tensors (`str` or [`~utils.TensorType`], *optional*): If set, will return tensors of a particular framework. Acceptable values are: - `'pt'`: Return PyTorch `torch.Tensor` objects. - `'np'`: Return NumPy `np.ndarray` objects. Returns: [`BatchFeature`]: A [`BatchFeature`] with the following fields: - **input_ids** -- List of token ids to be fed to a model. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model (when `return_attention_mask=True` or if *"attention_mask"* is in `self.model_input_names` and if `text` is not `None`). - **pixel_values** -- Pixel values to be fed to a model. Returned when `images` is not `None`. r<rrl)r4r<r>s r'process_imagesColPaliProcessor.process_imagess>}}5F5f55r&c *UR"SSU0UD6$)a Prepare for the model one or several texts. This method is a wrapper around the `__call__` method of the ColPaliProcessor's [`ColPaliProcessor.__call__`]. This method forwards the `text` and `kwargs` arguments to the tokenizer. Args: text (`str`, `list[str]`, `list[list[str]]`): The sequence or batch of sequences to be encoded. Each sequence can be a string or a list of strings (pretokenized string). If the sequences are provided as list of strings (pretokenized), you must set `is_split_into_words=True` (to lift the ambiguity with a batch of sequences). return_tensors (`str` or [`~utils.TensorType`], *optional*): If set, will return tensors of a particular framework. Acceptable values are: - `'pt'`: Return PyTorch `torch.Tensor` objects. - `'np'`: Return NumPy `np.ndarray` objects. Returns: [`BatchFeature`]: A [`BatchFeature`] with the following fields: - **input_ids** -- List of token ids to be fed to a model. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model (when `return_attention_mask=True` or if *"attention_mask"* is in `self.model_input_names` and if `text` is not `None`). r=rro)r4r=r>s r'process_queries ColPaliProcessor.process_queriess<}}1$1&11r&query_embeddingsz torch.Tensorpassage_embeddings batch_size output_dtypez torch.dtype output_devicez torch.devicec [U5S:Xa [S5e[U5S:Xa [S5eUSRUSR:wa [S5eUSRUSR:wa [S5eUcUSRn/n[ S[U5U5GHn/n[ R RRRXXs-SSS9n [ S[U5U5H}n [ R RRRX*X-SSS9n UR[ R"SX5RS S 9SRS S 95 M UR[ R"US S 9RU5RU55 GM [ R"USS 9$) a Compute the late-interaction/MaxSim score (ColBERT-like) for the given multi-vector query embeddings (`qs`) and passage embeddings (`ps`). For ColPali, a passage is the image of a document page. Because the embedding tensors are multi-vector and can thus have different shapes, they should be fed as: (1) a list of tensors, where the i-th tensor is of shape (sequence_length_i, embedding_dim) (2) a single tensor of shape (n_passages, max_sequence_length, embedding_dim) -> usually obtained by padding the list of tensors. Args: query_embeddings (`Union[torch.Tensor, list[torch.Tensor]`): Query embeddings. passage_embeddings (`Union[torch.Tensor, list[torch.Tensor]`): Passage embeddings. batch_size (`int`, *optional*, defaults to 128): Batch size for computing scores. output_dtype (`torch.dtype`, *optional*, defaults to `torch.float32`): The dtype of the output tensor. If `None`, the dtype of the input embeddings is used. output_device (`torch.device` or `str`, *optional*, defaults to "cpu"): The device of the output tensor. Returns: `torch.Tensor`: A tensor of shape `(n_queries, n_passages)` containing the scores. The score tensor is saved on the "cpu" device. rzNo queries providedzNo passages providedz/Queries and passages must be on the same devicez-Queries and passages must have the same dtypeT) batch_first padding_valuez bnd,csd->bcnsr)dimrB)rWrUdevicedtyperangetorchnnutilsrnn pad_sequenceraeinsummaxsumcatto) r4rurvrwrxryscoresi batch_scores batch_queriesjbatch_passagess r'score_retrieval ColPaliProcessor.score_retrievals@  A %23 3 ! "a '34 4 A  % %);A)>)E)E ENO O A  $ $(:1(=(C(C CLM M  +A.44L%'q#./:\]"A"##LL-PTTYZT[\]^bbghbi C MM%))La8;;LILL][ \=yyQ''r&)r-r,)NNNzDescribe the image.z Question: )NN)N)Ncpu)r r!r"r#r`r3propertyr:r rrr\r rr rlrprsrintrrr% __classcell__)r5s@r'r*r*.s$9( l " l  ll$(#((%)Z^XT!X++d9o=EV@WWX/0 X  Xx%)6T!6/06  6B2$y/)2/02  2H0449 >(^0D DE>(".$~2F"FG>( >( }- >( ^S01 >( >(>(r&r*)typingrr2transformers.models.paligemma.processing_paligemmarrrfeature_extraction_utilsr image_utilsr r processing_utilsr r tokenization_utils_baserrrrrr get_loggerr loggerrr*__all__rr&r'rsh #ww4?8C0   H % -U u()u(r r&