�
<��g � �� � d Z ddlmZ ddlZddlmZ d� ZdeiZd!d�Z d"d �Z
e d
e
d
� � dd l m Z e d e d � � n # e
$ r Y nw xY w dd
lmZ d#d�Z e ded� � n # e
$ r ddlmZ e dd� d� � Y nw xY w ddlmZ e ded� � e ded� � n # e
$ r Y nw xY w ddlZ e dej dd�� � e dej dd�� � n # e
$ r Y nw xY w G d� de� � Z ddlZ ej d� � e deg � � n# e
eef$ r Y nw xY w ddlZ e d ej j d � � n # e
$ r Y nw xY w ddl Z d#d �Z e d e d � � n # e
$ r Y nw xY wd � Z!dS )$z9Helper functions for a standard streaming compression API� )�ZipFileN)�AbstractBufferedFilec � � | S �N� )�file�mode�kwargss �b/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/fsspec/compression.py� noop_filer s � � �K� Fc � � t |t � � r|g}| t v r|st d| � �� � �|D ]-}|t j j v r|st d|� d| � d�� � ��.|t | < |D ]}| t j j |< �dS )aA Register an "inferable" file compression type.
Registers transparent file compression type for use with fsspec.open.
Compression can be specified by name in open, or "infer"-ed for any files
ending with the given extensions.
Args:
name: (str) The compression type name. Eg. "gzip".
callback: A callable of form (infile, mode, **kwargs) -> file-like.
Accepts an input file-like object, the target mode and kwargs.
Returns a wrapped file-like object.
extensions: (str, Iterable[str]) A file extension, or list of file
extensions for which to infer this compression scheme. Eg. "gz".
force: (bool) Force re-registration of compression type or extensions.
Raises:
ValueError: If name or extensions already registered, and not force.
z$Duplicate compression registration: z&Duplicate compression file extension: z (�)N)�
isinstance�str�compr�
ValueError�fsspec�utils� compressions)�name�callback�
extensions�force�exts r �register_compressionr s� � �( �*�c�"�"� "� �\�
� �u�}�}�U�}��F��F�F�G�G�G�� V� V�� �&�,�+� +� +�E� +� � T�c� T� T�T� T� T� T�U�U� U���E�$�K�� .� .��)-�� �!�#�&�&�.� .r
�rbc �� �� d|vr=|pd}t | fddi|����� |d�� � }|j f�fd� |_ |S t | � � �|��� � � d } �j |fddi|��S )N�rr r �w)r c �@ �� | � � p�� � � S r )�close)�closer�zs �r �<lambda>zunzip.<locals>.<lambda>< s �� �6�6�8�8�+@�q�w�w�y�y� r
r )r �openr" �namelist)�infiler �filenamer
�for$ s @r �unzipr+ 7 s� �� �
�$����%�v�� �F� /� /�� /�� /� /��
�V�V�H�3�V�
'�
'��!#��@�@�@�@�@���� �����A����:�:�<�<��?�� �1�6�(� /� /�� /�� /� /�/r
�zip)�BZ2File�bz2)�igzipc �* � t j d| |d�|��S )N)�fileobjr r )r/ � IGzipFile)r( r r
s r �isalr3 P s � ���C�v�D�C�C�F�C�C�Cr
�gzip�gz��GzipFilec � � t dd| i|��S )Nr1 r r6 )�fr
s r r% r% X s � �H�$A�$A�Q�$A�&�$A�$A� r
)�LZMAFile�lzma�xzT)r c �: � � e Zd Z� fd�Zdd�Zd d�Zd� Zd� Z� xZS )
�
SnappyFilec �� �� dd l } t � � j dd d|� d� � dz dd�|�� || _ d|v r |j � � | _ d S |j � � | _ d S )Nr �snappy�bi�ɚ;)�fs�pathr �sizer r )r@ �super�__init__�stripr( �StreamDecompressor�codec�StreamCompressor)�selfr( r r
r@ � __class__s �r rF zSnappyFile.__init__m s� �� ��
�
�
������
��(����C� � �3�)>�Y�
�
�RX�
�
�
� �� � �$�;�;�2��2�4�4�D�J�J�J�0��0�2�2�D�J�J�Jr
Fc �� � | j � d� � | j � | j � � � � � }| j � |� � dS )Nr T)�buffer�seekrI � add_chunk�readr( �write)rK �final�outs r �
_upload_chunkzSnappyFile._upload_chunky sV � � � ��������j�"�"�4�;�#3�#3�#5�#5�6�6�� � ���#� � � ��tr
r c � � t d� � �)NzSnappyFile is not seekable)�NotImplementedError)rK �loc�whences r rO zSnappyFile.seek s � �!�">�?�?�?r
c � � dS )NFr )rK s r �seekablezSnappyFile.seekable� s � ��ur
c �p � | j � ||z
� � }| j � |� � S )z*Get the specified set of bytes from remote)r( rQ rI �
decompress)rK �start�end�datas r � _fetch_rangezSnappyFile._fetch_range� s1 � ��{� � ��e� �,�,���z�$�$�T�*�*�*r
�F)r ) �__name__�
__module__� __qualname__rF rU rO r[ ra �
__classcell__)rL s @r r> r> l s� �� � � � � �
3�
3�
3�
3�
3�� � � � @� @� @� @�� � �+� +� +� +� +� +� +r
r> r
r@ �lz4c � � d|v r(t j � � }|� | � � S t j d�� � }|� | � � S )Nr �
)�level)�zstd�ZstdDecompressor�
stream_reader�ZstdCompressor�
stream_writer)r( r �cctxs r �zstandard_filerq � sT � � �$�;�;��(�*�*�D��%�%�f�-�-� -��&�R�0�0�0�D��%�%�f�-�-� -r
rk �zstc �* � t t � � S )z.Return a list of the implemented compressions.)�listr r r
r �available_compressionsru � s � � ��;�;�r
rb )r N)r )"�__doc__�zipfiler � fsspec.utilsr � fsspec.specr r r r r+ r. r- � ImportErrorr3 r/ r4 r7 r; r: �lzmaffir> r@ �compress� NameError�AttributeError� lz4.framerg �framer& � zstandardrk rq ru r r
r �<module>r� s� �� ?� ?� � � � � � � � � � � ,� ,� ,� ,� ,� ,�� � �
�y���".� ".� ".� ".�J
0�
0�
0�
0� � �U�E�5� )� )� )�0������� �����/�/�/�/�� � � � ��D� ����
�������D� D� D� D� ����t�,�,�,�,��� � � � � � � � � ����A�A�4�� � � � ����� � � � � � � �����6�2�2�2����x��.�.�.�.��� � � ��D� ���� ��N�N�N�����!1�6��F�F�F�F����w� /��T�B�B�B�B�B��� � � ��D� ���� +� +� +� +� +�%� +� +� +�> ��M�M�M��F�O�C���� ���:�r�2�2�2�2���Y��/� � � ��D� ���� ��������� ���6�6�6�6��� � � ��D� ����
� � � � �.� .� .� .� ��� ��7�7�7�7��� � � ��D� ����� � � � s} �A �A � A �A( �(B�B� B) �)B1�0B1�5,C" �"C*�)C*�<!D � D)�(D)�-E � E�E�E+ �+E3�2E3