� J�g�i��p�ddlmZmZmZdZGd�d��ZGd�de��ZGd�de��Zd S) �)�List�Tuple�Union)S)Srrr�rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr�rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr)Sr�rrr�rrrr rrrrrr r rr rr r rrr r r rrrrr r r�rr rr rr r r rr r rrrr rrr r rr r rrrrrr rr r rrrrrr r r r r rrrrrr r)Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr)Srrrr rr rrrrr rrr r r r rr r rr rrr rr r rr r rrr r r r r r r r r r r rr r r rr rrr rrrrrrrrr r rr r rrrrrr rrr rr rrrrrr�Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr)Srr rrrr rr rrr rr r r r rr r rrr r rrr rr rrrrr r rrr rr r rr r rrr rr rr r rr r rrrrr r rr r r r r rrrr rrrr rr r rrrrr r)Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr)Srrrr rr rrrr rrr rrrrrr rr r r r r rr rr r r r r rrr rr rr r r rrr rrr rrrrrrrrrrrrrr rrrrrr rrrrrr r rr rrrrrr )Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr)Srr rr rrrrrrrrrrrrrrrr r r rr r r r rrrr r r rrrrrrrr r rrrrr rrr r rr rrrrrr r rrrrr rrrrr rrrr r rrrr rrrr)Srrrrrrrrrr r rrr rr r rr r rr r rrrrr rrrr r rr rr rrr rr r rrr rrrr rrr r rrr rr rrrr r rr rr rrrrr r rr rrrrrr r)Srr rr rrrr rrrr rr r r rrrrrr rr rr r rrrrr rrr rrrr rrr r rrr rr rrrr r r rr rrrr r rr r r rrrrr rrr rrrr rrrrrr )Srr rrrr rrrr rrr rrrr r rr rr rr rrr rr rr rrrrrr r rrr r r rr rrr rrr rrrrr rrr rrr r r r rr r r r rrrrr rrrr r rrr )Srrrr rrrrrrr rrrrrrrrrr r r rrr rrrrrrrrr r rrr r rrr r rr r rrrrrrrrrrrrrrrrrrr rrrrr r r rrr rrr rrr r )Srrrrrr rr rrrrr r r r r r rr rrrr rr r rrr rr rrrr r r rr r r rrr r r r rr r rrr rr rrr r rrr r r rrrrr rrr rrr r rrrrr r)Srrrr rr rrrrrrrrrrrrr rr rr rrr rrr rr r r rr r r rrr rr rrrr rrrr rrrrrrr rrrrr r rrr rrrrrr rr rr r rr rrrr )Srr rr rrrrrr r rr rr rrrr rrr rr r r rrr rr rr rrr rr r rrrrr r rrrrrrrr rrrrrrrrrrr r r rr rrrrrrr r r rrrrrr)Srrrrrr rr rrr r r rr rrrr rr rr rr rrrrrrrrrrr rrr rrrrr rr rr rrrrrrrrrrrrrrrrrrrr rrrr rrrr rrrrrr r )Srrrrrr rrrrrrrr r rr r r r r r rr rrr rrr r r rrrr rrr r r rr rr r rrrr r rrr rrrrrr rrr r r r rr rrrr rrrr r rr rrrr )Srrrr rr rrrrr rr rrrrrr rr rr rr rrr r rr rr rrr rrrrrrrrrr r rrrrrrrrrrrrrrr rrr r rrrrrrr r rrrrr rrrr )Srrrr rrrrrrrrrr rr r r rrrr rr rrr rr r r r rrrr rrr rrrrr r rrr rrr rrrrrrrr r rrr r r rrrrrrr r r rr rrr rrrr )Srr rrrrrrrrr rrrr rr rrrrrr rrrrrrrrrrrr rrrrrrr rrrrr rrrrrrr rrrrrrrrrrr rrr rrrrrrrr rrrrrrr)Srrrr rr rr rrr rrr r r r rrr rrr r r r rrrrr rr rrrr r rrr r rr r rrrrr r rrr rr rrr r rr rrrrrrr r r rrr r r rrr rrrr)Srrrr rrrrrrr r r rrrr rr rr rrrrrrrrrrr rrrr rrrrrrr rrr r rrrrrrr rrrrrrrrr rrr r rr r r rr r rr r rrrrr r )Srrrrrr rrrrr r r rrrrrrr r rrr rr rr r rrr rr rr rr rrrrrrrr r r rrrrrrrrr rr r rrr r r rrr rrrrrr r r rrr rrr r )Srr rrrr rrrr rr r rr r r rr rr rrr r rrrr rr r rrrrrrr rr r r rr r rr rrrrrrrrr rrrrr r rr r rr rrrrr r rrrrrrrrr )Srrrrrrrr rrr r r rr rrrr rr r rr rrrrrrrr rrrr rr r r rrrrr r r rrrr rrrrrrrrrrrrr r r rr rrrrrrr r rrr r rr r )Srrrr rrrr rrr rrrrrrrr rrr r rrr rrr rrr rrr rrr r rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrrr)Srr rr rr rrrrrr rr r rrrr rrrr rrrrrr r rrr rrr rrr r rr r rrr r rrr r rrrrrrrr rrrrr r r rrrrrr rrrr rrr rrr r )Srr rr rr rrrr r r r rr rrrrrrrrrrrrrrrrrrrr rrrr r rrr rrr r rrrrrrrrrrrrrrrr rrr rr rrrr rrrrr rrrrr r )Srrrr rr rr rrr r rr r r rr r r r rr r rrrr rr rr r r rrr rrr rrrr rr r rrr rrr rrr r rrr rrr r r r rr rr rr r r r rrrrrrrr)Srrrrrr rr rr r rrrr rr rr rr rrrr rr r rr r r r rr rrr r r r rrrrrr rrr rrrr rrr rr rrrr rr rrr rrrrrrr rr rrrrr r)Srr rr rr rrrr rrr r r rrrrr r rr r r rrrr rrr rr rrrrrrr rrr rrrr rr r rr r rrrrrrrrr rr r r rr r r rrr r rrrr rrrr)Srrrrrrrrrrrrr rrrrrrrrrrrrrrrrrr rrrrrrr rrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrr)Srrrrrrrrrrrrrrrrr rrrr rrrr rr rrrr rrrrr rr rr rrrrrrrrrrrr rrr rrr rrrrrrrrrrrrrrrrrrrrrrrrr)Srrrr rr rrrr r rrr rr r r rr r rrr r r r r r rrrr rr rrr rrr rrrr r rr r r rrrr r rr rr r r r r r rr rr rr rr rr rrr rr rrrr )Srrrrrrrrrrrrrrrrrrr rrrrrrrrrrrr rrrrr rrrrrrrrrrrrrrrrrrrrr rrrrr rrrrrrrrrrr rr r rrrrrrr)Srr rr rr rr rr rrr rr r r rrr rr r r rr r rrr rr r rr r rrrr rrrr rr r r rr rrr r rr rrr r rrr r r r rrrr rrrr r r r rr rrrr )Srr rr rr rrrrrr r rrr r r rrrr r r r r r rrrrr r rr r rrrrrr rr r r r r rr rrr rrrrrr rrrrr rr rrrr rrr rr rrrr r rr r )Srrrr rr rrrrr r r r rr r rr rrr r r r r rrrr rrr rrrr rr rrr r rr r r rrr r rr r rr rrrr rrrr rr rrrrrrr rrr r rrrrr r )Srrrrrr rrrr r rrr rrr rr rr rr rr rrrr rr r rrrr rrrrr rrrr r rrrr rrrr rr rrr rrr rrr r rr rrrr rr r rrrrrrrr)Srrrr rrrr rrr r rr r r r r r r r rr r rr r rr rr r rrr rr rr rr r rrrr rr rr r rr rrrr rrrrr rr r r rr rrrrr r r rr rrrrr r )Srr rrrrrrrr rr rr rr r r rr rrr r r r rrrr rrrrr r rrrrrr r rr rr r r r r r r r rrrrr r rrr r r r r rrr r r r rrrrrrr rr r )Srrrr rr rrrrr r r rr r r rr rrrr rr rrrrrrr rrr rrrrrrr r rrr r r rrrrrrrrr rr rrr rrrr rrrrrr r rr r rrrrrr r )Srrrr rrrrrrrr rrr rrrrrr rrr rr rrrrrr rr r r rrrr r r r rrr rrrrrrrrrrrrrrrr rr rrrrrrrrr r r rrrrrrrr )Srr rrrr rrrrr r r r rr r rr rrrrrrr rrrr r r rr r rr r r r rr r rr rr r rrr rr r rr r rrr rrr r r r rrrr rr r r rrr rrrrr r )Srr rr rrrrrrrr rr r r r r r rrrrrrr r r r rrrrr rrr r rrr r r r rr rr r rr r r r rrrrrr r r rrr rrrrr rrrrrrrrrrrrr)Srrrrrr rrrr r rr rr rrrrrr r rrrr r rrrr r r rr r rrr r r r r r r r r rrrrrrrrrrrrrrr rrrr rr rrrrrr r rrrr rrrr)Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rr rr rrrrrrr rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrrr)Srrrr rrrrrr r r r rr rr r r r r r rrrrrrrrrr rr r r rrr r rr r r r r r r rrr rrrrrrrrrrrrrrr rr r rr r rrr rrrrrrrr )Srr rr rrrr rrr r r rr rrrr r rr r rr rr rr rrr rrr r rrr r rr rr rr r rrrrrrrrrrrrrrrrrrr rr rrrr r r r r rrrrrr r )Srrrrrrrrrrr rrrr rrrrrrrr rrrrrrrr rr rr rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrr rrrrrrrrr )Srrrr rr rr rrr r r rr rr rr rr r r rr rrr rrrr r rr r rrrrrr r rrrrr rrr rr rrrr rrrrr r rrr rr rrrr rrrr rrr rrr r )Srrrrrrrrrrr rrrr rrrr rr rr rrrrrrrr r r rr r rrrr rr r rrr rrrrrrrrrrr rrrrrrrrr rr rrrr rrrr rrrrrrr)Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrr )Srr rr rrrr rr r r rr rrrrr rr r r rr r rrr rr rrrrr rrr rr r rr rr rrrr rrrr rr rrrrrr rr rr rr rrrr r rrrrrrrrrr)Srrrr rrrrrrrrr rrrrrrrr rrrrrrrrrrrrrr r rr rr rr r rrr rr rrrrrrrrrrrrrrrrrr rrrrrr r r rr r rrrrrr )Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr )Srrrr rrrr rrrr rrr rrrr rrrr rrrrrr rrrrrr rrr rr r rrrrr rrrr rrrrrrrrr rrrrrr rrrrrrrr r rrr rrrrrr)Srrrrrr rr rrrrrrrrr rr rr rr rr rrrr rr rr rr r rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr r r r rrrrrr)Srrrr rr rrrrr rrrr rrrrrrrrrrrrrrrr rrrrr rrrrr rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrr )Srrrr rr rrrr rr r r rr r r rr rrr rr r r rr rr r rrr rr rr rr rrr r rr r rr rrrr rr rrr r rr r rr r rr rr rr rr rr r rrr rr r)Srr rr rr rr rr r rr rr rr rrr r r r r r r r rr rrr r rr rr rrrr rrr rrrrrrrrrrrrrrr rrr r rrr rr rrrrr rrr r rr rrrr)Srr rr rrrrrrrr r rr rr rrrr rrrr rr rrrr r r rr r r rr rrr r rr rr r rrrrrrrrrrr rrr rrrr rrrrrrr r rr r rrrrr r )Srr rrrrrr rr rr r rr r r rr rr r rr r r rrr rr r r rr r rr rr r rr r rr r rrrrrrrrrrrrrrrrrrr rr rrrrrr r r rrrrrr r)Srr rrrr rrrrrr r rr r r rrr rrr r rr rrrrrr rrr rrrrrrr rrr r rrrrrrr rrr rrr rrrr r r rrrrr rrrrr r r rrrrr r)Srrrrrr rrrr r r rrr r rrr r rrr rrrrrr rrrrrr rrrrr r rr rr r rrrrrr rrrrr rrrrr rrr r rr rrrrr r rr r rrrrrr)Srrrrrrrrrr rrr rrrr rr r r rrr rrr rrrr r rrr rrrr rr rr rr r rrrrrrr r rrrrr rrrrr rr rrrrrrrrrrrrr rrr r )Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr)Srrrr rrrrrrr r r rrrrrrrrrrrr rrrrrr rrrr r rrrrrrrrrrrrrrrrr rrrrrrrrrrrr rrrrrrrr r rr rrrrr rr)Srrrr rr rrrrrrrrr rrrr rrrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrrr rrrrrr )Srrrr rr rrrrrr r rr rr rr r r rrrrrr rrrrrrrr r rrrrrr rrr r r rrrrrrrrrrrr rrrr rrr rrrrrrr r rrrrr rrrr )Srrrr rrrrrrr rr r rr r r rr rrr r rr rrrrr rr rrrrr r rrr r rrr r r rr r rrr rr r rr r rrr rrrrr rrrr r rrr rrrr rrr )Srrrrrr rr rr rrrr r rrr rr rr r r rr rrrrrrr rr rrrr r r rr rrr rr rr rrr rrr rrr r r r r r r r rrrr r rr r r rrrr rrrr )Srrrr rrrr rr r r r rrr rrr rrrrrrr r r rr r r rr r rrrr r r r r rr r r rrr rrr r rrr rrrrrr rr r rrrr rr rr rr rrrrrrr)Srr rrrrrrrrr r r r r r r rrrr rrrr rrrr rr rr r r r rr r rr r r rr r r r rr rrrrrr rrrrrr rr rrrr rr rrr rr rr rrrrr r)Srr rrrr rr rr rrr rr rr r r r r rrr r rrrr r r r r rr r r rrrr rrrrrrrrr rrrrrrrrrr rr r rr rrr rrrr rr rrrrrrrrrr)Srr rr rrrr rrr rr r r rrrrrr rrrrrr rr rrr rrrr r r rr rr r rr rrr rrr rrrrrrrrrrrrrr rrrrrrr rrrr rrrrrrr )Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrr rrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrrrrrrr)Srrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrrrrrrrr rrrrrrrrrrrrr rrrrrrrrrrrrrrrrrrrr)Srrrrrrrr rrrr rrrr rrrrrr r r r r r rrrrr rr rrrrr rrrr r r rrrr rrr rr rrrrr r r rrr r r rrrr rrr r r rrrr rrr r )Srrrr rr rr rr r r r r r r rr rr r r rrrr r r r rr r r r rr rrr r r r rr rr r r rrr r r r rr r rrr rrr r r rrrrrrrr rrrrrr rrrrc��eZdZdZdZdZdZdZdd�Zdd �Z d e eefde ddfd�Zdefd �Zdefd�Zde eefdee e ffd�ZdS)�JapaneseContextAnalysis��di�r�returnNc�t�d|_g|_d|_d|_d|_|��dS�NrrF)� _total_rel�_rel_sample�_need_to_skip_char_num�_last_char_order�_done�reset��selfs �^/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/chardet/jpcntx.py�__init__z JapaneseContextAnalysis.__init__s9��&(��&'��#� "�� c�^�d|_dg|jz|_d|_d|_d|_dSr)r�NUM_OF_CATEGORYrrrrrs rrzJapaneseContextAnalysis.reset�s:��3��!5�5��'(��#� "�� r�byte_str� num_bytesc��|jrdS|j}||kr�|�|||dz��\}}||z }||kr||z |_d|_nl|dkr_|jdkrT|xjdz c_|j|jkr d|_dS|jt|j|xxdz cc<||_||k��dSdS)NrrrT)rr� get_orderrr�MAX_REL_THRESHOLDr�jp2_char_context)rr!r"�i�order�char_lens r�feedzJapaneseContextAnalysis.feed�s ��:� ��F� �'��)�m�m�"�n�n�X�a�!�a�%�i�-@�A�A�O�E�8� ��M�A��9�}�}�./�)�m��+�(*��%�%��R�K�K�d�&;�r�&A�&A��O�O�q�(�O�O��)?�?�?�%)�� $�(��)>�?��F��).��%��)�m�m�m�m�m�mrc�"�|j|jkS�N)r�ENOUGH_REL_THRESHOLDrs r�got_enough_dataz'JapaneseContextAnalysis.got_enough_data�s��!:�:�:rc�j�|j|jkr|j|jdz |jzS|jS)Nr)r�MINIMUM_DATA_THRESHOLDr� DONT_KNOWrs r�get_confidencez&JapaneseContextAnalysis.get_confidence�s6��?�T�8�8�8��O�d�&6�q�&9�9�T�_�L�L��~�r�_c��dS)N�rr�)rr3s rr$z!JapaneseContextAnalysis.get_order�s��ur�rN)�__name__� __module__�__qualname__r r1r-r%r0rrr�bytes� bytearray�intr*�boolr.�floatr2rr$r6rrr r xs��O��I�� .�U�5�)�#3�4�.��.��.�.�.�.�:;��;�;�;�;��5�� !1�2��u�S�#�X��rr c�l��eZdZd�fd�Zedefd��Zdeee fde eeffd�Z�xZ S)�SJISContextAnalysisrNc�V��t��d|_dS)N� SHIFT_JIS)�superr� _charset_name)r� __class__s �rrzSJISContextAnalysis.__init__�s'�� (��rc��|jSr,)rErs r�charset_namez SJISContextAnalysis.charset_name�s��!�!rr!c��|sdS|d}d|cxkrdksnd|cxkrdkr#nn d}|dksd |cxkrdkr nn d |_nd}t|��dkr%|d}|dkrd|cxkrd kr nn|dz |fSd|fS)Nr5r��r��CP932r��r)rE�len�rr!� first_charr)�second_chars rr$zSJISContextAnalysis.get_order�s�� 5��a�[� ��J�&�&�&�&�$�&�&�&�&�D�J�,F�,F�,F�,F�$�,F�,F�,F�,F�,F��H��d�"�"�� (B�(B�(B�(B�d�(B�(B�(B�(B�(B�%,��"��H��x�=�=�1��"�1�+�K��c�!�!��(C�(C�(C�(C�t�(C�(C�(C�(C�(C�"�T�)�8�3�3��8�|�rr7)r8r9r:r�property�strrHrr;r<rr=r$� __classcell__)rFs@rrArA�s��)�)�)�)�)�)��"�c�"�"�"��X�"��%��y�(8�"9��e�C��H�o��rrAc�>�eZdZdeeefdeeeffd�ZdS)�EUCJPContextAnalysisr!rc��|sdS|d}|dksd|cxkrdkrnnd}n|dkrd}nd }t|��d kr%|d }|d krd|cxkrdkr nn|dz |fSd|fS) Nr5r��r�r r��r)rSrTs rr$zEUCJPContextAnalysis.get_order�s�� 5��a�[� ��$��D�J�$>�$>�$>�$>�$�$>�$>�$>�$>�$>��H�H� �4� � ��H�H��H��x�=�=�1��"�1�+�K��d�"�"��)D�)D�)D�)D��)D�)D�)D�)D�)D�"�T�)�8�3�3��8�|�rN) r8r9r:rr;r<rr=r$r6rrr[r[�sH��%��y�(8�"9��e�C��H�o��rr[N)�typingrrrr&r rAr[r6rr�<module>rds��8&�%�%�%�%�%�%�%�%�%�T��pB�B�B�B�B�B�B�B�J��1��<��2��r