�
J�g�
� �b � d dl mZ ddlmZ ddlmZ ddlmZmZ ddl m
Z
G d� de� � Z d S )
� )�Union� )�
CharSetProber)�CodingStateMachine)� MachineState� ProbingState)�
UTF8_SM_MODELc � � � e Zd ZdZd � fd� Zd � fd� Zedefd�� � Zedefd�� � Z de
e e f de
fd �Zdefd
�Z� xZS ) �
UTF8Proberg �?�returnNc � �� t � � � � � t t � � | _ d| _ | � � � d S �Nr )�super�__init__r r � coding_sm�
_num_mb_chars�reset��self� __class__s ��b/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/chardet/utf8prober.pyr zUTF8Prober.__init__' sA �� �
��������+�M�:�:��� ��� �
�
� � � � � � c � �� t � � � � � | j � � � d| _ d S r )r r r r r s �r r zUTF8Prober.reset- s6 �� �
���
�
���� �� � � � � � ����r c � � dS )Nzutf-8� �r s r � charset_namezUTF8Prober.charset_name2 s � ��wr c � � dS )N� r r s r �languagezUTF8Prober.language6 s � ��rr �byte_strc �� � |D ]�}| j � |� � }|t j k rt j | _ na|t j k rt j | _ n>|t j k r-| j �
� � dk r| xj dz
c_ ��| j t j
k r.| � � � | j k rt j | _ | j S )N� r )r �
next_stater �ERRORr �NOT_ME�_state�ITS_ME�FOUND_IT�START�get_current_charlenr �state� DETECTING�get_confidence�SHORTCUT_THRESHOLD)r r! �c� coding_states r �feedzUTF8Prober.feed: s� � ��
,�
,�A� �>�4�4�Q�7�7�L��|� 1�1�1� *� 1�� ����|� 2�2�2� *� 3�� ����|� 1�1�1��>�5�5�7�7�1�<�<��&�&�!�+�&�&�� �:� �/� /� /��"�"�$�$�t�'>�>�>� *� 3�� ��z�r c �N � d}| j dk r|| j | j z z }d|z
S |S )Ng�G�z��?� g �?)r �
ONE_CHAR_PROB)r �unlikes r r. zUTF8Prober.get_confidenceM s9 � ��� � �� !� !� �d�(�$�*<�<� <�F���<� ��
r )r N)�__name__�
__module__� __qualname__r5 r r �property�strr r r �bytes� bytearrayr r2 �floatr. �
__classcell__)r s @r r r $ s� �� � � � � ��M�� � � � � � � � � � � �
��c� � � � �X�� ��#� � � � �X���U�5�)�#3� 4� � � � � � �&�� � � � � � � � r r N) �typingr �
charsetproberr �codingstatemachiner �enumsr r �mbcssmr r r r r �<module>rE s� ��8 � � � � � � (� (� (� (� (� (� 2� 2� 2� 2� 2� 2� -� -� -� -� -� -� -� -� !� !� !� !� !� !�.� .� .� .� .� � .� .� .� .� .r