�
J�g� � �z � d dl mZ ddlmZ ddlmZ ddlmZmZ ddl m
Z
ddl m Z ddl
mZ G d � d
e � � Zd S ) � )�Union� )�SJISDistributionAnalysis)�CodingStateMachine)� MachineState� ProbingState)�SJISContextAnalysis)�MultiByteCharSetProber)�
SJIS_SM_MODELc � � � e Zd Zd
� fd� Zd
� fd� Zedefd�� � Zedefd�� � Zde e
e f de fd�Z
defd �Z� xZS ) �
SJISProber�returnNc �� �� t � � � � � t t � � | _ t � � | _ t � � | _ | � � � d S �N)
�super�__init__r r � coding_smr �distribution_analyzerr �context_analyzer�reset��self� __class__s ��b/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/chardet/sjisprober.pyr zSJISProber.__init__' sU �� �
��������+�M�:�:���%=�%?�%?��"� 3� 5� 5�� � �
�
� � � � � � c �z �� t � � � � � | j � � � d S r )r r r r s �r r zSJISProber.reset. s/ �� �
���
�
���� � �#�#�%�%�%�%�%r c � � | j j S r )r � charset_name�r s r r zSJISProber.charset_name2 s � ��$�1�1r c � � dS )N�Japanese� r s r �languagezSJISProber.language6 s � ��zr �byte_strc � � | j �J �| j �J �t |� � D �]l\ }}| j � |� � }|t j k r;| j � d| j | j |� � t j | _ �n|t j
k rt j | _ n�|t j k r�| j � � � }|dk rW|| j d< | j � | j d|z
d � |� � | j � | j |� � ��| j � ||dz |z
|dz |z
� |� � | j � ||dz
|dz � |� � ��n|d | j d< | j t j k rG| j � � � r.| � � � | j k rt j | _ | j S )Nz!%s %s prober hit error at byte %sr r � � �����)r r � enumerate�
next_stater �ERROR�logger�debugr r# r �NOT_ME�_state�ITS_ME�FOUND_IT�START�get_current_charlen�
_last_charr �feed�state� DETECTING�got_enough_data�get_confidence�SHORTCUT_THRESHOLD)r r$ �i�byte� coding_state�char_lens r r5 zSJISProber.feed: s � ��~�)�)�)��)�5�5�5� ��*�*� W� W�G�A�t� �>�4�4�T�:�:�L��|� 1�1�1�� �!�!�7��%��M�� � � � +� 1�� ����|� 2�2�2� *� 3�� ����|� 1�1�1� �>�=�=�?�?����6�6�)-�D�O�A�&��)�.�.� ���H� ���7��� � � �.�3�3�D�O�X�N�N�N�N��)�.�.� ��Q���!1�A��E�H�4D�!D�E�x�� � � �.�3�3�H�Q��U�Q��U�]�4K�X�V�V�V�� %�b�\����� �:� �/� /� /��$�4�4�6�6�
4��#�#�%�%��(?�?�?� *� 3�� ��z�r c � � | j �J �| j � � � }| j � � � }t ||� � S r )r r r9 �max)r � context_conf� distrib_confs r r9 zSJISProber.get_confidenced sI � ��)�5�5�5��,�;�;�=�=� ��1�@�@�B�B� ��<� �.�.�.r )r N)�__name__�
__module__� __qualname__r r �property�strr r# r �bytes� bytearrayr r5 �floatr9 �
__classcell__)r s @r r
r
& s� �� � � � � �� � � � � �&� &� &� &� &� &� �2�c� 2� 2� 2� �X�2� ��#� � � � �X��(�U�5�)�#3� 4� (� � (� (� (� (�T/�� /� /� /� /� /� /� /� /r r
N)�typingr �chardistributionr �codingstatemachiner �enumsr r �jpcntxr �mbcharsetproberr
�mbcssmr r
r" r r �<module>rS s� ��8 � � � � � � 6� 6� 6� 6� 6� 6� 2� 2� 2� 2� 2� 2� -� -� -� -� -� -� -� -� '� '� '� '� '� '� 3� 3� 3� 3� 3� 3� !� !� !� !� !� !�C/� C/� C/� C/� C/�'� C/� C/� C/� C/� C/r