�
K�g�, � �� � d dl mZmZmZ d dlmZ d dlmZm Z d dl
mZ ddlm
Z
ddlmZ ddlmZmZ dd lmZmZmZ dd
lmZmZ ddlmZ ddlmZ dd
lmZ ee� � Zedk reZne Z G d� de� � ZdS )� )�absolute_import�division�unicode_literals)�unichr)�deque�OrderedDict)�version_info� )�spaceCharacters)�entities)�asciiLetters�asciiUpper2Lower)�digits� hexDigits�EOF)�
tokenTypes�
tagTokenTypes)�replacementCharacters)�HTMLInputStream)�Trie)� � c �� � � e Zd ZdZdM� fd� Zd� Zd� ZdNd�Zd� Zd � Z d
� Z
d� Zd� Zd
� Z
d� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd� Zd � Z d!� Z!d"� Z"d#� Z#d$� Z$d%� Z%d&� Z&d'� Z'd(� Z(d)� Z)d*� Z*d+� Z+d,� Z,d-� Z-d.� Z.d/� Z/d0� Z0d1� Z1d2� Z2d3� Z3d4� Z4d5� Z5d6� Z6d7� Z7d8� Z8d9� Z9d:� Z:d;� Z;d<� Z<d=� Z=d>� Z>d?� Z?d@� Z@dA� ZAdB� ZBdC� ZCdD� ZDdE� ZEdF� ZFdG� ZGdH� ZHdI� ZIdJ� ZJdK� ZKdL� ZL� xZMS )O�
HTMLTokenizera This class takes care of tokenizing HTML.
* self.currentToken
Holds the token that is currently being processed.
* self.state
Holds a reference to the method to be invoked... XXX
* self.stream
Points to HTMLInputStream object.
Nc �� �� t |fi |��| _ || _ d| _ g | _ | j | _ d| _ d | _ t t | � � � � � d S �NF)r �stream�parser�
escapeFlag�
lastFourChars� dataState�state�escape�currentToken�superr �__init__)�selfr r �kwargs� __class__s ��c/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/html5lib/_tokenizer.pyr&