�
���gi � �� � d dl mZ d dlZd dlmZ d dlmZ d dlmZ ddl m
Z
dZ d dl Z n# e
$ r d Z d dlZY nw xY w ej d
� � Zd d�Zd d�Zd d�Zd d�Zd!d�Zd"d �ZdS )#� )� annotationsN)�unescape)�Any)�unquote� )�DuckDuckGoSearchExceptionTFz<.*?>�objr �return�strc � � t r2t j | t j �� � � � � nt j | dd�� � S # t $ r,}t t |� � j � d|� �� � |�d }~ww xY w)N)�optionF� )� ensure_ascii�indent�: )
�
HAS_ORJSON�orjson�dumps� OPT_INDENT_2�decode�json� Exceptionr �type�__name__�r �exs �g/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/duckduckgo_search/utils.py�
json_dumpsr s� � �N� �
?�F�L��V�%8� 9� 9� 9� @� @� B� B� B���C�e�A�>�>�>�
��
� N� N� N�'�4��8�8�+<�(D�(D��(D�(D�E�E�2�M�����N���s �AA �
B� 'B�B� str | bytesc �� � t rt j | � � nt j | � � S # t $ r,}t t
|� � j � d|� �� � |�d }~ww xY w)Nr )r r �loadsr r r r r r s r �
json_loadsr" st � �N�$.�C�v�|�C� � � �D�J�s�O�O�C�� � N� N� N�'�4��8�8�+<�(D�(D��(D�(D�E�E�2�M�����N���s �.1 �
A'�'A"�"A'�
html_bytes�bytes�keywordsc �� � dD ]b\ }}} | � |� � |z }| � ||� � }| ||� � � � c S # t $ r Y �_w xY wt d|�d�� � �)z Extract vqd from html bytes.))s vqd="� � ")s vqd=� � &)s vqd='r' � 'z_extract_vqd() keywords=z Could not extract vqd.)�indexr �
ValueErrorr )r# r% �c1�c1_len�c2�start�ends r � _extract_vqdr3 & s� � ��
�
���F�B�
� �$�$�R�(�(�6�1�E� �"�"�2�u�-�-�C� �e�C�i�(�/�/�1�1� 1� 1� 1��� � � � �D� ����
#�$X�h�$X�$X�$X�
Y�
Y�Ys �A A�
A#�"A#�raw_htmlc �Z � | r(t t � d| � � � � ndS )z)Strip HTML tags from the raw_html string.� )r �REGEX_STRIP_TAGS�sub)r4 s r �
_normalizer9 6 s+ � �;C� K�8�$�(�(��X�6�6� 7� 7� 7��K� �urlc �P � | r#t | � � � dd� � ndS )z(Unquote URL and replace spaces with '+'.� �+r6 )r �replace)r; s r �_normalize_urlr@ ; s( � �-0� 8�7�3�<�<� � ��S� )� )� )�b�8r: �proxy�
str | Nonec � � | dk rdn| S )z.Expand "tb" to a full proxy URL if applicable.�tbzsocks5://127.0.0.1:9150� )rA s r �_expand_proxy_tb_aliasrF @ s � �(-��
�
� $� $�5�@r: )r r r
r )r r r
r )r# r$ r% r r
r )r4 r r
r )r; r r
r )rA rB r
rB )�
__future__r �re�htmlr �typingr � urllib.parser �
exceptionsr r r � ImportErrorr �compiler7 r r" r3 r9 r@ rF rE r: r �<module>rO sV �� "� "� "� "� "� "� � � � � � � � � � � � � � � � � � � � � � � 1� 1� 1� 1� 1� 1���J��M�M�M�M��� � � ��J��K�K�K�K�K����� �2�:�g�&�&� �N� N� N� N�N� N� N� N�
Z�
Z�
Z�
Z� L� L� L� L�
9� 9� 9� 9�
A� A� A� A� A� As �+ � 9�9