�
I�g � �p � d Z ddlmZ ddlmZ ddlmZ dad� Z G d� de� � Z G d � d
e� � Z dS ) z�Utility function to construct a loky.ReusableExecutor with custom pickler.
This module provides efficient ways of working with data stored in
shared memory with numpy.memmap arrays without inducing any memory
copy between the parent and child processes.
� )�get_memmapping_reducers)�TemporaryResourcesManager)�_ReusablePoolExecutorNc �& � t j | fi |��S �N)�MemmappingExecutor�get_memmapping_executor)�n_jobs�kwargss �_/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/joblib/executor.pyr r s � � � 5�f� G� G�� G� G�G� c �T � � e Zd Ze d� fd� � � Zd d�Zed� � � Z� xZS )
r �, N� c
�� �� |� � � } | � |r|ni � � | � t |||�� � � � t du p
t | k }
| at |� � } t dd| j d�|��\ } }
t � � � || |
|
||||�� � \ }}|s| |_ |�|j �
|� � |S )z_Factory for ReusableExecutor with automatic memmapping for large
numpy arrays.
)�timeout� initializer�initargsNT)�unlink_on_gc_collect�temp_folder_resolver)� job_reducers�result_reducers�reuser r r �envr ) �copy�update�dict�_executor_argsr r �resolve_temp_folder_name�super�get_reusable_executor�_temp_folder_manager�register_new_context)�clsr
r r r r � temp_folder�
context_id� backend_args�
executor_argsr �managerr r � _executor�executor_is_reused� __class__s �r r z*MemmappingExecutor.get_memmapping_executor s6 �� � %�)�)�+�+�
�� � �C� /�S�S�R�0�0�0�� � �T���x� I� I� I� J� J� J� �$�&�I�.�M�*I��&��+�K�8�8�� )@� ) �!%�!(�!A�) � ) � �) � ) �%� �o� ).���(E�(E� � ����k� �3� )F� )
� )
�%� �%� "� 5�
.5�I� *� � !�
� *� ?� ?�
� K� K� K��r
Fc � � | � |�� � | j 5 | j � |d�� � d d d � � d S # 1 swxY w Y d S )N)� kill_workersT)�force�allow_non_empty)�shutdown�_submit_resize_lockr" �_clean_temporary_resources)�selfr. s r � terminatez MemmappingExecutor.terminateI s� � � �
�
�<�
�0�0�0� �
%� � � � %� @� @�"�D�
A�
�
�
� � � � � � � � � � � � ���� � � � � � s � A�A �A c �| � t | dd � � �| j S | j � � � | _ | j S )N�_cached_temp_folder)�getattrr7 r" r )r4 s r � _temp_folderz MemmappingExecutor._temp_folder[ s@ � � �4�.�� 5� 5� A��+� +�'+�'@�'Y�'Y�'[�'[�D� $��+� +r
)r Nr NNN)F) �__name__�
__module__� __qualname__� classmethodr r5 �propertyr9 �
__classcell__�r, s @r r r s� �� � � � � ��FJ�CG�+/�-� -� -� -� -� �[�-�^� � � �$ �
,�
,� �X�
,�
,�
,�
,�
,r
r c �( � � e Zd ZdZd� Z� fd�Z� xZS )�_TestingMemmappingExecutorzWrapper around ReusableExecutor to ease memmapping testing with Pool
and Executor. This is only for testing purposes.
c �: � | j |g|�R � }|j |_ |S )zSchedule a func to be run)�submit�result�get)r4 �func�args�futures r � apply_asyncz&_TestingMemmappingExecutor.apply_asyncn s) � � ���T�)�D�)�)�)���]��
��
r
c �R �� t t � � j |g|�R � � � S r )�listr �map)r4 �frH r, s �r rM z _TestingMemmappingExecutor.mapt s) �� ��K�E�G�G�K��)�D�)�)�)�*�*�*r
)r: r; r< �__doc__rJ rM r? r@ s @r rB rB i sQ �� � � � � �� �� � � +� +� +� +� +� +� +� +� +r
rB )
rO �_memmapping_reducerr r � externals.loky.reusable_executorr r r r rB r r
r �<module>rR s� ��� � 9� 8� 8� 8� 8� 8� :� :� :� :� :� :� C� C� C� C� C� C� ��H� H� H�O,� O,� O,� O,� O,�.� O,� O,� O,�d +� +� +� +� +�!3� +� +� +� +� +r