�
��g�G � �� � d dl Z d dlZd dlZd dlZd dlmZ d dlmZmZm Z ddl
mZ d� Z
dd �Zdd
�Zdd�Z G d� d� � Z G d� d� � Zd� Zdd�Zdd�Zd� Zed d�� � Zdd�ZdS )!� N)�contextmanager)�Any�Dict�List� )�languagec �� � d� | � � } dddd| z dg}t j |� � }|� t j j � � � d� � }d� |D � � }|S )N�,�
nvidia-smi�-i�0z--query-gpu=z--format=csv,noheader,nounitsc �, � g | ]}t |� � ��S � )�int��.0�xs �^/home/asafur/pinokio/api/open-webui.git/app/env/lib/python3.11/site-packages/triton/testing.py�
<listcomp>znvsmi.<locals>.<listcomp> s � �
�
�
�a�3�q�6�6�
�
�
� )�join�
subprocess�check_output�decode�sys�stdout�encoding�split)�attrs�cmd�out�rets r �nvsmir#
ss � ��H�H�U�O�O�E���s�N�U�$:�<[�
\�C�
�
!�#�
&�
&�C�
�*�*�S�Z�(�
)�
)�
/�
/��
4�
4�C�
�
�3�
�
�
�C��Jr � �meanc � � ddl }|dv sJ �|j � � � |j � � � k rt d� � � | � � |�5|D ]2}|� � � |� d� � d|_ �3|j � � � }|j � |� � 5 | � � ddd� � n# 1 swxY w Y |j �
� � |j � d�� � }|j � d�� � }|� � � |�
� � |� � � |j �
� � |� |� � } t dt! || z � � � � }
|j � � � }|j � |� � 5 t# |
� � D ]}|�|D ] }d|_ �
| � � � ddd� � n# 1 swxY w Y |j �
� � g }d}
t# |
� � D ]�}|j � d�� � }|j � d�� � }|� � � |�
� � |� � � |j �
� � ||� |� � |
z gz
}��|� |� � } t'