widdlZddlmZddlmZmZmZmZmZddl m Z m Z ddl m Z GddeZGd d ZdS) N)Enum)AnyDictListSequenceTuple)get_available_providers get_device)loggerceZdZdZdZdZdZdS)EPCPUExecutionProviderCUDAExecutionProviderDmlExecutionProviderCANNExecutionProviderN)__name__ __module__ __qualname__CPU_EPCUDA_EP DIRECTML_EPCANN_EP/var/www/development/aibuddy-work/election-extract/venv/lib/python3.11/site-packages/rapidocr/inference_engine/onnxruntime/provider_config.pyrr s" #F%G(K%GGGrrc&eZdZdeeeffdZdeeeeeefffdZ deeeffdZ deeeffdZ deeeffdZ deeeffdZ d eefd Zdefd Zdefd Zdefd ZdeefdZdS)ProviderConfig engine_cfgct|_|jd|_|dd|_|dd|_|dd|_||_dS)Nruse_cudaFuse_dmluse_cann)r had_providersdefault_providerget cfg_use_cuda cfg_use_dml cfg_use_canncfg)selfrs r__init__zProviderConfig.__init__sm(?(A(A $ 21 5&NN:u==%>>)U;;&NN:u==rreturncptjj|fg}|r9|dtjj|f|rMtj d|dtj j| f| rMtj d|dtjj|f|S)NrzEWindows 10 or above detected, try to use DirectML as primary providerz)Try to use CANNExecutionProvider to infer)rrvalue cpu_ep_cfgis_cuda_availableinsertr cuda_ep_cfgis_dml_availabler infor dml_ep_cfgis_cann_availabler cann_ep_cfg)r+resultss r get_ep_listzProviderConfig.get_ep_listsIOT__%6%678  ! ! # # F NN1rz/1A1A1C1CD E E E  " " I KW    NN1r~3T__5F5FG H H H  ! ! # # F KC D D D NN1rz/1A1A1C1CD E E Erc4t|jjSN)dictr*r0r+s rr0zProviderConfig.cpu_ep_cfg1sDH'(((rc4t|jjSr<)r=r*r3r>s rr3zProviderConfig.cuda_ep_cfg4DH()))rc|jj |jjS|r|S|Sr<)r* dm_ep_cfgr1r3r0r>s rr6zProviderConfig.dml_ep_cfg7sN 8  )8% %  ! ! # # &##%% %   rc4t|jjSr<)r=r*r8r>s rr8zProviderConfig.cann_ep_cfg?r@rsession_providerscl|std|d}tj|jtj|jtj|ji}|D]P\}}|rA||j kr6tj |j d|dtj d|QdS)NzSession Providers is emptyrzT is available, but the inference part is automatically shifted to be executed under z. zThe available lists are ) ValueErrorrrr1rr4rr7itemsr/r warning)r+rDfirst_providerproviders_to_checkep check_funcs rverify_providerszProviderConfig.verify_providersBs  ;9:: :*1- J. ND1 J.  16688 O ONB z|| O"( : :xHHvDHHHM:KMMNNN  O Orc |jsdStjj}t dkr ||jvrdSt j|d|jd|jdd|dd d d d d |dg}| |dS)NFGPUT is not in available providers (). Use  inference by default.zIf you want to use za acceleration, you must do:(For reference only) If you want to use GPU acceleration, you must do:AFirst, uninstall all onnxruntime packages in current environment.zASecond, install onnxruntime-gpu by `pip install onnxruntime-gpu`.zHNote the onnxruntime-gpu version must match your cuda and cudnn version.zdYou can refer this link: https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.htmlThird, ensure zW is in available providers list. e.g. ['CUDAExecutionProvider', 'CPUExecutionProvider']) r'rrr/r r$r rHr% print_log)r+rinstall_instructionss rr1z ProviderConfig.is_cuda_availableUs  5*" <<5 W0B%B%B4 A A8J A ASWSh A A A    U' U U U O O V r }W } } }  +,,,urcD|jsdStj}|dkr"tjd|d|jddStjdd}|rt|nd}|d kr"tjd |d|jddStj j }||j vrd Stj|d |j d |jddddd|dg}||dS)NFWindowszFirst, ensure you have installed Huawei Ascend software stack.zOSecond, install onnxruntime with CANN support by following the instructions at:za https://onnxruntime.ai/docs/execution-providers/community-maintained/CANN-ExecutionProvider.htmlrTzW is in available providers list. e.g. ['CANNExecutionProvider', 'CPUExecutionProvider']) r)rrr/r$r rHr%rU)r+rrVs rr7z ProviderConfig.is_cann_availables  5*" d( ( (4 A A8J A ASWSh A A A    A L ] p }W } } }   +,,,urlog_listc8|D]}tj|dSr<)r r5)r+rflog_infos rrUzProviderConfig.print_logs.  " "H K ! ! ! ! " "rN)rrrrstrrr,rrr:r0r3r6r8rrMboolr1r4r7rUrrrrrs4S>T%T#s(^(;"<=$)DcN))))*T#s(^****!DcN!!!!*T#s(^****O(3-OOOO&4.#$####J4*"$s)""""""rr)r[enumrtypingrrrrr onnxruntimer r utils.logr rrrrrros33333333333333;;;;;;;;&&&&&&&&T"T"T"T"T"T"T"T"T"T"r