wi%ddlZddlZddlZddlZddlmZmZmZmZm Z m Z ddl m Z m Z ejZGddZGddZGdd eZGd d eZe eeeefZdS) N)AnyCallableDictListOptionalUnion) EXIT_FUNC INIT_FUNCceZdZdZ ddedeedeedeeded ee d dfd Z d efd Z d efd Z dd ee d dfdZ dd ee d efdZdeded dfdZdS) AsyncResultz4 Adapted from ``multiprocessing.pool.ApplyResult``. NTcachecallbackerror_callbackjob_iddelete_from_cachetimeoutreturnc2||_||_||_||_||_|t t n||_tj |_ d|_ d|_ |j|jvrtd|d||j|j<dS)a :param cache: Cache for storing intermediate results :param callback: Callback function to call when the task is finished. The callback function receives the output of the function as its argument :param error_callback: Callback function to call when the task has failed. The callback function receives the exception as its argument :param job_id: Job ID of the task. If None, a new job ID is generated :param delete_from_cache: If True, the result is deleted from the cache when the task is finished :param timeout: Timeout in seconds for a single task. When the timeout is exceeded, MPIRE will raise a ``TimeoutError``. Use ``None`` to disable (default) NJob ID  already exists in cache)_cache _callback_error_callback_delete_from_cache_timeoutnext job_counterr threadingEvent _ready_event_success_value ValueError)selfr rrrrrs j/var/www/development/aibuddy-work/election-extract/venv/lib/python3.11/site-packages/mpire/async_result.py__init__zAsyncResult.__init__s !-"3 +1>d;'''v %O--  ;$+ % %GvGGGHH H#' DK   c4|jS)z? :return: Returns True if the task is finished )r is_setr$s r%readyzAsyncResult.ready+s '')))r'cf|st|jd|jS)z :return: Returns True if the task has finished successfully :raises: ValueError if the task is not finished yet z is not ready)r+r#rr!r*s r% successfulzAsyncResult.successful1s5 zz|| < :::;; ;}r'c:|j|dS)zy Wait until the task is finished :param timeout: Timeout in seconds. If None, wait indefinitely N)r waitr$rs r%r/zAsyncResult.wait:s! w'''''r'c|||st|jr|jS|j)am Wait until the task is finished and return the output of the function :param timeout: Timeout in seconds. If None, wait indefinitely :return: Output of the function :raises: TimeoutError if the task is not finished within the timeout. When the task has failed, the exception raised by the function is re-raised )r/r+ TimeoutErrorr!r"r0s r%getzAsyncResult.getBsF 'zz||   = ; + r'successresultc ||_||_|jr!|jr||j|jr!|js||j|j|jr|j|j=dSdS)aw Set the result of the task and call any callbacks, when provided. This also removes the task from the cache, as it's no longer needed there. The user should store a reference to the result object :param success: True if the task has finished successfully :param result: Output of the function or the exception raised by the function N) r!r"rrr setrrrr$r4r5s r%_setzAsyncResult._setSs   > (dm ( NN4; ' ' '   .  .   - - -   " ) DK((( ) )r')NTNN)__name__ __module__ __qualname____doc__rrrintboolfloatr&r+r-r/rr3r9r'r%r r s:>>ko((d(hx.@(RZ[cRd(!#(BF(X`afXg(sw((((6*t**** D((HUO(t((((8E?c")D)#)$))))))r'r c eZdZdZ ddedeedeedeeddf dZdd Z dd e deede fd Z e Z dd Zde de ddfdZdeddfdZdefdZddZdS)UnorderedAsyncResultIteratorza Stores results of a task and provides an iterator to obtain the results in an unordered fashion Nr n_tasksrrrc||_d|_||_|ttn||_t j|_tj tj |_ d|_ d|_d|_tj|_|j|jvrt%d|d||j|j<|||dSdS)a :param cache: Cache for storing intermediate results :param n_tasks: Number of tasks that will be executed. If None, we don't know the lenght yet :param job_id: Job ID of the task. If None, a new job ID is generated :param timeout: Timeout in seconds for a single task. When the timeout is exceeded, MPIRE will raise a ``TimeoutError``. Use ``None`` to disable (default) N)lockrrr)r_n_tasksrrrr collectionsdeque_itemsr ConditionLock _condition _n_received _n_returned _exceptionr_got_exceptionr# set_length)r$r rErrs r%r&z%UnorderedAsyncResultIterator.__init__ms   +1>d;'''v !')) #-9>3C3CDDD'o// ;$+ % %GvGGGHH H#' DK   OOG $ $ $ $ $  r'c|Sr:rBr*s r%__iter__z%UnorderedAsyncResultIterator.__iter__s r'Tblockc|jr)|xjdz c_|jS|j|j|jkrt|s t j|j5|jsO|j| }|r t j|j|j|jkrt|jO|xjdz c_|jcdddS#1swxYwYdS)a2 Obtain the next unordered result for the task :param block: If True, wait until the next result is available. If False, raise queue.Empty if no result is available :param timeout: Timeout in seconds. If None, wait indefinitely :return: The next result N)r) rKrPpopleftrH StopIterationqueueEmptyrNr/)r$rVr timed_outs r%rz!UnorderedAsyncResultIterator.nextsV ; )    !  ;&&(( ( = $)9T])J)J  + _ ) )k ( $ 4 4W 4 E EE &+%=,1AT]1R1R'' k (    !  ;&&(( ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) )s$A?C00C47C4c|j5|j|j|jkr0|j|j |j|jk0ddddS#1swxYwYdS)z6 Wait until all results are available N)rNrHrOr/r*s r%r/z!UnorderedAsyncResultIterator.waits_ ' '-'4+;dm+K+K$$&&&-'4+;dm+K+K ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' ' 'sAAA!$A!r4r5c|re|xjdz c_|j||j5|jddddS#1swxYwYdS||_|jdS)z Set the result of the task :param success: True if the task has finished successfully :param result: Output of the function or the exception raised by the function rXN)rOrKappendrNnotifyrQrRr7r8s r%r9z!UnorderedAsyncResultIterator._sets  &    !   K  v & & & ) )&&((( ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) ) )%DO   # # % % % % %sAA"Alengthc|j'|j|krtd|jd|dS|j5||_|jddddS#1swxYwYdS)z_ Set the length of the iterator :param length: Length of the iterator Nz+Length of iterator has already been set to z, but is now set to )rHr#rNra)r$rbs r%rSz'UnorderedAsyncResultIterator.set_lengths = $}&& "?t}"?"?6<"?"?@@@ F _ % %"DM O " " $ $ $ % % % % % % % % % % % % % % % % % %s!A$$A(+A(cB|j|jSz? :return: The exception raised by the function )rRr/rQr*s r% get_exceptionz*UnorderedAsyncResultIterator.get_exceptions!   """r'c |j|j=dS)z4 Remove the iterator from the cache N)rrr*s r%remove_from_cachez.UnorderedAsyncResultIterator.remove_from_caches K $ $ $r')NN)rrD)TNrN)r;r<r=r>rrr?rAr&rUr@rr__next__r/r9rS ExceptionrfrhrBr'r%rDrDisEkkTX,0%%d%Xc]%HSM%"5/%59%%%%6))$))3))))>H''''&D&#&$&&&&"%%%%%%"y%%%%%%r'rDc@eZdZdededdffd ZdefdZddZxZ S) AsyncResultWithExceptionGetterr rrNcVt|dd|dddS)NF)rrrrr)superr&)r$r r __class__s r%r&z'AsyncResultWithExceptionGetter.__init__s< d6ej!%  ' ' ' ' 'r'c8||jSre)r/r"r*s r%rfz,AsyncResultWithExceptionGetter.get_exceptions {r'cTd|_d|_|jdS)) Reset the result object N)r!r"r clearr*s r%resetz$AsyncResultWithExceptionGetter.resets-   !!!!!r'ri) r;r<r=rr?r&rkrfru __classcell__rps@r%rmrms'd'C'D''''''y""""""""r'rmcHeZdZdeddffd ZdeefdZddZxZ S) UnorderedAsyncExitResultIteratorr rNc\t|dtddS)N)rErr)ror&r )r$r rps r%r&z)UnorderedAsyncExitResultIterator.__init__s* YMMMMMr'c*t|jS)z/ :return: List of exit results )listrKr*s r% get_resultsz,UnorderedAsyncExitResultIterator.get_resultssDK   r'cd|_|jd|_d|_d|_|jdS)rsNr)rHrKrtrOrPrQrRr*s r%ruz&UnorderedAsyncExitResultIterator.resetsQ   !!#####r'ri) r;r<r=rr&rrr}rurvrws@r%ryrysNdNtNNNNNN!T#Y!!!! $ $ $ $ $ $ $ $r'ry)rI itertoolsr[rtypingrrrrrr mpire.commsr r countrr rDrmryAsyncResultTyperBr'r%rs` ================,,,,,,,,io Z)Z)Z)Z)Z)Z)Z)Z)zx%x%x%x%x%x%x%x%v"""""[""",$$$$$'C$$$. %CEa89:r'