U
&.ep| @ s d dddgZ ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
m Z ddl
m Z m
Z
dd lmZ ejZz$ddlZdd
lmZmZmZmZ W n$ ek
r ejd kr dZY nX d Zd
ZdZe Z dZ dgZ e edrdZ e dg7 Z ejd kr dZ e dg7 Z efddZ!dd Z"dd Z#dd Z$dd Z%G d d d Z&ernG d d d e&Z'G d d! d!e&Z(G d"d de)Z*dPd#d Z+ejd krdQd%dZ,n
dRd&dZ,G d'd( d(e)Z-d)d* Z.ejd krG d+d, d,e)Z/d-d. Z0d/Z1d0Z2d1Z3d2Z4d3d4 Z5d5d6 Z6G d7d8 d8e)Z7d9d: Z8d;d< Z9G d=d> d>e*Z:d?d@ Z;ejd krzdAdB ZhZ?dSdCdZ@n,ddlAZAe eAdDreAjBZCneAjDZCdTdEdZ@ejd krdFdG ZEdHdI ZFeGe(eE dJdK ZHdLdM ZIeGe'eH n dNdG ZEdOdI ZFeGe(eE dS )UClientListenerPipewait N )util)AuthenticationErrorBufferTooShort) reduction)
WAIT_OBJECT_0WAIT_ABANDONED_0 WAIT_TIMEOUTINFINITEwin32i g 4@Zsha256AF_INETAF_UNIXAF_PIPEc C s t | S Ntime monotonic)timeout r 2/usr/lib64/python3.8/multiprocessing/connection.py
_init_timeout? s r c C s t | kS r r )tr r r _check_timeoutB s r c C sX | dkr dS | dkr&t jdt dS | dkrLt jdt ttf ddS td d
S ) z?
Return an arbitrary free address for the given family
r )Z localhostr r z listener-)prefixdirr z\\.\pipe\pyc-%d-%d- zunrecognized familyN) tempfileZmktempr Z get_temp_dirosgetpidnext
_mmap_counter
ValueErrorfamilyr r r arbitrary_addressI s r( c C sJ t jdkr | dkr td| t jdkrF| dkrFtt| sFtd| dS )zD
Checks if the family is valid for the current environment.
r r z Family %s is not recognized.r N)sysplatformr% hasattrsocketr& r r r _validate_familyW s
r- c C sT t | tkrdS t | tkr*| dr*dS t | tks@t| rDdS td| dS )z]
Return the types of the address
This can be 'AF_INET', 'AF_UNIX', or 'AF_PIPE'
r z\\r r z address type of %r unrecognizedN)typetuplestr
startswithr is_abstract_socket_namespacer% )addressr r r address_typec s r4 c @ s e Zd ZdZd+ddZdd Zdd Zd d
Zd d Zd
d Z e
dd Z e
dd Z e
dd Z
dd Zdd Zd,ddZd d Zd-d d Zd.d d!Zd"d# Zd/d%d&Zd'd( Zd)d* ZdS )0_ConnectionBaseNTc C s> | }|dk rtd|s(|s(td|| _|| _|| _d S )Nr zinvalid handlez6at least one of `readable` and `writable` must be True) __index__r% _handle _readable _writable)selfhandlereadablewritabler r r __init__y s z_ConnectionBase.__init__c C s | j d k r| d S r r7 _closer: r r r __del__ s
z_ConnectionBase.__del__c C s | j d krtdd S )Nzhandle is closed)r7 OSErrorrA r r r
_check_closed s
z _ConnectionBase._check_closedc C s | j stdd S )Nzconnection is write-only)r8 rC rA r r r _check_readable s z _ConnectionBase._check_readablec C s | j stdd S )Nzconnection is read-only)r9 rC rA r r r _check_writable s z _ConnectionBase._check_writablec C s" | j rd| _n| tdd S )NFzbad message length)r9 r8 closerC rA r r r _bad_message_length s z#_ConnectionBase._bad_message_lengthc C s
| j dkS )z True if the connection is closedNr7 rA r r r closed s z_ConnectionBase.closedc C s | j S )z"True if the connection is readable)r8 rA r r r r< s z_ConnectionBase.readablec C s | j S )z"True if the connection is writable)r9 rA r r r r= s z_ConnectionBase.writablec C s | | jS )z+File descriptor or handle of the connection)rD r7 rA r r r fileno s z_ConnectionBase.filenoc C s$ | j dk r z | W 5 d| _ X dS )zClose the connectionNr? rA r r r rG s
z_ConnectionBase.closer c C s | | t|}|jdkr.tt|}t|}|dk rFtd||k rVtd|dkrh|| }n&|dk rztdn|| |krtd| |||| dS )z,Send the bytes data from a bytes-like objectr r zoffset is negativezbuffer length < offsetNzsize is negativez buffer length < offset + size)rD rF
memoryviewitemsizebyteslenr% _send_bytes)r: bufoffsetsizemnr r r
send_bytes s"
z_ConnectionBase.send_bytesc C s$ | | | t| dS )zSend a (picklable) objectN)rD rF rP _ForkingPicklerdumpsr: objr r r send s z_ConnectionBase.sendc C sJ | | |dk r(|dk r(td| |}|dkrB| | S )z7
Receive bytes data as a bytes object.
Nr znegative maxlength)rD rE r% _recv_bytesrH getvalue)r: Z maxlengthrQ r r r
recv_bytes s
z_ConnectionBase.recv_bytesc
C s | | t|}|j}|t| }|dk r>tdn||krNtd| }| }||| k rvt| |
d | ||| || | |W 5 Q R S Q R X dS )zq
Receive bytes data into a writeable bytes-like object.
Return the number of bytes read.
r znegative offsetzoffset too largeN) rD rE rL rM rO r% r\ tellr r] seekreadinto)r: rQ rR rT rM ZbytesizeresultrS r r r recv_bytes_into s$
z _ConnectionBase.recv_bytes_intoc C s& | | | }t| S )z Receive a (picklable) object)rD rE r\ rW loads getbuffer)r: rQ r r r recv s z_ConnectionBase.recv c C s | | | |S )z/Whether there is any input available to be read)rD rE _pollr: r r r r poll s z_ConnectionBase.pollc C s | S r r rA r r r __enter__ s z_ConnectionBase.__enter__c C s | d S r rG r: exc_type exc_valueZexc_tbr r r __exit__
s z_ConnectionBase.__exit__)TT)r N)N)r )rg )__name__
__module__ __qualname__r7 r> rB rD rE rF rH propertyrJ r< r= rK rG rV r[ r^ rc rf rj rk rp r r r r r5 v s.
r5 c @ sD e Zd ZdZdZejfddZdd Zddd Z d
d Z
d d
Z dS )PipeConnectionz
Connection class based on a Windows named pipe.
Overlapped I/O is used, so the handles must have been created
with FILE_FLAG_OVERLAPPED.
Fc C s || j d S r rI )r: Z _CloseHandler r r r@ s zPipeConnection._closec C s t j| j|dd\}}zHz,|t jkrBt |jgdt}|tksBt W n |
Y nX W 5 |d\}}X |dks|t |t |kst d S )NT
overlappedFr ) _winapiZ WriteFiler7 GetOverlappedResultERROR_IO_PENDINGWaitForMultipleObjectseventr r AssertionErrorcancelrO )r: rQ overrZnwrittenwaitresr r r rP s
zPipeConnection._send_bytesNc C s2 | j rd| _ t S |d kr dnt|d}ztj| j|dd\}}d zHz,|tj krpt
|jgdt}|tksptW n | Y nX W 5 |d\}}|dkrt }|| | W S |tj
kr| || W S X W n: tk
r$ } z|jtjkrtn W 5 d }~X Y nX tdd S )NF Trv r z.shouldn't get here; expected KeyboardInterrupt)_got_empty_messageioBytesIOminrx ReadFiler7 ry writere ZERROR_MORE_DATA_get_more_datarz r{ r| r r r} r~ rC winerrorERROR_BROKEN_PIPEEOFError RuntimeError) r: maxsizeZbsizer r Znreadfr er r r r\ * s>
zPipeConnection._recv_bytesc C s. | j st| jd dkr dS tt| g|S )Nr T)r rx
PeekNamedPiper7 boolr ri r r r rh J s
zPipeConnection._pollc C s | }t }|| t| jd }|dks6t|d k rVt|| |krV| tj
| j|dd\}}| d\}}|dkst||kst|| |S )Nr r Trv ) re r r r rx r r7 r} rO rH r ry )r: r r rQ r leftr Zrbytesr r r r P s
z PipeConnection._get_more_data)N) rq rr rs __doc__r rx CloseHandler@ rP r\ rh r r r r r ru s
ru c @ s| e Zd ZdZer,ejfddZejZ ej
Z ne j
fddZe jZ e jZ e fddZe fddZd d
Zdd d
Zdd Zd S )
Connectionzo
Connection class based on an arbitrary file descriptor (Unix only), or
a socket handle (Windows).
c C s || j d S r rI r: r@ r r r r@ g s zConnection._closec C s || j d S r rI r r r r r@ l s c C s8 t |}|| j|}||8 }|dkr&q4||d }qd S Nr )rO r7 )r: rQ r remainingrU r r r _sendq s zConnection._sendc C sb t }| j}|}|dkr^|||}t|}|dkrJ||krBtntd|| ||8 }q|S )Nr z got end of file during message)r r r7 rO r rC r )r: rS readrQ r; r chunkrU r r r _recvz s
zConnection._recvc C s t |}|dkrHtdd}td|}| | | | | | n8td|}|dkrr| | | | n| || d S )Ni!i!Qi @ )rO structZpackr )r: rQ rU Z
pre_headerheaderr r r rP s
zConnection._send_bytesNc C s^ | d}td| \}|dkr@| d}td| \}|d k rT||krTd S | |S )N r r r )r r Zunpackr] )r: r rQ rS r r r r\ s
zConnection._recv_bytesc C s t | g|}t|S r )r r )r: r rr r r rh s zConnection._poll)N)rq rr rs r rx _multiprocessingZ closesocketr@ r[ Z_writerf Z_readr! rG r r r r rP r\ rh r r r r r ` s
r c @ sR e Zd ZdZdddZdd Zdd Zed
d Zed d
Z dd Z
dd Z dS )r z
Returns a listener object.
This is a wrapper for a bound socket which is 'listening' for
connections, or for a Windows named pipe.
Nr c C sp |p|rt |pt}|p t|}t| |dkr>t||| _nt|||| _|d k rft|tsft d|| _
d S )Nr authkey should be a byte string) r4 default_familyr( r- PipeListener _listenerSocketListener
isinstancerN TypeError_authkey)r: r3 r' backlogauthkeyr r r r> s zListener.__init__c C s> | j dkrtd| j }| jr:t|| j t|| j |S )zz
Accept a connection on the bound socket or named pipe of `self`.
Returns a `Connection` object.
Nzlistener is closed)r rC acceptr deliver_challengeanswer_challenge)r: cr r r r s
zListener.acceptc C s | j }|dk r d| _ | dS )zA
Close the bound socket or named pipe of `self`.
N)r rG )r: Zlistenerr r r rG s zListener.closec C s | j jS r )r _addressrA r r r r3 s zListener.addressc C s | j jS r )r _last_acceptedrA r r r
last_accepted s zListener.last_acceptedc C s | S r r rA r r r rk s zListener.__enter__c C s | d S r rl rm r r r rp s zListener.__exit__)NNr N) rq rr rs r r> r rG rt r3 r rk rp r r r r r s
c C sh |p
t | }t| |dkr&t| }nt| }|dk rHt|tsHtd|dk rdt|| t|| |S )z=
Returns a connection to the address of a `Listener`
r Nr ) r4 r-
PipeClient SocketClientr rN r r r )r3 r' r r r r r r s
Tc C sj | r>t \}}|d |d t| }t| }n$t \}}t|dd}t|dd}||fS )L
Returns pair of connection objects at either end of a pipe
TFr= r< )r, Z
socketpair setblockingr detachr! pipe)duplexs1s2c1c2Zfd1Zfd2r r r r s
c
C s t d}| r*tj}tjtjB }tt }}ntj}tj}dt }}t||tjB tj B tj
tj B tj B d||tj
tj}t||dtjtjtjtj}t|tj dd tj|dd}|d\} }
|
dkstt|| d} t|| d} | | fS ) r r r r NTrv r r )r( rx PIPE_ACCESS_DUPLEX GENERIC_READ
GENERIC_WRITEBUFSIZEZPIPE_ACCESS_INBOUNDCreateNamedPipeFILE_FLAG_OVERLAPPED FILE_FLAG_FIRST_PIPE_INSTANCEPIPE_TYPE_MESSAGEPIPE_READMODE_MESSAGE PIPE_WAITNMPWAIT_WAIT_FOREVERNULL
CreateFile
OPEN_EXISTINGSetNamedPipeHandleStateConnectNamedPipery r} ru )
r r3 ZopenmodeaccessZobsizeZibsizeZh1Zh2rw _r r r r r r r sV
c @ s* e Zd ZdZd
ddZdd Zdd Zd S ) r zO
Representation of a socket which is bound to an address and listening
r c C s t tt || _zRtjdkr2| jt jt jd | jd | j | | j
| | j | _ W n t
k
r | j Y nX || _d | _|dkrt|stj| tj|fdd| _nd | _d S )Nposixr Tr r argsZ exitpriority)r, getattr_socketr! nameZ
setsockoptZ
SOL_SOCKETZ SO_REUSEADDRr ZbindZlistenZ getsocknamer rC rG Z_familyr r r2 Finalizeunlink_unlink)r: r3 r' r r r r r> K s0
zSocketListener.__init__c C s& | j \}| _|d t| S )NT)r r r r r r r: sr r r r d s
zSocketListener.acceptc C s0 z| j W 5 | j }|d k r*d | _ | X d S r )r r rG )r: r r r r rG i s zSocketListener.closeN)r )rq rr rs r r> r rG r r r r r G s
r c
C sP t | }ttt|.}|d || t| W 5 Q R S Q R X dS )zO
Return a connection object connected to the socket given by `address`
TN)r4 r, r r Zconnectr r )r3 r' r r r r r s s
r c @ s8 e Zd ZdZd ddZd
ddZdd Zed
d ZdS )r z0
Representation of a named pipe
Nc C sL || _ | jddg| _d | _td| j tj| tj| j| j fdd| _ d S )NT)firstz listener created with address=%rr r )
r _new_handle
_handle_queuer r sub_debugr r _finalize_pipe_listenerrG )r: r3 r r r r r> s
zPipeListener.__init__Fc
C sH t jt jB }|r|t jO }t | j|t jt jB t jB t j t
t
t j t j S r )
rx r r r r r r r r ZPIPE_UNLIMITED_INSTANCESr r r )r: r flagsr r r r s
zPipeListener._new_handlec
C s | j | | j d}ztj|dd}W n0 tk
r^ } z|jtjkrN W 5 d }~X Y n\X z r r staticmethodr r r r r r s
r c
C s t }z6t| d t| tjtjB dtjtjtjtj}W q t k
rz } z |j
tj tj fksht
|rj W 5 d}~X Y qX qq t|tjdd t|S )zU
Return a connection object connected to the pipe given by `address`
r N)r rx Z
WaitNamedPiper r r r r r rC r ZERROR_SEM_TIMEOUTZERROR_PIPE_BUSYr r r ru )r3 r hr r r r r s8
r s #CHALLENGE#s #WELCOME#s #FAILURE#c C s dd l }t|ts$tdt|tt}| t
| | ||t
}| d}||krl| t n| t tdd S )Nr Authkey must be bytes, not {0!s} zdigest received was wrong)hmacr rN r% formatr. r! urandomMESSAGE_LENGTHrV CHALLENGEnewHMAC_DIGEST_NAMEdigestr^ WELCOMEFAILUREr Z
connectionr r messager Zresponser r r r s
r c C s dd l }t|ts$tdt|| d}|d tt tksNt d| |ttd }|
||t }|
| | d}|tkrtdd S )Nr r r z message = %rzdigest sent was rejected)r r rN r% r r. r^ rO r r} r r r rV r r r r r r r s
r c @ s$ e Zd Zdd Zdd Zdd ZdS )ConnectionWrapperc C s6 || _ || _|| _dD ]}t||}t| || qd S )N)rK rG rj r^ rV )_conn_dumps_loadsr setattr)r: connrX rd attrrZ r r r r> s
zConnectionWrapper.__init__c C s | |}| j| d S r )r r rV )r: rZ r r r r r[ s
zConnectionWrapper.sendc C s | j }| |S r )r r^ r r r r r rf s
zConnectionWrapper.recvN)rq rr rs r> r[ rf r r r r r s r c C s t | fd d d ddS )Nr utf-8) xmlrpclibrX encode)rZ r r r
_xml_dumps s r c C s t | d\\}}|S )Nr )r rd decode)r rZ methodr r r
_xml_loads s r
c @ s e Zd Zdd ZdS ) XmlListenerc C s" dd l ma t| }t|ttS r )
xmlrpc.clientclientr r r r r r
rY r r r r s
zXmlListener.acceptN)rq rr rs r r r r r r s r c O s dd l ma tt| |ttS r )r r
r r r r r
)r kwdsr r r XmlClient s r c C s t | }g }|rt|d|}|tkr*qn\t| krFtt| k rTn n
|t8 }n2t| krptt| k r~n n
|t8 }ntd||| ||d d }d}q |S )NFzShould not get herer r ) listrx r{ r
r rO r r r )Zhandlesr Lreadyr r r r _exhaustive_wait) s
r c
s^ |dkrt }n |dk r d}nt|d d }t| } i g }t t }z@| D ]&}zt|d} W n tk
r || < Y qPX zt | dd\}}W n8 tk
r } zd|j }}|tkrƂ W 5 d}~X Y nX |t jkr|| ||j < qP|rjt dd d krjz|d
\}}W n* tk
rP } z
|j}W 5 d}~X Y nX |sjt
|drjd|_ | d}qPt |}W 5 |D ]}| q|D ]}z|d\}}W n6 tk
r } z|j}|tkr W 5 d}~X Y nX |t j
kr|j } | |dkrt
|drd|_qX fd d |D fd
d| D S )
Wait till an object in object_list is ready/readable.
Returns list of those objects in object_list which are ready/readable.
Nr r g ?Tr rK ) r Fc 3 s | ]} | V qd S r r ).0r )waithandle_to_objr r s zwait..c s g | ]}| kr|qS r r )r o)
ready_objectsr r
s wait..)r intr setr~ ry rC r
_ready_errorsrx ZERROR_OPERATION_ABORTEDr| addr+ r r AttributeErrorr6 r rz r r) Zgetwindowsversionr keysupdate)
object_listr Zov_listZ
ready_handlesr r r r r rK r )r r r r ? sh
PollSelectorc
C s t }| D ]}||tj q |dk r4t | }||}|r\dd |D W 5 Q R S |dk r4|t }|dk r4|W 5 Q R S q4W 5 Q R X dS )r Nc S s g | ]\}}|j qS r )Zfileobj)r keyZeventsr r r r s r r )
_WaitSelectorregister selectorsZ
EVENT_READr r Zselect)r% r ZselectorrZ Zdeadliner r r r r s
c
C sZ | }t|tjtj6}ddlm} ||}t|| j | j
ffW 5 Q R S Q R X d S )Nr )resource_sharer) rK r, Zfromfdr Z SOCK_STREAMr r+ Z DupSocketrebuild_connectionr< r= )r r; r r+ dsr r r reduce_connection s
r. c C s | }t| ||S r r r )r- r< r= Zsockr r r r, s r, c C sB | j r tjnd| jrtjndB }t| |}t|| j | jffS r ) r< rx ZFILE_GENERIC_READr= ZFILE_GENERIC_WRITEr
Z DupHandlerK rebuild_pipe_connection)r r dhr r r reduce_pipe_connection s
r2 c C s | }t|||S r )r ru )r1 r< r= r; r r r r0 s r0 c C s t | }t|| j| jffS r )r
ZDupFdrK r, r< r= )r dfr r r r. s c C s | }t|||S r r/ )r3 r< r= fdr r r r, s )NN)T)T)N)N)J__all__r r! r) r, r r r itertoolsr r r r r contextr
ZForkingPicklerrW rx r r r
r ImportErrorr* r ZCONNECTION_TIMEOUTr countr$ r Zfamiliesr+ r r r( r- r4 r5 ru r objectr r r r r r r r r r r r r r r r
r r r r ZERROR_NETNAME_DELETEDr r r* r& r( ZSelectSelectorr. r, r) r2 r0 r r r r
s
PT=
,, 8 P