3
[ @ s d Z ddlZddlZddlZddlmZ ddlmZ ddl m
Z
ddl m Z m
Z
mZmZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZmZmZ dd
l m Z m Z m Z m Z m!Z!m"Z"m#Z# ddl$m%Z%m&Z& ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1 ddl2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;mZ> ddl2m?Z@ ddlAmBZB eBjCeBjDeBjEeBjFeBjGfZHdZId!ZJdZKG dd deLZMG dd deLZNG dd d eNZOG d d d eMeNZPG d d d eLZQdS )"z`
requests.models
~~~~~~~~~~~~~~~
This module contains the primary objects that power Requests.
N) RequestField)encode_multipart_formdata) parse_url) DecodeErrorReadTimeoutError
ProtocolErrorLocationParseError)UnsupportedOperation )
default_hooks)CaseInsensitiveDict)
HTTPBasicAuth)cookiejar_from_dictget_cookie_header_copy_cookie_jar) HTTPError
MissingSchema
InvalidURLChunkedEncodingErrorContentDecodingErrorConnectionErrorStreamConsumedError)to_native_stringunicode_is_ascii)
guess_filenameget_auth_from_url requote_uri stream_decode_response_unicodeto_key_val_listparse_header_links iter_slicesguess_json_utf super_lencheck_header_validity) CallableMapping cookielib
urlunparseurlsplit urlencodestrbytesis_py2chardet builtin_str
basestring)json)codes
i i c @ s0 e Zd Zedd Zedd Zedd ZdS )RequestEncodingMixinc C sN g }t | j}|j}|s d}|j| |j}|rD|jd |j| dj|S )zBuild the path URL to use./? )r( urlpathappendqueryjoin)selfr8 pr9 r; r? /usr/lib/python3.6/models.pypath_url= s
z RequestEncodingMixin.path_urlc C s t | ttfr| S t| dr | S t| drg }x|t| D ]p\}}t |tsVt|d r\|g}xJ|D ]B}|dk rb|jt |tr|jdn|t |tr|jdn|f qbW q8W t|ddS | S dS )zEncode parameters in a piece of data.
Will successfully encode parameters when passed as a dict or a list of
2-tuples. Order is retained if data is a list of 2-tuples but arbitrary
if parameters are supplied as a dict.
read__iter__Nzutf-8T)Zdoseq)
isinstancer* r+ hasattrr r/ r: encoder) )dataresultkZvsvr? r? r@ _encode_paramsR s
$ z#RequestEncodingMixin._encode_paramsc C s | st dnt|tr t dg }t|p,i }t| p8i } x|D ]\}}t|ts`t|d rf|g}x\|D ]T}|dk rlt|tst|}|jt|tr|jdn|t|tr|j dn|f qlW qBW x| D ]\}}d}d} t|t
t fr.t |dkr|\}
} n&t |dkr |\}
} }n |\}
} }} nt
|p:|}
|} t| tttfrX| } n(t| drn| j } n| dkr|qn| } t|| |
| d }
|
j|d
|j|
qW t|\}}||fS ) a Build the body for a multipart/form-data request.
Will successfully encode files when passed as a dict or a list of
tuples. Order is retained if data is a list of tuples but arbitrary
if parameters are supplied as a dict.
The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype)
or 4-tuples (filename, fileobj, contentype, custom_headers).
zFiles must be provided.zData must not be a string.rC Nzutf-8 rB )namerG filenameheaders) content_type)
ValueErrorrD r/ r rE r+ r* r: decoderF tuplelistlenr bytearrayrB r Zmake_multipartr )filesrG Z
new_fieldsZfieldsZfieldvalrJ rI ZftZfhfnfpZfdataZrfbodyrQ r? r? r@
_encode_filesm sP
$
z"RequestEncodingMixin._encode_filesN)__name__
__module__ __qualname__propertyrA staticmethodrK r] r? r? r? r@ r4 < s r4 c @ s e Zd Zdd Zdd ZdS )RequestHooksMixinc C sZ || j krtd| t|tr2| j | j| n$t|drV| j | jdd |D dS )zProperly register a hook.z1Unsupported event specified, with event name "%s"rC c s s | ]}t |tr|V qd S )N)rD r$ ).0hr? r? r@ s z2RequestHooksMixin.register_hook..N)hooksrR rD r$ r: rE extend)r= eventhookr? r? r@
register_hook s
z RequestHooksMixin.register_hookc C s. y| j | j| dS tk
r( dS X dS )ziDeregister a previously registered hook.
Returns True if the hook existed, False if not.
TFN)rg removerR )r= ri rj r? r? r@ deregister_hook s
z!RequestHooksMixin.deregister_hookN)r^ r_ r` rk rm r? r? r? r@ rc s rc c
@ s* e Zd ZdZd ddZdd Zdd ZdS )
Requesta{ A user-created :class:`Request ` object.
Used to prepare a :class:`PreparedRequest `, which is sent to the server.
:param method: HTTP method to use.
:param url: URL to send.
:param headers: dictionary of headers to send.
:param files: dictionary of {filename: fileobject} files to multipart upload.
:param data: the body to attach to the request. If a dictionary or
list of tuples ``[(key, value)]`` is provided, form-encoding will
take place.
:param json: json for the body to attach to the request (if files or data is not specified).
:param params: URL parameters to append to the URL. If a dictionary or
list of tuples ``[(key, value)]`` is provided, form-encoding will
take place.
:param auth: Auth handler or (user, pass) tuple.
:param cookies: dictionary or CookieJar of cookies to attach to this request.
:param hooks: dictionary of callback hooks, for internal usage.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'https://httpbin.org/get')
>>> req.prepare()
Nc
C s |d kr g n|}|d kr g n|}|d kr,i n|}|d kr)rp )r= r? r? r@ __repr__ s zRequest.__repr__c C s< t }|j| j| j| j| j| j| j| j| j | j
| j d
|S )zXConstructs a :class:`PreparedRequest ` for transmission and returns it.)
rp r8 rP rX rG r0 rq rr rs rg ) PreparedRequestpreparerp r8 rP rX rG r0 rq rr rs rg )r= r> r? r? r@ rw s
zRequest.prepare)
NNNNNNNNNN)r^ r_ r` __doc__rt ru rw r? r? r? r@ rn s
rn c
@ s e Zd ZdZdd Zd ddZdd Zd d
Zd d Ze d
d Z
dd Z dd Z d ddZ
dd Zd ddZdd Zd d ZdS )!rv a The fully mutable :class:`PreparedRequest ` object,
containing the exact bytes that will be sent to the server.
Generated from either a :class:`Request ` object or manually.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'https://httpbin.org/get')
>>> r = req.prepare()
>>> s = requests.Session()
>>> s.send(r)
c C s0 d | _ d | _d | _d | _d | _t | _d | _d S )N)rp r8 rP _cookiesr\ r rg _body_position)r= r? r? r@ rt " s zPreparedRequest.__init__Nc C sR | j | | j|| | j| | j| | j|||
| j|| | j| dS )z6Prepares the entire request with the given parameters.N)prepare_method prepare_urlprepare_headersprepare_cookies prepare_body prepare_auth
prepare_hooks) r= rp r8 rP rX rG rq rr rs rg r0 r? r? r@ rw 3 s
zPreparedRequest.preparec C s
d| j S )Nz)rp )r= r? r? r@ ru E s zPreparedRequest.__repr__c C sX t }| j|_| j|_| jd k r*| jj nd |_t| j|_| j|_| j|_| j |_ |S )N)
rv rp r8 rP copyr ry r\ rg rz )r= r> r? r? r@ r H s zPreparedRequest.copyc C s$ || _ | j dk r t| j j | _ dS )z Prepares the given HTTP method.N)rp r upper)r= rp r? r? r@ r{ S s
z PreparedRequest.prepare_methodc C s@ dd l }y|j| ddjd} W n |jk
r: tY nX | S )Nr T)Zuts46zutf-8)idnarF rS Z IDNAError UnicodeError)hostr r? r? r@ _get_idna_encoded_hostY s
z&PreparedRequest._get_idna_encoded_hostc C s0 t |tr|jd}ntr"t|nt|}|j }d|krT|j jd rT|| _ dS yt
|\}}}}}}} W n, t k
r }
zt |
j
W Y dd}
~
X nX |sd} | jt|d} t| |st d| t|sy| j|}W n tk
r t dY nX n|jdrt d|p"d } | r2| d
7 } | |7 } |rP| dt| 7 } |sZd }trt |trv|jd }t | tr| jd } t |tr|jd }t |tr|jd }t | tr| jd } t |ttfrt|}| j|}
|
r|r
d
||
f }n|
}tt|| |d|| g}|| _ dS )z Prepares the given HTTP URL.utf8:ZhttpNzDInvalid URL {0!r}: No schema supplied. Perhaps you meant http://{0}?z Invalid URL %r: No host suppliedzURL has an invalid label.*r7 @r5 zutf-8z%s&%s)rD r+ rS r, Zunicoder* lstriplower
startswithr8 r r r argsformatr r r r r rF rK r r' )r= r8 rq schemerr r Zportr9 r; ZfragmenteerrorZnetlocZ
enc_paramsr? r? r@ r| c sh
zPreparedRequest.prepare_urlc C s@ t | _|rPrepare Content-Length header based on request method and bodyNzContent-LengthGETHEAD0)r r )r" r. rP rp get)r= r\ r r? r? r@ r s z&PreparedRequest.prepare_content_lengthr7 c C sj |dkr"t | j}t|r |nd}|rft|trDt|dkrDt| }|| }| jj|j | j | j
dS )z"Prepares the given HTTP auth data.NrL ) r r8 anyrD rT rV r
__dict__updater r\ )r= rr r8 Zurl_authrr? r? r@ r s
z PreparedRequest.prepare_authc C s@ t |tjr|| _n
t|| _t| j| }|dk r<|| jd< dS )a Prepares the given HTTP cookie data.
This function eventually generates a ``Cookie`` header from the
given cookies using cookielib. Due to cookielib's design, the header
will not be regenerated if it already exists, meaning this function
can only be called once for the life of the
:class:`PreparedRequest ` object. Any subsequent calls
to ``prepare_cookies`` will have no actual effect, unless the "Cookie"
header is removed beforehand.
NZCookie)rD r& Z CookieJarry r r rP )r= rs Z
cookie_headerr? r? r@ r~ , s
z PreparedRequest.prepare_cookiesc C s* |pg }x |D ]}| j ||| qW dS )zPrepares the given hooks.N)rk )r= rg ri r? r? r@ r @ s
z PreparedRequest.prepare_hooks)
NNNNNNNNNN)N)r7 )r^ r_ r` rx rt rw ru r r{ rb r r| r} r r r r~ r r? r? r? r@ rv s
V
E
rv c
@ s e Zd ZdZdddddddd d
d g
Zd d
Zdd Zdd Zdd Zdd Z dd Z
dd Z dd Z d d Z
ed d Zed d! Zed"d# Zed$d% Zed&d' Zd;d*d+Zed,d,fd-d.Zed/d0 Zed1d2 Zd3d4 Zed5d6 Zd7d8 Zd9d: Z d,S )<ResponsezhThe :class:`Response ` object, which contains a
server's response to an HTTP request.
_content status_coderP r8 historyencodingreasonrs elapsedrequestc C s^ d| _ d| _d | _d | _t | _d | _d | _d | _g | _ d | _
t i | _ t
jd| _d | _d S )NFr )r _content_consumed_nextr r rP rawr8 r r r r rs datetimeZ timedeltar r )r= r? r? r@ rt T s
zResponse.__init__c C s | S )Nr? )r= r? r? r@ __enter__ s zResponse.__enter__c G s | j d S )N)close)r= r r? r? r@ __exit__ s zResponse.__exit__c s j s j fdd jD S )Nc s i | ]}t |d |qS )N)r )rd attr)r= r? r@
s z)Response.__getstate__..)r content __attrs__)r= r? )r= r@ __getstate__ s zResponse.__getstate__c C s> x |j D ]\}}t| || q
W t| dd t| dd d S )Nr Tr )ro setattr)r= staterN r r? r? r@ __setstate__ s zResponse.__setstate__c C s
d| j S )Nz)r )r= r? r? r@ ru s zResponse.__repr__c C s | j S )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
)ok)r= r? r? r@ __bool__ s zResponse.__bool__c C s | j S )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
)r )r= r? r? r@ __nonzero__ s zResponse.__nonzero__c C s
| j dS )z,Allows you to use a response as an iterator. ) iter_content)r= r? r? r@ rC s zResponse.__iter__c C s& y | j W n tk
r dS X dS )ax Returns True if :attr:`status_code` is less than 400, False if not.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
FT)raise_for_statusr )r= r? r? r@ r s
z Response.okc C s d| j ko| jtkS )zTrue if this Response is a well-formed HTTP redirect that could have
been processed automatically (by :meth:`Session.resolve_redirects`).
location)rP r REDIRECT_STATI)r= r? r? r@ is_redirect s zResponse.is_redirectc C s d| j ko| jtjtjfkS )z@True if this Response one of the permanent versions of redirect.r )rP r r1 Zmoved_permanentlypermanent_redirect)r= r? r? r@ is_permanent_redirect s z Response.is_permanent_redirectc C s | j S )zTReturns a PreparedRequest for the next request in a redirect chain, if there is one.)r )r= r? r? r@ next s z
Response.nextc C s t j| jd S )z7The apparent encoding, provided by the chardet library.r )r- Zdetectr )r= r? r? r@ apparent_encoding s zResponse.apparent_encodingr
Fc s~ fdd}j r(tjtr(t n$ dk rLt t rLtdt tj }| }j rh|n|}|rzt |}|S )a Iterates over the response data. When stream=True is set on the
request, this avoids reading the content at once into memory for
large responses. The chunk size is the number of bytes it should
read into memory. This is not necessarily the length of each item
returned as decoding can take place.
chunk_size must be of type int or None. A value of None will
function differently depending on the value of `stream`.
stream=True will read data as it arrives in whatever size the
chunks are received. If stream=False, data is returned as
a single chunk.
If decode_unicode is True, content will be decoded using the best
available encoding based on the response.
c 3 s t jdry$x jj ddD ]
} | V q W W q tk
rZ } zt|W Y d d }~X q tk
r } zt|W Y d d }~X q tk
r } zt|W Y d d }~X qX n x jj } | sP | V qW d_
d S )NstreamT)Zdecode_content) rE r r r r r r r r rB r )chunkr )
chunk_sizer= r? r@ generate s
z'Response.iter_content..generateNz.chunk_size must be an int, it is instead a %s.)
r rD r boolr intr typer r )r= r decode_unicoder Z
reused_chunksZ
stream_chunksZchunksr? )r r= r@ r s
zResponse.iter_contentNc c s d}x| j ||dD ]r}|dk r(|| }|r8|j|}n|j }|rn|d rn|rn|d d |d krn|j }nd}x|D ]
}|V qxW qW |dk r|V dS )zIterates over the response data, one line at a time. When
stream=True is set on the request, this avoids reading the
content at once into memory for large responses.
.. note:: This method is not reentrant safe.
N)r r r
r r r )r split
splitlinespop)r= r r Z delimiterpendingr linesliner? r? r@
iter_lines s $
zResponse.iter_linesc C sV | j dkrJ| jrtd| jdks,| jdkr4d| _ ndj| jtpFd| _ d| _| j S )z"Content of the response, in bytes.Fz2The content for this response was already consumedr N T)r r RuntimeErrorr r r< r CONTENT_CHUNK_SIZE)r= r? r? r@ r / s
zResponse.contentc C sh d}| j }| jstdS | j dkr(| j}yt| j|dd}W n& ttfk
rb t| jdd}Y nX |S )a Content of the response, in unicode.
If Response.encoding is None, encoding will be guessed using
``chardet``.
The encoding of the response content is determined based solely on HTTP
headers, following RFC 2616 to the letter. If you can take advantage of
non-HTTP knowledge to make a better guess at the encoding, you should
set ``r.encoding`` appropriately before accessing this property.
Nr7 replace)errors)r r r* r LookupErrorr )r= r r r? r? r@ textC s
z
Response.textc K sj | j rZ| jrZt| jdkrZt| j}|dk rZytj| jj|f|S tk
rX Y nX tj| jf|S )zReturns the json-encoded content of a response, if any.
:param \*\*kwargs: Optional arguments that ``json.loads`` takes.
:raises ValueError: If the response body does not contain valid json.
rM N) r r rV r! r loadsrS UnicodeDecodeErrorr )r= kwargsr r? r? r@ r0 i s
z
Response.jsonc C sJ | j jd}i }|rFt|}x(|D ] }|jdp8|jd}|||< q"W |S )z8Returns the parsed header links of the response, if any.linkZrelr8 )rP r r )r= r llinksr keyr? r? r@ r s
zResponse.linksc C s d}t | jtrDy| jjd}W qJ tk
r@ | jjd}Y qJX n| j}d| j ko^dk n rxd| j|| jf }n,d| j kodk n rd| j|| jf }|rt|| d d
S ) z2Raises stored :class:`HTTPError`, if one occurred.r7 zutf-8z
iso-8859-1i i z %s Client Error: %s for url: %siX z %s Server Error: %s for url: %s)ZresponseN)rD r r+ rS r r r8 r )r= Zhttp_error_msgr r? r? r@ r s zResponse.raise_for_statusc C s0 | j s| jj t| jdd}|dk r,| dS )zReleases the connection back to the pool. Once this method has been
called the underlying ``raw`` object must not be accessed again.
*Note: Should not normally need to be called explicitly.*
release_connN)r r r r )r= r r? r? r@ r s
zResponse.close)r
F) r^ r_ r` rx r rt r r r r ru r r rC ra r r r r r r ITER_CHUNK_SIZEr r r r0 r r r r? r? r? r@ r J s2
/
7 & r i ( )Rrx r sysZencodings.idnaZ encodingsZurllib3.fieldsr Zurllib3.filepostr Z urllib3.utilr Zurllib3.exceptionsr r r r ior rg r Z
structuresr rr r
rs r r r
exceptionsr r r r r r r Z_internal_utilsr r Zutilsr r r r r r r r! r" r# compatr$ r% r& r' r( r) r* r+ r, r- r. r/ r0 r Z status_codesr1 ZmovedfoundotherZtemporary_redirectr r ZDEFAULT_REDIRECT_LIMITr r r r4 rc rn rv r r? r? r? r@ sB $08 rJ <