Behold, the power of aiohttp client with Requests simplicity:
import asyncio
import aiohttp
from aiohttp_requests import requests
async def main():
response = await requests.get('https://api.github.com', auth=aiohttp.BasicAuth('user', 'password'))
text = await response.text()
json = await response.json()
return response, text, json
r, text, json = asyncio.run(main())
>>> r
<ClientResponse(https://api.github.com/) [200 OK]>
>>> r.status
200
>>> r.headers['Content-Type']
'application/json; charset=utf-8'
>>> r.get_encoding()
'utf-8'
>>> text
'{"current_user_url":"https://api.github.com/user",...'
>>> json
{'current_user_url': 'https://api.github.com/user', ... }
Plus built-in concurrency control to do multiple requests safely:
async def main():
# Pass in a list of urls instead of just one. Optionally pass in as_iterator=True to iterate the responses.
responses = await requests.get(['https://api.github.com'] * 2, auth=aiohttp.BasicAuth('user', 'password'))
print(responses) # [<ClientResponse(https://...) [200 OK]>, , <ClientResponse(https://...) [200 OK]>]
# It defaults to 10 concurrent requests maximum. If you can handle more, then set it higher:
requests.max_concurrency = 100
asyncio.run(main())
The requests object is just proxying get and other HTTP verb methods to aiohttp.ClientSession, which returns aiohttp.ClientResponse. To do anything else, read the aiohttp doc.
PyPI Package: https://pypi.python.org/pypi/aiohttp-requests
GitHub Source: https://github.com/maxzheng/aiohttp-requests
Report Issues/Bugs: https://github.com/maxzheng/aiohttp-requests/issues
Connect: https://www.linkedin.com/in/maxzheng
Contact: maxzheng.os @t gmail.com