Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Heap overflow with 300 request/min #248

Open
blakebyrnes opened this issue Jan 29, 2024 · 0 comments
Open

Heap overflow with 300 request/min #248

blakebyrnes opened this issue Jan 29, 2024 · 0 comments

Comments

@blakebyrnes
Copy link
Contributor

From discord:

Running into some heap overflow errors when trying to deploy ulixee cloud, it's saying it hit the 2079mb limit
Has anyone had this experience? I'm running around 20-35 concurrent heros, but doing around 300 resource requests per min
Seems to work fine for 20 minutes but then crashes consistently. The overflow message mentions sqlite3

Hey @blakeb ! I've done some heap analysis, and it seems that some data is being retained even after hero.close()
The set up I'm using is loading a web page, running ~150 fetches and then closing the session. The killer part is that the fetches are graphql so they're HUGE request size and response size. In the screenshots shown the heap reached 1700mb after cycling through quite a lot of Heros. At least 600mb of that heap is made of strings (graphql query body)
Happy to share an implementation example or any more details
image
image
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant