Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory problems with django management command #7

Open
deanmalmgren opened this issue Jan 29, 2015 · 1 comment
Open

Memory problems with django management command #7

deanmalmgren opened this issue Jan 29, 2015 · 1 comment

Comments

@deanmalmgren
Copy link
Owner

Try profiling the django management command against a plain Python script to see if the latter is a lighter option

@deanmalmgren
Copy link
Owner Author

There really has to be a better way to handle this than having a bajillion cron jobs that each follow a train down the tracks. That just won't be scalable beyond one route. Using a queuing system like rq seems like a decent option, where each worker could just ping the API at a particular stop and then add another task to the queue at a particular 'time to live' (ttl) in the future. Celery is obviously an option here too.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant