Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build Backend Functionality for 'Add Spot Instance Render Job:Add a Job' #3

Open
robksawyer opened this issue May 21, 2015 · 0 comments

Comments

@robksawyer
Copy link
Owner

The following needs to happen in the backend for the Add Job function.

  1. Take submitted .blend file or .zip, check to see which was submitted
    • .blend: Zip the file up
    • .zip, .gz: Just pass the file along
  2. Create a Brenda configuration file that brenda-work will use.
  3. Run the brenda-work command and produce a Amazon SQS Queue that contains all of the frames in project. e.g. brenda-work -T ~/Brenda/frame -s 1 -e 50 push

    ~/Brenda/frame should be the local copy of frame located in lib/task-scripts/frame.
    Support subframe at a later date.

  4. After the frames have been processed and the queue has been established. Run the brenda-run -N 4 -p 0.07 spot command and create the spot instance requests.

    These currently take Amazon around ~5 minutes to approve. And it's worth noting that it could fail. This may be due to price or other issues.

  5. Show the status of the job.
  6. Send an email notification when the job has been approved and has started.
  7. Figure out how to stop the instances after the jobs have been completed.

I'm sure there's a lot more that needs to happen here, but this is all I could think of at the moment.

Note on implementation

  • It'd be nice to show the process live as it's happening via AJAX. I can visualize some kind of progress as things are processing.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant