Control DANDI Jobs and Threads

[garrettmflynn]

This PR allows users to control the number of jobs and threads when uploading to DANDI on the GUIDE.

May fix the segmentation fault issue we discovered during alpha tests.

[CodyCBakerPhD]

@garrettmflynn Is there a way to constrain the values of the IntRangeSlider to not include zero? Also to include in the description something about how -1 syntax uses all available processes, etc...

[garrettmflynn]

Not yet—but I will make a way. Users can also free-input any flat value, so I'll implement a way to automatically round those too.

[CodyCBakerPhD]

@garrettmflynn Yeah, that too - for setting maximum caps here is the Python snippet if you want to add a simple endpoint to grab that value from the system reliably

from psutil import cpu_count

max_number_of_jobs = cpu_count(logical=False)

[garrettmflynn]

Working on this now. Is there a similar way to bound threads?

[garrettmflynn]

Just pushed the proper workflow for jobs. Threads currently have no maximum

[CodyCBakerPhD]

Is there a similar way to bound threads?

Yessir,

number_of_threads = cpu_count(logical=True) / cpu_count(logical=False)

(which is really threads per job, not the grand total - but that's what DANDI would want specified anyhow)

[garrettmflynn]

Sweet updated. Should be ready for review now

[CodyCBakerPhD]

One minor update to a description and otherwise LGTM

[garrettmflynn]

Awesome. Glad we're getting this in

[CodyCBakerPhD]

@garrettmflynn One question on the effect of the new chromatic stories

[garrettmflynn]

Working locally now on Storybook