Running locally?

[merlin9632]

What all do I need to know to run this locally on my own machine? I am using the AUTOMATIC1111 webui and was able to generate the spectrograms with seemingly no issue, but when I use a third party website to covert them to audio, it just sounds like buzzing or static basically. What am I missing?

[hmartiro]

If you want to convert spectograms to audio, check out the code in the Colab or gradio demos - it's pretty straightforward. If you want to use the interactive web app, you'll need to follow the instructions in this README and run the web app and inference server.

[merlin9632]

Thank you! Amazing work you two did!

[FXJunkie]

Hello, would it be possible to point us to a resource, online video or some sort of detailed step-by-step tutorial that describes how to install the necessary backend to run the web app and inference servers locally? I have Automatic1111 installed on several of my local machines and would love to try the plugin to generate something that can be listened to with it.

Also, for people who don't have video cards capable of the "40 steps under 5 seconds" requirements for real-time generation, what happens? does it keep looping the same audio segment until more audio is generated? (I have an RTX 3070 with 8 Gigs of GPU, probably not enough).

Lastly, what are the requirements for the web and inference servers be run on Google Colab Pro? I have a Colab Pro account and generally get T4 instances (although I can also get a P100 if needed at several times the cost in compute units), I tried running the notebook but I got errors "AttributeError: module 'PIL.Image' has no attribute 'Resampling'"
Not sure if it's because I need to have a path specified where the models are located in my GDrive, which is what I see most of notebooks requiring? Anyway, thanks in advance for any hints.

Your web site's interface is obviously very nice, but the inability to change the tempo beyond the fixed 94 BPM you have it set to makes it somewhat difficult to get very creative with after the initial buzz of discovering how cool it all is.