Implement cURL for many small files and compatibility #261
Replies: 2 comments
-
Sounds good, I'll have a look at implementing it. It's worth noting that Aria2 is only used for downloading models, not for updating tags, metadata or previews. |
Beta Was this translation helpful? Give feedback.
-
After looking around, there isn't a huge speed improvement to be gained from just switching to The performance of HTTP requests, whether made with The wait time you're experiencing mostly comes from waiting for a response from the CivitAI API. Besides, downloading a lot of preview images is usually something you'll have to do only once for all the models that were not downloaded with this extension. Last note, the speed for updating just the tags and metadata should already be really quick, for me updating 240 tags and metadata took only a few seconds Considering all of this, I won't be implementing |
Beta Was this translation helpful? Give feedback.
-
aria2 might be good for downloading larger files or larger archives of multiple files.
But it is horribly slow when it comes to downloading lots of images for previews and smaller requests.
Link to feature comparison table
cURL is also present in every OS by default and does not require additional binaries to run.
I have been holding back on even updating any of my model tags, metadata and previews just cause of how slow it is.
Just finished images. took 15 minutes. 250/250Mbit/s
Beta Was this translation helpful? Give feedback.
All reactions