You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I propose integrating a quantization field into the AIR schema to enhance its applicability beyond just stable diffusion models, extending its use to general AI applications. While quantization is not commonly associated with stable diffusion, incorporating quantized models can yield more unified naming schema.
Rationale:
Quantization methods vary widely, and when developing tools for inferencing, it is crucial to identify the file type directly. This approach avoids the need to parse the string for quantization details after determining the file type, streamlining the process.
Example:
GGML's SD inference demonstrates that quantization does not significantly degrade quality, especially considering the performance gains.
Proposed Regex Update:
To accommodate this change, I suggest updating our regex pattern as follows:
The proposed regex update introduces a new format that is not recognized by the original regex pattern. This discrepancy could lead to compatibility issues where systems using the old regex pattern are unable to parse identifiers that include the new quantization field.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Proposal for Adding Quantization to AIR
I propose integrating a
quantization
field into the AIR schema to enhance its applicability beyond just stable diffusion models, extending its use to general AI applications. While quantization is not commonly associated with stable diffusion, incorporating quantized models can yield more unified naming schema.Rationale:
Quantization methods vary widely, and when developing tools for inferencing, it is crucial to identify the file type directly. This approach avoids the need to parse the string for quantization details after determining the file type, streamlining the process.
Example:
GGML's SD inference demonstrates that quantization does not significantly degrade quality, especially considering the performance gains.
Proposed Regex Update:
To accommodate this change, I suggest updating our regex pattern as follows:
Grouped
NonGrouped
Potential Issue:
The proposed regex update introduces a new format that is not recognized by the original regex pattern. This discrepancy could lead to compatibility issues where systems using the old regex pattern are unable to parse identifiers that include the new
quantization
field.Beta Was this translation helpful? Give feedback.
All reactions