Looking to work on this as an extension of weight streaming; do we have a specific format already for a weights file or is that something that needs to be decided?

List of items for basic proof of concept:

• Remove weights from .mxr files
• Save weights to separate file(s)
• Load in weights during runtime

Replaced current literals with a fetch_literals dummy instruction that contains no data. Greatly reduces .mxr size, although still need to investigate why read of the model fails.

Added the ability to write and save weights in the strip_weights pass. Need to figure out how to pass output location to the pass (remove hard-coded location).

Fixed issue with writing weights and added test that successfully reads weights from file and adds weight back to MXR file

• Might look into taking the extra pass out of target.cpp and moving things into write_literals. This way instead of adding the literal first and then removing it, just add the dummy instruction in there and save the weights to the file if want to strip_weights. This would make it so no time is added during compilation and don't have to do MIGRAPHX_COPY_LITERALS{}

• Also could put in a check to see if weight file is already available for model compiling, and then don't write weights again for new compiled MXR file.

Finished above, going to look into different quantization options.