Total sampling time = 16.467 sec Total execution time = 27.783 sec Max memory used by tensors = 4.57206784 GB
bnb, 4bit, nf4, use_double_bit (False/True) Total sampling time = 21.359 sec Total execution time = 24.352 sec Max memory used by tensors = 0.920607232 GB