Buffering

First Milestone:

First milestone report file: MilestoneReport1.pdf

Final Report:

Final report file: Final-Report-Buffering.pdf

Presentation file: ML SYS Presentation.pptx

Data:

Data folder contains log files

Result folder contains 2 types:

• Python Notebook script
• Excel sheet

Reference code from

https://github.com/anyscale/llm-continuous-batching-benchmarks