Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve experiment scripts. #15

Open
achimnol opened this issue Jul 10, 2015 · 1 comment
Open

Improve experiment scripts. #15

achimnol opened this issue Jul 10, 2015 · 1 comment
Labels
enhancement persistent

Comments

@achimnol
Copy link
Member

All commits related to improvements of experiment scripts belong to this issue.
achimnol added a commit that referenced this issue Jul 10, 2015
@achimnol
refs #15: Fix subproc reclamation and implement auto-plotting in PPC …
04023bc 
…experiment scripts.

 * In Python, read() returns an empty string when it reaches EOF.
   The zombie process + infinite loop problem was due to missing this.

 * Automated PPC plotting using matplotlib.
   It can be reused for other types of load balancers as well.
achimnol added a commit that referenced this issue Jul 10, 2015
@achimnol
refs #15: Stop tracking temporary running script.
67db2d2
achimnol added a commit that referenced this issue Jul 13, 2015
@achimnol
refs #15: Re-architect exprlib and automate thruput plotting.
2d33bbf
@achimnol
Copy link
Member Author

Memo: we need to record the actual numbers when using automated plotting for later inspection.

achimnol added a commit that referenced this issue Jul 16, 2015
@achimnol
refs #15: Fix resseting the flag to check server status.
fe3e3f5
achimnol added a commit that referenced this issue Jul 18, 2015
@achimnol
refs #13, #15, #16: Use power-of-two number of worker threads for Mel…
64104b4 
…lanox cards

 * And use only the cores in the nodes that have available NICs.
achimnol added a commit that referenced this issue Aug 5, 2015
@achimnol
refs #15: More readable ppc plot.
94056a0
achimnol added a commit that referenced this issue Mar 19, 2016
@achimnol
refs #15: Use ZeroMQ to remove clutter.
999ec90 
 * No longer need to specify generator addresses.
   Just run them on any necessary hosts with a single address to
   the master (where NBA runs).
   PUB/SUB magic will do the rest.

 * Now requires Python 3.5 or higher.
   (We recommend to use pyenv and virtualenv to isolate Python
   installations from your base system.)

 * Adds requirements.txt that specifies Python dependencies.
   (You can run `pip install -r scripts/requirements.txt`)

 * TODO: Improve latency measurement.

   I'm planning to add built-in ZeroMQ support in pspgen executable
   so that it could pass the raw full latency histogram to the
   pspgen-server which will send the histogram again to the master.

   This will streamline future thruput/latency measurements, as they
   can be done at once without human intervention.
achimnol added a commit that referenced this issue Mar 20, 2016
@achimnol
refs #15: Use pandas to generalize data manipulation
f7f5ea4
achimnol added a commit that referenced this issue Mar 20, 2016
@achimnol
refs #15: Now save to pretty CSV files automatically.
00b5865
achimnol added a commit that referenced this issue Mar 20, 2016
@achimnol
refs #15: Implement ZeroMQ-based latency histogram recorder.
8f551ce 
 * It records latency histogram automagically.

 * TODO: auto-detect peer pktgen address.
         (currently hard-coded..)

 * TODO: auto-calculate CDF for easier plotting
achimnol added a commit that referenced this issue Mar 25, 2016
@achimnol
refs #15: Prevent division-by-zero error and wrong arg interpretation.
8c099b5
achimnol added a commit that referenced this issue Mar 25, 2016
@achimnol
refs #15: Refurbish run_throughput.py to run_app_perf.py
f7647f7 
 * With "-l" option, it automatically records latency CDF as CSV files
   that can be directly used in Excel to draw scatter-line plots.
achimnol added a commit that referenced this issue Mar 31, 2016
@achimnol
refs #15: Minor fix.
e4a8706
achimnol added a commit that referenced this issue Mar 31, 2016
@achimnol
refs #15: Some clean up and add a run-all script.
dcb350c
achimnol added a commit that referenced this issue Apr 7, 2016
@achimnol
refs #15: Minor fix.
48fff10
achimnol added a commit that referenced this issue Apr 7, 2016
@achimnol
refs #15: Add "hack" for IPsec latency measurements
15bc921
achimnol added a commit that referenced this issue Apr 7, 2016
@achimnol
refs #15: Add more automated experiment scripts and fix bugs.
c5bcdf4
achimnol added a commit that referenced this issue Apr 7, 2016
@achimnol
refs #15: Add auotmated branch prediction experiment script.
457dda7 
 * And found a segfault bug in NBA when using branch configs...
achimnol added a commit that referenced this issue Apr 19, 2016
@achimnol
refs #15: Clean up experiment scripts.
ec3b79a
achimnol added a commit that referenced this issue Apr 26, 2016
@achimnol
refs #15: Update ALB-related experiment scripts and configs.
5dcb1de
achimnol added a commit that referenced this issue Apr 27, 2016
@achimnol
refs #15: Cut the last seconds of thruput samples for ALB experiments.
aa3d0c2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement persistent
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@achimnol