Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add C++ benchmark program #243

Merged
merged 15 commits into from
Apr 9, 2024
Merged

Add C++ benchmark program #243

merged 15 commits into from
Apr 9, 2024

Conversation

edgchen1
Copy link
Contributor

Add a C++ model benchmark program. It is modeled after the existing Python benchmark script (benchmark/python/benchmark_e2e.py).

The motivation for a C++ version is to be able to run without Python. This is useful for Android.

benchmark/c/main.cpp Outdated Show resolved Hide resolved
benchmark/c/main.cpp Show resolved Hide resolved
benchmark/c/main.cpp Outdated Show resolved Hide resolved
build.py Outdated Show resolved Hide resolved
src/ort_genai.h Outdated Show resolved Hide resolved
@edgchen1 edgchen1 marked this pull request as ready for review April 2, 2024 21:06
src/ort_genai.h Outdated Show resolved Hide resolved
test/c_api_tests.cpp Show resolved Hide resolved
@edgchen1 edgchen1 merged commit bc503fb into main Apr 9, 2024
11 checks passed
@edgchen1 edgchen1 deleted the edgchen1/cpp_benchmark branch April 9, 2024 21:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants