Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix warnings and errors on cpu benchmark #20967

Merged
merged 5 commits into from
Jun 13, 2024
Merged

Fix warnings and errors on cpu benchmark #20967

merged 5 commits into from
Jun 13, 2024

Conversation

hanbitmyths
Copy link
Contributor

@hanbitmyths hanbitmyths commented Jun 7, 2024

Several changes to remove warnings or errors on CPU benchmark and other benchmarks.

  • Phi-3 codes doesn't require auth token, but trust_remote_code flag. Add "--trust" to enable only trust_remote_code.
  • Phi3 models are not working with sdpa and needs to be run with eager mode.
  • Fix CPU io binding error with null device id and element_type mismatch.
  • use_buffer_share only when engine is ort.

@hanbitmyths hanbitmyths marked this pull request as ready for review June 10, 2024 23:45
@hanbitmyths hanbitmyths merged commit 846cac6 into main Jun 13, 2024
96 checks passed
@hanbitmyths hanbitmyths deleted the sunghcho/benchmark branch June 13, 2024 22:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants