Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge wc_reference_data_2024.4.yaml and wc_reference_data.yaml #2997

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

alexsu52
Copy link
Contributor

@alexsu52 alexsu52 commented Sep 30, 2024

Changes

Merge wc_reference_data_2024.4.yaml and wc_reference_data.yaml

Reason for changes

Simplify maintenance due to the migration to OV 2024.4

Related tickets

N/A

Tests

post_training_weight_compression/198/

@alexsu52 alexsu52 requested a review from a team as a code owner September 30, 2024 12:21
@github-actions github-actions bot added the NNCF PTQ Pull requests that updates NNCF PTQ label Sep 30, 2024
@alexsu52 alexsu52 requested a review from l-bat October 1, 2024 08:52
num_int4: 94
num_int8: 124
metrics_xfail_reason: "Issue-148819"
tinyllama_scale_estimation_per_channel_backend_OV:
metric_value: 0.80873
metric_value: 0.80853
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't it be marked by xfail, since 197 build failed with 0.80873 reference?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In agreement with @l-bat, I updated the metrics. @l-bat, please, confirm that the result is reproducible on different hardware.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test has become unstable on openvino-nightly again (details at ticket: 152627)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NNCF PTQ Pull requests that updates NNCF PTQ
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants