Improve INC CI test torch version

[changwangss]

What does this PR do?

INC and INC IPEX are currently maintaining torch 2.4 and 2.5 but the CI have torch 2.2 and 2.3, which caused errors.

Fixes # (issue)

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[changwangss]

All INC CI passed, Could you please take a look about the IPEX issue? @jiqing-feng
If you fix it in another PR, please let me and @AlexKoff88 know.

[jiqing-feng]

The error brings by #975

[IlyasMoutawwakil]

when was the backward compatibility broken ? is there a table somewhere that we can link to for users to downgrade inc for torch>2.3 ? can you please also add torch>=2.4 in inc extra to reflect this constraint.

[jiqing-feng]

when was the backward compatibility broken ? is there a table somewhere that we can link to for users to downgrade inc for torch>2.3 ?

Hi Llyas, I think you can just ignore the failed tests in IPEX because we are refactoring the IPEXModel, in our new architecture, all ipex tests passed. So you can just review #1009

[IlyasMoutawwakil]

The error brings by #975

the pr you're mentioning only robustified the CI to make sure we're testing specific torch/ipex versions. no ipex modeling files were changed.

[jiqing-feng]

The error brings by #975

the pr you're mentioning only robustified the CI to make sure we're testing specific torch/ipex versions. no ipex modeling files were changed.

I see, there are some errors when upgrading torch to 2.4 in the current IPEXModel, but we are all fixed in #1009

[IlyasMoutawwakil]

okay ! let's add the version pinning in #1009

[jiqing-feng]

okay ! let's add the version pinning in #1009

And please merge this PR, it's just for upgrading torch version of INC CI