Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feedback for “Indirect Reasoning with LLMs” #595

Open
Crestina2001 opened this issue Nov 7, 2024 · 0 comments
Open

Feedback for “Indirect Reasoning with LLMs” #595

Crestina2001 opened this issue Nov 7, 2024 · 0 comments

Comments

@Crestina2001
Copy link

It does not work in my task.

My task is to tell whether a 'hypothesis' is entailed in a 'premise' or not. My hypothesis is a triple [subject, predicate, obeject], while my premise is a long text. My prompt firstly asks the LLM to find the sentence relevant to the hypothesis, then shorten the sentence, finally use NOT hypothesis and NOT premise for reasoning.

But the issue is with the sentence shortening: LLM cannot shorten the sentence correctly: it may combine the hypothesis into it !!

Any ideas to deal with lengthy premises with a lot of irrelevant information?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant