Any good practice at QA generations on rules and regulations of the company?

[jackqdldd]

I used this tool to generate QA tuples on rules and regulations of my company,It seems not smart!
The document consists of several parts: title, preface, catalog and chapters。
The questions like :
Q:What is the first chapter about?
Q:Which chapter is about salary?
-----No one wants to know about these，They will ask for specific details like 'What are the components of salary'

The questions also lack of summary,just ask from a separate paragraph.

Does anyone have experience in this area?

[MuhammadBilal848]

I think u can play with the prompt to make the answers better. Look at #70 & #71.

Also, when you are done creating the dataset using the tool you can fine-tune the model using unsloth, and with that you can use RAG Pipeline to extract information from the dataset or your main document.

You can close the issue if it answers your questions. also feel free to ask any here.

[jackqdldd]

Thanks! will try it later