Skip to content

Latest commit

 

History

History
862 lines (452 loc) · 46.2 KB

README.md

File metadata and controls

862 lines (452 loc) · 46.2 KB
Raw

Question-Generation-Paper-List

A summary of must-read papers for Neural Question Generation (NQG)

Please follow this link to view papers in chronological order.

Content

1. Survey
2. Models
 2.1 Basic Seq2Seq Models  2.2 Encoding Answers
 2.3 Linguistic Features  2.4 Question-specific Rewards
 2.5 Content Selection  2.6 Question Type Modeling
 2.7 Encode wider contexts  2.8 QG with pretraining
 2.9 Other Directions
2. Applications
 2.1 Difficulty Controllable QG  2.2 Conversational QG
 2.3 Asking Deep Questions  2.4 Combining QA and QG
 2.5 QG from knowledge graphs  2.6 Visual Question Generation
 2.7 Distractor Generation  2.8 Cross-lingual QG
 2.9 Clarification Question Generation
3. Evaluation
4. Resources

Survey papers

  1. Recent Advances in Neural Question Generation. arxiv, 2019. paper

    Liangming Pan, Wenqiang Lei, Tat-Seng Chua, Min-Yen Kan

  2. A Systematic Review of Automatic Question Generation for Educational Purposes. International Journal of Artificial Intelligence in Education, 2020. paper

    Ghader Kurdi, Jared Leo, Bijan Parsia, Uli Sattler, Salam Al-Emari

  3. A Review on Question Generation from Natural Language Text. ACM Transactions on Information Systems, Volume 40, Issue 1, 2022. paper

    Ruqing Zhang, Jiafeng Guo, Lu Chen, Yixing Fan, Xueqi Cheng

Models

Basic Seq2Seq Models

Basic Seq2Seq models with attention to generate questions.

  1. Learning to ask: Neural question generation for reading comprehension. ACL, 2017. paper

    Xinya Du, Junru Shao, Claire Cardie.

  2. Neural question generation from text: A preliminary study. NLPCC, 2017. paper

    Qingyu Zhou, Nan Yang, Furu Wei, Chuanqi Tan, Hangbo Bao, Ming Zhou.

  3. Machine comprehension by text-to-text neural question generation. Rep4NLP@ACL, 2017. paper

    Xingdi Yuan, Tong Wang, Çaglar Gülçehre, Alessandro Sordoni, Philip Bachman, Saizheng Zhang, Sandeep Subramanian, Adam Trischler

Encoding Answers

Applying various techniques to encode the answer information thus allowing for better quality answer-focused questions.

  1. Answer-focused and Position-aware Neural Question Generation. EMNLP, 2018. paper

    Xingwu Sun, Jing Liu, Yajuan Lyu, Wei He, Yanjun Ma, Shi Wang

  2. Improving Neural Question Generation Using Answer Separation. AAAI, 2019. paper code

    Yanghoon Kim, Hwanhee Lee, Joongbo Shin, Kyomin Jung.

  3. Improving Question Generation with Sentence-level Semantic Matching and Answer Position Inferring. AAAI, 2020. paper

    Xiyao Ma, Qile Zhu, Yanlin Zhou, Xiaolin Li, Dapeng Wu

  4. Answer-driven Deep Question Generation based on Reinforcement Learning. COLING, 2020. paper

    Liuyin Wang, Zihan Xu, Zibo Lin, Hai-Tao Zheng, Ying Shen

Linguistic Features

Improve QG by incorporating various linguistic features into the QG process.

  1. Neural Generation of Diverse Questions using Answer Focus, Contextual and Linguistic Features. INLG, 2018. paper

    Vrindavan Harrison, Marilyn Walker

  2. Automatic Question Generation using Relative Pronouns and Adverbs. ACL, 2018. paper

    Payal Khullar, Konigari Rachna, Mukul Hase, Manish Shrivastava

  3. Learning to Generate Questions by Learning What not to Generate. WWW, 2019. paper code

    Bang Liu, Mingjun Zhao, Di Niu, Kunfeng Lai, Yancheng He, Haojie Wei, Yu Xu.

  4. Improving Neural Question Generation using World Knowledge. arXiv, 2019. paper

    Deepak Gupta, Kaheer Suleman, Mahmoud Adada, Andrew McNamara, Justin Harris

  5. Syn-QG: Syntactic and Shallow Semantic Rules for Question Generation. ACL, 2020. paper

    Kaustubh D. Dhole, Christopher D. Manning

  6. Automatically Generating Cause-and-Effect Questions from Passages. EACL Workshop, 2021. paper codes

    Katherine Stasaski, Manav Rathod, Tony Tu, Yunfang Xiao, Marti A. Hearst

  7. Asking It All: Generating Contextualized Questions for any Semantic Role. EMNLP, 2021. paper codes

    Valentina Pyatkin, Paul Roit, Julian Michael, Yoav Goldberg, Reut Tsarfaty and Ido Dagan

Question-specific Rewards

Improving the training via combining supervised and reinforcement learning to maximize question-specific rewards

  1. Teaching Machines to Ask Questions. IJCAI, 2018. paper

    Kaichun Yao, Libo Zhang, Tiejian Luo, Lili Tao, Yanjun Wu

  2. Natural Question Generation with Reinforcement Learning Based Graph-to-Sequence Model NeurIPS Workshop, 2019. paper

    Yu Chen, Lingfei Wu, Mohammed J. Zaki

  3. Putting the Horse Before the Cart:A Generator-Evaluator Framework for Question Generation from Text CoNLL, 2019. paper

    Vishwajeet Kumar, Ganesh Ramakrishnan, Yuan-Fang Li

  4. Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering EMNLP, 2019. paper code

    Shiyue Zhang, Mohit Bansal

  5. Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation ICLR, 2020. paper codes

    Yu Chen, Lingfei Wu, Mohammed J. Zaki

  6. Exploring Question-Specific Rewards for Generating Deep Questions. COLING, 2020. paper codes

    Yuxi Xie, Liangming Pan, Dongzhe Wang, Min-Yen Kan, Yansong Feng

  7. Answer-driven Deep Question Generation based on Reinforcement Learning. COLING, 2020. paper

    Liuyin Wang, Zihan Xu, Zibo Lin, Hai-Tao Zheng, Ying Shen

  8. Cooperative Learning of Zero-Shot Machine Reading Comprehension. arXiv, 2021. paper

    Hongyin Luo, Shang-Wen Li, Seunghak Yu, James Glass

  9. Contrastive Multi-document Question Generation. EACL, 2021. paper codes

    Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan

  10. Generating Self-Contained and Summary-Centric Question Answer Pairs via Differentiable Reward Imitation Learning. EMNLP, 2021. paper codes

    Li Zhou, Kevin Small, Yong Zhang and Sandeep Atluri

Content Selection

Improve QG by considering how to select question-worthy contents (content selection) before asking a question.

  1. Identifying Where to Focus in Reading Comprehension for Neural Question Generation. EMNLP, 2017. paper

    Xinya Du, Claire Cardie

  2. Neural Models for Key Phrase Extraction and Question Generation. ACL Workshop, 2018. paper

    Sandeep Subramanian, Tong Wang, Xingdi Yuan, Saizheng Zhang, Adam Trischler, Yoshua Bengio

  3. A Comparative Study on Question-Worthy Sentence Selection Strategies for Educational Question Generation. AIED, 2019. paper

    Guanliang Chen, Jie Yang, Dragan Gasevic

  4. Learning to Generate Questions by Learning What not to Generate. WWW, 2019. paper code

    Bang Liu, Mingjun Zhao, Di Niu, Kunfeng Lai, Yancheng He, Haojie Wei, Yu Xu.

  5. Improving Question Generation With to the Point Context. EMNLP, 2019. paper

    Jingjing Li, Yifan Gao, Lidong Bing, Irwin King, Michael R. Lyu.

  6. Weak Supervision Enhanced Generative Network for Question Generation. IJCAI, 2019. paper

    Yutong Wang, Jiyuan Zheng, Qijiong Liu, Zhou Zhao, Jun Xiao, Yueting Zhuang

  7. A Multi-Agent Communication Framework for Question-Worthy Phrase Extraction and Question Generation. AAAI, 2019. paper

    Siyuan Wang, Zhongyu Wei, Zhihao Fan, Yang Liu, Xuanjing Huang

  8. Self-Attention Architectures for Answer-Agnostic Neural Question Generation. ACL, 2019. paper

    Thomas Scialom, Benjamin Piwowarski, Jacopo Staiano.

  9. Mixture Content Selection for Diverse Sequence Generation. EMNLP, 2019. paper code

    Jaemin Cho, Minjoon Seo, Hannaneh Hajishirzi

  10. Asking Questions the Human Way: Scalable Question-Answer Generation from Text Corpus. WWW, 2020. paper

    Bang Liu, Haojie Wei, Di Niu, Haolan Chen, Yancheng He

Question Type Modeling

Improve QG by explicitly modeling question types or interrogative words.

  1. Question Generation for Question Answering. EMNLP,2017. paper

    Nan Duan, Duyu Tang, Peng Chen, Ming Zhou

  2. Answer-focused and Position-aware Neural Question Generation. EMNLP, 2018. paper

    Xingwu Sun, Jing Liu, Yajuan Lyu, Wei He, Yanjun Ma, Shi Wang

  3. Let Me Know What to Ask: Interrogative-Word-Aware Question Generation EMNLP Workshop, 2019. paper

    Junmo Kang, Haritz Puerto San Roman, Sung-Hyon Myaeng

  4. Question-type Driven Question Generation EMNLP, 2019. paper

    Wenjie Zhou, Minghua Zhang, Yunfang Wu

  5. Expanding, Retrieving and Infilling: Diversifying Cross-Domain Question Generation with Flexible Templates. EACL, 2021. paper codes

    Xiaojing Yu, Anxiao Jiang

Encode Wider Contexts

Improve QG by incorporating wider contexts in the input passage.

  1. Harvesting paragraph-level question-answer pairs from wikipedia. ACL, 2018. paper code&dataset

    Xinya Du, Claire Cardie

  2. Leveraging Context Information for Natural Question Generation ACL, 2018. paper code

    Linfeng Song, Zhiguo Wang, Wael Hamza, Yue Zhang, Daniel Gildea

  3. Paragraph-level Neural Question Generation with Maxout Pointer and Gated Self-attention Networks. EMNLP, 2018. paper

    Yao Zhao, Xiaochuan Ni, Yuanyuan Ding, Qifa Ke

  4. Capturing Greater Context for Question Generation AAAI, 2020. paper

    Luu Anh Tuan, Darsh J Shah, Regina Barzilay

  5. How to Ask Good Questions? Try to Leverage Paraphrases ACL, 2020. paper

    Xin Jia, Wenjie Zhou, Xu SUN, Yunfang Wu

  6. PathQG: Neural Question Generation from Facts EMNLP, 2020. paper code

    Siyuan Wang, Zhongyu Wei, Zhihao Fan, Zengfeng Huang, Weijian Sun, Qi Zhang, Xuanjing Huang

  7. AnswerQuest: A System for Generating Question-Answer Items from Multi-Paragraph Documents. EACL Demo, 2021. paper codes

    Melissa Roemmele, Deep Sidhpura, Steve DeNeefe, Ling Tsou

  8. OneStop QAMaker: Extract Question-Answer Pairs from Text in a One-Stop Approach. arXiv, 2021. paper

    Shaobo Cui, Xintong Bao, Xinxing Zu, Yangyang Guo, Zhongzhou Zhao, Ji Zhang, Haiqing Chen

  9. ASQ: Automatically Generating Question-Answer Pairs using AMRs. arXiv, 2021. paper

    Geetanjali Rakshit, Jeffrey Flanigan

  10. Zero-shot Fact Verification by Claim Generation. ACL, 2021. paper codes

    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang

  11. Iterative GNN-based Decoder for Question Generation. EMNLP, 2021. paper

    Zichu Fei, Qi Zhang and Yaqian Zhou

QG with pretraining

Improve QG ultilizing NLP pretraining models.

  1. Unified Language Model Pre-training for Natural Language Understanding and Generation. NeurIPS, 2019. paper code

    Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon

  2. A Recurrent BERT-based Model for Question Generation. MRQA Workshop, 2019. paper

    Ying-Hong Chan, Yao-Chung Fan

  3. CopyBERT: A Unified Approach to Question Generation with Self-Attention. ACL Workshop, 2020. paper code

    Stalin Varanasi, Saadullah Amin, Guenter Neumann

  4. QURIOUS: Question Generation Pretraining for Text Generation. arXiv, 2020. paper

    Shashi Narayan, Gonçalo Simoes, Ji Ma, Hannah Craighead, Ryan Mcdonald

  5. UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. arXiv, 2020. paper code

    Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Songhao Piao, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon

Other Directions

  1. Generating Question-Answer Hierarchies. ACL, 2019. paper code

    Kalpesh Krishna and Mohit Iyyer.

  2. Can You Unpack That? Learning to Rewrite Questions-in-Context. EMNLP, 2019. paper

    Ahmed Elgohary, Denis Peskov, Jordan L. Boyd-Graber

  3. Sequential Copying Networks. AAAI, 2018. paper

    Qingyu Zhou, Nan Yang, Furu Wei, Ming Zhou

  4. Let's Ask Again: Refine Network for Automatic Question Generation. EMNLP, 2019. paper

    Preksha Nema, Akash Kumar Mohankumar, Mitesh M. Khapra, Balaji Vasan Srinivasan, Balaraman Ravindran

Applications

Difficulty Controllable QG

Endowing the model with the ability to control the difficulty of the generated questions.

  1. Easy-to-Hard: Leveraging Simple Questions for Complex Question Generation. arxiv, 2019. paper

    Jie Zhao, Xiang Deng, Huan Sun.

  2. Difficulty Controllable Generation of Reading Comprehension Questions. IJCAI, 2019. paper

    Yifan Gao, Lidong Bing, Wang Chen, Michael R. Lyu, Irwin King

  3. Difficulty-controllable Multi-hop Question Generation From Knowledge Graphs. ISWC, 2019. paper code&dataset

    Vishwajeet Kumar, Yuncheng Hua, Ganesh Ramakrishnan, Guilin Qi, Lianli Gao, Yuan-Fang Li

  4. Guiding the Growth: Difficulty-Controllable Question Generation through Step-by-Step Rewriting. ACL, 2021. paper codes

    Yi Cheng, Siyao Li, Bang Liu, Ruihui Zhao, Sujian Li, Chenghua Lin, Yefeng Zheng

  5. Question Generation for Adaptive Education. ACL, 2021. paper codes

    Megha Srivastava, Noah Goodman

Conversational QG

Learning to generate a series of coherent questions grounded in a question answering style conversation.

  1. Learning to Ask Questions in Open-domain Conversational Systems with Typed Decoders. ACL, 2018. paper code dataset

    Yansen Wang, Chenyi Liu, Minlie Huang, Liqiang Nie

  2. Answerer in Questioner's Mind: Information Theoretic Approach to Goal-Oriented Visual Dialog. NIPS, 2018. paper

    Sang-Woo Lee, Yu-Jung Heo, Byoung-Tak Zhang

  3. Interconnected Question Generation with Coreference Alignment and Conversation Flow Modeling. ACL, 2019. paper code

    Yifan Gao, Piji Li, Irwin King, Michael R. Lyu

  4. Reinforced Dynamic Reasoning for Conversational Question Generation. ACL, 2019. paper code dataset

    Boyuan Pan, Hao Li, Ziyu Yao, Deng Cai, Huan Sun

  5. Towards Answer-unaware Conversational Question Generation. ACL Workshop, 2019. paper

    Mao Nakanishi, Tetsunori Kobayashi, Yoshihiko Hayashi

  6. What Should I Ask? Using Conversationally Informative Rewards for Goal-oriented Visual Dialog. ACL, 2019. paper

    Pushkar Shukla, Carlos Elmadjian, Richika Sharan, Vivek Kulkarni, Matthew Turk, William Yang Wang

  7. Visual Dialogue State Tracking for Question Generation. AAAI, 2020. paper

    Wei Pang, Xiaojie Wang

  8. Interactive Classification by Asking Informative Questions. ACL, 2020. paper

    Lili Yu, Howard Chen, Sida Wang, Tao Lei, Yoav Artzi

  9. Learning to Ask More: Semi-Autoregressive Sequential Question Generation under Dual-Graph Interaction. ACL, 2020. paper dataset

    Zi Chai, Xiaojun Wan

  10. Stay Hungry, Stay Focused: Generating Informative and Specific Questions in Information-Seeking Conversations. EMNLP, 2020. paper codes

    Peng Qi, Yuhao Zhang, Christopher D. Manning

  11. ChainCQG: Flow-Aware Conversational Question Generation. EACL, 2021. paper codes

    Jing Gu, Mostafa Mirshekari, Zhou Yu, Aaron Sisto

  12. GTM: A Generative Triple-wise Model for Conversational Question Generation. ACL, 2021. paper

    Lei Shen, Fandong Meng, Jinchao Zhang, Yang Feng, Jie Zhou

  13. Learning to Ask Conversational Questions by Optimizing Levenshtein Distance. ACL, 2021. paper codes

    Zhongkun Liu, Pengjie Ren, Zhumin Chen, Zhaochun Ren, Maarten de Rijke, Ming Zhou

Asking Deep Questions

This direction focuses on exploring how to ask deep questions that require high cognitive levels, such as multi-hop reasoning questions, mathematical questions, open-ended questions, and non-factoid questions.

  1. Automatic Opinion Question Generation. ICNLG, 2018. paper

    Yllias Chali, Tina Baghaee

  2. A Multi-language Platform for Generating Algebraic Mathematical Word Problems. arxiv, 2019. paper

    Vijini Liyanage, Surangika Ranathunga

  3. Asking the Crowd: Question Analysis, Evaluation and Generation for Open Discussion on Online Forums. ACL, 2019. paper

    Zi Chai, Xinyu Xing, Xiaojun Wan, Bo Huang

  4. Learning to Ask Unanswerable Questions for Machine Reading Comprehension. ACL, 2019. paper

    Haichao Zhu, Li Dong, Furu Wei, Wenhui Wang, Bing Qin, Ting Liu

  5. Distant Supervised Why-Question Generation with Passage Self-Matching Attention. IJCNN, 2019. paper

    Jiaxin Hu, Zhixu Li, Renshou Wu, Hongling Wang, An Liu, Jiajie Xu, Pengpeng Zhao, Lei Zhao

  6. Conclusion-Supplement Answer Generation for Non-Factoid Questions. AAAI, 2020. paper

    Makoto Nakatsuji, Sohei Okui

  7. Generating Multi-hop Reasoning Questions to Improve Machine Reading Comprehension. WWW, 2020. paper

    Jianxing Yu, Xiaojun Quan, Qinliang Su, Jian Yin

  8. Low-Resource Generation of Multi-hop Reasoning Questions. ACL, 2020. paper

    Jianxing Yu, Wei Liu, Shuang Qiu, Qinliang Su, Kai Wang, Xiaojun Quan, Jian Yin

  9. Semantic Graphs for Generating Deep Questions. ACL, 2020. paper code

    Liangming Pan, Yuxi Xie, Yansong Feng, Tat-Seng Chua, Min-Yen Kan

  10. Review-based Question Generation with Adaptive Instance Transfer and Augmentation. ACL, 2020. paper

    Qian Yu, Lidong Bing, Qiong Zhang, Wai Lam, Luo Si

  11. Inquisitive Question Generation for High Level Text Comprehension. EMNLP, 2020. paper dataset

    Wei-Jen Ko, Te-Yuan Chen, Yiyan Huang, Greg Durrett, Junyi Jessy Li

  12. Stronger Transformers for Neural Multi-Hop Question Generation. ArXiv, 2020. paper

    Devendra Singh Sachan, Lingfei Wu, Mrinmaya Sachan, William Hamilton

  13. Mathematical Word Problem Generation from Commonsense Knowledge Graph and Equations. ArXiv, 2020. paper

    Tianqiao Liu, Qian Fang, Wenbiao Ding, Zhongqin Wu, Zitao Liu

  14. Reinforced Multi-task Approach for Multi-hop Question Generation. COLING, 2020. paper

    Deepak Gupta, Hardik Chauhan, Akella Ravi Tej, Asif Ekbal, Pushpak Bhattacharyya

  15. Exploring Question-Specific Rewards for Generating Deep Questions. COLING, 2020. paper codes

    Yuxi Xie, Liangming Pan, Dongzhe Wang, Min-Yen Kan, Yansong Feng

  16. Ask to Learn: A Study on Curiosity-driven Question Generation. COLING, 2020. paper codes

    Thomas Scialom, Jacopo Staiano

  17. EQG-RACE: Examination-Type Question Generation. AAAI, 2021. paper

    Xin Jia, Wenjie Zhou, Xu Sun, Yunfang Wu

  18. CliniQG4QA: Generating Diverse Questions for Domain Adaptation of Clinical Question Answering. NeurIPS Workshop, 2021. paper codes

    Xiang Yue, Xinliang Frederick Zhang, Ziyu Yao, Simon Lin, Huan Sun

  19. Quiz-Style Question Generation for News Stories. WWW, 2021. paper codes

    Adam D. Lelkes, Vinh Q. Tran, Cong Yu

  20. Back-Training excels Self-Training at Unsupervised Domain Adaptation of Question Generation and Passage Retrieval. arXiv, 2021. paper

    Devang Kulshreshtha, Robert Belfer, Iulian Vlad Serban, Siva Reddy

  21. Contrastive Multi-document Question Generation. EACL, 2021. paper codes

    Woon Sang Cho, Yizhe Zhang, Sudha Rao, Asli Celikyilmaz, Chenyan Xiong, Jianfeng Gao, Mengdi Wang, Bill Dolan

  22. Controllable Open-ended Question Generation with A New Question Type Ontology. ACL, 2021. paper codes

    Shuyang Cao, Lu Wang

Combining QA and QG

This direction investigate how to combine the task of QA and QG by multi-task learning or joint training.

  1. Question Generation for Question Answering. EMNLP,2017. paper

    Nan Duan, Duyu Tang, Peng Chen, Ming Zhou

  2. Learning to Collaborate for Question Answering and Asking. NAACL, 2018. paper

    Duyu Tang, Nan Duan, Zhao Yan, Zhirui Zhang, Yibo Sun, Shujie Liu, Yuanhua Lv, Ming Zhou

  3. Generating Highly Relevant Questions. EMNLP, 2019. paper

    Jiazuo Qiu, Deyi Xiong

  4. Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds. arxiv, 2019. paper

    Tassilo Klein, Moin Nabi

  5. Triple-Joint Modeling for Question Generation Using Cross-Task Autoencoder. NLPCC, 2019. paper

    Hongling Wang, Renshou Wu, Zhixu Li, Zhongqing Wang, Zhigang Chen, Guodong Zhou

  6. Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering EMNLP, 2019. paper code

    Shiyue Zhang, Mohit Bansal

  7. Synthetic QA Corpora Generation with Roundtrip Consistency ACL, 2019. paper

    Chris Alberti, Daniel Andor, Emily Pitler, Jacob Devlin, Michael Collins

  8. Unsupervised Question Answering by Cloze Translation ACL, 2019. paper

    Patrick Lewis, Ludovic Denoyer, Sebastian Riedel

  9. Generating Multi-hop Reasoning Questions to Improve Machine Reading Comprehension. WWW, 2020. paper

    Jianxing Yu, Xiaojun Quan, Qinliang Su, Jian Yin

  10. Template-Based Question Generation from Retrieved Sentences for Improved Unsupervised Question Answering. ACL, 2020. paper

    Alexander R. Fabbri, Patrick Ng, Zhiguo Wang, Ramesh Nallapati, Bing Xiang

  11. On the Importance of Diversity in Question Generation for QA. ACL, 2020. paper

    Md Arafat Sultan, Shubham Chandel, Ramón Fernandez Astudillo, Vittorio Castelli

  12. End-to-End Synthetic Data Generation for Domain Adaptation of Question Answering Systems. EMNLP, 2020. paper

    Siamak Shakeri, Cicero Nogueira dos Santos, Henry Zhu, Patrick Ng, Feng Nan, Zhiguo Wang, Ramesh Nallapati, Bing Xiang

  13. Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space. EMNLP, 2020. paper

    Dayiheng Liu, Yeyun Gong, Jie Fu, Yu Yan, Jiusheng Chen, Jiancheng Lv, Nan Duan, Ming Zhou

  14. Training Question Answering Models From Synthetic Data. EMNLP, 2020. paper

    Raul Puri, Ryan Spring, Mostofa Patwary, Mohammad Shoeybi, Bryan Catanzaro

  15. Unsupervised Multi-hop Question Answering by Question Generation. NAACL, 2021. paper

    Liangming Pan, Wenhu Chen, Wenhan Xiong, Min-Yen Kan, William Yang Wang

  16. Data-QuestEval: A Referenceless Metric for Data to Text Semantic Evaluation. arXiv, 2021. paper

    Clément Rebuffel, Thomas Scialom, Laure Soulier, Benjamin Piwowarski, Sylvain Lamprier, Jacopo Staiano, Geoffrey Scoutheeten, Patrick Gallinari

  17. Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering EMNLP, 2021. paper

    Or Honovich, Leshem Choshen, Roee Aharoni, Ella Neeman, Idan Szpektor, Omri Abend

  18. Improving Question Answering Model Robustness with Synthetic Adversarial Data Generation arXiv, 2021. paper

    Max Bartolo, Tristan Thrush, Robin Jia, Sebastian Riedel, Pontus Stenetorp, Douwe Kiela

  19. Cooperative Learning of Zero-Shot Machine Reading Comprehension. arXiv, 2021. paper

    Hongyin Luo, Shang-Wen Li, Seunghak Yu, James Glass

  20. Progressively Pretrained Dense Corpus Index for Open-Domain Question Answering. EACL, 2021. paper codes

    Wenhan Xiong, Hong Wang, William Yang Wang

  21. Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models. NAACL, 2021. paper codes

    Tushar Khot, Daniel Khashabi, Kyle Richardson, Peter Clark, Ashish Sabharwal

  22. Improving Unsupervised Question Answering via Summarization-Informed Question Generation. EMNLP, 2021. paper

    Chenyang Lyu, Lifeng Shang, Yvette Graham, Jennifer Foster, Xin Jiang, Qun Liu

QG from knowledge graphs

This direction is about generating questions from a knowledge graph.

  1. Generating Factoid Questions With Recurrent Neural Networks: The 30M Factoid Question-Answer Corpus. ACL, 2016. paper dataset

    Iulian Vlad Serban, Alberto García-Durán, Çaglar Gülçehre, Sungjin Ahn, Sarath Chandar, Aaron C. Courville, Yoshua Bengio

  2. Generating Natural Language Question-Answer Pairs from a Knowledge Graph Using a RNN Based Question Generation Model. ACL, 2017. paper

    Mitesh M. Khapra, Dinesh Raghu, Sachindra Joshi, Sathish Reddy

  3. Knowledge Questions from Knowledge Graphs. ICTIR, 2017. paper

    Dominic Seyler, Mohamed Yahya, Klaus Berberich.

  4. Zero-Shot Question Generation from Knowledge Graphs for Unseen Predicates and Entity Types. NAACL, 2018. paper code

    Hady Elsahar, Christophe Gravier, Frederique Laforest.

  5. A Neural Question Generation System Based on Knowledge Base NLPCC, 2018. paper

    Hao Wang, Xiaodong Zhang, Houfeng Wang

  6. Formal Query Generation for Question Answering over Knowledge Bases. ESWC, 2018. paper

    Hamid Zafar, Giulio Napolitano, Jens Lehmann

  7. Generating Questions for Knowledge Bases via Incorporating Diversified Contexts and Answer-Aware Loss. EMNLP, 2019. paper

    Cao Liu, Kang Liu, Shizhu He, Zaiqing Nie, Jun Zhao

  8. Difficulty-controllable Multi-hop Question Generation From Knowledge Graphs. ISWC, 2019. paper code&dataset

    Vishwajeet Kumar, Yuncheng Hua, Ganesh Ramakrishnan, Guilin Qi, Lianli Gao, Yuan-Fang Li

  9. How Question Generation Can Help Question Answering over Knowledge Base. NLPCC, 2019. paper

    Sen Hu, Lei Zou, Zhanxing Zhu

  10. Toward Subgraph Guided Knowledge Graph Question Generation with Graph Neural Networks. arXiv, 2020. paper

    Yu Chen, Lingfei Wu, Mohammed J. Zaki

  11. Generating Semantically Valid Adversarial Questions for TableQA. arXiv, 2020. paper

    Yi Zhu, Menglin Xia, Yiwei Zhou

  12. Knowledge-enriched, Type-constrained and Grammar-guided Question Generation over Knowledge Bases. COLING, 2020. paper

    Sheng Bi, Xiya Cheng, Yuan-Fang Li, Yongzhen Wang, Guilin Qi

Visual Question Generation

Asking questions based on visual inputs (usually an image).

  1. Generating Natural Questions About an Image ACL, 2016. paper

    Nasrin Mostafazadeh, Ishan Misra, Jacob Devlin, Margaret Mitchell, Xiaodong He, Lucy Vanderwende

  2. Creativity: Generating Diverse Questions Using Variational Autoencoders CVPR,2017. paper

    Unnat Jain, Ziyu Zhang, Alexander G. Schwing

  3. Automatic Generation of Grounded Visual Questions IJCAI, 2017. paper

    Shijie Zhang, Lizhen Qu, Shaodi You, Zhenglu Yang, Jiawan Zhang

  4. A Reinforcement Learning Framework for Natural Question Generation using Bi-discriminators COLING, 2018. paper

    Zhihao Fan, Zhongyu Wei, Siyuan Wang, Yang Liu, Xuanjing Huang

  5. Customized Image Narrative Generation via Interactive Visual Question Generation and Answering CVPR, 2018. paper

    Andrew Shin, Yoshitaka Ushiku, Tatsuya Harada

  6. Multimodal Differential Network for Visual Question Generation EMNLP, 2018. paper

    Badri Narayana Patro, Sandeep Kumar, Vinod Kumar Kurmi, Vinay P. Namboodiri

  7. A Question Type Driven Framework to Diversify Visual Question Generation IJCAI, 2018. paper

    Zhihao Fan, Zhongyu Wei, Piji Li, Yanyan Lan, Xuanjing Huang

  8. Visual Question Generation as Dual Task of Visual Question Answering. CVPR, 2018. paper

    Yikang Li, Nan Duan, Bolei Zhou, Xiao Chu, Wanli Ouyang, Xiaogang Wang, Ming Zhou

  9. Two can play this Game: Visual Dialog with Discriminative Question Generation and Answering. CVPR, 2018. paper

    Unnat Jain, Svetlana Lazebnik, Alexander Schwing

  10. Information Maximizing Visual Question Generation. CVPR, 2019. paper

    Ranjay Krishna, Michael Bernstein, Li Fei-Fei

  11. What Should I Ask? Using Conversationally Informative Rewards for Goal-oriented Visual Dialog. ACL, 2019. paper

    Pushkar Shukla, Carlos Elmadjian, Richika Sharan, Vivek Kulkarni, Matthew Turk, William Yang Wang

Distractor Generation

Learning to generate distractors for multi-choice questions.

  1. Generating Questions and Multiple-Choice Answers using Semantic Analysis of Texts. COLING, 2016. paper

    Jun Araki, Dheeraj Rajagopal, Sreecharan Sankaranarayanan, Susan Holm, Yukari Yamakawa, Teruko Mitamura

  2. Distractor Generation for Multiple Choice Questions Using Learning to Rank. NAACL Workshop, 2018. paper code

    Chen Liang, Xiao Yang, Neisarg Dave, Drew Wham, Bart Pursel, C. Lee Giles

  3. Generating Distractors for Reading Comprehension Questions from Real Examinations. AAAI, 2019. paper

    Yifan Gao, Lidong Bing, Piji Li, Irwin King, Michael R. Lyu

  4. Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions. AAAI, 2021. paper

    Siyu Ren, Kenny Q. Zhu

Cross-lingual QG

Building cross-lingual models to generate questions in low-resource languages.

  1. Cross-Lingual Training for Automatic Question Generation. ACL, 2019. paper dataset

    Vishwajeet Kumar, Nitish Joshi, Arijit Mukherjee, Ganesh Ramakrishnan, Preethi Jyothi

  2. Cross-Lingual Natural Language Generation via Pre-Training. AAAI, 2020. paper

    Zewen Chi, Li Dong, Furu Wei, Wenhui Wang, Xian-Ling Mao, Heyan Huang

  3. Quinductor: a multilingual data-driven method for generating reading-comprehension questions using Universal Dependencies. arXiv, 2021. paper codes

    Dmytro Kalpakchi, Johan Boye

Clarification Question Generation

Learning to ask clarification questions to better understand user intents in conversation, recommendation system, or search engine.

  1. Are You Asking the Right Questions? Teaching Machines to Ask Clarification Questions. ACL Workshop, 2017. paper

    Sudha Rao

  2. Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Information. ACL, 2018. paper code

    Sudha Rao, Hal Daumé III

  3. Interpretation of Natural Language Rules in Conversational Machine Reading. EMNLP, 2018. paper dataset

    Marzieh Saeidi, Max Bartolo, Patrick Lewis, Sameer Singh, Tim Rocktäschel, Mike Sheldon, Guillaume Bouchard, Sebastian Riedel

  4. Answer-based Adversarial Training for Generating Clarification Questions. NAACL, 2019. paper code

    Rao S, Daumé III H.

  5. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations. SIGIR, 2019. paper dataset

    Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, W. Bruce Croft

  6. Asking Clarification Questions in Knowledge-Based Question Answering. EMNLP, 2019. paper dataset

    Jingjing Xu, Yuechen Wang, Duyu Tang, Nan Duan, Pengcheng Yang, Qi Zeng, Ming Zhou, Xu Sun

  7. ClarQ: A large-scale and diverse dataset for Clarification Question Generation. ACL, 2020. paper dataset

    Vaibhav Kumar, Alan W. black.

  8. Interactive Classification by Asking Informative Questions. ACL, 2020. paper

    Lili Yu, Howard Chen, Sida Wang, Tao Lei, Yoav Artzi

  9. Towards Question-based Recommender Systems. SIGIR, 2020. paper

    Jie Zou, Yifan Chen, Evangelos Kanoulas

  10. Generating Clarifying Questions for Information Retrieval. WWW, 2020. paper

    Hamed Zamani, Susan T. Dumais, Nick Craswell, Paul N. Bennett, and Gord Lueck

  11. Diverse and Specific Clarification Question Generation with Keywords WWW, 2021. paper codes

    Zhiling Zhang, Kenny Q. Zhu

  12. Data Augmentation with Hierarchical SQL-to-Question Generation for Cross-domain Text-to-SQL Parsing EMNLP, 2021. paper

    Ao Zhang, Kun Wu, Lijie Wang, Zhenghua Li, Xinyan Xiao, Hua Wu, Min Zhang, Haifeng Wang

  13. Learning to Ask Appropriate Questions in Conversational Recommendation SIGIR, 2021. paper codes

    Xuhui Ren, Hongzhi Yin, Tong Chen, Hao Wang, Zi Huang, Kai Zheng

  14. Ask whats missing and whats useful: Improving Clarification Question Generation using Global Knowledge. NAACL, 2021. paper codes

    Bodhisattwa Prasad Majumder, Sudha Rao, Michel Galley, Julian McAuley

Evaluation

This direction investigates the mechanism behind question asking, and how to evaluate the quality of generated questions.

  1. Question Asking as Program Generation. NeurIPS, 2017. paper

    Anselm Rothe, Brenden M. Lake, Todd M. Gureckis.

  2. Towards a Better Metric for Evaluating Question Generation Systems. EMNLP, 2018. paper

    Preksha Nema, Mitesh M. Khapra.

  3. Evaluating Rewards for Question Generation Models. NAACL, 2019. paper

    Tom Hosking and Sebastian Riedel.

Resources

QG-specific datasets and toolkits.

  1. LearningQ: A Large-Scale Dataset for Educational Question Generation. ICWSM, 2018. paper

    Guanliang Chen, Jie Yang, Claudia Hauff, Geert-Jan Houben.

  2. ParaQG: A System for Generating Questions and Answers from Paragraphs. EMNLP Demo, 2019. paper

    Vishwajeet Kumar, Sivaanandh Muneeswaran, Ganesh Ramakrishnan, Yuan-Fang Li.

  3. How to Ask Better Questions? A Large-Scale Multi-Domain Dataset for Rewriting Ill-Formed Questions. AAAI, 2020. paper code

    Zewei Chu, Mingda Chen, Jing Chen, Miaosen Wang, Kevin Gimpel, Manaal Faruqui, Xiance Si.

  4. ClarQ: A large-scale and diverse dataset for Clarification Question Generation. ACL, 2020. paper dataset

    Vaibhav Kumar, Alan W. black.

  5. [Toolkit] Question Generation using transformers . github link

    Suraj Patil

  6. Inquisitive Question Generation for High Level Text Comprehension. EMNLP, 2020. paper dataset

    Wei-Jen Ko, Te-Yuan Chen, Yiyan Huang, Greg Durrett, Junyi Jessy Li

  7. Quiz-Style Question Generation for News Stories. WWW, 2021. paper codes

    Adam D. Lelkes, Vinh Q. Tran, Cong Yu

  8. Back-Training excels Self-Training at Unsupervised Domain Adaptation of Question Generation and Passage Retrieval. EMNLP, 2021. paper

    Devang Kulshreshtha, Robert Belfer, Iulian Vlad Serban, Siva Reddy

  9. Automatically Generating Cause-and-Effect Questions from Passages. EACL Workshop, 2021. paper codes

    Katherine Stasaski, Manav Rathod, Tony Tu, Yunfang Xiao, Marti A. Hearst