Yankai Lin
 

Assistant Professor
Gaoling School of Artificial Intelligence,
Renmin University of China

Email: mrlyk423 [at] gmail.com
Add: Floor 11, China Technology Trading Mansion Parking Lot, 38 Haidian St, Haidian District, Beijing

Research Interests: Natural Language Processing

Education and Experience | Publications | Talks

Teaching

Students

Graduates

Publications

[Google Scholar]

Journal and Conference Papers

    (*: equal contribution)

    2023

  1. Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, Ruobing Xie, Fanchao Qi, Zhiyuan Liu, Maosong Sun and Jie Zhou. Interactive Web Search for Chinese Long-form Question Answering. The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)
  2. Chaojun Xiao, Zhengyan Zhang, Xu Han, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Xiangyang Li, Zhonghua Li, Zhao Cao and Maosong Sun. Plug-and-Play Document Modules for Pre-trained Models. The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)
  3. Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Huadong Wang, Deming Ye, Chaojun Xiao, Xu Han, Zhiyuan Liu, Peng Li, Maosong Sun and Jie Zhou. Plug-and-Play Knowledge Injection for Pre-trained Language Models. The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)
  4. Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Chaojun Xiao, Xiaozhi Wang, Xu Han, Zhiyuan Liu, Ruobing Xie, Maosong Sun and Jie Zhou. Emergent Modularity in Pre-trained Transformers. Findings of ACL 2023
  5. Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun and Jie Zhou. Recyclable Tuning for Continual Pre-training. Findings of ACL 2023
  6. Weize Chen, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun and Jie Zhou. Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning. Findings of ACL 2023
  7. Xin Cheng, Yankai Lin, Xiuying Chen, Dongyan Zhao and Rui Yan. PlugLM: Language Modeling with Plug-in Knowledge Memory. Findings of ACL 2023

    8. 2022

  8. Lan Jiang, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Rui Jiang. ROSE: Robust Selective Fine-tuning for Pre-trained Language Models. The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)
  9. Xiaozhi Wang, Yulin Chen, Ning Ding, Hao Peng, Zimu Wang, Yankai Lin, Xu Han, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou. MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction. The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)
  10. Yujia Qin, Cheng Qian, Jing Yi, Weize Chen, Yankai Lin, Xu Han, Zhiyuan Liu, Maosong Sun, Jie Zhou. Exploring Mode Connectivity for Pre-trained Language Models. The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)
  11. Jing Yi, Weize Chen, Yujia Qin, Yankai Lin, Ning Ding, Xu Han, Zhiyuan Liu, Maosong Sun, Jie Zhou. Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Parameter-Efficient Tuning. Findings of EMNLP 2022
  12. Zichun Yu, Tianyu Gao, Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Maosong Sun, Jie Zhou. Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models the 29th International Conference on Computational Linguistics (COLING 2022)
  13. Deli Chen, Yankai Lin, Lei Li, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun. Rethinking the Promotion Brought by Contrastive Learning to Semi-supervised Node Classification. The 31st International Joint Conference on Artificial Intelligence (IJCAI-22)
  14. Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou. Knowledge Inheritance for Pre-trained Language Models. The 2022 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022)
  15. Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou. On Transferability of Prompt Tuning for Natural Language Processing. The 2022 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022)
  16. Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou. Fully Hyperbolic Neural Networks. The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)
  17. Deming Ye, Yankai Lin, Peng Li, Maosong Sun. Packed Levitated Marker for Entity and Relation Extraction. The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)
  18. Pei Ke, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Xiaoyan Zhu, Minlie Huang. CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation. The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)
  19. Deming Ye, Yankai Lin, Peng Li, Maosong Sun, Zhiyuan Liu. A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models. The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)
  20. Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou. MoEfication: Conditional Computation of Transformer Models for Efficient Inference. Findings of ACL 2022
  21. Yujia Qin, Jiajie Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou. ELLE: Efficient Lifelong Pre-training for Emerging Data. Findings of ACL 2022.
  22. Xin Lv, Yankai Lin, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou. Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach. Findings of ACL 2022
  23. Lan Jiang, Tianshu Lyu, Yankai Lin, Meng Chong, Xiaoyong Lyu, Dawei Yin. On Length Divergence Bias in Textual Matching Models. Findings of ACL 2022

    24. 2021

  24. Deli Chen, Yankai Lin , Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun. Topology-Imbalance Learning for Semi-Supervised Node Classification. Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021)
  25. Wenkai Yang, Yankai Lin , Peng Li, Jie Zhou and Xu Sun. RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models. The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)
  26. Yuan Yao, Jiaju Du, Yankai Lin , Peng Li, Zhiyuan Liu, Jie Zhou and Maosong Sun. CodRED: A Cross-Document Relation Extraction Dataset for Acquiring Knowledge in the Wild. The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)
  27. Lei Li, Yankai Lin , Shuhuai Ren, Peng Li, Jie Zhou and Xu Sun. Dynamic Knowledge Distillation for Pre-trained Language Models. The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)
  28. Lei Li, Yankai Lin , Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou and Xu Sun. CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade. Findings of EMNLP 2021
  29. Jifan Yu, Yuquan Wang, Qingyang Zhong, Gan Luo, Yiming Mao, Kai Sun, Wenzheng Feng, Wei Xu, Shulin Cao, Kaisheng Zeng, Zijun Yao, Lei Hou, Yankai Lin , Peng Li, Jie Zhou, Bin Xu, Juanzi Li, Jie Tang and Maosong Sun. MOOCCubeX: A Large Knowledge-centered Repository for Adaptive Learning in MOOCs. 30th ACM International Conference on Information and Knowledge Management (CIKM 2021)
  30. Yusheng Su, Xu Han, Zhengyan Zhang, Peng Li, Zhiyuan Liu, Yankai Lin, Jie Zhou, Maosong Sun. CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models. AI Open, 2021. [pdf]
  31. Wenkai Yang, Yankai Lin , Peng Li, Jie Zhou and Xu Sun. Rethinking Stealthiness of Backdoor Attack against NLP Models. The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021). [pdf]
  32. Tianyu Gao, Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyu Xie, Yankai Lin , Zhiyuan Liu, Peng Li, Maosong Sun and Jie Zhou. Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction. Findings of ACL 2021. [pdf]
  33. Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun and Jie Zhou. ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning. The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021). [pdf]
  34. Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li and Jie Zhou. CLEVE: Contrastive Pre-training for Event Extraction. The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021). [pdf]
  35. Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun. TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference. 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT 2021) [pdf]
  36. Huimin Chen, Yankai Lin, Fanchao Qi, Jinyi Hu, Peng Li, Jie Zhou, Maosong Sun. Aspect-Level Sentiment-Controllable Review Generation with Mutual Learning Framework. Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021) [pdf]
  37. Qiu Ran, Yankai Lin, Peng Li, Jie Zhou. Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information. Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021) [pdf]

    38. 2020

  38. Deming Ye, Yankai Lin, Jiaju Du, Zhenghao Liu, Peng Li, Maosong Sun and Zhiyuan Liu. Coreferential Reasoning Learning for Language Representation. The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020). [pdf] [codes]
  39. Hao Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun and Jie Zhou. Learning from Context or Names? An Empirical Study on Neural Relation Extraction. The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020). [pdf] [codes]
  40. Xiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang, Rong Han, Zhiyuan Liu, Juanzi Li, Peng Li, Yankai Lin and Jie Zhou. MAVEN: A Massive General Domain Event Detection Dataset. The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020). [pdf] [codes]
  41. Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li, Jie Zhou and Yan Zhang. Disentangle-based Continual Graph Representation Learning. The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020). [pdf] [codes]
  42. Xu Han, Tianyu Gao, Yankai Lin, Hao Peng, Yaoliang Yang, Chaojun Xiao, Zhiyuan Liu, Peng Li, Jie Zhou and Maosong Sun. More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction. The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 9th International Joint Conference on Natural Language Processing (AACL-IJCNLP 2020). [pdf]
  43. Qiu Ran*, Yankai Lin*, Peng Li*, Jie Zhou. Learning to Recover from Errors for Non-Autoregressive Neural Machine Translation. The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020). [pdf] [codes]
  44. Xu Han, Yi Dai, Tianyu Gao, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou. Continual Relation Learning via Episodic Memory Activation and Reconsolidation. The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020).[pdf] [codes]
  45. Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, Xu Sun. Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View. The 34th AAAI Conference on Artificial Intelligence (AAAI 2020). [pdf]

    46. 2019

  46. Qiu Ran*, Yankai Lin*, Peng Li, Jie Zhou. NumNet: machine reading comprehension with numerical reasoning. The Conference on Empirical Methods in Natural Language Processing (EMNLP 2019) [pdf] [codes]
  47. Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun. DocRED: A Large-Scale Document-Level Relation Extraction Dataset. The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019). [pdf] [codes]
  48. Hao Zhu, Yankai Lin, Zhiyuan Liu, Jie Fu, Tat-Seng Chua, Maosong Sun. Graph Neural Networks with Generated Parameters for Relation Extraction. The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019). [pdf] [codes]
  49. Shun Zheng, Xu Han, Yankai Lin, Peilin Yu, Lu Chen, Ling Huang, Zhiyuan Liu, Wei Xu. DIAG-NRE: A Neural Pattern Diagnosis Framework for Distantly Supervised Neural Relation Extraction. The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019). [pdf] [codes]
  50. Jiahua Liu*, Yankai Lin*, Zhiyuan Liu, Maosong Sun. XQA: A Cross-lingual Open-domain Question Answering Dataset. The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019). [pdf] [codes]
  51. Zihao Fu, Yankai Lin, Zhiyuan Liu, Wai Lam. Fact Discovery from Knowledge Base via Facet Decomposition. The 2019 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2019). [pdf][codes]

    52. 2018

  52. Fanchao Qi*, Yankai Lin*, Maosong Sun, Hao Zhu, Ruobing Xie, Zhiyuan Liu. Cross-lingual Lexical Sememe Prediction. The Conference on Empirical Methods in Natural Language Processing (EMNLP 2018). Long paper. [pdf][codes]
  53. Xiaozhi Wang, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun. Adversarial Multi-lingual Neural Relation Extraction. The 27th International Conference on Computational Linguistics (COLING 2018). [pdf][codes]
  54. Yankai Lin, Haozhe Ji, Zhiyuan Liu, Maosong Sun. Denoising Distantly Supervised Open-Domain Question Answering. The 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018). [pdf][codes]
  55. Ji Xin, Yankai Lin, Zhiyuan Liu, Maosong Sun. Improving Neural Fine-Grained Entity Typing with Knowledge Attention. The 32th AAAI Conference on Artificial Intelligence (AAAI 2018). [pdf][codes]

    56. 2017

  56. Wenyuan Zeng, Yankai Lin, Zhiyuan Liu, Maosong Sun. Incorporating Relation Paths in Neural Relation Extraction. The Conference on Empirical Methods in Natural Language Processing (EMNLP 2017). [pdf][codes]
  57. Ayana, Shiqi Shen, Yankai Lin, Cunchao Tu, Yu Zhao, Zhiyuan Liu, Maosong Sun. Recent Advances on Neural Headline Generation. Journal of Computer Science and Technology (JCST 2017).[pdf].
  58. Yankai Lin, Zhiyuan Liu, Maosong Sun. Neural Relation Extraction with Multi-lingual Attention. The 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017). [pdf][codes]

    59. 2016

  59. Stefan Heinrich, Cornelius Weber, Stefan Wermter, Ruobing Xie, Yankai Lin, Zhiyuan Liu. Crossmodal language grounding, learning, and teaching. The 30th Conference on Neural Information Processing Systems (CoCo@NIPS'16). Workshop. [pdf]
  60. Huimin Chen, Maosong Sun, Cunchao Tu, Yankai Lin and Zhiyuan Liu. Neural Sentiment Classification with User and Product Attention. The Conference on Empirical Methods in Natural Language Processing (EMNLP 2016) . [pdf] [codes]
  61. Yankai Lin, Shiqi Shen, Zhiyuan Liu, Maosong Sun. Neural Relation Extraction with Selective Attention over Instances. The 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016). [pdf][codes]
  62. Yankai Lin, Zhiyuan Liu, Maosong Sun. Knowledge Representation Learning with Entities, Attributes and Relations. International Joint Conference on Artificial Intelligence (IJCAI 2016). [pdf][codes]
  63. Zhiyuan Liu, Maosong Sun, Yankai Lin, Ruobing Xie. Knowledge Representation Learning: A Review. Journal of Computer Research and Development, 2016. (In Chinese) [pdf]

    64. 2015

  64. Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, Song Liu. Modeling Relation Paths for Representation Learning of Knowledge Bases. The Conference on Empirical Methods in Natural Language Processing (EMNLP 2015). Long paper. [pdf][codes]
  65. Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, Xuan Zhu. Learning Entity and Relation Embeddings for Knowledge Graph Completion. Long paper. The 29th AAAI Conference on Artificial Intelligence (AAAI 2015). [pdf][codes]

Education and Experience