教育经历

2014-2019 清华大学计算机科学与技术系 博士

2010-2014 清华大学计算机科学与技术系 本科

工作经历

2024.09-至今 中国人民大学预聘副教授

2022.09-2024.08 中国人民大学预聘助理教授

2019.07-2022.08 腾讯微信模式识别中心 高级研究员

研究方向

预训练模型

自然语言处理

学生要求

具备较强的自主驱动能力,致力于开展具有较高创新性的研究工作,而非追求快速发表论文。

教授课程

本科生课程:《知识表示与学习》

研究生课程:《知识表示与推理》《预训练模型》

科研项目

国自然面上项目《基于大规模预训练模型的工具学习研究》

学术论文

2023

PlugLM: Language Modeling with Plug-in Knowledge Memory.

Xin Cheng, Yankai Lin, Xiuying Chen, Dongyan Zhao and Rui Yan.

Findings of ACL 2023



Stochastic Bridges as Effective Regularizers for Parameter-Efficient Tuning.

Weize Chen, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun and Jie Zhou.

Findings of ACL 2023



Recyclable Tuning for Continual Pre-training.

Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun and Jie Zhou.

Findings of ACL 2023



Emergent Modularity in Pre-trained Transformers.

Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Chaojun Xiao, Xiaozhi Wang, Xu Han, Zhiyuan Liu, Ruobing Xie, Maosong Sun and Jie Zhou.

Findings of ACL 2023



Plug-and-Play Knowledge Injection for Pre-trained Language Models.

Zhengyan Zhang, Zhiyuan Zeng, Yankai Lin, Huadong Wang, Deming Ye, Chaojun Xiao, Xu Han, Zhiyuan Liu, Peng Li, Maosong Sun and Jie Zhou.

The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)



Plug-and-Play Document Modules for Pre-trained Models.

Chaojun Xiao, Zhengyan Zhang, Xu Han, Chi-Min Chan, Yankai Lin, Zhiyuan Liu, Xiangyang Li, Zhonghua Li, Zhao Cao and Maosong Sun.

The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)



Interactive Web Search for Chinese Long-form Question Answering

Yujia Qin, Zihan Cai, Dian Jin, Lan Yan, Shihao Liang, Kunlun Zhu, Yankai Lin, Xu Han, Ning Ding, Huadong Wang, Ruobing Xie, Fanchao Qi, Zhiyuan Liu, Maosong Sun and Jie Zhou

The 61th Annual Meeting of the Association for Computational Linguistics (ACL 2023)


2022

On Length Divergence Bias in Textual Matching Models.

Lan Jiang, Tianshu Lyu, Yankai Lin, Meng Chong, Xiaoyong Lyu, Dawei Yin.

Findings of ACL 2022



Do Pre-trained Models Benefit Knowledge Graph Completion? A Reliable Evaluation and a Reasonable Approach.

Xin Lv, Yankai Lin, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou.

Findings of ACL 2022



ELLE: Efficient Lifelong Pre-training for Emerging Data.

Yujia Qin, Jiajie Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.

Findings of ACL 2022.



MoEfication: Conditional Computation of Transformer Models for Efficient Inference.

Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.

Findings of ACL 2022



A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models.

Deming Ye, Yankai Lin, Peng Li, Maosong Sun, Zhiyuan Liu.

The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)



CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation.

Pei Ke, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Xiaoyan Zhu, Minlie Huang.

The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)



Packed Levitated Marker for Entity and Relation Extraction.

Deming Ye, Yankai Lin, Peng Li, Maosong Sun.

The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)



Fully Hyperbolic Neural Networks.

Weize Chen, Xu Han, Yankai Lin, Hexu Zhao, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.

The 60th Annual Meeting of the Association for Computational Linguistics (ACL 2022)



On Transferability of Prompt Tuning for Natural Language Processing.

Yusheng Su, Xiaozhi Wang, Yujia Qin, Chi-Min Chan, Yankai Lin, Huadong Wang, Kaiyue Wen, Zhiyuan Liu, Peng Li, Juanzi Li, Lei Hou, Maosong Sun, Jie Zhou.

The 2022 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022)



Knowledge Inheritance for Pre-trained Language Models.

Yujia Qin, Yankai Lin, Jing Yi, Jiajie Zhang, Xu Han, Zhengyan Zhang, Yusheng Su, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou.

The 2022 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2022)



Rethinking the Promotion Brought by Contrastive Learning to Semi-supervised Node Classification.

Deli Chen, Yankai Lin, Lei Li, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun.

The 31st International Joint Conference on Artificial Intelligence (IJCAI-22)



Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models

Zichun Yu, Tianyu Gao, Zhengyan Zhang, Yankai Lin, Zhiyuan Liu, Maosong Sun, Jie Zhou.

The 29th International Conference on Computational Linguistics (COLING 2022)



Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Parameter-Efficient Tuning.

Jing Yi, Weize Chen, Yujia Qin, Yankai Lin, Ning Ding, Xu Han, Zhiyuan Liu, Maosong Sun, Jie Zhou.

Findings of EMNLP 2022



Exploring Mode Connectivity for Pre-trained Language Models.

Yujia Qin, Cheng Qian, Jing Yi, Weize Chen, Yankai Lin, Xu Han, Zhiyuan Liu, Maosong Sun, Jie Zhou.

The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)



MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction.

Xiaozhi Wang, Yulin Chen, Ning Ding, Hao Peng, Zimu Wang, Yankai Lin, Xu Han, Lei Hou, Juanzi Li, Zhiyuan Liu, Peng Li, Jie Zhou.

The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)



ROSE: Robust Selective Fine-tuning for Pre-trained Language Models.

Lan Jiang, Hao Zhou, Yankai Lin, Peng Li, Jie Zhou, Rui Jiang.

The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022)


2021

Guiding Non-Autoregressive Neural Machine Translation Decoding with Reordering Information

Qiu Ran, Yankai Lin, Peng Li, Jie Zhou

Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021)



Aspect-Level Sentiment-Controllable Review Generation with Mutual Learning Framework

Huimin Chen, Yankai Lin, Fanchao Qi, Jinyi Hu, Peng Li, Jie Zhou, Maosong Sun

Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI 2021)



TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference

Deming Ye, Yankai Lin, Yufei Huang, Maosong Sun

2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT 2021)



CLEVE: Contrastive Pre-training for Event Extraction

Ziqi Wang, Xiaozhi Wang, Xu Han, Yankai Lin, Lei Hou, Zhiyuan Liu, Peng Li, Juanzi Li and Jie Zhou

The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)



ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

Yujia Qin, Yankai Lin, Ryuichi Takanobu, Zhiyuan Liu, Peng Li, Heng Ji, Minlie Huang, Maosong Sun and Jie Zhou

The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)



Manual Evaluation Matters: Reviewing Test Protocols of Distantly Supervised Relation Extraction

Tianyu Gao, Xu Han, Yuzhuo Bai, Keyue Qiu, Zhiyu Xie, Yankai Lin , Zhiyuan Liu, Peng Li, Maosong Sun and Jie Zhou

Findings of ACL 2021



Rethinking Stealthiness of Backdoor Attack against NLP Models

Wenkai Yang, Yankai Lin , Peng Li, Jie Zhou and Xu Sun

The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)



CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models

Yusheng Su, Xu Han, Zhengyan Zhang, Peng Li, Zhiyuan Liu, Yankai Lin, Jie Zhou, Maosong Sun

AI Open, 2021



MOOCCubeX: A Large Knowledge-centered Repository for Adaptive Learning in MOOCs

Jifan Yu, Yuquan Wang, Qingyang Zhong, Gan Luo, Yiming Mao, Kai Sun, Wenzheng Feng, Wei Xu, Shulin Cao, Kaisheng Zeng, Zijun Yao, Lei Hou, Yankai Lin , Peng Li, Jie Zhou, Bin Xu, Juanzi Li, Jie Tang and Maosong Sun

30th ACM International Conference on Information and Knowledge Management (CIKM 2021)



CascadeBERT: Accelerating Inference of Pre-trained Language Models via Calibrated Complete Models Cascade

Lei Li, Yankai Lin , Deli Chen, Shuhuai Ren, Peng Li, Jie Zhou and Xu Sun

Findings of EMNLP 2021



Dynamic Knowledge Distillation for Pre-trained Language Models

Lei Li, Yankai Lin , Shuhuai Ren, Peng Li, Jie Zhou and Xu Sun

The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)



CodRED: A Cross-Document Relation Extraction Dataset for Acquiring Knowledge in the Wild

Yuan Yao, Jiaju Du, Yankai Lin , Peng Li, Zhiyuan Liu, Jie Zhou and Maosong Sun

The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)



RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models

Wenkai Yang, Yankai Lin , Peng Li, Jie Zhou and Xu Sun

The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP 2021)



Topology-Imbalance Learning for Semi-Supervised Node Classification

Deli Chen, Yankai Lin , Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun

Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021)



Topology-Imbalance Learning for Semi-Supervised Node Classification.

Deli Chen, Yankai Lin , Guangxiang Zhao, Xuancheng Ren, Peng Li, Jie Zhou, Xu Sun.

Thirty-fifth Conference on Neural Information Processing Systems (NeurIPS 2021)


2020

Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological View

Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, Xu Sun

The 34th AAAI Conference on Artificial Intelligence (AAAI 2020)



Continual Relation Learning via Episodic Memory Activation and Reconsolidation

Xu Han, Yi Dai, Tianyu Gao, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, Jie Zhou

The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)



Learning to Recover from Errors for Non-Autoregressive Neural Machine Translation

Qiu Ran*, Yankai Lin*, Peng Li*, Jie Zhou

The 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)



More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extraction

Xu Han, Tianyu Gao, Yankai Lin, Hao Peng, Yaoliang Yang, Chaojun Xiao, Zhiyuan Liu, Peng Li, Jie Zhou and Maosong Sun

The 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 9th International Joint Conference on Natural Language Processing (AACL-IJCNLP 2020)



Disentangle-based Continual Graph Representation Learning

Xiaoyu Kou, Yankai Lin, Shaobo Liu, Peng Li, Jie Zhou and Yan Zhang

The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)



MAVEN: A Massive General Domain Event Detection Dataset

Xiaozhi Wang, Ziqi Wang, Xu Han, Wangyi Jiang, Rong Han, Zhiyuan Liu, Juanzi Li, Peng Li, Yankai Lin and Jie Zhou

The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)



Learning from Context or Names? An Empirical Study on Neural Relation Extraction

Hao Peng, Tianyu Gao, Xu Han, Yankai Lin, Peng Li, Zhiyuan Liu, Maosong Sun and Jie Zhou

The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)



Coreferential Reasoning Learning for Language Representation

Deming Ye, Yankai Lin, Jiaju Du, Zhenghao Liu, Peng Li, Maosong Sun and Zhiyuan Liu

The 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020)


2019

XQA: A Cross-lingual Open-domain Question Answering Dataset

Jiahua Liu*, Yankai Lin*, Zhiyuan Liu, Maosong Sun

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)



Fact Discovery from Knowledge Base via Facet Decomposition

Zihao Fu, Yankai Lin, Zhiyuan Liu, Wai Lam

The 2019 Conference of the North American Chapter of the Association for Computational Linguistics - Human Language Technologies (NAACL-HLT 2019)



DIAG-NRE: A Neural Pattern Diagnosis Framework for Distantly Supervised Neural Relation Extraction

Shun Zheng, Xu Han, Yankai Lin, Peilin Yu, Lu Chen, Ling Huang, Zhiyuan Liu, Wei Xu

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)



Graph Neural Networks with Generated Parameters for Relation Extraction

Hao Zhu, Yankai Lin, Zhiyuan Liu, Jie Fu, Tat-Seng Chua, Maosong Sun

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)



DocRED: A Large-Scale Document-Level Relation Extraction Dataset

Yuan Yao, Deming Ye, Peng Li, Xu Han, Yankai Lin, Zhenghao Liu, Zhiyuan Liu, Lixin Huang, Jie Zhou, Maosong Sun

The 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019)



NumNet: machine reading comprehension with numerical reasoning

Qiu Ran*, Yankai Lin*, Peng Li, Jie Zhou

The Conference on Empirical Methods in Natural Language Processing (EMNLP 2019)


2018

Improving Neural Fine-Grained Entity Typing with Knowledge Attention

Ji Xin, Yankai Lin, Zhiyuan Liu, Maosong Sun

The 32th AAAI Conference on Artificial Intelligence (AAAI 2018)



Denoising Distantly Supervised Open-Domain Question Answering

Yankai Lin, Haozhe Ji, Zhiyuan Liu, Maosong Sun

The 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018)



Adversarial Multi-lingual Neural Relation Extraction

Xiaozhi Wang, Xu Han, Yankai Lin, Zhiyuan Liu, Maosong Sun

The 27th International Conference on Computational Linguistics (COLING 2018)



Cross-lingual Lexical Sememe Prediction

Fanchao Qi*, Yankai Lin*, Maosong Sun, Hao Zhu, Ruobing Xie, Zhiyuan Liu

The Conference on Empirical Methods in Natural Language Processing (EMNLP 2018)


2017

Neural Relation Extraction with Multi-lingual Attention

Yankai Lin, Zhiyuan Liu, Maosong Sun

The 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017)



Recent Advances on Neural Headline Generation

Ayana, Shiqi Shen, Yankai Lin, Cunchao Tu, Yu Zhao, Zhiyuan Liu, Maosong Sun

Journal of Computer Science and Technology (JCST 2017)



Incorporating Relation Paths in Neural Relation Extraction

Wenyuan Zeng, Yankai Lin, Zhiyuan Liu, Maosong Sun

The Conference on Empirical Methods in Natural Language Processing (EMNLP 2017)


2016

Knowledge Representation Learning with Entities, Attributes and Relations

Yankai Lin, Zhiyuan Liu, Maosong Sun

International Joint Conference on Artificial Intelligence (IJCAI 2016)



Neural Relation Extraction with Selective Attention over Instances

Yankai Lin, Shiqi Shen, Zhiyuan Liu, Maosong Sun

The 54th Annual Meeting of the Association for Computational Linguistics (ACL 2016)



Neural Sentiment Classification with User and Product Attention

Huimin Chen, Maosong Sun, Cunchao Tu, Yankai Lin and Zhiyuan Liu

The Conference on Empirical Methods in Natural Language Processing (EMNLP 2016)



Crossmodal language grounding, learning, and teaching

Stefan Heinrich, Cornelius Weber, Stefan Wermter, Ruobing Xie, Yankai Lin, Zhiyuan Liu

The 30th Conference on Neural Information Processing Systems (CoCo@NIPS'16)


2015

Learning Entity and Relation Embeddings for Knowledge Graph Completion

Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, Xuan Zhu

The 29th AAAI Conference on Artificial Intelligence (AAAI 2015).



Modeling Relation Paths for Representation Learning of Knowledge Bases

Yankai Lin, Zhiyuan Liu, Huanbo Luan, Maosong Sun, Siwei Rao, Song Liu

The Conference on Empirical Methods in Natural Language Processing (EMNLP 2015)

荣誉奖励

2024 北京市科技新星计划

2022 世界互联网领先科技成果《大规模知识图表示学习的体系化基础算法及开源工具》(第三完成人)

2020 教育部自然科学一等奖 《结构化知识表示学习方法》(第三完成人)

2019 北京市普通高等学校优秀毕业生 博士

2018 百度奖学金

社会兼职

CCF NOI科学委员会委员

Frontier of Computer Science 青年编委

北京智源 青源会会员

中国中文信息学会 青工委委员

联系

邮箱:yankailin@ruc.edu.cn

个人网页:https://linyankai.github.io/