Publications

2023

  1. Pre-trained Language Models in Biomedical Domain: A Survey from Multiscale Perspective
    Benyou Wang, Qianqian Xie, Jiahuan Pei, Prayag Tiwari, Zhao Li, and Fu Jie,
    ACM Computing Surveys 2023
  2. Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk
    Benyou Wang, Xiangbo Wu, Xiaokang Liu, Jianquan Li, Prayag Tiwari, and Qianqian Xie,
    ACL 2023 2023
    arXiv Code
  3. Adapting Pre-trained Language Models for Quantum Natural Language Processing
    Qiuchi Li, Benyou Wang, Yudong Zhu, Christina Lioma, and Qun Liu,
    arXiv preprint arXiv:2302.13812 2023
    arXiv
  4. Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts
    Zhihong Chen, Shizhe Diao, Benyou Wang, Guanbin Li, and Xiang Wan,
    ICCV 2023 2023
    arXiv Code
  5. Modular Retrieval for Generalization and Interpretation
    Juhao Liang, Chen Zhang, Zhengyang Tang, Jie Fu, Dawei Song, and Benyou Wang,
    arXiv preprint arXiv:2303.13419 2023
    arXiv Code
  6. Effective Open Intent Classification with K-center Contrastive Learning and Adjustable Decision Boundary
    Xiaokang Liu, Jianquan Li, Jingjing Mu, Min Yang, Ruifeng Xu, and Benyou Wang,
    In AAAI 2023
  7. Phoenix: Democratizing chatgpt across languages
    Zhihong Chen, Feng Jiang, Junying Chen, Tiannan Wang, Fei Yu, Guiming Chen, Hongbo Zhang, Juhao Liang, Chen Zhang, Zhiyi Zhang, and others,
    arXiv preprint arXiv:2304.10453 2023
    arXiv Code
  8. Lifting the Curse of Capacity Gap in Distilling Language Models
    Chen Zhang, Yang Yang, Jiahao Liu, Jingang Wang, Yunsen Xian, Benyou Wang, and Dawei Song,
    ACL 2023 2023
  9. One Cannot Stand for Everyone! Leveraging Multiple User Simulators to train Task-oriented Dialogue Systems
    Yajiao LIU, Xin Jiang, Yichun Yin, Yasheng Wang, Fei Mi, Qun Liu, Xiang Wan, and Benyou Wang,
    ACL 2023 2023
  10. On the Difference of BERT-style and CLIP-style Text Encoders
    Zhihong Chen, Guiming Hardy Chen, Shizhe Diao, Xiang Wan, and Benyou Wang,
    ACL 2023 findings 2023
  11. Few-Shot Class-Incremental Learning for Medical Time Series Classification
    Le Sun, Mingyang Zhang, Benyou Wang, and Prayag Tiwari,
    IEEE Journal of Biomedical and Health Informatics 2023
  12. Natural language reasoning, a survey
    Fei Yu, Hongbo Zhang, and Benyou Wang,
    arXiv preprint arXiv:2303.14725 2023
  13. Huatuo-26M, a Large-scale Chinese Medical QA Dataset
    Jianquan Li, Xidong Wang, Xiangbo Wu, Zhiyi Zhang, Xiaolong Xu, Jie Fu, Prayag Tiwari, Xiang Wan, and Benyou Wang,
    arXiv preprint arXiv:2305.01526 2023
    arXiv Code
  14. Is Information Extraction Solved by ChatGPT? An Analysis of Performance, Evaluation Criteria, Robustness and Errors
    Ridong Han, Tao Peng, Chaohao Yang, Benyou Wang, Lu Liu, and Xiang Wan,
    arXiv preprint arXiv:2305.14450 2023
    arXiv Code
  15. HuatuoGPT, towards Taming Language Model to Be a Doctor
    Hongbo Zhang, Junying Chen, Feng Jiang, Fei Yu, Zhihong Chen, Jianquan Li, Guiming Chen, Xiangbo Wu, Zhiyi Zhang, Qingying Xiao, and others,
    arXiv preprint arXiv:2305.15075 2023
    arXiv Code
  16. Injecting Knowledge into Biomedical Pre-trained Models via Polymorphism and Synonymous Substitution
    Hongbo Zhang, Xiang Wan, and Benyou Wang,
    arXiv preprint arXiv:2305.15010 2023
  17. CMB: A Comprehensive Medical Benchmark in Chinese
    Xidong Wang, Guiming Hardy Chen, Dingjie Song, Zhiyi Zhang, Zhihong Chen, Qingying Xiao, Feng Jiang, Jianquan Li, Xiang Wan, Benyou Wang, and others,
    arXiv preprint arXiv:2308.08833 2023
    arXiv Code
  18. Large Language Model as a User Simulator
    Chuyi Kong, Yaxin Fan, Xiang Wan, Feng Jiang, and Benyou Wang,
    arXiv preprint arXiv:2308.11534 2023
    arXiv Code

2022

  1. Exploring extreme parameter compression for pre-trained language models
    Benyou Wang, Yuxin Ren, Lifeng Shang, Xin Jiang, and Qun Liu,
    In ICLR 2022 2022
  2. DPTDR: Deep Prompt Tuning for Dense Passage Retrieval
    Zhengyang Tang, Benyou Wang, and Ting Yao,
    COLING 2022 2022
    arXiv Code
  3. Doge Tickets: Uncovering Domain-general Language Models by Playing Lottery Tickets
    Yi Yang, Chen Zhang, Benyou Wang, and Dawei Song,
    NLPCC 2022 Best Paper 2022
    arXiv Code
  4. MorphTE: Injecting Morphology in Tensorized Embeddings
    Guobing Gan, Peng Zhang, Sunzhu Li, Xiuqing Lu, and Benyou Wang,
    NeurIPS 2022 2022
    arXiv Code
  5. Document-level Relation Extraction with Relation Correlations
    Ridong Han, Tao Peng, Benyou Wang, Lu Liu, and Xiang Wan,
    arXiv preprint arXiv:2212.10171 2022
    arXiv
  6. Hypoformer: Hybrid decomposition transformer for edge-friendly neural machine translation
    Sunzhu Li, Peng Zhang, Guobing Gan, Xiuqing Lv, Benyou Wang, Junqiu Wei, and Xin Jiang,
    In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing 2022

2021