Jiawei Liu


I am a PhD student at UIUC PLFMSE working with Lingming Zhang.

I am interested in programming systems and machine learning, specifically:

  • AI4Code: How to build and evaluate AI programmers to improve developer efficiency and improve software quality?
  • MLSys Correctness: How to detect, debug and mitigate errors in our ML systems, from silicon to compiler and cloud?

ūü§ó Feel free to drop me an email if you are interested in my research.

Papers Show All

  1. Pre-print
    Magicoder: Source Code Is All You Need
    Yuxiang Wei, Zhe Wang,  Jiawei Liu, Yifeng Ding,  and Lingming Zhang
    arXiv preprint arXiv:2312.02120. 2023
  2. NeurIPS’23
      To Appear  
    Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation
    Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang,  and Lingming Zhang
    Thirty-seventh Conference on Neural Information Processing Systems. 2023
  3. ESEC/FSE’23
    Atifact AvailableAtifact Reusable
    NeuRI: Diversifying DNN Generation via Inductive Rule Inference
    Jiawei Liu, Jinjun Peng, Yuyao Wang,  and Lingming Zhang
    Proceedings of the 31st ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering. 2023
    ūüŹÜ ¬†ACM SIGSOFT Distinguished Paper Award
  4. ASPLOS’23
    Atifact AvailableAtifact FunctionalResults Reproduced
    NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers
    Jiawei Liu, Jinkun Lin, Fabian Ruffy, Cheng Tan, Jinyang Li, Aurojit Panda,  and Lingming Zhang
    Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2. 2023
    ūüŹÜ ¬†Distinguished Artifact Award
  5. OOPSLA’22
    Atifact AvailableAtifact Reusable
    Coverage-guided tensor compiler fuzzing with joint IR-pass mutation
    Jiawei Liu, Yuxiang Wei, Sen Yang, Yinlin Deng,  and Lingming Zhang
    Proceedings of the ACM on Programming Languages 6 (OOPSLA1). Apr 2022
*PLSE conferences like OOPSLA and ESEC/FSE do not badge for reproducibility at artifact evaluation as it requires third-party re-implementation. Nonetheless, we got all badges we can get. :D

Academic Services

Organizing: LLM4Code@ICSE'24

Reviewer: TSE, TOSEM, DCAA@AAAI'23

Artifact Evaluation Committee: PLDI'23, OSDI'22, ATC'22


LLMs for Software Testing (Guest Lecture) Automating DL Compiler Bug Finding with NNSmith Coverage-Guided Tensor Compiler Fuzzing with Joint IR-Pass Mutation