Jieshan Chen 陈洁珊

Research Scientist at CSIRO’s Data61
✉ Jieshan.Chen@data61.csiro.au · GitHub · Google Scholar · LinkedIn · Twitter

About me

Jieshan is currently a research scientist and UI intelligence team lead at CSIRO’s Data61. She received her Ph.D. degree in computer science at Australian National University, where she was advised by Zhenchang Xing and Chunyang Chen.

She works at the intersection of software engineering and human computer interaction. She is always passionate on addressing real-life problems that can actually impact people’s daily life. The main goal of her research is to use human-centred technique to examine and ensure responsible software development by design. She is currently working on dark pattern detection, data visualisation, UI design search and generation, and mobile application accessibility enhancement.

Jieshan has published many papers at top-tier CORE A* ranked conferences/journals, including ICSE, FSE, UIST, CHI, TOSEM and USENIX Security. The ICSE20 paper got the SIGSOFT Distinguished Paper Award. See her Google Scholar Page for more details.

News

Selected Publications

[UIST’24] GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and Learning
Minh Duc Vu, Han Wang, Zhuang Li, Jieshan Chen, Shengdong Zhao, Zhenchang Xing, Chunyang Chen
ACM· Arxiv· Acceptance rate: 24% (146/608)

[ICSE’24] Where is it? Tracing the Vulnerability-relevant Files from Vulnerability Reports
Jiamou Sun, Jieshan Chen, Zhenchang Xing, Qinghua Lu, Xiwei (Sherry) Xu, Liming Zhu
ACM· Acceptance rate: 22.3% (234/1051)

[TOSEM’23] Prompt Sapper: A LLM-Empowered Production Tool for Building AI Chains
Yu Cheng, Jieshan Chen*, Qing Huang, Zhenchang Xing, Xiwei Xu, Qinghua Lu
Nov 2023 · ACM · PDF · Tool

[UIST’23] Unveiling the tricks: automated detection of dark pattern in mobile applications
Jieshan Chen, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu and Chunyang Chen
ACM · PDF · Talk · Dataset · Code · Acceptance Rate 25% (121/483)

[ASE’23] Let’s Chat to Find the APIs: Connecting Human, LLM and Knowledge Graph through AI Chain
Qing Huang, Zhenyu Wan, Zhenchang Xing, Changjing Wang, Jieshan Chen, Xiwei Xu, Qinghua Lu
Official Page · Acceptance Rate 20.3% (134/661)

[Preprint] Towards Real Smart Apps: Investigating Human-AI Interactions in Smartphone On-Device AI Apps
Jason Ching Yuen Siu, Jieshan Chen*, Yujin Huang, Zhenchang Xing, Chunyang Chen
July 2023 · PDF

[Preprint] Extracting Replayable Interactions from Videos of Mobile App Usage
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang
July 2022 · PDF

[CHI’22] Towards Complete Icon Labeling in Mobile Applications
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang.
PDF · Talk · Acceptance Rate 12.5% (324/2,597)

[ESEC/FSE’20] Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu and Guoqiang Li
PDF · Tool Demo · Talk · Code · Acceptance Rate 28% (101/360)

[TOSEM’20] Wireframe-based UI Design Search through Image Autoencoder.
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang.
PDF · Talk · Code

[ICSE’20] Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning.
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhu, Guoqiang Li, and Jinshui Wang.
🏆 ACM SIGSOFT Distinguished Paper Award
PDF · Talk · Code · Acceptance Rate 20.9% (129/617)

[IJCNN’17] Ensemble Application of Convolutional and Recurrent Neural Networks for Multi-label Text Categorization.
Guibin Chen, Deheng Ye, Zhenchang Xing, Jieshan Chen, and Erik Cambria.
PDF

* means corresponding authors.

Service

Chair
· ACM Conference on Computer and Communications Security (CCS’24 – LAMPS Workshop https://lamps-ccs.com/)

Program Committee
· International Conference on Software Engineering (ICSE’25)
· ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA’24)
· IEEE/ACM International Conference on Automated Software Engineering (ASE’23, ASE’24-Artifact Evaluation)
· IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER’24 ERA Track, SANER’25 ERA Track)
· ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023-SRC Track)
· ACM international joint conference on pervasive and ubiquitous computing (UbiComp/ISWC’23 Posters and Demos)
· IEEE International Symposium on Software Reliability Engineering (ISSRE’22-Industry Track, ISSRE’23-Industry Track)
· The Mining Software Repositories (MSR’23-Junior PC, MSR’22-Shadow PC)
· International Conference on Software and System Processes (ICSSP’23 - PC Member)
· ACM CHI Conference on Human Factors in Computing Systems (CHI’22-Computational UI Workshop)

Reviewer
· ACM Symposium on User Interface Software and Technology (UIST’22, UIST’24)
· ACM CHI Conference on Human Factors in Computing Systems (CHI’22, CHI’23, CHI’24, CHI’25)
· ACM SIGCHI Conference on Computer-Supported Cooperative Work & Social Computing (CSCW’24)
· International Conference on Software Engineering (ICSE’24)
· IEEE Transactions on Software Engineering and Methodology (TOSEM)
· IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR’23)
· ACM international joint conference on pervasive and ubiquitous computing (UbiComp’22)
· International Journal of Human-Computer Interaction (IJHCI’22)
· IEEE International Symposium on Software Reliability Engineering (ISSRE’22)
· IEEE Transactions on Software Engineering (TSE)
· Information and Software Technology (IST Journal’21)
· The Mining Software Repositories (MSR’21)