About me

Jieshan is currently a senior research scientist and UI intelligence team lead at CSIRO’s Data61. She received her Ph.D. degree in computer science at Australian National University, where she was advised by Zhenchang Xing and Chunyang Chen.

She works at the intersection of software engineering and human–computer interaction, driven by a passion for solving real-world problems that meaningfully impact people’s everyday lives. Her research focuses on software usability, UI engineering and Responsible AI, with the long-term goal of creating intelligent software that co-evolves with people, understanding human intent, supporting collaboration, and ensuring transparency and trust.

Specifically, she is currently working on four research topics:
(1) GUI design generation and repair (e.g., TOSEM20, TOCHI25, ICSE25);
(2) Software and AI usability and accessibility (e.g., ICSE20, FSE20, CHI22, UIST24, TOSEM23);
(3) Deceptive pattern detection and prevention (e.g., UIST23, WWW25); and
(4) Agentic AI systems

Jieshan has published papers at top-tier CORE A*/R1 venues, including ICSE, FSE, ASE, UIST, CHI, TOSEM and TOCHI, and contanstly serves as PC members and reviewers for top-tier conferences and journal. She got one SIGSOFT Distinguished Paper Award at ICSE2020. Her research outcomes have been integrated into industrial tools adopted by major companies such as Apple and Alibaba, ultimately benefiting billions of end-users worldwide. See her Google Scholar Page for more details.

News

• [2026-04] Our paper “From Exploration to Revelation: App-Level Context-Aware Deceptive Pattern Detection for Mobile Applications” is just accepted by TOSEM 2026.
  
• [2025-11] I just get promoted to be a senior research scientist at CSIRO’s Data61. Cheers!
  
• [2025-10] Our paper “Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs” just get accepted by TOCHI.
  
• [2025-07] Our International Workshop on Responsible AI Engineering (RAIE2026@ICSE) is accepted and will be co-located with ICSE2026. Welcome your submission!
  
• [2025-02] Invited as a PC Member for ASE 2025
  
• [2025-01-20] Two papers accepted at WWW’2025
  

> 2024

- [2024-12] Invited as a PC Member for ICSE 2026
- [2024-12-16] Gave a guest lecture on software usability and accessibility at TUM
- [2024-12-09] Gave a keynote titled "Empowering Users to Detect and Prevent Cyber Threat Through UI Awareness" at [ICDM 2024 - ML4Cyber workshop](https://ml4cyber.github.io/24/)
- [2024-11] One paper accepted at ICSE 2025.
- [2024-08] I was awarded the Dieter Schwarz Fellowship funded by TUM-IAS as the first recipient.
- [2024-07] One paper accepted at UIST 2024.
- [2024-06] Two papers accepted at TOSEM 2024
- [2024-06-14] Call for paper for CCS'24 LAMPS Workshop (https://lamps-ccs.com/)!

> 2023

- [2023-12] Our paper "Where is it? Tracing the Vulnerability-relevant Files from Vulnerability Reports" is accepted by ICSE'2024!
- [2023-12-05] Our paper "Prompt Sapper: A LLM-Empowered Production Tool for Building AI Chains" is accepted by TOSEM 2023!
- [2023-11] Invited as a PC Member for ICSE 2025
- [2023-08-05] Our paper "Unveiling the tricks: automated detection of dark pattern in mobile applications" is accepted by [UIST 2023](https://uist.acm.org/2023/)
- [2023-07] Invited as a PC Member for SANER 2024
- [2023-05] Invited as a PC Member for ASE 2023

> 2022 and before

- [2022-12-01] Selected as a Junior PC Member at MSR 2023
- [2022-08-31] Gave a talk titled **"Understanding Fairness Issues in Machine Unlearning and Dark Pattern"** at [NIST Workshop on Mitigating AI Bias in Context](https://www.nccoe.nist.gov/get-involved/attend-events/workshop-mitigating-ai-bias-context)
- [2022-07-08] Released a preprint version of our work **"Extracting Replayable Interactions from Videos of Mobile App Usage"**
- [2022-01-10] Joined CSIRO's Data61 as a research scientist
- [2021-11-16] Our paper **"Towards Complete Icon Labeling in Mobile Applications"** accepted at [CHI 2022](https://chi2022.acm.org/)
- [2021-05-26] Presented our paper **"Wireframe-based UI Design Search through Image Autoencoder"** at ICSE 2021

Selected Publications

Please see full the publication list in Google Scholar

- **[TOSEM'26] From Exploration to Revelation: App-Level Context-Aware Deceptive Pattern Detection for Mobile Applications.** **Jieshan Chen\***, Zhen Wang, Jiamou Sun, Zhenchang Xing, Qinghua Lu, Qing Huang, Xiwei Xu, Liming Zhu. [Preprint](https://arxiv.org/abs/2411.18084) - **[TOCHI'25] Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs.** Mingyue Yuan, **Jieshan Chen\***, Yongquan Hu, Sidong Feng, Mulong Xie, Gelareh Mohammadi, Zhenchang Xing, Aaron Quigley. [ACM](https://dl.acm.org/doi/10.1145/3773035) - **[WWW'25] 50 Shades of Deceptive Patterns: A Unified Taxonomy, Multimodal Detection, and Security Implications.** Zewei Shi, Ruoxi Sun, **Jieshan Chen**, Jiamou Sun, Jason Xue, Yansong Gao, Feng Liu, Xingliang Yuan. [ACM](https://dl.acm.org/doi/abs/10.1145/3696410.3714593) · Acceptance rate: 19.8% (409/2062) - Oral - **[ICSE'25] DesignRepair: Dual-Stream Design Guideline-Aware Frontend Repair with Large Language Models.** Mingyue Yuan, **Jieshan Chen\***, Zhenchang Xing, Aaron Quigley, Yuyu Luo, Gelareh Mohammadi, Qinghua Lu, Liming Zhu. [IEEE/ACM](https://dl.acm.org/doi/10.1109/ICSE55347.2025.00109) · [Preprint](https://arxiv.org/pdf/2411.01606) · [GitHub](https://github.com/UGAIForge/DesignRepair2024) · Acceptance rate: 21.3% (245/1150) - **[UIST'24] GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and Learning.** Minh Duc Vu, Han Wang, Zhuang Li, **Jieshan Chen**, Shengdong Zhao, Zhenchang Xing, Chunyang Chen. [ACM](https://dl.acm.org/doi/10.1145/3654777.3676356) · [Preprint](https://arxiv.org/pdf/2401.14268) · [GitHub](https://github.com/vuminhduc796/GPTVoiceTasker) · Acceptance rate: 24% (146/608) - **[ICSE'24] Where is it? Tracing the Vulnerability-relevant Files from Vulnerability Reports.** Jiamou Sun, **Jieshan Chen**, Zhenchang Xing, Qinghua Lu, Xiwei (Sherry) Xu, Liming Zhu. [ACM](https://dl.acm.org/doi/10.1145/3597503.3639202) · [GitHub](https://github.com/anonymous-77400046/vulnerability_file_trace) · Acceptance rate: 22.3% (234/1051) - **[TOSEM'23] Prompt Sapper: A LLM-Empowered Production Tool for Building AI Chains.** Yu Cheng, **Jieshan Chen\***, Qing Huang, Zhenchang Xing, Xiwei Xu, Qinghua Lu. Nov 2023 · [ACM](https://dl.acm.org/doi/10.1145/3638247) · [Preprint](https://arxiv.org/pdf/2306.12028) · [Talk](https://www.youtube.com/watch?v=6QZW8WjYesI&lc=Ugyadp9ya26_0qr0g0p4AaABAg) · [Tool](https://www.aichain.online/) - **[UIST'23] Unveiling the tricks: automated detection of dark pattern in mobile applications.** ***Jieshan Chen***, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu and Chunyang Chen. [ACM](https://dl.acm.org/doi/10.1145/3586183.3606783) · [Preprint](https://arxiv.org/pdf/2308.05898.pdf) · [Talk](https://m.youtube.com/watch?v=PkXHuPkatpk&t=16167s) · [Dataset](https://zenodo.org/records/8126443) · [Code](https://github.com/chenjshnn/UIST23-UIGuard) · Acceptance Rate 25% (121/483) - **[ASE'23] Let's Chat to Find the APIs: Connecting Human, LLM and Knowledge Graph through AI Chain.** Qing Huang, Zhenyu Wan, Zhenchang Xing, Changjing Wang, **Jieshan Chen**, Xiwei Xu, Qinghua Lu. [IEEE](https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=10298399) · Acceptance Rate 20.3% (134/661) - **[CHI'22] Towards Complete Icon Labeling in Mobile Applications.** ***Jieshan Chen***, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang. [PDF](/files/CHI_2022_Icon.pdf) · [Talk](https://www.youtube.com/watch?v=3eaTDpBfqQM&ab_channel=ACMSIGCHI) · Acceptance Rate 12.5% (324/2,597) · [Available in iOS](https://machinelearning.apple.com/research/icon-labelling) - **[ESEC/FSE'20] Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?** ***Jieshan Chen***, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu and Guoqiang Li. [PDF](/files/FSE2020-UIDetection.pdf) · [Tool Demo](http://uied.online/) · [Talk](https://www.youtube.com/watch?v=KFFp81N6zlg) · [Code](https://github.com/chenjshnn/Object-Detection-for-Graphical-User-Interface) · Acceptance Rate 28% (101/360) · [Integrated into an industrial testing tool for daily testing apps of 1B+ users](https://taoxiease.github.io/publications/icse22seip-vtest.pdf) - **[TOSEM'20] Wireframe-based UI Design Search through Image Autoencoder.**
***Jieshan Chen***, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang. [PDF](/files/tosem2020-uisearch.pdf) · [Talk](https://www.youtube.com/watch?v=wF4VDrMpRdo) · [Code](https://github.com/chenjshnn/WAE) - **[ICSE'20 🏆] Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning.**
***Jieshan Chen***, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhu, Guoqiang Li, and Jinshui Wang. 🏆 ACM SIGSOFT Distinguished Paper Award. [PDF](/files/ICSE2020-predictContent.pdf) · [Talk](https://www.youtube.com/watch?v=zoRu7UOXAeY&list=PLh7v-bsdypMGkREL9PPVczHtaVLlL4P5h&index=5) · [Code](https://github.com/chenjshnn/LabelDroid) · Acceptance Rate 20.9% (129/617)

* means corresponding authors.

Service

Organising Committee
· 4th International Workshop on Responsible AI Engineering (RAIE@ICSE2026, Organisation Co-Chair) · ACM Conference on Computer and Communications Security (CCS’24 – LAMPS Workshop, Program Co-Chair)

Program Committee
· International Conference on Software Engineering (ICSE’25, ICSE’26, ICSE’27)
· IEEE/ACM International Conference on Automated Software Engineering (ASE’23, ASE’24-Artifact Evaluation), ASE’25
· ACM international conference on AI Foundation Models and Software Engineering (FORGE’25-Data and Benchmarking)
· ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA’24)
· IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER’24-ERA, SANER’25-ERA)
· ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023-SRC)
· ACM international joint conference on pervasive and ubiquitous computing (UbiComp/ISWC’23 Posters & Demos)
· IEEE International Symposium on Software Reliability Engineering (ISSRE’22-Industry, ISSRE’23-Industry Track)
· The Mining Software Repositories (MSR’23-Junior PC, MSR’22-Shadow PC)
· International Conference on Software and System Processes (ICSSP’23)
· ACM CHI Conference on Human Factors in Computing Systems (CHI’22-Computational UI Workshop)

Reviewer
· ACM CHI Conference on Human Factors in Computing Systems (CHI’22, CHI’23, CHI’24, CHI’25, CHI’26)
· IEEE Transactions on Software Engineering and Methodology (TOSEM’24, TOSEM’25)
· AACM Transactions on Computer-Human Interaction (TOCHI’24)
· ACM Symposium on User Interface Software and Technology (UIST’22, UIST’24)
· ACM SIGCHI Conference on Computer-Supported Cooperative Work & Social Computing (CSCW’24)
· International Conference on Software Engineering (ICSE’24)
· IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR’23)
· ACM international joint conference on pervasive and ubiquitous computing (UbiComp’22)
· International Journal of Human-Computer Interaction (IJHCI’22)
· IEEE International Symposium on Software Reliability Engineering (ISSRE’22)
· IEEE Transactions on Software Engineering (TSE)
· Information and Software Technology (IST Journal’21)
· The Mining Software Repositories (MSR’21)