About me

Jieshan is currently a research scientist at CSIRO’s Data61. She received her Ph.D. degree in computer science at Australian National University, where she was advised by Zhenchang Xing and Chunyang Chen.

She works at the interaction of software engineering and human computer interaction. The main goal of her research is to use human-centred technique to examine and ensure responsible software development by design. She is currently working on dark pattern detection, data visualisation, UI design search and generation, and mobile application accessibility enhancement.

Jieshan has many publications at top-tier conferences/journals, like ICSE, FSE, UIST, CHI and TOSEM. The ICSE20 paper got the SIGSOFT Distinguished Paper Award.

News

• [2023-08-05] Our paper “Unveiling the tricks: automated detection of dark pattern in mobile applications” is accepted by UIST 2023
• [2023-07] Invited as a PC Member for SANER 2024
• [2023-05] Invited as a PC Member for ASE 2023
• [2022-12-01] Selected as a Junior PC Member at MSR 2023
• [2022-08-31] Gave a talk titled “Understanding Fairness Issues in Machine Unlearning and Dark Pattern” at NIST Workshop on Mitigating AI Bias in Context
• [2022-07-08] Released a preprint version of our work “Extracting Replayable Interactions from Videos of Mobile App Usage”
• [2022-01-10] Joined CSIRO’s Data61 as a research scientist
• [2021-11-16] Our paper “Towards Complete Icon Labeling in Mobile Applications” accepted at CHI 2022
• [2021-05-26] Presented our paper “Wireframe-based UI Design Search through Image Autoencoder” at ICSE 2021

Publications

[UIST’23] Unveiling the tricks: automated detection of dark pattern in mobile applications
Jieshan Chen, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu and Chunyang Chen
Preprint

[Preprint] Towards Real Smart Apps: Investigating Human-AI Interactions in Smartphone On-Device AI Apps
Jason Ching Yuen Siu, Jieshan Chen, Yujin Huang, Zhenchang Xing, Chunyang Chen
July 2023 · PDF

[Preprint] Prompt Sapper: A LLM-Empowered Production Tool for Building AI Chains
Yu Cheng, Jieshan Chen, Qing Huang, Zhenchang Xing, Xiwei Xu, Qinghua Lu
June 2023 · PDF

[Preprint] Extracting Replayable Interactions from Videos of Mobile App Usage
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang
July 2022 · PDF

[CHI’22] Towards Complete Icon Labeling in Mobile Applications
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang.
PDF · Talk · Acceptance Rate 12.5% (324/2,597)

[ESEC/FSE’20] Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu and Guoqiang Li
PDF · Tool Demo · Talk · Code · Acceptance Rate 28% (101/360)

[TOSEM’20] Wireframe-based UI Design Search through Image Autoencoder.
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang.
PDF · Talk · Code

[ICSE’20] Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning.
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhu, Guoqiang Li, and Jinshui Wang.
🏆 ACM SIGSOFT Distinguished Paper Award
PDF · Talk · Code · Acceptance Rate 20.9% (129/617)

[IJCNN’17] Ensemble Application of Convolutional and Recurrent Neural Networks for Multi-label Text Categorization.
Guibin Chen, Deheng Ye, Zhenchang Xing, Jieshan Chen, and Erik Cambria.
PDF

Service

Program Committee
· IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER’24 ERA Track)
· ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2023-SRC Track)
· IEEE/ACM International Conference on Automated Software Engineering (ASE’23)
· ACM international joint conference on pervasive and ubiquitous computing (UbiComp/ISWC’23 Posters and Demos)
· IEEE International Symposium on Software Reliability Engineering (ISSRE’22-Industry Track, ISSRE’23-Industry Track)
· The Mining Software Repositories (MSR’23-Junior PC, MSR’22-Shadow PC)
· International Conference on Software and System Processes (ICSSP’23 - PC Member)
· ACM CHI Conference on Human Factors in Computing Systems (CHI’22-Computational UI Workshop)

Reviewer
· ACM SIGCHI Conference on Computer-Supported Cooperative Work & Social Computing (CSCW’24)
· International Conference on Software Engineering (ICSE’24)
· IEEE Transactions on Software Engineering and Methodology (TOSEM)
· IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR’23)
· ACM CHI Conference on Human Factors in Computing Systems (CHI’22, CHI’23)
· ACM international joint conference on pervasive and ubiquitous computing (UbiComp’22)
· International Journal of Human-Computer Interaction (IJHCI’22)
· IEEE International Symposium on Software Reliability Engineering (ISSRE’22)
· ACM Symposium on User Interface Software and Technology (UIST’22)
· IEEE Transactions on Software Engineering (TSE)
· Information and Software Technology (IST Journal’21)
· The Mining Software Repositories (MSR’21)