Jieshan Chen

Research Scientist at CSIRO’s Data61
Jieshan.Chen@data61.csiro.au · GitHub · Google Scholar · LinkedIn

About me

I am currently a research scientist at CSIRO’s Data61. Before joining Data61, I was a Ph.D. student in computer science at Australian National University. My supervisors are Zhenchang Xing and Chunyang Chen.

My work lies in the fields of software engineering, deep learning, and human computer interaction. By understanding the semantics of user interfaces, my work aims to improve designers’, developers’, and end-users’ efficiency when designing, developing and using the mobile applications. I am currently working on android code generation from User Interface (UI) design, UI design search and generation, and mobile application accessibility enhancement.



[Preprint] Extracting Replayable Interactions from Videos of Mobile App Usage
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang
July 2022 · PDF

[CHI’22] Towards Complete Icon Labeling in Mobile Applications
Jieshan Chen, Amanda Swearngin, Jason Wu, Titus Barik, Jeffrey Nichols and Xiaoyi Zhang.
PDF · Talk · Acceptance Rate 12.5% (324/2,597)

[ESEC/FSE’20] Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?
Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu and Guoqiang Li
PDF · Tool Demo · Talk · Code · Acceptance Rate 28% (101/360)

[TOSEM’20] Wireframe-based UI Design Search through Image Autoencoder.
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang.
PDF · Talk · Code · Cited By 17

[ICSE’20] Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning.
Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhu, Guoqiang Li, and Jinshui Wang.
🏆 ACM SIGSOFT Distinguished Paper Award
PDF · Talk · Code · Acceptance Rate 20.9% (129/617)

[IJCNN’17] Ensemble Application of Convolutional and Recurrent Neural Networks for Multi-label Text Categorization.
Guibin Chen, Deheng Ye, Zhenchang Xing, Jieshan Chen, and Erik Cambria.


Program Committee