Publications

ViBR: Automated Bug Replay from Video-based Reports Using Vision-Language Models

Sidong Feng, Dingbang Wang, Nikola Tomic, Tingting Yu, Aldeida Aleti, Chunyang Chen

FSE 2026 📄 PDF

International Workshop on User Interface and Experience for Software Engineering (UISE 2026)

Sidong Feng, Kevin Moran, Tingting Yu, Sam Malek, Chunyang Chen

ICSE 2026 Workshop 🌐 call for paper

Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing

Sidong Feng, Changhao Du, Huaxiao Liu, Qingnan Wang, Zhengwei Lv, Mengfei Wang, Chunyang Chen

ICSE 2026 Acceptance rate: 9.2% (60/646) 📄 PDF

How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction

Sidong Feng, Chunyang Chen

Blog 📝 Blog

Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs

Mingyue Yuan, Jieshan Chen, Yongquan Hu, Sidong Feng, Mulong Xie, Gelareh Mohammadi, Zhenchang Xing, Aaron Quigley

TOCHI 2025 📄 PDF

Agent for User: Testing Multi-User Interactive Features in TikTok

Sidong Feng, Changhao Du, Huaxiao Liu, Qingnan Wang, Zhengwei Lv, Gang Huo, Xu Yang, Chunyang Chen

ICSE 2025 Industry 📄 PDF

An Empirical Study on Leveraging Images in Automated Bug Report Reproduction

Dingbang Wang, Zhaoxu Zhang, Sidong Feng, William G.J. Halfond, Tingting Yu

MSR 2025 📄 PDF

Enabling Cost-Effective UI Automation Testing with Retrieval-Based LLMs: A Case Study in WeChat

Sidong Feng, Haochuan Lu, Jianqin Jiang, Ting Xiong, Likun Huang, Yinglin Liang, Xiaoqin Li, Yuetang Deng, Aldeida Aleti

ASE 2024 Industry 📄 PDF

Feedback-Driven Automated Whole Bug Report Reproduction for Android Apps

Dingbang Wang, Yu Zhao, Sidong Feng, Zhaoxu Zhang, William GJ Halfond, Chunyang Chen, Xiaoxia Sun, Jiangfan Shi, Tingting Yu

ISSTA 2024 📄 PDF

MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling

Sidong Feng, Suyu Ma, Han Wang, David Kong, Chunyang Chen

CHI 2024 📄 PDF 💻 dataset

Designing with Language: Wireframing UI Design Intent with Generative Large Language Models

Sidong Feng, Mingyue Yuan, Jieshan Chen, Zhenchang Xing, Chunyang Chen

CHI 2024 Workshop 📄 PDF

Prompting Is All You Need: Automated Android Bug Replay with Large Language Models

Sidong Feng, Chunyang Chen

ICSE 2024 Acceptance rate: 6.6% 📄 PDF

Towards Efficient Record and Replay: A Case Study in WeChat

Sidong Feng, Haochuan Lu, Ting Xiong, Yuetang Deng, Chunyang Chen

ESEC/FSE 2023 Industry 📄 PDF

Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos

Sidong Feng, Chunyang Chen, Zhenchang Xing

UIST 2023 📄 PDF

Unveiling the tricks: Automated Detection of Dark Pattern in Mobile Applications

Jieshan Chen, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu, Chunyang Chen

UIST 2023 📄 PDF

Efficiency Matters: Speeding Up Automated Testing with GUI Rendering Inference

Sidong Feng, Mulong Xie, Chunyang Chen

ICSE 2023 🏆 ACM SIGSOFT Distinguished Paper Award 📄 PDF 💻 code

Read It, Don't Watch It: Captioning Bug Recordings Automatically

Sidong Feng, Mulong Xie, Yinxing Xue, Chunyang Chen

ICSE 2023 📄 PDF 💻 code

Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images

Mulong Xie, Zhenchang Xing, Sidong Feng, Chunyang Chen, Liming Zhu, Xiwei Xu

ESEC/FSE 2022 📄 PDF 💻 code

GIFdroid: Automated Replay of Visual Bug Reports for Android Apps

Sidong Feng, Chunyang Chen

ICSE 2022 📄 PDF 💻 code 🎥 video 📺 presentation

GIFdroid: An Automated Light-weight Tool for Replaying Visual Bug Reports

Sidong Feng, Chunyang Chen

ICSE-C 2022 📄 PDF 💻 code 🎥 video 📺 presentation

Gallery D.C.: Auto-created GUI Component Gallery for Design Search and Knowledge Discovery

Sidong Feng, Chunyang Chen, Zhenchang Xing

ICSE-C 2022 📄 PDF 🔧 Tool 🎥 video

Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development

Sidong Feng, Minmin Jiang, TingTing Zhou, Yankun Zhen, Chunyang Chen

TIIS 2022 📄 PDF 🔧 tool

Auto-icon: An automated code generation tool for icon designs assisting in UI development

Sidong Feng, Suyu Ma, Jinzhong Yu, Chunyang Chen, TingTing Zhou, Yankun Zhen

IUI 2021 🏆 Highlight of IUI 2021 (11/241) 📄 PDF 🔧 tool

From lost to found: Discover missing UI design semantics through recovering missing tags

Chunyang Chen, Sidong Feng, Zhengyang Liu, Zhenchang Xing, Shengdong Zhao

CSCW 2020 📄 PDF 💻 code

UIED: a hybrid tool for GUI element detection

Mulong Xie, Sidong Feng, Zhenchang Xing, Jieshan Chen, Chunyang Chen

ESEC/FSE 2020 📄 PDF 🔧 tool 💻 code

Gallery D.C.: Design Search and Knowledge Discovery through Auto-created GUI Component Gallery

Chunyang Chen, Sidong Feng, Zhenchang Xing, Linda Liu, Shendong Zhao, Jinshui Wang

CSCW 2019 📄 PDF 🔧 tool 📺 slides 📝 blog

Dynamic facial stress recognition in temporal convolutional network

Sidong Feng

ICONIP 2019 📄 PDF 🖼 poster

Conference & Journal Papers

2026 Publications

ViBR: Automated Bug Replay from Video-based Reports Using Vision-Language Models

International Workshop on User Interface and Experience for Software Engineering (UISE 2026)

Breaking Single-Tester Limits: Multi-Agent LLMs for Multi-User Feature Testing

How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction

2025 Publications

Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs

Agent for User: Testing Multi-User Interactive Features in TikTok

An Empirical Study on Leveraging Images in Automated Bug Report Reproduction

2024 Publications

Enabling Cost-Effective UI Automation Testing with Retrieval-Based LLMs: A Case Study in WeChat

Feedback-Driven Automated Whole Bug Report Reproduction for Android Apps

MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling

Designing with Language: Wireframing UI Design Intent with Generative Large Language Models

Prompting Is All You Need: Automated Android Bug Replay with Large Language Models

2023 Publications

Towards Efficient Record and Replay: A Case Study in WeChat

Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial Videos

Unveiling the tricks: Automated Detection of Dark Pattern in Mobile Applications

Efficiency Matters: Speeding Up Automated Testing with GUI Rendering Inference

Read It, Don't Watch It: Captioning Bug Recordings Automatically

2022 Publications

Psychologically-Inspired, Unsupervised Inference of Perceptual Groups of GUI Widgets from GUI Images

GIFdroid: Automated Replay of Visual Bug Reports for Android Apps

GIFdroid: An Automated Light-weight Tool for Replaying Visual Bug Reports

Gallery D.C.: Auto-created GUI Component Gallery for Design Search and Knowledge Discovery

Auto-Icon+: An Automated End-to-End Code Generation Tool for Icon Designs in UI Development

2021 Publications

Auto-icon: An automated code generation tool for icon designs assisting in UI development

2020 Publications

From lost to found: Discover missing UI design semantics through recovering missing tags

UIED: a hybrid tool for GUI element detection

2019 Publications

Gallery D.C.: Design Search and Knowledge Discovery through Auto-created GUI Component Gallery

Dynamic facial stress recognition in temporal convolutional network