5th Year MS Thesis Presentation - Xin Yue Amanda Li

— 11:00am

Location:
In Person and Virtual - ET - Gates Hillman 7101 and Zoom

Speaker:
XIN YUE AMANDA LI, Master's Student, Computer Science Department, Carnegie Mellon University
https://www.linkedin.com/in/amanda--li

WaybackUI: A Dataset to Support the Longitudinal Analysis of User Interfaces

How do user interfaces (UIs) change over time? Understanding the evolution of UIs is essential for assessing the impact on users and automated systems that interact with them. To this end, we collected WaybackUI, a dataset of nearly 100,000 UIs from 2014 -- 2024 mined from publicly available internet archives, paired with rendered screenshots and programmatically-extracted semantics. The resulting data allowed us to analyze how a decade of UI changes has impacted i) visual design, ii) accessibility, and iii) automated systems that interact with UIs. Examples of our findings include: i) a growing preference for muted color palettes in visual design, ii) an increase in the number of highly inaccessible web pages in recent years, and iii) quantifying the impact of data drift on the performance of UI understanding models. We conclude with a discussion of how WaybackUI can enable future data-driven discovery and understanding of UI trends. 

Thesis Committee Jeffrey Bigham (Chair)

Nikolas Martelaro

Additional Information

In Person and Zoom Participation.   See announcement.