GUICourse is a group of complete datasets to train visual-based GUI agents from general VLMs, through improving VLMs' fundamental abilities and GUI knowledge. GUICourse is composed of three datasets: ...

Abstract: Graphical User Interface (GUI) based testing is a commonly used practice in industry. Although valuable and, in many cases, necessary, it is associated with challenges such as high cost and ...

Abstract: This paper presents a novel method for GUI testing in web applications that largely automates the process by integrating the advanced language model GPT-4 with Selenium, a popular web ...

As AI tools begin to transform creative workflows, Google Labs has updated Stitch, its experimental design platform that can generate user interfaces from text prompts and images. The tool, described ...

Google launched an AI-design platform, pushing Figma shares down 12% in two days. Figma, which went public in July, reached an agreement last year to use more of Google's AI services. Figma's stock is ...