Sign In

Communications of the ACM

ACM TechNews

Picture-Driven Computing

View as: Print Mobile App Share:
GUI-based programming

Credit: MIT

Massachusetts Institute of Technology (MIT) researchers have developed Sikuli, a system that enables computer users to write programs using screen shots of graphical user interfaces (GUIs). The researchers say that Sikuli could allow novice computer users to create their own programs without having to master a programming language.

Sikuli was designed by MIT professor Rob Miller and graduate student Tsung-Hsiang Chang, and the University of Maryland's Tom Yeh. The researchers won the best-student-paper award at ACM's recent User Interface Software and Technology conference. The paper described how Sikuli can build short programs that aid other, larger programs. Sikuli uses computer vision algorithms to analyze the computer screen and can work with any program that has a graphical interface.

Another Sikuli application lets programmers who are working on large software development projects create scripts that automatically test an application's GUI components.

From MIT News
View Full Article


Abstracts Copyright © 2010 Information Inc., Bethesda, Maryland, USA


No entries found