Sign In

Communications of the ACM

ACM TechNews

Programming Tool Turns Handwriting into Computer Code

View as: Print Mobile App Share:
Writing code long-hand.

The Notate pen-based interface lets users of computational, digital notebooks open drawing canvases and handwrite diagrams within lines of traditional, digitized computer code.


A team of Cornell University researchers created the Notate interface to translate handwriting and sketches into computer code.

The pen-based interface enables digital notebook users to open drawing canvases and to handwrite diagrams within lines of traditional code.

Notate is driven by a deep learning model, allowing notation in the handwritten diagram to reference textual code and vice versa.

Cornell's Ian Arawjo said, "People are ready for this type of feature, but developers of interfaces for typing code need to take note of this and support images and graphical interfaces inside code."

From Cornell Chronicle
View Full Article


Abstracts Copyright © 2022 SmithBucklin, Washington, DC, USA


No entries found

Sign In for Full Access
» Forgot Password? » Create an ACM Web Account