Researchers from Cornell University, New York, have recently developed a Jupyter notebook extension-Notate that enables users to include handwriting and sketch and convert it into code. Jupyter notebook extensions are simple add-ons used to extend the functionality of the Jupyter environment. The information about Notate was published in the 35th Annual ACM Symposium on User Interface Software and Technology.
With the pen-based extension, Notate, users can draw circuit diagrams on canvases, which can then be included in the code. Using the deep learning model, Notate extension bridges handwritten and textual programming context: notation in the handwritten chart can reference textual code and vice versa.
Lan Arawjo, a doctoral student in the field of information science at Cornell University, realized that recent developers hardly support images and graphical interfaces inside code. Therefore, Lan Arawjo, with his professors, Anthony DerArmas, Michael Roberts, Tapan Parikh, and Shrutasrhi Basu, developed Notate, artificial intelligence-enabled pen-based coding. He stated that Notate is an excellent data science tool for sketching plots and charts interacting with textual codes.
Notate is a challenge to conventional coding, which typically relies on typing. Tools like Notate are significant as they open new ways to programming and describe how different tools and practices can change the programming perspective.
Read more: London researchers develop a new visual speech recognition model
