In a recent interview with Chris Lawley, Apple has delved into the details of the new standout features of iPadOS 18: Math Notes and Smart Script. Features that promise to revolutionize the way we interact with our iPads, especially through the Apple Pencil, and that make the Notes app much more than just a blank sheet.
Math Notes: Reinventing the calculator
Math Notes is a tool that allows us to write mathematical expressions by hand and then see them solved instantly in our own handwriting. According to Ty Jordan, Apple’s Product Experience Manager, this feature aims to go beyond a basic or scientific calculator, integrating the use of the Apple Pencil with advanced machine learning models on the device.
“It’s like magic,” says Jordan. You just have to write the equation as if you were on paper and, like magic, you get the answer. Jordan also explains how Math Notes can automatically recognize if an equation can be graphed and how animations are incorporated to enhance visual interaction.
Smart Script: Improving handwriting
On the other hand, Smart Script is a feature designed to improve the quality of our handwriting when taking notes. According to Jordan, this system not only learns and perfects our writing style from the first stroke, but also incorporates an immediate spell checker and the ability to easily rearrange handwritten text.
“Smart Script is a machine learning model that operates on the device and learns continuously,” explains Jordan, highlighting that the feature is designed to maintain our personal style without turning it into a generic typography.
In addition, the function allows converting handwritten text into machine-written text, adding even more flexibility if we need to add external text when taking notes. “With Smart Script, we can expect a seamless integration of handwritten notes with digital ones, significantly improving the usability and aesthetics of our documents.”
A focus on user experience
Both features reflect Apple’s focus on making technology personal. We’re not just talking about the customization that comes with iOS 18, for example, we’re talking about Apple’s artificial intelligence being able to learn from our handwriting without us even realizing it.
“It works like magic. It combines the natural input of a pencil with the incredible machine learning models on the device that Jenny and her team work on. You just have to write math like on paper and it magically gives you the answer. It’s very simple and intuitive.”
With the release of iPadOS 18 scheduled for autumn, these features are already available in the beta version for developers and through the public beta. With Math Notes and Smart Script, Apple is not only adding new tools to its operating system, but is redefining what an iPad can do and what we can do with it.