Last year, Apple added a feature in iOS 15 that lets you highlight and select written and typed text in photos to interact with it like text anywhere else in the operating system.
With iOS 16, which will be available to all users in September, Apple has further improved Live Text and there are some impressive new features that we summarize below.
Live Text in Videos
Video support is the biggest new feature in Live Text. Instead of just selecting text in photos, you can now pause a video and interact with the text as you would with an image. The text in any paused video frame can be copied and pasted or translated, and it also works with Look Up. Live Text works across the operating system in Photos, Camera, Safari, and other apps. To copy text in a video, pause it at the frame you want, then touch and hold a word. You can move the two blue markers to narrow or expand your selection.
quick actions
Text included in a photo or video also supports Quick Actions, a feature Apple added in iOS 15. In iOS 16, there are new Quick Actions that let you track flights and packages, translate languages, and convert currencies — right from a photo or video. For example, if you have a photo with a sign in a foreign language, you might see the Translate Quick Action. Or if it's a foreign currency, Apple offers the Convert Quick Action.
translate camera
Apple takes advantage of the Live Text feature in the Translate app and adds a camera button that opens the device's camera so you can get live translations in real time.
New Languages
Live Text now works with Japanese, Korean and Ukrainian text, in addition to English, Chinese, French, German, Spanish, Italian and Portuguese.
Live Text Spotlight Search
Live Text features that allow text to be recognized in photos and videos can be used in Spotlight Search in iOS 16. This allows you to perform a Spotlight search to find specific text in an image or video.
iOS 16 Live Text requirements
To use the Live Text features, you need an iPhone with an A12 Bionic or higher. The 2018 iPhone XR, iPhone XS, and iPhone XS Max come with an A12 Bionic, so if you have one of these devices or newer, you can take advantage of Live Text. Whether your device is equipped with the new software is compatible, you can find out here. (Image: Apple)
