The patent and trademark office has granted Apple a new patent for the development in the field of synchronized interactive augmented reality. According Holographica, the document describes a system that can be used in future iOS devices, including integrated with goggles to view the AR/VR content.
The patent describes Apple development in the area of overlap of the annotations on the image from the camera device in real-time by the user or automatically from local or network data sources. Such a device may be a smartphone, tablet, game console, music player or PC. Annotations can be text, multimedia or hypertext (containing links to other data) and displayed either automatically or in response to the recorded computer events.
Before the formation of the information layer objects must be identified in real-time — automatically or manually. Used identification methods include contour recognition, SIFT, pattern matching, gradient histograms, intraclass transfer learning, explicit or implicit, three-dimensional object models, global scene representations, shading, reflectance, texture, thematic model, three-dimensional characters, context, leveraging Internet data, etc.
The annotation may also occur during the transfer of streaming video between devices, when the screen of one gadget data appears superimposed on the image by the user or automatically from another device.
One of the scenarios the implementation of augmented reality involves the use of loupe — region of the magnified image, which the user can move around the screen in real time. For three-dimensional shooting using a single camera is proposed to do two pictures from different angles, which a computer stitches and interprets data from the position sensors of the device.
As the case studies for health care describes the recognition of the faces of the patients and display information about them on the screen, the diagnosis from external features (e.g., skin color), streaming video to other specialists for consultation, display real-time data with x-ray or MRI. As an example of the use of technology for the automotive industry is the annotation of the video with the engine for repairs and the recognition of the individual parts and the removal of the excerpts from the manuals.
Also describes a potentially very useful consumer case. It is to share streaming video between two gadgets, one of which recognizes the environment and sends data about the location of the user on the second, which shows him as geo-location tag to true for streaming video. Thus encouraged to tell friends about where the user is located.
