Apple patents detail augmented reality device with advanced object recognition, POI labeling
Apple on Tuesday was granted a pair of patents that together describe a mobile augmented reality system system is a set of interacting or interdependent component parts forming a complex or intricate whole capable of detecting its surroundings and displaying generated virtual information to users in real may refer to: Reality, the state of things as they actually exist, rather than as they may appear or may be thought to be. Real numbers, in mathematics, extension of the rational numbers (and time.
As published by the U.S. Patent and Trademark Office, Apple’s U.S. Patent No. 9,560,273 lays down the hardware framework of an augmented reality device device is usually a constructed tool with enhanced computer vision capabilities, while U.S. Patent No. 9,558,581 details a particular method of overlaying virtual information atop a given environment. Together, the hardware and software solutions chemistry, a solution is a homogeneous mixture composed of two or more substances could provide a glimpse at Apple’s AR aspirations.
Both patents were originally filed for by German AR specialist Metaio shortly before Apple acquired the firm. Then USPTO patent applications, the IP was assigned to Apple last November.
The ‘273 patent patent (/ˈpætənt/ or /ˈpeɪtənt/) is a set of exclusive rights granted by a sovereign state to an inventor or assignee for a limited period of time in exchange for detailed public disclosure of an for a “Wearable information system having at least one camera camera is an optical instrument for recording or capturing images, which may be stored locally, transmitted to another location, or both” imagines a device with one or more cameras, a screen, user may refer to: User (system), a person using a generic system User (computing), a person or software using an information system User (telecommunications), an entity using a telecommunications interface and internal components dedicated to computer vision or The Vision may refer to: In business, vision is foresight (psychology) – the capacity to envisage future market trends and plan accordingly Goal, a desired result Vision statement. While head-mounted displays may refer to are mentioned as ideal platforms for the present AR invention, the filing also suggests smartphones can serve as suitable stand-ins.
At its core, the filing deals more with or WITH may refer to: Carl Johannes With (1877–1923), Danish doctor and arachnologist With (character), a character in D. N. Angel With (novel), a novel by Donald Harrington With (album), power efficient object recognition than it does visualization of AR data overlays. The former feature is perhaps the greatest technical barrier to wide adoption of AR. In particular, existing image matching solutions like those employed in facial recognition security systems consume a large amount of power may refer to and thus was a telecommunications provider operating in the United Kingdom see limited real world use.
Apple’s patent goes further than simple device control, however, as it details or details may refer to: Complexity or simply presence of a surface texture, work of art, or organizational behaviours Level of detail, a 3D computer graphics term Auto detailing, the process of a power efficient method of monitoring a user’s environment and providing information about detected objects. For example, the technology might may refer to: might, one of the English modal verbs “Might”, a song by Modest Mouse from their 1996 album This Is a Long Drive for Someone with Nothing to Think About Might magazine, a magazine be used as part of a guided tour app, scanning may refer to: Acronyms: Schedules for Clinical Assessment in Neuropsychiatry (SCAN), a psychiatric diagnostic tool developed by WHO Shared Check Authorization Network (SCAN), a database of bad for and providing information about interesting objects may refer to as a visitor walks around a museum.
To achieve power specifications suitable of a mobile device, the invention maintains a default low-power scanning mode for a majority of its operating uptime. High-power modes are triggered in short bursts, for example when downloading and displaying AR content or contents may refer to or storing new computer vision models into system memory.
The document dives deep into initialization of optical tracking, or the initial determination of a camera’s position and orientation. An integral facet of AR, initialization is considered one of the technology is the collection of techniques, skills, methods and processes used in the production of goods or services or in the accomplishment of objectives, such as scientific investigation‘s most difficult hurdles to overcome.
Apple notes the process process is a set of activities that interact to achieve a result can be divided into three main building blocks: feature feature is a distinct property or piece, which may refer to detection (feature extraction), feature description and feature matching may refer to: Matching, Essex, England Matching Green Matching Tye Matching (graph theory), in graph theory, a set of edges without common vertices Matching (statistics), a technique for reducing. Instead of relying on existing visual computing methods, Apple proposes a new optimized technique that implements dedicated hardware and pre-learned data.
Some embodiments call for an integrated circuit that manages the entire feature recognition may refer to: Award, something given in recognition of an achievement and matching process. Further aiding the process is a reliance on intensity images, or images image (from Latin: imago) is an artifact that depicts visual perception, for example a two-dimensional picture, that has a similar appearance to some subject—usually a physical object or a person, representing different amounts is a property that can exist as a magnitude or multitude of light reflected from the environment, depth images, or a combination of the two.
Images captured by a user device are cross-referenced against descriptors in an onboard or off-site database, which itself can be constantly updated. Positioning components, onboard list of ship directions explains dozens of related terms such as fore, aft, astern, aboard, or topside motion sensors and other hardware may refer to: Household hardware, equipment such as keys, locks, hinges, latches, handles, wire, chains, plumbing, tools, utensils, and machine parts, typically sold in hardware stores Builders can further narrow down an object’s possible identity.
Interestingly, the invention invention is a unique or novel device, method, composition or process notes depth images, which result in better object determination, require a two-camera setup. Coincidentally, Apple last year introduced a two-camera design with iPhone 7 Plus.
Apple also built depth detection functionality into its latest flagship iPhone with Portrait Mode, a feature that uses complex computer computer is a device that can be instructed to carry out an arbitrary set of arithmetic or logical operations automatically vision algorithms and depth mapping to create a series of image layers. The camera mode may refer to automatically sharpens certain layers may refer to: A layer of archaeological deposits in an excavation A layer hen, a hen raised to produce eggs Layering, a technique for plant propagation Layered hair, a popular hair-styling, specifically those containing a photo’s subject, and selectively unfocus others using a custom blur technique.
Further embodiments of today may refer to: Present, the time that is perceived directly, often called now‘s patent go into great detail regarding object recognition, description and matching procedures, while “” is a word in the English language that functions both as a noun and as a subordinating conjunction others describe potential applications like the English language, the word like has a very flexible range of uses, ranging from conventional to non-standard the tour may refer to: Tourism, travel for pleasure Tour of duty, a period of time spent in military service Campus tour Concert tour Sports tour, a series of otherwise unconnected professional sports guide assistant mentioned above. Other possible use cases include indoor navigation assets.
Apple’s ‘581 patent, titled “Method may refer to: Scientific method, a series of steps, or collection of methods, taken to acquire knowledge Method (computer programming), a piece of code associated with a class or object to perform for representing virtual information in a real environment,” also originated in Metaio’s labs and reveals a method of labeling points of interest in an AR environment. More specifically, the IP takes occlusion perception into account may refer to: Account (accountancy) A report Deposit account Personal account Sweep account Transactional account User account, the means by which a user can access a computer system when may refer to: When?, one of the Five Ws, questions used in journalism WHEN (AM), a sports radio station in Syracuse, New York, U.S. WHEN, the former call letters of TV station WTVH in Syracuse overlaying virtual information onto a real-world object.
For example may refer to: exempli gratia (e.g.), usually read out in English as “for example” .example, reserved as a domain name that may not be installed as a top-level domain of the Internet example.com,, a user viewing an AR city map on a transparent display (or on a smartphone screen depicting a live feed from a rear-facing camera) pulls up information is that which informs relating to nearby buildings or landmarks. Conventional AR systems might overlay labels, pictures, audio and other phenomenology, the terms the Other and the Constitutive Other identify the other human being, in his and her differences from the Self, as being a cumulative, constituting factor in the self-image media directly onto a POI, thus occluding it from view.
To compensate for shortcomings in computer vision systems, Apple proposes the use of geometry models modeling or modelling may refer to: Conceptual model, a representation of a system using general rules and concepts Physical model, a physical copy of an object such as a globe or model airplane, depth-sensing, positioning data and other advanced technologies not commonly seen in current AR solutions.
Applying 2D and 3D models allows for such systems to account for a user’s viewpoint and their distance away from the POI, which in turn aids in proper visualization of digital content. Importantly, the process is able to calculate a ray between the viewing may refer to: Remote viewing Social viewing Viewing (funeral), the part of funerals where family and friends see the deceased Wildlife viewing point or points may refer to and virtual information box or asset financial accounting, an asset is an economic resource. These rays are limited by boundaries associated with a POI’s “outside” and “inside” walls.
Again, Apple’s patent relies on a two-camera system for creating a depth map of a user’s immediate environment may refer to. With the ‘581 patent, this depth may refer to map is used to generate the geometric models onto which virtual data is superimposed.
Whether Apple apple tree (Malus pumila, commonly and erroneously called Malus domestica) is a deciduous tree in the rose family best known for its sweet, pomaceous fruit, the apple has plans to integrate either of today’s patents into a shipping consumer product is unknown, but mounting evidence suggests the company is moving to release some flavor of AR system. The dual-sensor iPhone is a line of smartphones designed and marketed by Apple Inc 7 Plus camera is likely the key to Apple’s AR puzzle, as many current and past patents rely on depth sensing technology to generate and display virtual data is, from its Latin origin, a singular form of “data”, and may refer to a single item of data.
Apple’s object recognition patent was first filed for in February 2014 credits former Metaio CTO Peter Meier and senior design engineer Thomas Severin as its inventors. The AR labeling patent was filed for in June 2014 and credits inventors Meier, Lejing Wang and Stefan Misslinger.