Display system and method using a detached combiner

The present application is related to: U.S. patent application Ser. No. 12/700,557, entitled, “Worn Display System and Method Without Requiring Real Time Tracking For BoreSight Precision,” filed on Feb. 4, 2010, incorporated herein by reference in its entirety, and assigned to the assignee of the present application, U.S. patent application Ser. No. 13/250,621, entitled, “System For and Method of Catadioptric Collimation In a Compact Head Up Display (HUD),” filed on Sep. 30, 2011, incorporated herein by reference in its entirety and assigned to the assignee of the present application, U.S. patent application Ser. No. 13/250,940, entitled, “Head Up Display (HUD) Utilizing Diffractive Gratings Having Graded Efficiency,” filed on Sep. 30, 2011, incorporated herein by reference in its entirety, and assigned to the assignee of the present application; U.S. patent application Ser. No. 13/250,858, entitled, “Ultra-Compact HUD Utilizing Waveguide Pupil Expander With Surface Relief Gratings In High Refractive Index Materials,” filed on Sep. 30, 2011, incorporated herein by reference in its entirety, and assigned to the assignee of the present application; U.S. patent application Ser. No. 13/251,087, entitled, “System for and Method of Extending Vertical Field of View in Head Up Display Utilizing a Waveguide Combiner,” filed on Sep. 30, 2011, incorporated herein by reference in its entirety, and assigned to the assignee of the present application; U.S. patent application Ser. No. 13/250,970, entitled, “System For and Method of Stowing HUD Combiners,” filed on Sep. 30, 2011 and assigned to the assignee of the present application, incorporated herein by reference in its entirety; and U.S. patent application Ser. No. 13/250,994, entitled, “Compact Head Up Display (HUD) for Cockpits with Constrained Space Envelopes,” filed on Sep. 30, 2011, incorporated herein by reference herein in its entirety and assigned to the assignee of the present application.

The present specification relates generally to the field of displays. More specifically, the specification relates to virtual displays.

Virtual displays can provide information that is viewable in virtual space for a user of equipment, such as aircraft, ships, boats, naval craft, medical equipment, robotic equipment, remote vehicles, unmanned vehicle systems (UVSs), training simulators, entertainment systems, military equipment, land vehicles, etc. The information can include navigation parameters, guidance parameters, equipment parameters, location information, video information, remote views, symbology, etc.

Virtual displays can utilize Head Mounted Displays (HMDs) (e.g., helmet mounted displays and head worn displays) to provide images to an operator or user (e.g., a pilot in a cockpit). In aircraft applications, HMDs generally include visors, combiners, optical projection elements, an image source, and a head orientation sensor. The image source provides an image which is projected to a combiner to provide a collimated image to the pilot. The image can include enhanced vision images, targeting data, flight instrument data, synthetic vision images, head up display (HUD) data, etc.

Conventional HMDs and HUDs require bore sight accuracy. Conventional HUDs typically position the combiner and the projector for bore sight accuracy at installation. The conventional HUDs require a fixed combiner and projector, each being fixed to a single calibrated position in the cockpit. HMDs, such as those used on modern fighters, use a complex head orientation sensor to coordinate the image provided to the pilot with respect to the view within and outside the cockpit. However, complex orientation sensors are expensive, tolerance limited, bulky, require calibration, and can be inaccurate.

HMDs and HUDs have used wave guides with diffraction gratings. The gratings can be switchable Bragg gratings. Certain HMD and HUD systems (such as those described in the applications incorporated herein by reference) use an optical waveguide configured as a flat plat glass with diffraction gratings. The flat plate of glass serves as a waveguide and a combiner. Light from a single LED illuminated LCD micro display is collimated and provided in the forward field of view of the pilot as an expanded view of the image on the micro display. Generally, the expanded view image is limited to the information provided on the single micro display.

Thus, there is a need for a low cost, lightweight virtual display system capable of displaying images from more than one image source. There is also a need for a multiple display virtual display system. There is further a need for HUD or HMD system and method that can be easily integrated in the design of a cockpit without requiring extra display space. There is further a need for a HUD or HMD that can provide multiple sources of information on a combiner. There is also a need for a virtual display system and method that is optimized for providing different types of information suitable for use in a cockpit environment. Yet further, there is a need for an HMD or HUD system that displays types of information in positions that are appropriate for the particular type of information. Further still, there is a need for an HMD which does not require head tracking.

Accordingly, it would be desirable to provide a display system and/or method that provides one or more of these or other advantageous features. Other features or advantages will be made apparent in the present specification. The teachings disclosed extend to those embodiments which fall within the scope of the appended claims, regardless of whether they accomplish one or more of the aforementioned advantages or features.

An exemplary embodiment relates to apparatus that provides a virtual display in an environment for various applications including avionic, naval, military, remote control, medical and other applications. The apparatus can be a head up display (HUD) or head worn display (e.g., helmet mounted display (HMD)) and can include image sources, each disposed at a respective image source position, and a combiner detached from the image sources. The combiner is movable to a respective combiner position for receiving light from a respective image source of the image sources. The combiner provides an image from the respective image source to a user.

Another embodiment relates to an apparatus for providing a virtual display in an environment. The apparatus includes image sources, each being disposed at a respective image source position. The apparatus also includes a combiner detached from the image sources and movable to a respective combiner position for receiving light from a respective image source of the image sources. The combiner provides an image from the respective image source to a user.

Another exemplary embodiment relates to a method of providing a virtual display in an environment. The method includes positioning a combiner at one of at least two positions, the two positions being a first position for receiving collimated light from a first image source and a second position for receiving collimated light from a second image source. The method also includes providing a virtual image to eyes. The virtual image includes a first image from the first image source or a second image from a second image source. The combiner is physically detached from the first image source and the second image source.

Another embodiment relates to an apparatus for providing an optical display. The apparatus includes means for receiving an image from one of two or more image sources and providing the image to eyes, and means for positioning the means for receiving at one of a first position associated with a first image source of the images sources or a second position associated with a second image sources of the second image sources.

These and other features, aspects, and advantages of the present invention will become apparent from the following description, appended claims, and the accompanying exemplary embodiments shown in the drawings, wherein like numerals denote like elements, which are briefly described below:

FIG. 1 is a schematic general block diagram of a virtual display system including a detached combiner in accordance with an exemplary embodiment;

FIG. 2 is a more detailed block diagram of a head worn virtual display system including a detached combiner in accordance with another exemplary embodiment;

FIG. 3 is a front view schematic illustration an exemplary head worn detached combiner for use in the system illustrated in FIG. 2 in accordance with another exemplary embodiment;

FIG. 4 is a more detailed block diagram of a head up display system including a detached combiner in accordance with another exemplary embodiment; and

FIG. 5 is a side view schematic illustration of an exemplary image source and detached combiner for the virtual display system illustrated in FIG. 4 in accordance with another exemplary embodiment.

Before describing in detail the particular improved system and method, it should be observed that the invention includes, but is not limited to, a novel structural combination of components and not in the particular detailed configurations thereof. Accordingly, the structure, software, optics, methods, functions, control and arrangement of components have been illustrated in the drawings by readily understandable block representations and schematic drawings in order not to obscure the disclosure with structural details which will be readily available to those of ordinary skill in the art having the benefit of the description herein. Further, the invention is not limited to the particular embodiments depicted in the exemplary diagrams, but should be construed in accordance with the language of the claims.

With reference to FIG. 1 , a virtual display system 10 provides a virtual image at one or more locations in an environment 11 . System 10 can be part of a head up display (HUD) system, a head worn display system, a helmet mounted display (HMD) system, or other worn display system. Virtual display system 10 can be utilized in various applications, including but not limited to aviation, medical, naval, targeting, ground-based vehicle, military, remote control, etc. In one embodiment, virtual display system 10 is configured for use in smaller cockpit embodiments, for use in remote vehicle or aircraft applications, for use in ships or boats, or for use in simulators or other training devices. System 10 can be utilized for two dimensional or three dimensional virtual images.

In one embodiment, virtual display system 10 is utilized in an operational system or a training system to observe and control aircraft or vehicle operation. Virtual system 10 is disposed in environment 11 which can be a cockpit, bridge, operating room, etc. Environment 11 can have a window 19 or port to an environment 21 external to environment 11 in one embodiment. For example, environment 11 can be an aircraft cockpit, and environment 12 can be the real world viewable through the windshield of the cockpit.

Virtual display system 10 includes two or more image sources 12 and 14 in one embodiment. Image sources 12 and 14 are positioned at respective positions within environment 11 . Display system 10 also includes a combiner 16 . Combiner 16 is movable into one or more positions corresponding to the positions of image sources 12 and 14 in one embodiment. In one embodiment, combiner 16 can be positioned in a position 30 A associated with image source 14 and a position 30 B associated with image source 12 . In another embodiment, combiner 16 is movable by changing its angle of view from a view of source 12 to a view of source 14 or vice versa. In an embodiment in which combiner 16 is worn on the head, the position of combiner 16 can be changed by turning the head to view image source 12 or image source 14 .

A user 20 can view information from image source 12 when combiner 16 is positioned at position 30 B and can view information from image source 14 when combiner 16 is positioned at position 30 A. Alternatively, a user 20 can view information from image source 12 when the view through combiner 16 points toward source 12 and can view information from image source 14 when the view through combiner 16 points toward image source 14 . Image sources 12 and 14 can be a variety of optical devices for providing light to combiner 16 . Image sources 12 and 14 can be embodied as projectors for providing collimated light to combiner 16 .

Combiner 16 can be embodied as a head worn combiner or a HUD combiner. In one embodiment, combiner 16 utilizes wave guide optics and diffraction gratings to receive collimated light provided by sources 12 and 14 and provide collimated light to a user 20 . Therefore, system 10 can take advantage of the optical nature of wave guide technology to overlay symbology conforming on the viewed outside scene without dependence on the position of combiner 16 but only on the location of image sources 12 and 14 according to one embodiment. Therefore, combiner 16 is physically detached from image sources 12 and 14 and not in a fixed location relative to the aircraft bore sight according to one embodiment.

Advantageously, system 10 can take advantage of periscopic effects so that rays of light entering combiner 16 are parallel and in a reverse direction to rays of light entering combiner 16 from one of image sources 12 and 14 according to one embodiment. In one embodiment, combiner 16 is entirely passive and insensitive to movement in all six degrees of freedom according to one embodiment. In this way, system 10 does not require head tracking equipment and/or electric connectivity between combiner 16 and other parts of environment 11 according to one embodiment. Alternatively, head tracking equipment and electrical connectivity can be used with system 10 .

Image sources 12 and 14 can be or include any type of devices for providing an image including but not limited to a CRT display, an LED display, an active matrix liquid crystal display (LCD), a light emitting diode, laser illuminator, etc. In a preferred embodiment, image sources 12 and 14 include a micro LCD assembly or liquid crystal on silicon (LCOS) display and can provide linearly polarized light. Image sources 12 and 14 can include a laser or LED backlight.

Image sources 12 and 14 can also include collimating optics which can be a single optical component, such as a lens, or include multiple optical components. The collimating optics can be integrated with each of image sources 12 and 14 in one embodiment. The collimating optics can also be separate or partially separate from image sources 12 and 14 .

In operation, display system 10 provides images from one of sources image source 12 and 14 to a pilot or other operator so that he or she can simultaneously view the images and a real world scene in one embodiment. The images can include graphic and/or text information (e.g., flight path vector, target icons, symbols, fuel indicators, course deviation indicator, pitch indicator, etc.). The image can also include information from other sensors or equipment associated with environment 10 (e.g., a vertical traffic collision avoidance display, terrain avoidance and awareness display, a weather radar display, flight control sensors, an electronic flight bag, a navigation system, environmental sensors, etc. in an aircraft) in one embodiment. In addition, the images can include synthetic or enhanced vision images. In one embodiment, collimated light representing the image from image source 12 is provided on combiner 16 so that the pilot can view the image conformally on the real world scene through combiner 16 . In one embodiment, the image from image source 14 is an image associated with navigation or electronic flight bags and does not require conformal presentation with a real world scene.

Image sources 12 and 14 can provide information from a variety of sources. In one embodiment, image sources 12 and 14 can provide information from aircraft sensors, instruments, and systems including but not limited to one or more of a targeting computer, a HUD computer, a synthetic vision system (SVS), an enhanced vision system (EVS), a flight computer, a navigation system, an electronic flight bag system and a virtual displays system.

With reference to FIG. 2 , a display system 200 similar to display system 10 includes a combiner 216 , and image sources 212 , 213 and 214 . A pilot 220 can wear combiner 216 which can be a binocular combiner or a monocular combiner. Combiner 216 is preferably a waveguide combiner with a diffractive grating input and a diffractive grating output. Combiner 216 can be integrated with or attached to a helmet, glasses, a head band, hat, etc. according to various embodiments.

System 200 is employed in an aircraft environment 211 or a cockpit including a window 254 and a window 256 in one embodiment. In addition, environment 211 can include a control panel 202 , a primary flight display 204 , a navigation display 206 , a navigation display 208 , a primary flight display 210 , an electronic flight bag 212 and electronic flight bag 214 . Primary flight display 210 , a navigation display 208 , and electronic flight bag 214 can be redundant systems provided for a co-pilot, as shown in FIG. 2 according to one embodiment.

In operation, when the pilot's view is positioned in front of image source 213 at position 230 B, the pilot receives primary flight display information or symbology associated with primary flight display 204 on combiner 216 . A HUD computer can provide the data for the image on source 213 in one embodiment. In one embodiment, the primary flight symbology is conformal with the outside environment viewed by the pilot through window 254 (e.g., center image source 213 is aligned with the view through window 254 ). Pilot 220 can turn or rotate head position to view information on combiner 216 associated with image source 214 at position 230 A. Image source 214 can be configured to provide electronic flight bag information associated with an electronic flight bag display 212 . Pilot 220 can turn or rotate head position to view information on combiner 216 associated with image source 212 at position 230 C. Image source 212 can be configured to provide navigation information associated with navigation display 212 .

A field of view 272 through combiner 216 for the information on image source 213 includes window 254 . A field of view 270 of combiner 216 for information on image source 214 includes only a small portion of window 254 in one embodiment. A view through window 254 is generally not necessary when viewing electronic flight bag information. Field of view 270 including image source 214 can be positioned below a glare shield in one embodiment. A field of view 278 of combiner 216 for the information on image source 212 can be above the glare shield and include portions of windows 254 and 256 .

Although only three image sources 212 , 213 , and 214 and fields of view 270 , 272 , and 278 are shown in FIG. 2 , more image sources and fields of view can be provided. Advantageously, pilot 220 can obtain information from three different systems simply by rotating head position to the appropriate position associated with the appropriate information. As shown in the embodiment in FIG. 2 , rotating the head position to the left results in receiving electronic flight bag information on combiner 216 , and rotating the head position to the right allows pilot 220 to view navigation information.

In one embodiment, image source 212 is positioned at a position 230 C, which is below the positions associated with positions 230 A and 230 B. With such a position, by looking downward, pilot 220 can receive the information associated with image source 212 . In such an embodiment, the image source 212 provides information that need not be conformal with views outside of windows 254 and 256 .

In one embodiment, combiner 216 can be movable along the pilot's head. For example, the pilot can have a left-eye view associated with position 230 B and a right-eye view associated with position 230 C. In this way, the pilot can select which information is received by combiner 216 . For example, when performing electronic flight bag tests, combiner 216 can be positioned in front of an eye associated with image source 214 and when in flight, combiner 216 can be positioned in front of an eye associated with image source 213 and primary flight data. Alternatively, a combiner 216 is binocular combiner or is provided only in front of one eye.

With reference to FIG. 3 , a combiner system 300 can be utilized in systems 10 and 200 . Combiner system 300 includes a combiner 316 and a band 318 worn by pilot 320 . An alignment sensor 322 can be provided on a portion of band 314 . Combiner 316 can be movable via a clip 314 on band 318 . Light from image sources can be received at a front face 342 of combiner 316 or a slanted top surface 344 . A diffraction grating can be provided on face 342 or surface 344 to inject light into the body of combiner 316 , and a diffraction grating can eject light toward the eye of pilot 320 .

With reference to FIG. 4 , a display system 400 , similar to display system 10 , is configured for use in a cockpit environment 411 . Display system includes a HUD combiner 416 and image sources 412 , 414 and 416 . Combiner 416 is movable to position 430 A associated with image source 414 , position 430 B associated with image source 413 and position 430 C associated with image source 412 . Combiner 416 is attachable to a rail 462 .

Rail 462 can be a three segment rail including segments 464 A, 464 B and 464 C in one embodiment. Rail 462 can be configured in accordance with a cockpit configuration associated with a window 472 and a window 474 . Rail 462 allows combiner 416 to align with eyes of pilot 420 when it is positioned outside of center position 430 B (e.g., in positions 430 A and 430 C.). Environment 411 includes electronic flight bag system 412 , control panel 402 , primary flight display 404 , navigation display 406 , navigation display 408 , primary flight display 410 and electronic flight bag system 414 . Combiner 416 is preferably slidable along rail 416 to each of positions 430 A, 430 B, and 430 C. In one embodiment, a detente mechanism or clamp mechanism can be utilized to lock combiner 416 into one of positions 430 A, 430 B and 430 C along rail 462 .

At position 430 A, combiner 416 provides electronic flight bag information from image source 414 . When positioned at position 430 B, combiner 416 provides primary flight display information associated with source 413 conformally viewed through window 472 . When combiner 416 is positioned at position 430 C, combiner 416 provides navigation information from image source 412 to pilot 420 . Advantageously, display system 400 is a HUD that can present the same information as viewed from the flight deck of a primary flight display (e.g., display 404 ) with symbols displayed conformally as appropriate to an outside scene through window 472 according to one embodiment. Fields of view for positions 430 A, 430 B, and 430 C can be similar to the fields of view 270 , 272 , and 278 discussed with reference to FIG. 2 . In one embodiment, the fields of view associated with positions 430 A, 430 B, and 430 C are vertically similar.

With reference to FIG. 5 , image source 413 includes a backlit liquid crystal display module 470 including a transmissive AMLCD display 473 . A very compact optical system 474 receives light from lens 472 and provides collimated light to combiner 416 (e.g., collimation via a catadioptric folded collimator in one embodiment). Generally, the collimated light input to combiner 416 has a small dimension in a vertical direction allowing a compact design. Combiner 416 includes a diffractive grating 476 for coupling light into the waveguide associated with combiner 416 and a diffractive grating 478 that ejects light out of combiner 416 to pilot 420 . Gratings 476 and 478 are configured for pupil expansion

The image sources 412 and 414 can be similar to image source 413 discussed above with reference to FIG. 5 . Sources 412 , 413 and 414 can be attached to a ceiling of the cockpit in one embodiment.

While the detailed drawings, specific examples, and particular configurations given describe preferred and exemplary embodiments, they serve the purpose of illustration only. The inventions disclosed are not limited to the specific forms shown. For example, the methods may be performed in any of a variety of sequence of steps or according to any of a variety of mathematical formulas. The hardware and software configurations shown and described may differ depending on the chosen performance characteristics and physical characteristics of the communications devices. For example, the type of system components and their interconnections may differ. The systems and methods depicted and described are not limited to the precise details and conditions disclosed. The figures show preferred exemplary operations only. The specific data types and operations are shown in a non-limiting fashion. Furthermore, other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangement of the exemplary embodiments without departing from the scope of the invention as expressed in the appended claims.