USPatent applicationPatented

Color filter array apparatus

Granted 18 Sep 2018 · 1 office action

Application· this page
15/668,944
filed 4 Aug 2017
Publication
Not published
not published
Patent
US 10,079,255
granted 18 Sep 2018

Life of the application

9 dated events
⤢ drag to zoom20182020202220242026202820302032203420362038ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

A color filter array apparatus is provided. The apparatus includes a first color filter array comprising color filters arranged in a first pattern and a second color filter array comprising color filters arranged in a second pattern. The first pattern and second pattern may be arranged to optimize the detection or viewing of first and second objects, respectively.

Description

5 parts
›INTRODUCTION

Apparatuses and methods consistent with exemplary embodiments relate to color filter arrays. More particularly, apparatuses and methods consistent with exemplary embodiments relate to color filter arrays optimized for detecting different types of objects.

›SUMMARY

One or more exemplary embodiments provide an apparatus that includes a color filter array including two or more color filter patterns. More particularly, one or more exemplary embodiments provide a color filter array including two or more color filter patterns, each of the two or more color filter patterns are configured differently from each other to optimize detection of one or more types of objects or features in an image in different regions within an image or for different types of applications, for example to optimize viewing the image on a display by a human.

According to an exemplary embodiment, a color filter array apparatus is provided. The apparatus includes a first color filter array comprising color filters arranged in a first pattern, a second color filter array comprising color filters arranged in a second pattern. The arrangement of color filters of the second pattern is different from the arrangement of the color filters of the first pattern.

The first pattern may include color filters arranged to optimize detection of a first type of object or feature. The second pattern may include color filters arranged to optimize detection of a second type of object or feature.

The first type of object or feature may include a traffic light. The second type of object or feature may include lane markers.

The first pattern may include one green filter, two clear filters, and one red filter. The second pattern may include one blue filter and three clear filters.

The apparatus may also include a third color filter array comprising color filters arranged in a third pattern, wherein the arrangement of color filters of the third pattern is different from the first pattern and the second pattern. The third pattern may include s color filters arranged to optimize viewing of an object or feature on a display by a human.

The third pattern may include one red filter, one blue filter and two green filters.

The apparatus may include one imaging sensor configured to receive light passing through the first color filter array, the second color filter array, and the third color filter array.

The first pattern may be arranged between a plurality of the second pattern.

The apparatus may include one imaging sensor configured to receive light passing through the first color filter array and the second color filter array.

The first pattern and the second pattern may consist of a 2×2 unit cell array.

The first pattern may include three clear filters and one red filter and the second pattern may include four clear filters.

According to an exemplary embodiment, a color filter array apparatus is provided. The apparatus includes: a first color filter array including color filters arranged in a first pattern configured to optimize detection of a first type of object or feature in an image captured by a first sensor receiving light through the first color filter array; and a second color filter array including color filters arranged in a second pattern configured to optimize viewing of the image captured by the first sensor receiving light through the second color filter array.

The apparatus may also include a third color filter array comprising color filters arranged in a third pattern configured to optimize detection of a second type of object or feature in the image captured by a first sensor receiving light through the third color filter array.

The first pattern may include one green filter, two clear filters, and one red filter or one blue filter and three clear filters. The second pattern may include one red filter, one blue filter and two green filters.

Other objects, advantages and novel features of the exemplary embodiments will become more apparent from the following detailed description of exemplary embodiments and the accompanying drawings.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a diagram of a color filter array as part of a camera apparatus according to an exemplary embodiment;

FIG. 2 shows examples of patterns of color filters according to an aspect of an exemplary embodiment;

FIG. 3 shows an example of color filter array combining three patterns of color filters according to an aspect of an exemplary embodiment; and

FIG. 4 shows an example of a color filter array combining two patterns of color filters according to an aspect of an exemplary embodiment.

›DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS · 1 of 2

A color filter array apparatus will now be described in detail with reference to FIGS. 1-4 of the accompanying drawings in which like reference numerals refer to like elements throughout.

FIG. 1 shows a diagram 100 of a color filter array as part of a camera apparatus according to an exemplary embodiment. Referring to FIG. 1 , light 107 reflected off an object 101 or scene may pass through a lens 102 . The light 107 that passes through the lens 102 may then pass through color filter array 103 . The sensor 104 captures the light that passes through the color filter array 103 . The sensor 104 generates image data 109 based on the captured light. The image data 109 may be processed by image processor 105 or may be stored in raw format in memory. The image data 109 may then be processed to be displayed on a display 106

The color filter array 103 includes one or more color filters 108 that correspond to one or more sensing units of the sensor 104 . The one or more color filters 108 may only allow light of a specific wavelength to pass through the respective color filters to the respective sensing unit. The sensor 104 captures the light that passes through the color filter array 103 .

The sensor 104 includes an array of photosensors captures the light that passes through the color filter array 103 and converts that to electrical charges. The sensor may include one or more from among a pinned photodiode, a p-n junction photodiode, a Schottky photodiode, a photogate, or any other suitable photoconversion device or device that may accumulate and/or store photocharges.

The image processor 105 may include one or more from among a processor, a microprocessor, a central processing unit (CPU), a graphics processor, Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs), state machines, circuitry, and a combination of hardware, software and firmware components.

The display 106 may include one or more from among a display, a centrally-located display, a head up display, a windshield display, liquid crystal display, organic light emitting diode display, etc.

The image data may be stored on one or more from among floppy diskettes, optical disks, CD-ROMs (Compact Disc-Read Only Memories), magneto-optical disks, ROMs (Read Only Memories), RAMs (Random Access Memories), EPROMs (Erasable Programmable Read Only Memories), EEPROMs (Electrically Erasable Programmable Read Only Memories), magnetic or optical cards, flash memory, cache memory, and other type of media/machine-readable medium suitable for storing machine-executable instructions.

FIG. 2 shows examples of patterns of color filters according to an aspect of an exemplary embodiment. Referring to FIG. 2 , color filters are arranged in 2×2 patterns. The 2×2 arrangements shown are exemplary and other pattern arrangements may be used, e.g., 2×4, 4×2, 4×1, 1×4, 4×4, etc. The patterns may include a clear filter 201 , a red color filter 202 , a green color filter 203 , and a blue color filter 204 .

The clear filter 201 or transparent filter may pass white light or may pass light of all wavelengths. The clear filter 201 or transparent filter may also block infrared light. The red color filter 202 passes light corresponding to the red color wavelength. The green color filter 203 passes light corresponding to the green color wavelength. The blue color filter 204 passes light corresponding to the blue color wavelength. Color filter 201 - 204 are only examples of color filters and other color filters may be used.

The first pattern 210 includes two clear filters 201 , a red color filter 202 , and a green color filter 203 . The first pattern 210 may be repeated across a color filter array and may be combined with other patterns. The light filtered by the first pattern 210 and captured by an image sensor may be used to process image data optimized for detecting traffic lights.

The second pattern 220 includes a blue color filter 204 , a red color filter 202 , and two green color filters 203 . The second pattern 220 may be repeated across a color filter array and may be combined with other patterns. The light filtered by the second pattern 220 and captured by an image sensor may be used to process image data optimized for viewing on a display. For example, it may be optimized for viewing an image of an area behind a vehicle.

The third pattern 230 includes a blue color filter 204 , and three clear filters 201 . The third pattern 230 may be repeated across a color filter array and may be combined with other patterns. The light filtered by the third pattern 230 and captured by an image sensor may be used to process image data optimized for detecting lane features or for lane sensing.

The patterns 210 , 220 , and 230 are exemplary, and other patterns optimized for detecting other features and objects may be used in place of the exemplary patterns.

FIG. 3 shows an example of a color filter array combining three patterns of color filters according to an aspect of an exemplary embodiment. Referring to FIG. 3 , a color filter array 300 is shown. The color filter array show includes three areas corresponding to three different patterns: a first area 301 on top, a second area 302 in the middle, and a third area 303 at the bottom. The arrangement and number of the areas and patterns shown is an example and other patterns, arrangement of areas, or number of areas and patterns may be used. For example, there may be two or four areas or more. In another example, the areas may be arranged side by side.

The first area 301 includes first pattern 210 arranged in a repetitive manner across the area. The second area includes second pattern 220 arranged in a repetitive manner across the area. The third area includes third pattern 230 arranged in a repetitive manner across the area.

FIG. 4 shows an example of a color filter array combining two patterns of color filters according to an aspect of an exemplary embodiment. Referring to FIG. 4 , a first array 400 and a second array 410 are shown.

›DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS · 2 of 2

The first array 400 includes first areas 401 and second areas 402 arranged in between first area 401 . First areas 401 includes only clear filter 201 . Second areas 402 include a repetitive pattern of 2×2 color filters including three clear color filter 201 and one red color filter 202 .

The second array 410 includes first areas 411 and second areas 412 arranged in between first areas 411 . First areas 411 includes only clear color filter 201 . Second areas 412 include a repetitive pattern of 2×2 color filters including one red color filter 202 , two green color filters 203 , and one blue color filter 204 .

The following disclosure will enable one skilled in the art to practice the inventive concept. However, the exemplary embodiments disclosed herein are merely exemplary and do not limit the inventive concept to exemplary embodiments described herein. Moreover, descriptions of features or aspects of each exemplary embodiment should typically be considered as available for aspects of other exemplary embodiments.

It is also understood that where it is stated herein that a first element is “connected to,” “attached to,” “formed on,” or “disposed on” a second element, the first element may be connected directly to, formed directly on or disposed directly on the second element or there may be intervening elements between the first element and the second element, unless it is stated that a first element is “directly” connected to, attached to, formed on, or disposed on the second element. In addition, if a first element is configured to “send” or “receive” information from a second element, the first element may send or receive the information directly to or from the second element, send or receive the information via a bus, send or receive the information via a network, or send or receive the information via intermediate elements, unless the first element is indicated to send or receive information “directly” to or from the second element.

Throughout the disclosure, one or more of the elements disclosed may be combined into a single device or into one or more devices. In addition, individual elements may be provided on separate devices.

One or more exemplary embodiments have been described above with reference to the drawings. The exemplary embodiments described above should be considered in a descriptive sense only and not for purposes of limitation. Moreover, the exemplary embodiments may be modified without departing from the spirit and scope of the inventive concept, which is defined by the following claims.

Claims as granted

15 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

4 codes
IPC · International Patent Classification
Section G — Physics
  • G06V10/147
Section H — Electricity
  • H01L27/146
  • H04N25/00
  • H04N23/10

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJul 2017Oct 2017Jan 2018Apr 2018Jul 2018Oct 2018USPTOApplicantNon-final rejectionResponse after non-finalNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
1.1 y
410 days filing → grant
Office actions
1
non-final + final
Responses
1
no RCE
Examiner
Timothy J Henn
art unit 2662 · TC 2600
Citations: 17 back · 1 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20182020202220242026202820302032203420362038Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock