Image sensor for controlling a transmission speed of sensed image data and image processing system including the same
Granted 11 Jul 2017 · 2 office actions
Assignee: Samsung Electronics
Law firm: Law firm · Log in to unlock
Attorney: Attorney · Log in to unlock
Inventors: Jin Ho Seo, Jin Young Jeong, Sung Ho Suh, Hyeok Jong Lee +1 · Examiner: Nicholas Giles · AU 2662 · TC 2600
Life of the application
13 dated eventsAbstract
In one embodiment, an image sensor includes a pixel array including a plurality of pixels, an analog-to-digital converter configured to convert analog pixel signals output from the pixels into digital signals, a first cluster configured to store a first group of digital signals among the digital signals and to output first image data, a second cluster configured to store a second group of digital signals among the digital signals and to output second image data, and at least one cluster switch connected to the first cluster and the second cluster, a first channel, and a second channel. The image sensor is configured to transmit at least one among the first image data and the second image data to at least one among the first channel and the second channel based on an operation mode.
Description
16 parts›CROSS-REFERENCE TO RELATED APPLICATIONS
This application claims priority under 35 U.S.C. §119(a) from Korean Patent Application No. 10-2014-0046988 filed on Apr. 18, 2014, the disclosure of which is hereby incorporated by reference in its entirety.
›BACKGROUND
Embodiments of the inventive concepts relate to an image sensor, and more particularly, to an image sensor for controlling a transmission speed of sensed image data and a number of transmission channels based on variable channel interface and/or an image processing system including the same.
When image data is sensed and stored using a camera, the image data is acquired by an image sensor. The image sensor includes a plurality of pixels that sense light. The image data sensed by the pixels is stored in an internal memory within the image sensor. The image data is transmitted from the memory to an image signal processor (ISP), which is connected to the image sensor, to be processed. The size (or amount) of the image data transmitted from the image sensor to the ISP may vary with a number of pixels included in the image sensor and an available frame rate.
When the specification of an image sensor is determined, the image sensor is customized according to the specification. In this case, the power and/or area of circuits implemented in the image sensor can be optimized. However, when the specification is changed, the design of the image sensor changes according to the changed specification. This process takes a lot of time and is also costly.
›SUMMARY
Some embodiments of the inventive concepts provide an image sensor for adjusting a transmission speed of sensed image data and a number of transmission channels based on a variable channel interface structure and/or an image processing system including the same.
According to some embodiments of the inventive concepts, there is provided an image sensor including a pixel array including a plurality of pixels, an analog-to-digital converter configured to convert analog pixel signals output from the pixels into digital signals, a first cluster configured to store a first group of digital signals among the digital signals and to output first image data, a second cluster configured to store a second group of digital signals among the digital signals and to output second image data, at least one cluster switch connected to the first cluster and the second cluster, a first channel, and a second channel. The image sensor is configured to transmit at least one among the first image data and the second image data to at least one among the first channel and the second channel based on an operation mode.
The first cluster may include a first buffer memory block configured to receive and store the first group of digital signal, a first data bus, a plurality of first column switches configured to transmit the first group of digital signals from the first buffer memory block to the first data bus, a first sense amplifier connected to the first channel, and a first bus switch connected between the first data bus and the first sense amplifier.
The second cluster may include a second buffer memory block configured to receive and store the second group of digital signal, a second data bus, a plurality of second column switches configured to transmit the second group of digital signals from the second buffer memory block to the second data bus, a second sense amplifier connected to the second channel, and a second bus switch connected between the second data bus and the second sense amplifier.
The at least one cluster switch may be connected between the first data bus and the second data bus and may always be in an on-state.
The image sensor may further include a first physical layer (PHY) connected between the first channel and the first sense amplifier to change a protocol of output signals of the first sense amplifier and a second PHY connected between the second channel and the second sense amplifier to change a protocol of output signals of the second sense amplifier.
The at least one cluster switch may include a first cluster switch connected between the first channel and the first cluster, a second cluster switch and a third cluster switch connected in series between the first cluster and the second cluster, and a fourth cluster switch connected between the second cluster and the second channel.
The first cluster may include a plurality of first bank buffer units connected in series between the first cluster switch and the second cluster switch. The second cluster may include a plurality of second bank buffer units connected in series between the third cluster switch and the fourth cluster switch. Image data processed by the second bank buffer units may be transmitted to the first bank buffer units through the second and third cluster switches, which are connected to each other, based on the operation mode.
According to other embodiments of the inventive concepts, there is provided an image processing system including an image sensor and a first image signal processor connected with the image sensor through a first channel. The image sensor includes a pixel array including a plurality of pixels, an analog-to-digital converter configured to convert analog pixel signals output from the pixels into digital signals, a first cluster connected to the first channel to store and output a first group of digital signals among the digital signals, a second cluster configured to store and output a second group of digital signals among the digital signals, and at least one cluster switch connected between the first cluster and the second cluster.
The first cluster may include a first buffer memory block configured to receive and store the first group of digital signal, a first data bus, a plurality of first column switches configured to transmit the first group of digital signals from the first buffer memory block to the first data bus, a first sense amplifier connected to the first channel, and a first bus switch connected between the first data bus and the first sense amplifier.
The second cluster may be connected to the first image signal processor through a second channel. The second cluster may include a second buffer memory block configured to receive and store the second group of digital signal, a second data bus, a plurality of second column switches configured to transmit the second group of digital signals from the second buffer memory block to the second data bus, a second sense amplifier connected to the second channel, and a second bus switch connected between the second data bus and the second sense amplifier.
The at least one cluster switch may be connected between the first data bus and the second data bus.
The image processing system may further include a second image signal processor connected to the second cluster through a second channel. The second cluster may include a second buffer memory block configured to receive and store the second group of digital signal, a second data bus, a plurality of second column switches configured to transmit the second group of digital signals from the second buffer memory block to the second data bus, a second sense amplifier connected to the second channel, and a second bus switch connected between the second data bus and the second sense amplifier.
The image sensor and the first image signal processor may be formed on one silicon substrate. The first image signal processor may be embedded in the image sensor.
According to further embodiments of the inventive concepts, there is provided an image sensor including a plurality of column lines, a first cluster connected to a first group of column lines among the plurality of column lines to store first image data received from the first group of column lines, a second cluster connected to a second group of column lines among the plurality of column lines to store second image data received from the second group of column lines, at least one cluster switch connected between the first cluster and the second cluster, a first channel connected to the first cluster, and a second channel connected to the second cluster. At least one among the first image data and the second image data may be transmitted through at least one among the first channel and the second channel based on an operation mode.
›BRIEF DESCRIPTION OF THE DRAWINGS
The above and other features and advantages of the inventive concepts will become more apparent by describing in detail example embodiments thereof with reference to the attached drawings in which:
FIG. 1 is a block diagram of an image processing system according to some embodiments of the inventive concepts;
FIG. 2 is a block diagram of an image processing system according to other embodiments of the inventive concepts;
FIG. 3 is a block diagram of a buffer bank according to some embodiments of the inventive concepts;
FIG. 4 is a block diagram of an image sensor according to some embodiments of the inventive concepts;
FIG. 5 is a timing chart showing the operation of the image sensor illustrated in FIG. 4 ;
FIG. 6 is a block diagram of an image sensor according to other embodiments of the inventive concepts;
FIG. 7 is a timing chart showing the operation of the image sensor illustrated in FIG. 6 ;
FIG. 8 is a block diagram of a first cluster switch according to some embodiments of the inventive concepts;
FIG. 9 is a block diagram of a second cluster switch according to some embodiments of the inventive concepts;
FIG. 10 is a block diagram of an image sensor according to still other embodiments of the inventive concepts;
FIG. 11 is a block diagram of an image sensor according to even other embodiments of the inventive concepts:
FIG. 12 is a block diagram of an image sensor according to yet other embodiments of the inventive concepts;
FIG. 13 is a block diagram of an image sensor according to further embodiments of the inventive concepts;
FIG. 14 is a flowchart of an image data latching operation of an image sensor according to some embodiments of the inventive concepts;
FIG. 15 is a flowchart of a variable channel output operation of an image sensor according to some embodiments of the inventive concepts; and
FIG. 16 is a diagram of an electronic system and interface according to some embodiments of the inventive concepts.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 1 of 12
The inventive concepts now will be described more fully hereinafter with reference to the accompanying drawings, in which embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In the drawings, the size and relative sizes of layers and regions may be exaggerated for clarity. Like numbers refer to like elements throughout.
It will be understood that when an element is referred to as being “connected” or “coupled” to another element, it can be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being “directly connected” or “directly coupled” to another element, there are no intervening elements present. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items and may be abbreviated as “/”.
It will be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first signal could be termed a second signal, and, similarly, a second signal could be termed a first signal without departing from the teachings of the disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” or “includes” and/or “including” when used in this specification, specify the presence of stated features, regions, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, regions, integers, steps, operations, elements, components, and/or groups thereof.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and/or the present application, and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
FIG. 1 is a block diagram of an image processing system 100 according to some embodiments of the inventive concepts. Referring to FIG. 1 , the image processing system 100 includes an image sensor 70 that can change an image data transmission channel (simply referred to as a “channel”) and a first image signal processor (ISP) 80 - 1 .
The image sensor 70 , e.g., a complementary metal-oxide semiconductor (CMOS) image sensor, includes a pixel array 10 , a row driver 15 , an analog-to-digital converter (ADC) 20 , a buffer 40 , a ramp signal generator 25 , and a timing generator 35 .
The pixel array 10 includes a plurality of pixels in an active region. The pixels may include a red pixel which converts light in the red spectrum into an electrical signal, a green pixel which converts light in the green spectrum into an electrical signal, and a blue pixel which converts light in the blue spectrum into an electrical signal. In addition, a color filter may be arrayed above each of the pixels to transmit light in a particular spectrum.
The row driver 15 may generate a plurality of control signals for controlling the light sensing operations of the pixels according to the control of the timing generator 35 . The row driver 15 may drive the pixels in units of rows.
The ADC 20 converts signals output from the pixels into digital signals. The ADC 20 includes a comparison block 21 and a counter block 23 .
The comparison block 21 includes a plurality of comparators 22 connected with the pixel array 10 and the ramp signal generator 25 . An each output signal of the pixel array 10 is input to a first input terminal of each of the comparators 22 and a ramp signal Ramp output from the ramp signal generator 25 is input to a second input terminal of each comparator 22 . Each comparator 22 may compare the each output signal of the pixel array 10 with the ramp signal Ramp from the ramp signal generator 25 and output a comparison result signal.
At this time, the comparison result signal output from each comparator 22 may correspond to a difference between a reset signal and an image signal that changes according to external illumination. The ramp signal Ramp is used to output the difference between the image signal and the reset signal. The difference between the image signal and the reset signal may be picked up and output in accordance with a slope of the ramp signal Ramp. The ramp signal generator 25 may operate based on a control signal generated by the timing generator 35 .
The counter block 23 includes a plurality of counters 24 . Each of the counters 24 is connected to an output terminal of corresponding one of the comparators 22 . Each counter 24 counts the comparison result signal based on a counter clock signal CNT_CLK output from the timing generator 35 and outputs a digital signal corresponding to a count result.
For example, each counter 24 may function as a column counter. At this time, the counter clock signal CNT_CLK may be generated, based on a counter control signal generated by the timing generator 35 , by a counter controller (not shown) that is implemented within the counter block 23 or is connected to the timing generator 35 .
At this time, the counter block 23 includes an up/down counter or a bit-wise inversion counter. The bit-wise inversion counter may perform a similar operation to the up/down counter. For example, the bit-wise inversion counter has a function of performing up-count and a function of inverting all bits in a counter into a 1's complement in response to a certain signal, and therefore, the bit-wise inversion counter performs a reset count and inverts a count value into a 1's complement, i.e., a negative value using those functions.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 2 of 12
The buffer 40 includes a first cluster 40 - 1 and a second cluster 40 - 2 . The first cluster 40 - 1 may transmit digital signals BCNT 1 in a first group among a plurality of digital signals output from the ADC 20 to a first channel 70 - 1 and/or a second channel 70 - 2 according to connection or disconnection of a cluster switch 46 . The first cluster 40 - 1 includes a first buffer memory block 41 - 1 , a plurality of first column switches 43 - 1 , a first bus switch 44 - 1 , and a first sense amplifier 45 - 1 .
The second cluster 40 - 2 may transmit digital signals BCNT 2 in a second group among a plurality of digital signals output from the ADC 20 to the first channel 70 - 1 and/or the second channel 70 - 2 according to connection or disconnection of the cluster switch 46 . The second cluster 40 - 2 includes a second buffer memory block 41 - 2 , a plurality of second column switches 43 - 2 , a second bus switch 44 - 2 , and a second sense amplifier 45 - 2 .
The first buffer memory block 41 - 1 includes a plurality of buffer memories 42 - 1 and the second buffer memory block 41 - 2 includes a plurality of buffer memories 42 - 2 . The buffer memories 42 - 1 and 42 - 2 may operate according to a control signal generated by the timing generator 35 or a buffer control signal generated by a memory controller (not shown) connected to each of the buffer memory blocks 41 - 1 and 41 - 2 or the timing generator 35 . Each of the buffer memories 42 - 1 and 42 - 2 may be implemented using volatile memory such as static random access memory (SRAM).
The column switches 43 - 1 and 43 - 2 and the bus switches 44 - 1 and 44 - 2 are used to deliver an output signal of each of the buffer memories 42 - 1 and 42 - 2 , which is selected according to a buffer clock signal SCLK generated by the timing generator 35 and a buffer control signal generated by the memory controller, to the sense amplifier 45 - 1 or 45 - 2 through data buses BUS 1 and BUS 2 .
According to a buffer control signal, each of the buffer memory blocks 41 - 1 and 41 - 2 temporarily stores an output signal of the ADC 20 and then outputs the signal to the sense amplifier 45 - 1 or 45 - 2 through the switches 43 - 1 and 44 - 1 or the switches 43 - 2 and 44 - 2 .
The first sense amplifier 45 - 1 senses and amplifies an output signal of the first bus switch 44 - 1 and outputs an amplified signal. The second sense amplifier 45 - 2 senses and amplifies an output signal of the second bus switch 44 - 2 and outputs an amplified signal. Each of the buffer memory blocks 41 - 1 and 41 - 2 may include a latch (not shown) that stores a sensed output. The latch may be connected to an output of the sense amplifier 45 - 1 or 45 - 2 or may be integrated into the sense amplifier 45 - 1 or 45 - 2 .
The cluster switch 46 controls the connection between the first data bus BUS 1 corresponding to the first cluster 40 - 1 and the second data bus BUS 2 corresponding to the second cluster 40 - 2 . Although the cluster switch 46 is positioned between the first cluster 40 - 1 and the second cluster 40 - 2 in the embodiments illustrated in FIG. 1 , the cluster switch 46 may be positioned within one of the first cluster 40 - 1 and the second cluster 40 - 2 in other embodiments. The timing generator 35 outputs control signals for controlling the operations of the elements 15 , 25 , 20 , and 40 .
The image sensor 70 may include a first physical layer (PHY) 60 - 1 that may convert and transmit an output signal of the sense amplifier 45 - 1 of the first cluster 40 - 1 according to a first communication protocol. The image sensor 70 may also include a second PHY 60 - 2 that may convert and transmit an output signal of the sense amplifier 45 - 2 of the second cluster 40 - 2 according to a second communication protocol. The first PHY 60 - 1 and the second PHY 60 - 2 may indicate an interface.
The first and second communication protocols may be a mobile industry processor interface (MIPI®) protocol, but they are not limited thereto. The first and second communication protocols may be a different communication protocol from the MIPI® protocol and may have transmission features different from MIPI transmission features.
The image sensor 70 may transmit image data corresponding to output signals of the pixel array 10 to the first ISP 80 - 1 through the first PHY 60 - 1 or the second PHY 60 - 2 . For example, the first ISP 80 - 1 may receive the image data from the buffer 40 , may process the image data to be nice for people to look at, and may transmit processed data to another image processing device (not shown).
Although the first ISP 80 - 1 is positioned outside the image sensor 70 in the embodiments illustrated in FIG. 1 , the first ISP 80 - 1 may be positioned within the image sensor 70 in other embodiments. When the first ISP 80 - 1 is positioned within the image sensor 70 , the first PHY 60 - 1 may be omitted in terms of design.
The first ISP 80 - 1 may be selectively connected to either the first PHY 60 - 1 or the second PHY 60 - 2 . An ISP connected to each PHY 60 - 1 or 60 - 2 may have a different specification. For example, the ISP may be a high performance ISP, i.e., big ISP or a low-power ISP, i.e., little ISP.
The image sensor 70 illustrated in FIG. 1 includes a structure in which image data corresponding to output signals of the pixel array 10 is transmitted to a single channel or a plurality of channels.
In detail, as shown in FIG. 1 , when the first bus switch 44 - 1 of the first cluster 40 - 1 is turned on, the second bus switch 44 - 2 of the second cluster 40 - 2 is turned off, and the cluster switch 46 is turned on; all image data stored in the buffer 40 is transmitted to the first ISP 80 - 1 through the first PHY 60 - 1 and the first channel 70 - 1 . In other words, the image sensor 70 may control the bus switches 44 - 1 and 44 - 2 and the cluster switch 46 to deliver image data to the first ISP 80 - 1 through one channel 70 - 1 .
However, when the first bus switch 44 - 1 of the first cluster 40 - 1 is turned off, the second bus switch 44 - 2 of the second cluster 40 - 2 is turned on, and the cluster switch 46 is turned on; all image data stored in the buffer 40 is transmitted to the first ISP 80 - 1 through the second PHY 60 - 2 and the second channel 70 - 2 . In other words, the image sensor 70 may control the bus switches 44 - 1 and 44 - 2 and the cluster switch 46 to deliver image data to the first ISP 80 - 1 through one channel 70 - 2 . At this time, the cluster switch 46 may be replaced with a transmission line.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 3 of 12
The image processing system 100 illustrated in FIG. 1 includes two channels 70 - 1 and 70 - 2 . When the image sensor 70 is connected to an external ISP or an external signal processing device, package bonding is easy. In addition, since the image sensor 70 is closely connected with the external ISP or the external signal processing device, noise is reduced in the image processing system 100 .
In addition, each of the first PHY 60 - 1 and the second PHY 60 - 2 may have different performance, power, transmission feature or protocol according to a type of external ISP connected thereto.
The first ISP 80 - 1 may be embedded in the image sensor 70 in other embodiments. When the first ISP 80 - 1 is an embedded ISP, the first PHY 60 - 1 may not be implemented. When the first ISP 80 - 1 is an embedded ISP, the image sensor 70 may transmit image data to an external ISP without running the first ISP 80 - 1 . For example, when an embedded first ISP is a low-power ISP or a low performance ISP, an external ISP may be a high performance ISP.
FIG. 2 is a block diagram of an image processing system 200 according to other embodiments of the inventive concepts. Referring to FIG. 2 , the image processing system 200 includes an image sensor 70 , a first ISP 80 - 1 , and a second ISP 80 - 2 . The image sensor 70 illustrated in FIG. 2 includes the same elements as the image sensor 70 illustrated in FIG. 1 .
The first PHY 60 - 1 in the image sensor 70 receives image data from the first cluster 40 - 1 and transmits the image data to the first ISP 80 - 1 through the first channel 70 - 1 according to a first communication protocol. The second PHY 60 - 2 receives image data from the second cluster 40 - 2 and transmits the image data to the second ISP 80 - 2 through the second channel 70 - 2 according to a second communication protocol. At this time, the first communication protocol may be the same as the second communication protocol. For example, the first communication protocol and the second communication protocol may be a MIPI protocol. However, they are not restricted to the MIPI protocol and may be a different protocol according to a type of an external ISP.
The image sensor 70 illustrated in FIG. 2 includes a structure in which image data generated from the pixel array 10 is transmitted to either a single channel 70 - 1 or 70 - 2 or a plurality of channels 70 - 1 and 70 - 2 .
In detail, as shown in FIG. 2 , when both the first bus switch 44 - 1 of the first cluster 40 - 1 and the second bus switch 44 - 2 of the second cluster 40 - 2 are turned on and the cluster switch 46 is turned off, image data stored in the first buffer memory block 41 - 1 is transmitted to the first ISP 80 - 1 through the first PHY 60 - 1 and image data stored in the second buffer memory block 41 - 2 is transmitted to the second ISP 80 - 2 through the second PHY 60 - 2 . In other words, the image sensor 70 may control the bus switches 44 - 1 and 44 - 2 and the cluster switch 46 to transmit image data from the first cluster 40 - 1 and image data from the second cluster 40 - 2 to the ISPs 80 - 1 and 80 - 2 , respectively, through the channels 70 - 1 and 70 - 2 , respectively.
The first cluster 40 - 1 and the second cluster 40 - 2 are defined by grouping columns of the pixel array 10 into clusters. The size of a cluster may vary with different embodiments. Although only two clusters are illustrated in the embodiments illustrated in FIGS. 1 and 2 for clarity of the description, the scope of the inventive concepts are not limited to these embodiments. The number of image data transmission channels (i.e., channels) for the image sensor 70 may increase according to the number of clusters.
In the embodiments illustrated in FIG. 2 , the first ISP 80 - 1 and the second ISP 80 - 2 may be formed together on one silicon substrate or may be respectively formed on different silicon substrates. At least one of the ISPs 80 - 1 and 80 - 2 may be embedded in the image sensor 70 or may be implemented outside the image sensor 70 . When at least one of the ISPs 80 - 1 and 80 - 2 is embedded in the image sensor 70 , the first PHY 60 - 1 and/or the second PHY 60 - 2 respectively connected to the ISPs 80 - 1 and 80 - 2 may be omitted from the image sensor 70 .
FIG. 3 is a block diagram of a buffer bank 300 according to some embodiments of the inventive concepts. The buffer bank 300 may receive a bank address, may receive image data corresponding to the bank address from a pixel array and store the image data, and may shift and output the stored image data. Referring to FIG. 3 , the buffer bank 300 includes a bank buffer unit 340 and a bank address unit 350 .
The bank buffer unit 340 includes a plurality of buffer memories 342 , a plurality of column switches 344 respectively connected to the buffer memories 342 , a cluster switch 346 , a bank bus 345 connected to the column switches 344 and the cluster switch 346 , and a sense amplifier 347 connected to the bank bus 345 .
The bank buffer unit 340 stores first image data corresponding to a bank counter input BCNT in the buffer memories 342 . The bank counter input BCNT corresponds to each of banks into which outputs of the ADC 20 of the image sensor 70 illustrated in FIG. 1 or 2 are grouped. For example, a group of the digital signals BCNT 1 or BCNT 2 illustrated in FIG. 1 or 2 may correspond to the bank counter input BCNT.
The bank buffer unit 340 also receives second image data corresponding to a bank image input BM_I. The bank buffer unit 340 receives a switch control signal through a column selection input CSEL. The switch control signal includes control signals for controlling each of the column switches 344 and the cluster switch 346 . The bank buffer unit 340 may turn off the cluster switch 346 and turn on one of the column switches 344 based on the switch control signal, so that the first image data is transmitted to the bank bus 345 . The bank buffer unit 340 may turn off all of the column switches 344 and turn on the cluster switch 346 based on the switch control signal, so that the second image data is transmitted to the bank bus 345 .
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 4 of 12
It may be designed that the bank bus 345 and the buffer memories 342 have the same bus width, but the inventive concepts are not limited thereto. When necessary, it may be designed that the bank bus 345 has a different bus width than the buffer memories 342 in order to transmit additional information. The buffer memories 342 may include SRAM cells and may output a bit line signal and a complementary bit line signal.
The number of the buffer memories 342 in the bank buffer unit 340 may be 512, 1024, or 2048 but is not limited thereto. The number of the buffer memories 342 may vary with at least one among the numbers of columns, banks and clusters in the image sensor 70 .
The number of bits stored in each of the buffer memories 342 may vary from 10 to 15 but is not limited thereto. The number of bits stored in each of the buffer memories 342 may vary with the number of color levels that can be expressed by each of the pixels included in the pixel array 10 of the image sensor 70 .
A plurality of bank buffer units having the same structure as the bank buffer unit 340 may be connected in a single pipeline chain, which will be described in detail with reference to FIGS. 4 and 6 and FIGS. 10 through 13 .
The column switches 344 and the cluster switch 346 may deliver either the first image data corresponding to an output 343 of the buffer memories 342 or the second image data corresponding to the bank image input BM_I to the bank bus 345 according to an output of a decoder latch 353 of the bank address unit 350 .
The sense amplifier 347 receives the first or second image data delivered to the bank bus 345 through the column switches 344 or the cluster switch 346 and senses and amplifies the image data to output a bank image output BM_O. For example, the sense amplifier 347 may have a hold function. The sense amplifier 347 may store the first or second image data in synchronization with the buffer clock signal SCLK. When the second image data is selected, the sense amplifier 347 may just pass or store the second image data.
The bank address unit 350 includes an address latch 351 , an address decoder 352 , and the decoder latch 353 .
The address latch 351 stores a first bank address input through a bank address input BA_I and outputs the stored first bank address to a bank address output BA_O in synchronization with the buffer clock signal SCLK.
The address decoder 352 decodes the first bank address input through the bank address input BA_I and determines whether the first bank address is the same as a current address of the buffer bank 300 . At this time, the first bank address includes a bank address bit and a column address bit for turning on one of the column switches 344 and the cluster switch 346 in the bank buffer unit 340 .
The decoder latch 353 latches an output of the address decoder 352 when the output of the address decoder 352 is stabilized. An output of the decoder latch 353 is provided as a control signal for each of the column switches 344 and the cluster switch 346 .
According to some embodiments, the buffer bank 300 may also include a bank storage unit 360 . The bank storage unit 360 may be used like a pipeline to shift an external bank input address BS_I and image data. For example, the bank storage unit 360 may shift the bank input address BS_I to output a bank output address BS_O. The shifting operation of the bank storage unit 360 will be described in detail together with the shifting operation of the bank buffer unit 340 and the shifting operation of the bank address unit 350 .
FIG. 4 is a block diagram of an image sensor 71 A according to some embodiments of the inventive concepts. The image sensor 71 A includes a structure which allows image data to be transmitted from a plurality of column lines a single channel or a plurality of channels.
Referring to FIG. 4 , the image sensor 71 A includes a first cluster 400 - 1 , a second cluster 400 - 2 , a first cluster switch 800 - 1 , a second cluster switch 900 - 1 , a third cluster switch 800 - 2 , and a fourth cluster switch 900 - 2 .
The first cluster 400 - 1 may include a plurality of bank buffer units 340 - 1 and 340 - 2 , a plurality of bank address units 350 - 1 and 350 - 2 , and a plurality of bank storage units 360 - 1 and 360 - 2 . The second cluster 400 - 2 may include a plurality of bank buffer units 340 - 3 and 340 - 4 , a plurality of bank address units 350 - 3 and 350 - 4 , and a plurality of bank storage units 360 - 3 and 360 - 4 .
The structure and the operations of each of the bank buffer units 340 - 1 through 340 - 4 are substantially the same as those of the bank buffer unit 340 illustrated in FIG. 3 . Each of the bank buffer units 340 - 1 through 340 - 4 selectively stores one of two types of image data in synchronization with the buffer clock signal SCLK and outputs the stored image data to the next bank buffer unit. The bank buffer units 340 - 1 through 340 - 4 receive bank counter inputs BCNT 11 , BCNT 12 , BCNT 21 , and BCNT 22 , respectively.
The structure and the operations of each of the bank address units 350 - 1 through 350 - 4 are substantially the same as those of the bank address unit 350 illustrated in FIG. 3 . Each of the bank address units 350 - 1 through 350 - 4 stores a bank address input through the bank address input BA_I and generates a column selection signal for corresponding one of the bank buffer units 340 - 1 through 340 - 4 . Each of the bank address units 350 - 1 through 350 - 4 also outputs the stored bank address to the next bank address unit through the bank address output BA_O in synchronization with the buffer clock signal SCLK.
The structure and the operations of the bank storage units 360 - 1 through 360 - 4 are substantially the same as those of the bank storage unit 360 illustrated in FIG. 3 . Each of the bank storage units 360 - 1 through 360 - 4 stores a bank input address or image data in synchronization with the buffer clock signal SCLK and outputs a bank output address or image data, which corresponds to the stored bank input address, to the next bank storage unit.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 5 of 12
Each of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 includes a plurality of latches (not shown) and a selector (not shown). The cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 controls the flow of a bank address and/or image data corresponding to the bank address according to switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 , respectively.
The structure and the operations of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 will be described in detail with reference to FIGS. 8 and 9 later. Therefore, input of a bank address and output of image data performed in the image sensor 71 A will be described with reference to FIG. 4 here.
Referring to FIG. 4 , the image sensor 71 A outputs image data through a single channel CHANNEL 1 in a first operation mode. The first operation mode may be set through the setting of an external pin of the image sensor 71 A or interface with an external controller. The interface may be camera control interface (CCI), which may operate according to a protocol such as serial peripheral interface (SPI) or inter integrated circuit (I2C), but the inventive concepts are not restricted thereto. The first operation mode influences the switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 and thus controls the flow of a bank address and/or image data in the image sensor 71 A.
FIG. 5 is a timing chart showing the operation of the image sensor 71 A illustrated in FIG. 4 . Referring to FIGS. 3 through 5 , the image sensor 71 A receives a first bank address A 0 from a first bank address input HDA 1 and transmits the first bank address A 0 to a first address input TA_I of the first cluster switch 800 - 1 at a first clock cycle T 0 .
The first bank address A 0 is shifted by a first internal latch of the first cluster switch 800 - 1 and is transmitted as a first address output signal TA 11 to an input BS_I of the first bank storage unit 360 - 1 through an output TA_O of the first cluster switch 800 - 1 at a second clock cycle T 1 .
The first bank address A 0 is shifted by an internal latch of the first bank storage unit 360 - 1 and transmitted as a first bank storage unit output signal TA 12 to an input BS_I of the second bank storage unit 360 - 2 at a third clock cycle T 2 .
The first bank address A 0 is shifted by an internal latch of the second bank storage unit 360 - 2 and transmitted as a second bank storage unit output signal TA 13 to a first address input TA_I of the second cluster switch 900 - 1 at a fourth clock cycle T 3 .
The first bank address A 0 is shifted by a first internal latch of the second cluster switch 900 - 1 and transmitted as a first address output signal CSW 1 to a first address input TA_I of the second cluster 400 - 2 and to a first address input TA_I of the third cluster switch 800 - 2 through an output TA_O of the second cluster switch 900 - 1 at a fifth clock cycle T 4 .
The first bank address A 0 is shifted by a first internal latch of the third cluster switch 800 - 2 and is transmitted as a first address output signal TA 21 to an input BS_I of the third bank storage unit 360 - 3 through an output TA_O of the third cluster switch 800 - 3 at a sixth clock cycle T 5 .
The first bank address A 0 is shifted by an internal latch of the third bank storage unit 360 - 3 and transmitted as a third bank storage unit output signal TA 22 to an input BS_I of the fourth bank storage unit 360 - 4 at a seventh clock cycle T 6 .
The first bank address A 0 is shifted by an internal latch of the fourth bank storage unit 360 - 4 and transmitted as a fourth bank storage unit output signal TA 23 to a first address input TA_I of the fourth cluster switch 900 - 2 at an eighth clock cycle T 7 .
The first bank address A 0 is shifted by a first internal latch of the fourth cluster switch 900 - 2 and transmitted as a second address output signal BA 23 to an input BA_I of the fourth bank address unit 350 - 4 at a ninth clock cycle T 8 . At the same time, the first bank address A 0 is decoded by the address decoder 352 in the fourth bank address unit 350 - 4 .
The fourth bank address unit 350 - 4 generates a fourth selection signal CS 22 and a fourth bank address output signal BA 22 at a tenth clock cycle T 9 . In other words, as described with reference to FIG. 3 above, the decoder latch 353 of the fourth bank address unit 350 - 4 latches an output signal of the address decoder 352 thereof to generate the fourth selection signal CS 22 and outputs the fourth selection signal CS 22 to the column selection input CSEL of the fourth bank buffer unit 340 - 4 . Meanwhile, the first bank address A 0 is shifted by the address latch 351 in the fourth bank address unit 350 - 4 and transmitted as the fourth bank address output signal BA 22 to a bank address input BA_I of the third bank address unit 350 - 3 .
The third bank address unit 350 - 3 generates a third selection signal CS 21 and a third bank address output signal BA 21 at an eleventh clock cycle T 10 . In other words, as described with reference to FIG. 3 above, the decoder latch 353 of the third bank address unit 350 - 3 latches an output signal of the address decoder 352 of the third bank address unit 350 - 3 to generate the third selection signal CS 21 and outputs the third selection signal CS 21 to a column selection input CSEL of the third bank buffer unit 340 - 3 . Meanwhile, the first bank address A 0 is shifted by the address latch 351 in the third bank address unit 350 - 3 and transmitted as the third bank address output signal BA 21 to a second address input A_I of the third cluster switch 800 - 2 .
At the eleventh clock cycle T 10 , the fourth bank buffer 340 - 4 selects first image data input through the bank counter input BCNT 22 of the fourth bank buffer 340 - 4 or second image data, i.e., M 23 received through a bank image input BM_I of the fourth bank buffer 340 - 4 based on the fourth selection signal CS 22 to generate fourth bank image data M 22 , as described with reference to FIG. 3 above.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 6 of 12
The fourth bank image data M 22 is transmitted as a fourth bank buffer data output signal M 22 to a bank image input BM_I of the third bank buffer unit 340 - 3 . Meanwhile, the fourth bank buffer 340 - 4 is the first bank buffer unit in a chain of the units 340 - 1 through 340 - 4 forming a bank buffer unit, and therefore, the second image data M 23 may be ignored as invalid data.
The third bank buffer unit 340 - 3 selects either first image data input through the bank counter input BCNT 21 of the third bank buffer unit 340 - 3 or second image data, i.e., M 22 received through a bank image input BM_I of the third bank buffer unit 340 - 3 based on the third selection signal CS 21 to generate third bank image data M 21 at a 12th clock cycle T 11 . The third bank image data M 21 is transmitted as a third bank buffer data output signal M 21 to a column data input CM_I of the third cluster switch 800 - 2 .
At the 12th clock cycle T 11 , the first bank address A 0 input to the second address input A_I of the third cluster switch 800 - 2 is shifted by a second internal latch of the third cluster switch 800 - 2 and then transmitted as a second address output signal CSW 2 to a second address input A_I of the second cluster switch 900 - 1 through an output A_O of the third cluster switch 800 - 2 .
The third bank image data M 21 input to the third cluster switch 800 - 2 is shifted by a third internal latch of the third cluster switch 800 - 2 and then transmitted as an image data output signal CSW 3 to a column data input CM_I of the second cluster switch 900 - 1 through an output CM_O of the third cluster switch 800 - 2 at a 13th clock cycle T 12 . At the same time, the first bank address A 0 input to the second cluster switch 900 - 1 is shifted by a second internal latch of the second cluster switch 900 - 1 and then transmitted to a bank address input BA_I of the second bank address unit 350 - 2 .
The third bank image data M 21 input to the second cluster switch 900 - 1 is shifted by a third internal latch of the second cluster switch 900 - 1 and then transmitted as an image data output signal M 13 of the second cluster 400 - 2 to a bank image input BM_I of the second bank buffer unit 340 - 2 at a 14th clock cycle T 13 .
In addition, at the 14th clock cycle T 13 , the second bank address unit 350 - 2 generates a second selection signal CS 12 and a second bank address output signal BA 12 . In other words, as described with reference to FIG. 3 above, the decoder latch 353 of the second bank address unit 350 - 2 latches an output signal of the address decoder 352 of the second bank address unit 350 - 2 to generate the second selection signal CS 12 and outputs the second selection signal CS 12 to a column selection input CSEL of the second bank buffer unit 340 - 2 . Meanwhile, the first bank address A 0 is shifted by the address latch 351 in the second bank address unit 350 - 2 and then transmitted as the second bank address output signal BA 12 to a bank address input BA_I of the first bank address unit 350 - 1 .
The second bank buffer unit 340 - 2 , as described with reference to FIG. 3 , selects either first image data input through the bank counter input BCNT 12 of the second bank buffer unit 340 - 2 or second image data, i.e., M 13 received through a bank image input BM_I of the second bank buffer unit 340 - 2 based on the second selection signal CS 12 to generate second bank image data M 12 at a 15th clock cycle T 14 . The second bank image data M 12 is transmitted as a second bank buffer data output signal M 12 to a bank image input BM_I of the first bank buffer unit 340 - 1 .
In addition, at the 15th clock cycle T 14 , the first bank address unit 350 - 1 generates a first selection signal CS 11 and a first bank address output signal BA 11 . In other words, as described with reference to FIG. 3 above, the decoder latch 353 of the first bank address unit 350 - 1 latches an output signal of the address decoder 352 of the first bank address unit 350 - 1 to generate the first selection signal CS 11 and outputs the first selection signal CS 11 to a column selection input CSEL of the first bank buffer unit 340 - 1 . Meanwhile, the first bank address A 0 is shifted by the address latch 351 in the first bank address unit 350 - 1 and then transmitted as the first bank address output signal BA 11 to a second address input A_I of the first cluster switch 800 - 1 .
The first bank buffer unit 340 - 1 , as described with reference to FIG. 3 , selects either first image data input through the bank counter input BCNT 11 of the first bank buffer unit 340 - 1 or second image data, i.e., M 12 received through the bank image input BM_I of the first bank buffer unit 340 - 1 based on the first selection signal C 11 to generate first bank image data M 11 at a 16th clock cycle T 15 . The first bank image data M 11 is transmitted as a first bank buffer data output signal M 11 to a buffer memory input CM_I of the first cluster switch 800 - 1 .
The first bank image data M 11 input to the first cluster switch 800 - 1 is shifted by a third internal latch of the first cluster switch 800 - 1 and output as first bank image data output DATA 1 . The first bank image data M 11 , i.e., the first bank image data output DATA 1 may be transmitted to the first ISP 80 - 1 via the first PHY 60 - 1 illustrated in FIG. 1 or FIG. 2 . The first bank address input HDA 1 and the first bank image data output DATA 1 form the first channel CHANNEL 1 .
As described above, the image sensor 71 A illustrated in FIG. 4 outputs image data through the single channel CHANNEL 1 in the first operation mode and may receive random or consecutive bank addresses and output image data corresponding to the addresses to the first channel CHANNEL 1 .
The structure of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 is not restricted to the embodiments illustrated in FIG. 4 , but the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 may be omitted or combined with each other according to the length of a transmission line and a design specification. The internal latches of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 may be omitted according to the design specification.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 7 of 12
Transmission of bank addresses and image data in the image sensor 71 A may be performed using a pipeline chain. For example, the first cluster switch 800 - 1 receives a second bank address A 1 at the second clock cycle T 1 and may receive other bank addresses consecutively at each clock cycle thereafter like a pipeline. Transmission of a bank address or image data occurring at each clock cycle is performed in the same manner as that described above, so that a single image data pipeline is formed, which will be described with reference to FIG. 5 .
With reference to FIGS. 4 and 5 , the image sensor 71 A receives the first bank address A 0 through the first bank address input HDA 1 in synchronization with the buffer clock signal SCLK. Thereafter, consecutive bank addresses A 1 through A 18 may be input to the image sensor 71 A at clock cycles T 1 through T 18 , respectively.
The bank addresses A 0 through A 18 are sequentially transferred through the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 , the bank address units 350 - 1 through 350 - 4 , and the bank storage units 360 - 1 through 360 - 4 . Image data read according to each of the bank addresses A 0 through A 18 is output as the first bank image data output DATA 1 through the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 and the bank buffer units 340 - 1 through 340 - 4 .
In other words, when random or consecutive bank addresses are sequentially input in a pipeline form, image data read according to the bank addresses A 0 through A 18 are also sequentially output in a pipeline form. At this time, the output order of the image data is the same as the input order of the bank addresses A 0 through A 18 .
In the embodiments illustrated in FIG. 5 , latches operate in synchronization with a positive or rising edge of the buffer clock signal SCLK. However, in other embodiments, some or all of the latches may be designed to operate in response to a negative or falling edge of the buffer clock signal SCLK.
FIG. 6 is a block diagram of an image sensor 71 B according to other embodiments of the inventive concepts. The image sensor 71 B includes a structure which allows image data to be transmitted from a plurality of column lines either to a single channel or a plurality of channels based on an operation mode. At this time, the image sensor 71 B may perform transmission using a plurality of channels CHANNEL 1 and CHANNEL 2 .
Referring to FIG. 6 , the image sensor 71 B includes a first cluster 400 - 1 , a second cluster 400 - 2 , a first cluster switch 800 - 1 , a second cluster switch 900 - 1 , a third cluster switch 800 - 2 , and a fourth cluster switch 900 - 2 .
The first cluster 400 - 1 may include the bank buffer units 340 - 1 and 340 - 2 , the bank address units 350 - 1 and 350 - 2 , and the bank storage units 360 - 1 and 360 - 2 . The second cluster 400 - 2 may include the bank buffer units 340 - 3 and 340 - 4 , the bank address units 350 - 3 and 350 - 4 , and the bank storage units 360 - 3 and 360 - 4 .
The structure and the operations of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 360 - 1 through 360 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 6 are substantially the same as those of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 360 - 1 through 360 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 4 , and therefore, detailed descriptions thereof will be omitted.
Outputting image data through the channels CHANNEL 1 and CHANNEL 2 will be described, focusing on the operations of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 below.
Referring to FIG. 6 , the image sensor 71 B outputs image data through the channels CHANNEL 1 and CHANNEL 2 in a second operation mode. The second operation mode may be set through the setting of an external pin of the image sensor 71 B or interface with an external controller. The interface may be CCI, which may operate according to a protocol such as SPI or I2C, but the inventive concepts are not restricted thereto.
The second operation mode influences the switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 and thus controls the flow of a bank address and/or image data in the image sensor 71 B. In the second operation mode, the image sensor 71 B outputs image data from two independent clusters CLUSTER 1 and CLUSTER 2 , respectively, to the channels CHANNEL 1 and CHANNEL 2 , respectively, according to the switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 .
FIG. 7 is a timing chart showing the operation of the image sensor 71 B illustrated in FIG. 6 . Referring to FIGS. 6 and 7 , the image sensor 71 B receives a first bank address A 0 from a first bank address input HDA 1 of the first channel CHANNEL 1 and transmits the first bank address A 0 to a first address input TA_I of the first cluster switch 800 - 1 at a first clock cycle T 0 .
At second through fourth clock cycles T 1 through T 3 , the first bank address A 0 is shifted sequentially by the first cluster switch 800 - 1 , the first bank storage unit 360 - 1 , and the second bank storage unit 360 - 2 to be transmitted to a first address input TA_I of the second cluster switch 900 - 1 .
The first bank address A 0 is transmitted from the first address input TA 1 to a second address output A_O in the second cluster switch 900 - 1 at a fifth clock cycle T 4 . The first bank address A 0 is shifted sequentially to the second bank address unit 350 - 2 and the first bank address unit 350 - 1 at sixth and seventh clock cycles T 5 and T 6 , respectively.
During sixth through eighth clock cycles T 5 through T 7 , the second bank buffer unit 340 - 2 and the first bank buffer unit 340 - 1 sequentially shift first image data D 0 based on the first bank address A 0 to transmit the first image data D 0 to an image data input CM_I. At a ninth clock cycle T 8 , the first cluster switch 800 - 1 outputs the first image data D 0 as the first bank image data output DATA 1 through an output CM_O.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 8 of 12
Similarly, at the first clock cycle T 0 , the image sensor 71 B receives a ninth bank address A 8 through a second bank address input HDA 2 of the second channel CHANNEL 2 and transmits the ninth bank address A 8 to a second bank address input A_I of the fourth cluster switch 900 - 2 .
During the second through fourth clock cycles T 1 through T 3 , a ninth bank address A 8 is shifted sequentially to the fourth cluster switch 900 - 2 , the fourth bank address unit 350 - 4 , and the third bank address unit 360 - 3 , so that the ninth bank address A 8 is transmitted to a second address input A_I of the third cluster switch 800 - 2 . During the third through fifth clock cycles T 2 through T 4 , the fourth bank buffer unit 340 - 4 and the third bank buffer unit 340 - 3 sequentially shift ninth image data D 8 based on the ninth bank address A 8 , so that the ninth image data D 8 is transmitted to an image data input CM_I of the third cluster switch 800 - 2 .
At the sixth clock cycle T 5 , the third cluster switch 800 - 2 outputs the ninth image data D 8 through a first address output TA_O. During the seventh and eighth clock cycles T 6 and T 7 , the third bank storage unit 360 - 3 and the fourth bank storage unit 360 - 4 sequentially shift the ninth image data DS 8 , so that the ninth image data D 8 is transmitted to a first address input TA_I of the fourth cluster switch 900 - 4 . At the ninth clock cycle 18 , the fourth cluster switch 900 - 4 outputs the ninth image data D 8 as a second bank image data output DATA 2 of the image sensor 71 B through an output TA_O.
The first bank address input HDA 1 and the first bank image data output DATA 1 form the first channel CHANNEL 1 of the image sensor 71 B and the second bank address input HDA 2 and the second bank image data output DATA 2 form the second channel CHANNEL 2 of the image sensor 71 B. Referring to FIG. 2 , the first bank image data output DATA 1 may be transmitted via the first PHY 60 - 1 to the first ISP 80 - 1 connected through the first channel CHANNEL 1 and the second bank image data output DATA 2 may be transmitted via the second PHY 60 - 2 to the second ISP 80 - 2 connected through the second channel CHANNEL 2 .
As described above, the image sensor 71 B performs an operation of outputting image data using a plurality of the channels CHANNEL 1 and CHANNEL 2 in the second operation mode. The image sensor 71 B may receive bank addresses input in random order or in consecutive order through the channels CHANNEL 1 and CHANNEL 2 and may output image data, which correspond to the respective bank addresses respectively received through the channels CHANNEL 1 and CHANNEL 2 , through the channels CHANNEL 1 and CHANNEL 2 , respectively 7, at the same time.
Referring to FIGS. 3, 6, and 7 , the image sensor 71 B receives the first bank address A 0 through the first bank address input HDA 1 and the ninth bank address A 8 through the second bank address input HDA 2 in synchronization with the buffer clock SCLK at the first clock cycle T 0 .
In this manner, pairs of bank addresses A 0 through A 50 may be input to the image sensor 71 B at respective clock cycles in a pipeline form. Each of the bank addresses A 0 through A 50 is transmitted sequentially through some among the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 , the bank address units 350 - 1 through 350 - 4 , and the bank storage units 360 - 1 through 360 - 4 .
Image data D 0 through D 50 read according to the bank addresses A 0 through A 50 are sequentially output as first bank image data outputs DATA 1 and the second bank image data outputs DATA 2 through the bank buffer units 340 - 1 through 340 - 4 and the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 .
In other words, when the bank addresses A 0 through A 50 are sequentially input in a pipeline form, the image data D 0 through D 50 read according to the bank addresses A 0 through A 50 , respectively, are sequentially output in a pipeline form. At this time, the input order of the image data D 0 through D 50 is the same as the input order of the bank addresses A 0 through A 50 .
It has been described with reference to FIG. 7 that latches included in the image sensor 71 B illustrated in FIG. 6 operate in response to a positive edge or rising edge of the buffer clock signal SCLK. However, some or all of the latches may be designed to operate in response to a negative edge or falling edge of the buffer clock signal SCLK
FIG. 8 is a block diagram of a first cluster switch 800 according to some embodiments of the inventive concepts. The first cluster switch 800 includes a first latch 810 , a second latch 820 , a third latch 830 , and a selector 840 . The first cluster switch 800 may represent the cluster switches 800 - 1 and 800 - 2 illustrated in FIG. 4 or 6 . The selector 840 selects and outputs one among bank image data input through the image data input CM_I and a first bank address input through the first address input TA_I.
The first latch 810 receives and latches an output of the selector 840 and outputs a latched value to the first address output TA_O. The second latch 820 latches a second bank address received through the second address input A_I and outputs the latched second bank address to the second address output A_O.
The third latch 830 latches the image data received through the image data input CM_I and outputs the latched image data to the image data output CM_O. When a selection signal CTL for the selector 840 is at a first logic level (e.g., a ground voltage), the selector 840 selects and outputs the bank image data to the first latch 810 .
When the selection signal CTL is at a second logic level (e.g., a power supply voltage), the selector 840 selects and outputs the first bank address to the first latch 810 . The first cluster switch 800 transfers a bank address and image data of the first and second clusters 400 - 1 and 400 - 2 , as described with reference to FIG. 4 .
A bank address and image data are latched by the latches 810 , 820 , and 830 when they are transferred in the embodiments described above, but the inventive concepts is not restricted to these embodiments. When there is no restriction on the transfer of a bank address and image data, at least one of the latches 810 , 820 , and 830 may be omitted and either the bank address or the image data may not be transferred without being stored.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 9 of 12
FIG. 9 is a block diagram of a second cluster switch 900 according to some embodiments of the inventive concepts. Referring to FIG. 9 , the second cluster switch 900 includes a first latch 910 , a second latch 920 , a third latch 930 , and a selector 940 . The second cluster switch 900 may represent the cluster switches 900 - 1 and 900 - 2 illustrated in FIG. 4 or 6 .
The first latch 910 latches a first bank address received through the first address input TA_I and outputs the latched first bank address to the first address output TA_O. The selector 940 selects and outputs either a second bank address received through the second address input A_I or the first bank address.
The second latch 930 receives and latches an output of the selector 940 and outputs a latched value to the second address output A_O. When a selection signal CTL is at a first logic level (e.g., the ground voltage), the selector 940 selects and outputs the second bank address. When the selection signal CTL is at a second logic level (e.g., the power supply voltage), the selector 940 selects and outputs the first bank address.
The third latch 930 latches image data received through the image data input CM_I and outputs the latched image data to the image data output CM_O. The second cluster switch 900 transfers a bank address and image data of the first and second clusters 400 - 1 and 400 - 2 , as described with reference to FIG. 4 .
A bank address and image data are latched by the latches 910 , 920 , and 930 when they are transferred in the embodiments described above, but the inventive concepts is not restricted to these embodiments. When there is no restriction on the transfer of a bank address and image data, at least one of the latches 910 , 920 , and 930 may be omitted and either the bank address or the image data may not be transferred without being stored.
The first cluster switch 800 illustrated in FIG. 8 and the second cluster switch 900 illustrated in FIG. 9 may be simplified in some cases or may be integrated into a single cluster switch to increase transmission speed. For instance, when the second and third cluster switches 900 - 1 and 800 - 2 illustrated in FIG. 4 are integrated into a single cluster switch, the single cluster switch may have the same structure as the first cluster switch 800 - 1 .
Referring to FIGS. 4 through 9 , the selection signal CTL input to each of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 determines the flow of a bank address and/or image data, which will be transmitted to a single channel or a plurality of channels of the image sensors 71 A and 71 B according to the operation mode of the image sensors 71 A and 71 B. Here, the selection signal CTL may represent the selection signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 .
When the selection signal CTL 11 for the first cluster switch 800 - 1 is at the second logic level (e.g., the power supply voltage), the selection signal CTL 12 for the second cluster switch 900 - 1 is at the first logic level (e.g., the ground voltage), the selection signal CTL 21 for the third cluster switch 800 - 2 is at the second logic level, and the selection signal CTL 22 for the fourth cluster switch 900 - 2 is at the second logic level; the image sensor 71 A illustrated in FIG. 4 outputs image data through the single channel CHANNEL 1 .
However, when the selection signal CTL 11 for the first cluster switch 800 - 1 is at the second logic level, the selection signal CTL 12 for the second cluster switch 900 - 1 is at the second logic level, the selection signal CTL 21 for the third cluster switch 800 - 2 is at the first logic level, and the selection signal CTL 22 for the fourth cluster switch 900 - 2 is at the second logic level; the image sensor 71 B illustrated in FIG. 6 outputs image data through a plurality of the channels CHANNEL 1 and CHANNEL 2 . The image sensor 71 B has two channels in the embodiments illustrated in FIG. 6 , but two or more channels may be provided for the image sensor 71 B according to the number of clusters and/or the number of PHYs.
FIG. 10 is a block diagram of an image sensor 72 A according to still other embodiments of the inventive concepts. The image sensor 72 A may include a first cluster 400 - 1 A, a second cluster 400 - 2 A, the first cluster switch 800 - 1 , the second cluster switch 900 - 1 , the third cluster switch 800 - 2 , and the fourth cluster switch 900 - 2 . The image sensor 72 A illustrated in FIG. 10 may transmit image data through the single channel CHANNEL 1 .
The first cluster 400 - 1 A may include the bank buffer units 340 - 1 and 340 - 2 and the bank address units 350 - 1 and 350 - 2 . Unlike the first cluster 400 - 1 illustrated in FIG. 4 , the first cluster 400 - 1 A illustrated in FIG. 10 does not include the bank storage units 360 - 1 and 360 - 2 . The second cluster 400 - 2 A may include the bank buffer units 340 - 3 and 340 - 4 and the bank address units 350 - 3 and 350 - 4 . Unlike the second cluster 400 - 2 illustrated in FIG. 4 , the second cluster 400 - 2 A illustrated in FIG. 10 does not include the bank storage units 360 - 3 and 360 - 4 .
The structure and the functions of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 10 are substantially the same as those of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 4 . Thus, detailed descriptions of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 10 will be omitted and an operation of outputting image data transmitted through a single channel will be described, focusing on the operations of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 .
Referring to FIG. 10 , the image sensor 72 A outputs image data through one channel CHANNEL 1 in a third operation mode. The third operation mode may be set through the setting of an external pin of the image sensor 72 A or interface with an external controller. At this time, the interface may be CCI, which may operate according to a protocol such as SPI or I2C, but the inventive concepts are not restricted thereto.
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 10 of 12
The third operation mode influences the switch control signals CTL 11 , CT 12 , CTL 21 , and CTL 22 and thus controls the flow of a bank address and/or image data in the image sensor 72 A. In the third operation mode, the image sensor 72 A outputs image data to the one channel CHANNEL 1 based on the switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 .
Referring to FIGS. 5 and 10 , the image sensor 72 A receives the first bank address A 0 through the first bank address input HDA 1 of the first channel CHANNEL 1 and transmits the first bank address A 0 to the first address input TA_I of the first cluster switch 800 - 1 at the first clock cycle T 0 . The first bank address A 0 is input to the first bank address input TA_I of the second cluster switch 900 - 1 at the second clock cycle T 1 .
The first bank address A 0 is input to the first bank address input TA_I of the third cluster switch 800 - 2 through the output TA_O of the second cluster switch 900 - 1 at the third clock cycle T 2 . The first bank address A 0 is input to the first bank address input TA_I of the fourth cluster switch 900 - 2 through the output TA_O of the third cluster switch 800 - 2 at the fourth clock cycle T 2 . The operations afterwards are the same as those described with reference to FIG. 4 . Thus, detailed descriptions thereof will be omitted.
Referring to FIG. 10 , the image sensor 72 A outputs the first image data D 0 corresponding to the first bank address A 0 through the image data output CM_O of the first cluster switch 800 - 1 as the first bank image data output DATA 1 for the first channel CHANNEL 1 at the 13th clock cycle T 12 .
FIG. 11 is a block diagram of an image sensor 72 B according to even other embodiments of the inventive concepts. The image sensor 72 B illustrated in FIG. 11 may transmit image data through a plurality of the channels CHANNEL 1 and CHANNEL 2 . The image sensor 72 B may include the first cluster 400 - 1 A, the second cluster 400 - 2 A, the first cluster switch 800 - 1 , the second cluster switch 900 - 1 , the third cluster switch 800 - 2 , and the fourth cluster switch 900 - 2 .
The first cluster 400 - 1 A may include the bank buffer units 340 - 1 and 340 - 2 and the bank address units 350 - 1 and 350 - 2 . The second cluster 400 - 2 A may include the bank buffer units 340 - 3 and 340 - 4 and the bank address units 350 - 3 and 350 - 4 .
The structure and the operations of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 11 are substantially the same as those of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 6 .
Thus, detailed descriptions of the elements 340 - 1 through 340 - 4 , 350 - 1 through 350 - 4 , 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 illustrated in FIG. 11 will be omitted and an operation of outputting image data transmitted through the channels CHANNEL 1 and CHANNEL 2 using the independent two clusters 400 - 1 A and 400 - 2 A will be described, focusing on the operations of the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 .
Referring to FIG. 11 , the image sensor 72 B outputs image data through two channels CHANNEL 1 and CHANNEL 2 in a fourth operation mode. The fourth operation mode may be set through the setting of an external pin of the image sensor 72 B or interface with an external controller. At this time, the interface may be CCI, which may operate according to a protocol such as SPI or I2C, but the inventive concepts are not restricted thereto.
The fourth operation mode influences the switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 and thus controls the flow of a bank address and/or image data in the image sensor 72 B. In the fourth operation mode, the image sensor 72 B outputs image data to the channels CHANNEL 1 and CHANNEL 2 based on the switch control signals CTL 11 , CTL 12 , CTL 21 , and CTL 22 .
Referring to FIGS. 7 and 11 , the image sensor 72 B receives the first bank address A 0 through the first bank address input HDA 1 of the first channel CHANNEL 1 and transmits the first bank address A 0 to the first address input TA_I of the first cluster switch 800 - 1 at the first clock cycle T 0 . The first bank address A 0 is input to the first bank address input TA_I of the second cluster switch 900 - 1 through the output TA_O of the first cluster switch 800 - 1 at the second clock cycle T 1 . The operations afterwards are the same as or similar to those described with reference to FIGS. 6 and 7 . Thus, detailed descriptions thereof will be omitted.
Referring to FIGS. 7 and 11 , the image sensor 72 B outputs the first image data D 0 corresponding to the first bank address A 0 through the image data output CM_O of the first cluster switch 800 - 1 as the first bank image data output DATA 1 at the seventh clock cycle T 6 .
The image sensor 72 B receives the ninth bank address A 8 through the second bank address input HDA 2 of the second channel CHANNEL 2 and transmits the ninth bank address A 8 to the second bank address input A_I of the fourth cluster switch 900 - 2 at the first clock cycle T 0 . The ninth bank address A 8 is input to the bank address input BA_I of the fourth bank address unit 350 - 4 at the second clock cycle T 1 . The operations afterwards are the same as or similar to those described with reference to FIGS. 6 and 7 . Thus, detailed descriptions thereof will be omitted.
Referring to FIGS. 7 and 11 , the image sensor 72 B transmits the ninth image data D 8 corresponding to the ninth bank address A 8 from the first bank address output TA_O of the third cluster switch 800 - 2 to the first bank address input TA_I of the fourth cluster switch 900 - 2 at the sixth clock cycle T 5 .
The fourth cluster switch 900 - 2 outputs the ninth image data D 8 as the second bank image data output DATA 2 to the second channel CHANNEL 2 at the seventh clock cycle T 6 . Input of the following bank addresses and output of image data corresponding to the following bank addresses are performed in a pipeline form in the same manner as or a similarly manner to that described with reference to FIGS. 6 and 7 .
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 11 of 12
FIG. 12 is a block diagram of an image sensor 73 A according to yet other embodiments of the inventive concepts. Except for the position of the bank address input HDA 1 , the structure of the image sensor 73 A illustrated in FIG. 12 is substantially the same as those of the image sensor 72 A illustrated in FIG. 10 . In detail, a bank address is input to the second bank address input A_I of the fourth cluster switch 900 - 2 through the bank address input HDA 1 of the first channel CHANNEL 1 .
The fundamental operations of the image sensor 73 A illustrated in FIG. 12 are similar to those described with reference to FIGS. 4, 6, 10, and 11 . Thus, detailed descriptions of the image sensor 73 A will be omitted. However, image data is output at the eleventh clock cycle T 10 .
FIG. 13 is a block diagram of an image sensor 73 B according to further embodiments of the inventive concepts. The image sensor 73 B illustrated in FIG. 13 may perform image data transmission using a plurality of the channels CHANNEL 1 and CHANNEL 2 . Except for the position of the bank address input HDA 1 and the image data output DATA 2 , the structure of the image sensor 73 B illustrated in FIG. 13 is substantially the same as that of the image sensor 72 B illustrated in FIG. 11 .
A bank address is input to the first bank address input TA_I of the second cluster switch 900 - 1 through the bank address input HDA 1 of the first channel CHANNEL 1 . Image data corresponding to the second bank image data output DATA 2 is output through the first bank address output TA_O of the third cluster switch 800 - 2 .
Even when there are more than two channels, an image sensor operating with a plurality of channels may be realized depending on setting a position of a cluster switch through which a bank address is input and a position of a cluster switch through which image data corresponding to the bank address is output.
The fundamental operations of the image sensor 73 B illustrated in FIG. 13 are similar to those described with reference to FIGS. 4, 6, 10, and 11 . Thus, detailed descriptions of the image sensor 73 B will be omitted. However, the first bank image data DATA 1 and the second bank image data DATA 2 are output at the sixth clock cycle T 5 .
FIG. 14 is a flowchart of an image data latching operation of the image sensor 71 A, 71 B, 72 A, 72 B, 73 A, or 73 B according to some embodiments of the inventive concepts. Referring to FIGS. 1 through 14 , an operation mode is determined in operation S 1410 . The operation mode may be one of the first through fourth operation modes.
A bank address is input to least one of the first and second bank address inputs HDA 1 and HDA 2 through the operations of the clusters 40 - 1 and 40 - 2 or 400 - 1 and 400 - 2 and the cluster switches 800 - 1 , 900 - 1 , 800 - 2 , and 900 - 2 based on the operation mode in operation S 1420 . The first cluster 400 - 1 collectively denotes the clusters 400 - 1 A and 400 - 1 B and the second cluster 400 - 2 collectively denotes the clusters 400 - 2 A and 400 - 2 B.
According to the operation mode, consecutive bank addresses are transmitted in random order or sequential order to the clusters 40 - 1 and 40 - 2 or 400 - 1 and 400 - 2 through at least one of the first and second channels CHANNEL 1 and CHANNEL 2 in operation S 1430 . The bank address that has been input is compared with a bank address assigned to each of the buffer banks 41 - 1 and 41 - 2 or 300 included in the clusters 40 - 1 and 40 - 2 or 400 - 1 and 400 - 2 , respectively, in operation S 1440 .
Either first image data output from the buffer memories 42 - 1 and 42 - 2 or 340 - 1 through 340 - 4 included in the buffer banks 41 - 1 and 41 - 2 or 300 , respectively, or second image data received from a previous bank is selectively latched based on the comparison result in operations S 1450 and S 1460 . Latched image data is shifted and output to the first or second channel CHANNEL 1 or CHANNEL 2 in operation S 1470 .
FIG. 15 is a flowchart of a variable channel output operation of an image sensor according to some embodiments of the inventive concepts. Referring to FIG. 15 , an operation mode is determined in operation S 1510 . In order to set the operation mode, a voltage of an external pin of the image sensor may be set or operation mode information may be input to the image sensor from an external device (e.g., an application processor) through interface (e.g., CCI) of a controller for the image sensor. It is determined whether the operation mode is a first operation mode or a second operation mode in operation S 1520 .
When the operation mode is the first operation mode, the image sensor receives the first bank address A 0 through the first bank address input HDA 1 of the first channel CHANNEL 1 according to random order or sequential order in operation S 1530 . The image sensor shifts and outputs image data output from the first cluster 40 - 1 or 400 - 1 and the second cluster 40 - 2 or 400 - 2 as the first bank image data output DATA 1 of the first channel CHANNEL 1 in operation S 1540 .
When the operation mode is the second operation mode, the image sensor receives in random or sequential order a first bank address and a second bank address independently through the first bank address input HDA 1 of the first channel CHANNEL 1 and the second bank address input HDA 2 of the second channel CHANNEL 2 , respectively, in operation S 1550 . The image sensor shifts and outputs image data from the first cluster 40 - 1 and image data from the second cluster 40 - 2 as the first bank image data output DATA 1 and the second bank image data output DATA 2 to the first channel CHANNEL 1 and the second channel CHANNEL 2 , respectively, in operation S 1560 .
FIG. 16 is a diagram of an electronic system 1600 , which includes an image sensor, and interface according to some embodiments of the inventive concepts. Referring to FIGS. 1 through 16 , the electronic system 1600 may be implemented as a data processing device, such as a mobile phone, a personal digital assistant (PDA), a portable media player (PMP), or a smart phone, which can use or support mobile industry processor interface (MIPI®).
›DETAILED DESCRIPTION OF THE EMBODIMENTS · 12 of 12
The electronic system 1600 includes an application processor 1610 , an image sensor 1671 , and a display 1660 . An ISP 1612 included in the application processor 1610 may perform serial communication with the image sensor 1671 included in a camera device 1670 through a camera serial interface (CSI). At this time, the ISP 1612 and the image sensor 1671 may include a CCI to transmit and receive control information.
The application processor 1610 may set an operation mode for the image sensor 1671 transmitting image data through a single channel or a plurality of channels through the CCI. The CSI and the CCI may be formed on the same silicon substrate as the image sensor 1671 . In addition, the camera device 1670 may be a camera module and the CCI may be implemented as SPI or I2C, but inventive concepts are not restricted thereto. The image sensor 1671 may be the image sensor 71 A, 71 B, 72 A, 72 B, 73 A, or 73 B described above.
A display serial interface (DSI) host 1611 included in the application processor 1610 may perform serial communication with a DSI device 1661 included in the display 1660 through DSI. At this time, a serializer SER and a deserializer DES may be formed in the DSI host 1611 and the DSI device 1661 , respectively. The serializer SER and the deserializer DES may communicate signals electrically or optically.
The electronic system 1600 may also include a radio frequency (RF) chip 1620 communicating with the application processor 1610 . A PHY 1613 of the application processor 1610 and a PHY 1621 of the RF chip 1620 may communicate data with each other according to MIPI DigRF.
The electronic system 1600 may further include a global positioning system (GPS) receiver 1630 , a storage 1636 , a microphone (MIC) 1635 , a dynamic random access memory (DRAM) 1637 , and a speaker 1634 . The electronic system 1600 may communicate using a worldwide interoperability for microwave access (Wimax) 1633 , a wireless local area network (WLAN) 1632 , and an ultra-wideband (UWB) 1631 .
A channel described in the embodiments of the inventive concepts may indicate a physical transmission path through which data is transmitted or may indicate data itself.
As described above, according to some embodiments of the inventive concepts, when transmitting image data generated by a plurality of pixels, an image sensor groups a plurality of pixel columns included in the image sensor into clusters and adjusts a transmission channel for image data corresponding to each of the clusters, thereby variably adjusting transmission speed of the image data, transmission direction of the image data, and/or the number of transmission channels for the image data. In addition, the image sensor includes a switch that can changes the transmission path based on a control signal received through an external controller or an external pin, so that image sensor variably adjusts the transmission speed of the image data, the transmission direction of the image data, and/or the number of transmission channels for the image data. Moreover, since the image sensor divides the structure of an internal buffer memory into banks or clusters, so that the image sensor can easily change the transmission path for the image data.
While the inventive concepts has been particularly shown and described with reference to example embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in forms and details may be made therein without departing from the spirit and scope of the inventive concepts as defined by the following claims.
Claims as granted
20 claimsLog in to read the claims of this application.
Log in to unlockClassifications
4 codes- H04N3/14
- H04N5/76
- H04N25/42
- H04N25/00
Claim changes
SoonSee which claims were amended, added or cancelled during examination, with every added and removed word marked.
The published claims of this application are not paired with the granted ones in what we hold.
File wrapper
See the full prosecution history — every USPTO and applicant action on this file, in order.
Log in to unlockDocuments
Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.
Log in to unlockChain of title
See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.
Log in to unlock