Noise performance of image sensors is improved by use of inter-pixel comparisons, which may number in the hundreds, all contributing information about a given pixel. This permits accurate determination of image chromaticity, even at extremely low signal-to-noise ratios. In other embodiments, filters of non-conventional spectral transmission functions are employed to reduce metamerism, enabling discernment of scene information not visible to the human eye. Still other embodiments involve fabricating a sparse array of transparent pedestals on an image photosensor array. When color resist is thereafter applied, these pedestals cause thickness variations in the resulting resist layer, leading to pixels having different spectral responses despite using the same color resist. Still other embodiments concern image sensor arrangements enabling generation of red, green, blue and NIR output data using only four conventional (red, green, blue, cyan, magenta, yellow) color resists. Many other novel features and arrangements are also detailed.
Detailed camera systems and methods achieve rich light field sampling within limited cost and power constraints. Exemplary arrangements include designs for heterogeneous array cameras, including multifocal arrays, arrays matching depth of field to have uniform pixel density, array-aware focus, exposure and frame rate control, multispectral arrays, and multiscale arrays. One embodiment incorporates lens assemblies of two different types: a first type in which all lens elements move under control of a focus actuator, and a second type in which only some of the lens elements move under control of a focus actuator—the others are stationary. A great number of other features and arrangements are also detailed.
H04N 23/45 - Cameras or camera modules comprising electronic image sensorsControl thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
H04N 23/55 - Optical parts specially adapted for electronic image sensorsMounting thereof
H04N 23/90 - Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
H04N 23/951 - Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
H04N 25/11 - Arrangement of colour filter arrays [CFA]Filter mosaics
3.
IMAGE PROCESSING ARRANGEMENTS, INCLUDING METHODS FOR DYNAMIC RANGE EXTENSION AND NOISE REDUCTION
High dynamic range (HDR) imaging, and so-called ‘denoising’ of CMOS-sensor-derived image data, are a universally pursued and evolving technical art. This disclosure further advances the art, honing in on the measurable non-uniformities of CMOS sensors as one of the major challenges to increasing dynamic range and decreasing noise. Simplicity and low cost of mass-scale deployment of these approaches become a central commercial requirement. Provisions are described for measuring sensor non-uniformities, generating efficient informational storage of these non-uniformities, then using this stored information during operation of a sensor in a wide variety of camera applications. Extensions of dynamic range on the order of 2 to 4 bits per pixel are typical.
H04N 25/585 - Control of the dynamic range involving two or more exposures acquired simultaneously with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes
H04N 23/72 - Combination of two or more compensation controls
H04N 23/73 - Circuitry for compensating brightness variation in the scene by influencing the exposure time
H04N 23/74 - Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
H04N 23/741 - Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
H04N 23/76 - Circuitry for compensating brightness variation in the scene by influencing the image signals
H04N 25/671 - Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
An imaging device capable of producing images or data with relatively high spectral diversity, allowing for creation of information-rich feature vectors, is provided. Among other things, such information-rich feature vectors may be applied to a range of artificial intelligence and machine learning applications. The imaging device may include a substrate having a baseline spectral responsivity function, multiple pixels forming a cell fabricated on the substrate, and spectral filters each configured to filter light based on a transmission function corresponding to a substantially broad portion of the baseline spectral responsivity function. The spectral filters may be notch filters. Each of the multiple pixels in the cell may be configured to receive light through each of the spectral filters. The transmission function of each of the spectral filters may be substantially different for each of at least a majority of the multiple pixels in the cell.
An imaging device capable of producing images or data with relatively high spectral diversity, allowing for creation of information-rich feature vectors, is provided. Among other things, such information-rich feature vectors may be applied to a range of artificial intelligence and machine learning applications. The imaging device may include a substrate having a baseline spectral responsivity function, multiple pixels forming a cell fabricated on the substrate, and spectral filters each configured to filter light based on a transmission function corresponding to a substantially broad portion of the baseline spectral responsivity function. The spectral filters may be notch filters. Each of the multiple pixels in the cell may be configured to receive light through each of the spectral filters. The transmission function of each of the spectral filters may be substantially different for each of at least a majority of the multiple pixels in the cell.
09 - Scientific and electric apparatus and instruments
35 - Advertising and business services
42 - Scientific, technological and industrial services, research and design
Goods & Services
Scientific apparatus, namely, a non-medical imaging device and image sensor that transmits spectrally diverse image data to various applications; Scientific apparatus, namely, a non-medical imaging device and image sensor comprised of optical filters that select particular wavelength or wavelength ranges of light to transmit to various applications; Downloadable software application for analyzing and rendering spectrally diverse image data Business research and business consulting services in the fields of imaging devices, sensors, image data storage devices, optical filters, imaging analysis devices, and image rendering devices Providing temporary use of online non-downloadable software applications for rendering spectrally diverse image data; Scientific research, scientific research consulting, product design, and product development services, all in the fields of imaging devices, sensors, image data, optical filters, imaging analysis, and image rendering
Noise performance of image sensors is improved by use of inter-pixel comparisons, which may number in the hundreds, all contributing information about a given pixel. This permits accurate determination of image chromaticity, even at extremely low signal-to-noise ratios. In other embodiments, filters of non-conventional spectral transmission functions are employed to reduce metamerism, enabling discernment of scene information not visible to the human eye. Still other embodiments involve fabricating a sparse array of transparent pedestals on an image photosensor array. When color resist is thereafter applied, these pedestals cause thickness variations in the resulting resist layer, leading to pixels having different spectral responses despite using the same color resist. Still other embodiments concern image sensor arrangements enabling generation of red, green, blue and NIR output data using only four conventional (red, green, blue, cyan, magenta, yellow) color resists. Many other novel features and arrangements are also detailed.
An imaging device capable of producing images or data with relatively high spectral diversity, allowing for creation of information-rich feature vectors, is provided. Among other things, such information-rich feature vectors may be applied to a range of artificial intelligence and machine learning applications. The imaging device may include a substrate having a baseline spectral responsivity function, multiple pixels forming a cell fabricated on the substrate, and spectral filters each configured to filter light based on a transmission function corresponding to a substantially broad portion of the baseline spectral responsivity function. The spectral filters may be notch filters. Each of the multiple pixels in the cell may be configured to receive light through each of the spectral filters. The transmission function of each of the spectral filters may be substantially different for each of at least a majority of the multiple pixels in the cell.
Noise performance of image sensors is improved by use of inter-pixel comparisons, which may number in the hundreds, all contributing information about a given pixel. This permits accurate determination of image chromaticity, even at extremely low signal-to-noise ratios. In other embodiments, filters of non-conventional spectral transmission functions are employed to reduce metamerism, enabling discernment of scene information not visible to the human eye. Still other embodiments involve fabricating a sparse array of transparent pedestals on an image photosensor array. When color resist is thereafter applied, these pedestals cause thickness variations in the resulting resist layer, leading to pixels having different spectral responses despite using the same color resist. Still other embodiments concern image sensor arrangements enabling generation of red, green, blue and NIR output data using only four conventional (red, green, blue, cyan, magenta, yellow) color resists. Many other novel features and arrangements are also detailed.
09 - Scientific and electric apparatus and instruments
Goods & Services
Computer hardware and downloadable software for image signal processing, namely, digital signal processors used to convert raw image data into image data for image processing; microchip image processors; Digital signal processors; Optical image sensors and processors; Electronic video and image signal processing apparatus for use in the capture and production of video and digital images, namely for digital cameras and other devices.
09 - Scientific and electric apparatus and instruments
42 - Scientific, technological and industrial services, research and design
Goods & Services
Camera filters; Cameras; Lens filters; Sensor chips for scientific use; Digital cameras; Digital cameras for industrial use; Electric or electronic sensors for cameras; Infrared cameras; Motion-activated cameras; Multiple purpose cameras; Security cameras; Surveillance cameras; Wide-angle lenses for cameras Software as a service (SAAS) services featuring software for image capture, image data processing, data visualization
12.
Co-boresighted monocentric multiscale (MMS) camera exhibiting Galilean multiscale design
Disclosed are systems, methods, and structures for monocentric multiscale gigapixel imaging systems and cameras employing a Galilean architecture wherein adjacent subimages do not overlap while advantageously producing a reduced system volume, improved relative illumination and image quality as compared with prior art systems.
H04N 13/218 - Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
G03B 27/10 - Copying apparatus with a relative movement between the original and the light source during exposure
G02B 13/00 - Optical objectives specially designed for the purposes specified below
G02B 9/16 - Optical objectives characterised both by the number of the components and their arrangements according to their sign, i.e. + or – having three components only arranged + – + all the components being simple
Aspects of the present disclosure describe systems, methods, and structures for improved compression of array camera image data and improved power budgets for array cameras.
H04N 5/345 - Extracting pixel data from an image sensor by controlling scanning circuits, e.g. by modifying the number of pixels having been sampled or to be sampled by partially reading an SSIS array
H04N 5/378 - Readout circuits, e.g. correlated double sampling [CDS] circuits, output amplifiers or A/D converters
14.
Array camera imaging system having distributed memory
An array-camera imaging system and method for producing a rendered image are presented, wherein the system includes a plurality of imagers, a plurality of image processors, and a plurality of memory modules that are networked with the image processors via a communications bus. Each image processor provides processed and processed image data from at least one imager to the memory modules. Preferably, the processed image data is distributed among the memory modules at multiple resolution scales. In response to a request from an image rendering system, image data is read out from the memory modules at the resolution scale of the request.
An imaging system and method for enabling the capture and rendering of an image without the latency and bandwidth requirements of the prior art is presented. Embodiments of the present invention employ a plurality of imagers that provide image data to a plurality of capture and hosting servers to which they are connected via a first communications bus. One or more rendering systems are interconnected to the plurality of servers via a second communications bus. The servers perform parallel processing of only raw image data necessary to satisfy individual rendering requests from the rendering systems. Since image processing is performed only on the image data required to render the particular view of interest, an entire high-resolution image is not formed to satisfy the rendering request and the desired image can be rendered with less latency and requires less bandwidth for transmission to the rendering system.
A panoramic imager comprising a mirror and a multi-scale imaging system is presented. The multi-scale imaging system comprises an objective lens and a plurality of cameras that is arranged in a non-planar arrangement at the image field of the objective lens. The objective lens reduces a first aberration introduced by the mirror, and each camera further reduces any residual first aberration. As a result, panoramic imagers of the present invention can provide improved image quality and higher resolution than panoramic imagers of the prior art.
A means of enabling an imaging lens system that overcomes some of the costs and disadvantages of the prior art is disclosed. A lens system in accordance with the present invention reduces or eliminates one or more aberrations of an optical input by separating image collection functionality from image processing functionality. As a result, each function can be performed without compromising the other function. An embodiment of the present invention comprises a collection optic that provides a first optical field, based on light from a scene, to a processing optic that comprises a plurality of lenslets. The processing optic tiles the first optical field into a plurality of second optical fields. Each lenslet receives a different one of the plurality of second optical fields, reduces at least one localized aberration in its received second optical field, and provides the corrected optical field to a different one of plurality of photodetectors whose collective output is used to form a spatially correlated sub-image of that corrected optical field. The sub-images are readily combined into a spatially correlated image of the scene.
