Noise performance of image sensors is improved by use of inter-pixel comparisons, which may number in the hundreds, all contributing information about a given pixel. This permits accurate determination of image chromaticity, even at extremely low signal-to-noise ratios. In other embodiments, filters of non-conventional spectral transmission functions are employed to reduce metamerism, enabling discernment of scene information not visible to the human eye. Still other embodiments involve fabricating a sparse array of transparent pedestals on an image photosensor array. When color resist is thereafter applied, these pedestals cause thickness variations in the resulting resist layer, leading to pixels having different spectral responses despite using the same color resist. Still other embodiments concern image sensor arrangements enabling generation of red, green, blue and NIR output data using only four conventional (red, green, blue, cyan, magenta, yellow) color resists. Many other novel features and arrangements are also detailed.
H04N 25/13 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres caractérisées par les caractéristiques spectrales des éléments filtrants
H04N 23/84 - Chaînes de traitement de la caméraLeurs composants pour le traitement de signaux de couleur
Detailed camera systems and methods achieve rich light field sampling within limited cost and power constraints. Exemplary arrangements include designs for heterogeneous array cameras, including multifocal arrays, arrays matching depth of field to have uniform pixel density, array-aware focus, exposure and frame rate control, multispectral arrays, and multiscale arrays. One embodiment incorporates lens assemblies of two different types: a first type in which all lens elements move under control of a focus actuator, and a second type in which only some of the lens elements move under control of a focus actuator—the others are stationary. A great number of other features and arrangements are also detailed.
H04N 23/45 - Caméras ou modules de caméras comprenant des capteurs d'images électroniquesLeur commande pour générer des signaux d'image à partir de plusieurs capteurs d'image de type différent ou fonctionnant dans des modes différents, p. ex. avec un capteur CMOS pour les images en mouvement en combinaison avec un dispositif à couplage de charge [CCD] pour les images fixes
H04N 23/90 - Agencement de caméras ou de modules de caméras, p. ex. de plusieurs caméras dans des studios de télévision ou des stades de sport
H04N 23/951 - Systèmes de photographie numérique, p. ex. systèmes d'imagerie par champ lumineux en utilisant plusieurs images pour influencer la résolution, la fréquence d'images ou le rapport de cadre
H04N 25/11 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres
3.
IMAGE PROCESSING ARRANGEMENTS, INCLUDING METHODS FOR DYNAMIC RANGE EXTENSION AND NOISE REDUCTION
High dynamic range (HDR) imaging, and so-called ‘denoising’ of CMOS-sensor-derived image data, are a universally pursued and evolving technical art. This disclosure further advances the art, honing in on the measurable non-uniformities of CMOS sensors as one of the major challenges to increasing dynamic range and decreasing noise. Simplicity and low cost of mass-scale deployment of these approaches become a central commercial requirement. Provisions are described for measuring sensor non-uniformities, generating efficient informational storage of these non-uniformities, then using this stored information during operation of a sensor in a wide variety of camera applications. Extensions of dynamic range on the order of 2 to 4 bits per pixel are typical.
H04N 25/585 - Commande de la gamme dynamique impliquant plusieurs expositions acquises simultanément avec des pixels ayant des sensibilités différentes à l'intérieur du capteur, p. ex. des pixels rapides ou lents ou des pixels ayant des tailles différentes
H04N 23/72 - Combinaison de plusieurs commandes de compensation
H04N 23/73 - Circuits de compensation de la variation de luminosité dans la scène en influençant le temps d'exposition
H04N 23/74 - Circuits de compensation de la variation de luminosité dans la scène en influençant la luminosité de la scène à l'aide de moyens d'éclairage
H04N 23/741 - Circuits de compensation de la variation de luminosité dans la scène en augmentant la plage dynamique de l'image par rapport à la plage dynamique des capteurs d'image électroniques
H04N 23/76 - Circuits de compensation de la variation de luminosité dans la scène en agissant sur le signal d'image
H04N 25/671 - Traitement du bruit, p. ex. détection, correction, réduction ou élimination du bruit appliqué au bruit à motif fixe, p. ex. non-uniformité de la réponse pour la détection ou la correction de la non-uniformité
An imaging device capable of producing images or data with relatively high spectral diversity, allowing for creation of information-rich feature vectors, is provided. Among other things, such information-rich feature vectors may be applied to a range of artificial intelligence and machine learning applications. The imaging device may include a substrate having a baseline spectral responsivity function, multiple pixels forming a cell fabricated on the substrate, and spectral filters each configured to filter light based on a transmission function corresponding to a substantially broad portion of the baseline spectral responsivity function. The spectral filters may be notch filters. Each of the multiple pixels in the cell may be configured to receive light through each of the spectral filters. The transmission function of each of the spectral filters may be substantially different for each of at least a majority of the multiple pixels in the cell.
H04N 25/13 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres caractérisées par les caractéristiques spectrales des éléments filtrants
H04N 25/706 - Pixels pour la mesure de l'exposition ou de la lumière ambiante
An imaging device capable of producing images or data with relatively high spectral diversity, allowing for creation of information-rich feature vectors, is provided. Among other things, such information-rich feature vectors may be applied to a range of artificial intelligence and machine learning applications. The imaging device may include a substrate having a baseline spectral responsivity function, multiple pixels forming a cell fabricated on the substrate, and spectral filters each configured to filter light based on a transmission function corresponding to a substantially broad portion of the baseline spectral responsivity function. The spectral filters may be notch filters. Each of the multiple pixels in the cell may be configured to receive light through each of the spectral filters. The transmission function of each of the spectral filters may be substantially different for each of at least a majority of the multiple pixels in the cell.
H04N 25/13 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres caractérisées par les caractéristiques spectrales des éléments filtrants
H04N 25/706 - Pixels pour la mesure de l'exposition ou de la lumière ambiante
09 - Appareils et instruments scientifiques et électriques
35 - Publicité; Affaires commerciales
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Scientific apparatus, namely, a non-medical imaging device and image sensor that transmits spectrally diverse image data to various applications; Scientific apparatus, namely, a non-medical imaging device and image sensor comprised of optical filters that select particular wavelength or wavelength ranges of light to transmit to various applications; Downloadable software application for analyzing and rendering spectrally diverse image data Business research and business consulting services in the fields of imaging devices, sensors, image data storage devices, optical filters, imaging analysis devices, and image rendering devices Providing temporary use of online non-downloadable software applications for rendering spectrally diverse image data; Scientific research, scientific research consulting, product design, and product development services, all in the fields of imaging devices, sensors, image data, optical filters, imaging analysis, and image rendering
Noise performance of image sensors is improved by use of inter-pixel comparisons, which may number in the hundreds, all contributing information about a given pixel. This permits accurate determination of image chromaticity, even at extremely low signal-to-noise ratios. In other embodiments, filters of non-conventional spectral transmission functions are employed to reduce metamerism, enabling discernment of scene information not visible to the human eye. Still other embodiments involve fabricating a sparse array of transparent pedestals on an image photosensor array. When color resist is thereafter applied, these pedestals cause thickness variations in the resulting resist layer, leading to pixels having different spectral responses despite using the same color resist. Still other embodiments concern image sensor arrangements enabling generation of red, green, blue and NIR output data using only four conventional (red, green, blue, cyan, magenta, yellow) color resists. Many other novel features and arrangements are also detailed.
H04N 25/13 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres caractérisées par les caractéristiques spectrales des éléments filtrants
An imaging device capable of producing images or data with relatively high spectral diversity, allowing for creation of information-rich feature vectors, is provided. Among other things, such information-rich feature vectors may be applied to a range of artificial intelligence and machine learning applications. The imaging device may include a substrate having a baseline spectral responsivity function, multiple pixels forming a cell fabricated on the substrate, and spectral filters each configured to filter light based on a transmission function corresponding to a substantially broad portion of the baseline spectral responsivity function. The spectral filters may be notch filters. Each of the multiple pixels in the cell may be configured to receive light through each of the spectral filters. The transmission function of each of the spectral filters may be substantially different for each of at least a majority of the multiple pixels in the cell.
H04N 25/13 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres caractérisées par les caractéristiques spectrales des éléments filtrants
H04N 25/706 - Pixels pour la mesure de l'exposition ou de la lumière ambiante
Noise performance of image sensors is improved by use of inter-pixel comparisons, which may number in the hundreds, all contributing information about a given pixel. This permits accurate determination of image chromaticity, even at extremely low signal-to-noise ratios. In other embodiments, filters of non-conventional spectral transmission functions are employed to reduce metamerism, enabling discernment of scene information not visible to the human eye. Still other embodiments involve fabricating a sparse array of transparent pedestals on an image photosensor array. When color resist is thereafter applied, these pedestals cause thickness variations in the resulting resist layer, leading to pixels having different spectral responses despite using the same color resist. Still other embodiments concern image sensor arrangements enabling generation of red, green, blue and NIR output data using only four conventional (red, green, blue, cyan, magenta, yellow) color resists. Many other novel features and arrangements are also detailed.
H04N 23/84 - Chaînes de traitement de la caméraLeurs composants pour le traitement de signaux de couleur
H04N 25/13 - Agencement de matrices de filtres colorés [CFA]Mosaïques de filtres caractérisées par les caractéristiques spectrales des éléments filtrants
09 - Appareils et instruments scientifiques et électriques
Produits et services
Computer hardware and downloadable software for image signal processing, namely, digital signal processors used to convert raw image data into image data for image processing; microchip image processors; Digital signal processors; Optical image sensors and processors; Electronic video and image signal processing apparatus for use in the capture and production of video and digital images, namely for digital cameras and other devices.
09 - Appareils et instruments scientifiques et électriques
42 - Services scientifiques, technologiques et industriels, recherche et conception
Produits et services
Camera filters; Cameras; Lens filters; Sensor chips for scientific use; Digital cameras; Digital cameras for industrial use; Electric or electronic sensors for cameras; Infrared cameras; Motion-activated cameras; Multiple purpose cameras; Security cameras; Surveillance cameras; Wide-angle lenses for cameras Software as a service (SAAS) services featuring software for image capture, image data processing, data visualization
12.
Co-boresighted monocentric multiscale (MMS) camera exhibiting Galilean multiscale design
Disclosed are systems, methods, and structures for monocentric multiscale gigapixel imaging systems and cameras employing a Galilean architecture wherein adjacent subimages do not overlap while advantageously producing a reduced system volume, improved relative illumination and image quality as compared with prior art systems.
H04N 13/218 - Générateurs de signaux d’images utilisant des caméras à images stéréoscopiques utilisant un seul capteur d’images 2D utilisant le multiplexage spatial
G03B 27/10 - Appareils de reproduction avec mouvement relatif entre l'original et la source lumineuse pendant l'exposition
G02B 13/00 - Objectifs optiques spécialement conçus pour les emplois spécifiés ci-dessous
G02B 9/16 - Objectifs optiques caractérisés à la fois par le nombre de leurs composants et la façon dont ceux-ci sont disposés selon leur signe, c.-à-d. + ou — ayant uniquement trois composants disposés + — + tous trois étant simples
Aspects of the present disclosure describe systems, methods, and structures for improved compression of array camera image data and improved power budgets for array cameras.
H04N 5/345 - Extraction de données de pixels provenant d'un capteur d'images en agissant sur les circuits de balayage, p.ex. en modifiant le nombre de pixels ayant été échantillonnés ou à échantillonner en lisant partiellement une matrice de capteurs SSIS
H04N 5/378 - Circuits de lecture, p.ex. circuits d’échantillonnage double corrélé [CDS], amplificateurs de sortie ou convertisseurs A/N
14.
Array camera imaging system having distributed memory
An array-camera imaging system and method for producing a rendered image are presented, wherein the system includes a plurality of imagers, a plurality of image processors, and a plurality of memory modules that are networked with the image processors via a communications bus. Each image processor provides processed and processed image data from at least one imager to the memory modules. Preferably, the processed image data is distributed among the memory modules at multiple resolution scales. In response to a request from an image rendering system, image data is read out from the memory modules at the resolution scale of the request.
An imaging system and method for enabling the capture and rendering of an image without the latency and bandwidth requirements of the prior art is presented. Embodiments of the present invention employ a plurality of imagers that provide image data to a plurality of capture and hosting servers to which they are connected via a first communications bus. One or more rendering systems are interconnected to the plurality of servers via a second communications bus. The servers perform parallel processing of only raw image data necessary to satisfy individual rendering requests from the rendering systems. Since image processing is performed only on the image data required to render the particular view of interest, an entire high-resolution image is not formed to satisfy the rendering request and the desired image can be rendered with less latency and requires less bandwidth for transmission to the rendering system.
A panoramic imager comprising a mirror and a multi-scale imaging system is presented. The multi-scale imaging system comprises an objective lens and a plurality of cameras that is arranged in a non-planar arrangement at the image field of the objective lens. The objective lens reduces a first aberration introduced by the mirror, and each camera further reduces any residual first aberration. As a result, panoramic imagers of the present invention can provide improved image quality and higher resolution than panoramic imagers of the prior art.
G03B 37/00 - Photographie panoramique ou à grand écranPhotographie de surfaces étendues, p. ex. pour la géodésiePhotographie de surfaces internes, p. ex. de tuyaux
H04N 5/232 - Dispositifs pour la commande des caméras de télévision, p.ex. commande à distance
G02B 13/06 - Objectifs panoramiquesLentilles dites "de ciel"
A means of enabling an imaging lens system that overcomes some of the costs and disadvantages of the prior art is disclosed. A lens system in accordance with the present invention reduces or eliminates one or more aberrations of an optical input by separating image collection functionality from image processing functionality. As a result, each function can be performed without compromising the other function. An embodiment of the present invention comprises a collection optic that provides a first optical field, based on light from a scene, to a processing optic that comprises a plurality of lenslets. The processing optic tiles the first optical field into a plurality of second optical fields. Each lenslet receives a different one of the plurality of second optical fields, reduces at least one localized aberration in its received second optical field, and provides the corrected optical field to a different one of plurality of photodetectors whose collective output is used to form a spatially correlated sub-image of that corrected optical field. The sub-images are readily combined into a spatially correlated image of the scene.
G02B 13/16 - Objectifs optiques spécialement conçus pour les emplois spécifiés ci-dessous à utiliser en combinaison avec des convertisseurs ou des amplificateurs d'image
G02B 27/10 - Systèmes divisant ou combinant des faisceaux
