Device, system and method of data conversion for wide gamut displays Number:7,436,996 from the United States Patent and Trademark Office (PTO) owispatent

Title: Device, system and method of data conversion for wide gamut displays

Abstract: A method and system for converting color image data (data outputting from element 202) from a, for example, three-dimensional color space format to a format usable by an n-primary display (206), wherein n is greater than or equal to 3. The system (converter 204) may define a two-dimensional sub-space having a plurality of two-dimensional positions, each position representing a set of n primary color values and a third, scaleable coordinate value for generating an n-primary display input signal (signal inputting toi display 206). Furthermore, the system may receive a three-dimensional color space input signal including out-of range pixel data not reproducible by a three-primary additive display, and may convert the data to side gamut color image pixel data suitable for driving the wide gamut color display.

Patent Number: 7,436,996 Issued on 10/14/2008 to Ben-Chorin,   et al.

---

Inventors:	Ben-Chorin; Moshe (Rehovot, IL), Ben-David; Oded (Rishon LeZion, IL)
Assignee:	Genoa Color Technologies Ltd (Herzliya, IL)
Appl. No.:	10/479,845
Filed:	May 23, 2002
PCT Filed:	May 23, 2002
PCT No.:	PCT/IL02/00410
371(c)(1),(2),(4) Date:	December 08, 2003
PCT Pub. No.:	WO02/099557
PCT Pub. Date:	December 12, 2002

---

Related U.S. Patent Documents

---

	Application Number	Filing Date	Patent Number	Issue Date
	60296175	Jun., 2001
	60332058	Nov., 2001

---

Current U.S. Class:	382/167 ; 345/590; 345/602; 345/603; 345/604; 358/518; 358/519; 382/162; 382/254
Current International Class:	G06K 9/00 (20060101); G09G 5/02 (20060101)
Field of Search:	345/589,590,600,601,602 382/167,162,254 358/518,519,500

---

References Cited [Referenced By]

---

U.S. Patent Documents

4390893	June 1983	Russell et al.
4751535	June 1988	Myers
4800375	January 1989	Silverstein et al.
4843381	June 1989	Baron
4843573	June 1989	Taylor et al.
4985853	January 1991	Taylor et al.
5416890	May 1995	Beretta
5455600	October 1995	Friedman et al.
5539540	July 1996	Spaulding et al.
5592188	January 1997	Doherty et al.
5650942	July 1997	Granger
5751385	May 1998	Heinze
5835099	November 1998	Marimont
5867286	February 1999	Lee et al.
5870530	February 1999	Balasubramanian
5872898	February 1999	Mahy
5892891	April 1999	Dalal et al.
5907629	May 1999	Funt et al.
5995165	November 1999	Oh
5999153	December 1999	Lind et al.
6018237	January 2000	Havel
6058207	May 2000	Tuijn et al.
6097367	August 2000	Kuriwaki et al.
6147720	November 2000	Guerinot et al.
6198512	March 2001	Harris
6220710	April 2001	Raj et al.
6231190	May 2001	Dewald
6236406	May 2001	Li
6246396	June 2001	Gibson et al.
6256073	July 2001	Pettitt
6259430	July 2001	Riddle et al.
6262710	July 2001	Smith
6262744	July 2001	Carrein
6280034	August 2001	Brennesholtz
6324006	November 2001	Morgan
6400843	June 2002	Shu et al.
6438264	August 2002	Gallagher et al.
6459425	October 2002	Holub et al.
6707938	March 2004	de Queiroz et al.
6727959	April 2004	Eskin
7327876	February 2008	Hoshuyama
2001/0017627	August 2001	Marsden et al.
2003/0137610	July 2003	Ohsawa

Foreign Patent Documents

	2000253263		Sep., 2000		JP
	2000338950		Dec., 2000		JP
	WO 95/10160		Apr., 1995		WO
	WO 97/42770		Nov., 1997		WO
	WO 01/95544		Dec., 2001		WO
	WO 02/99557		May., 2002		WO
	WO 02/50763		Jun., 2002		WO

Other References

Jack, Keith. "YCbCr to RGB Consideration." Intersil Application Note (1997): 1-2. cited by examiner . Ajito, Takeyuku, Kenro Ohsawa, Takashi Obi, and Masahiro Yamaguchi Ohyama. "Color Conversion Method for Multiprimary Display Using Matrix Switching." Optical Review. 8(2001): 191-187. cited by examiner . U.S. Appl. No. 09/710,895, filed Jun. 7, 2000, Ben-David et al. cited by other . Wyble and Berns, "A critical view of Spectral Models Applied to Binary Color Printing", Color Research and Application, vol. 25, 2000, pp. 4-19. cited by other . Imai, Francisco H., "Spectral reproduction from scene to hardcopy, Part 1--Multi-spectral acquisition and spectral estimation using a Trichromatic Digital Camera System associated with absorbtion filters", Munsell Color Science Laboratory, Rochester Institute of Technology. cited by other . Rosen et al., "Spectral Reproduction from Scene to Hardcopy II: Image Processing", Munsell Color Science Laboratory, RIT-Proceedings of SPIE vol. 4300 (2001), pp. 33-41. cited by other . Pointer, M.R., "The Gamut of Real Surface Colors", Color Research & Application. 5(3): 144-155, 1980. cited by other . Ajito et al., "Expanded Color Gamut Reproduced by Six-Primary Projection Display", Proceedings of SPIE, vol. 3954 (2000), pp. 130-137. cited by other . Ajito et al., "Multiprimary color display for liquid crystal display projectors using diffraction grating", Optical Eng. 38(11) 1883-1888 (Nov. 1999). (Abstract). cited by other . Wyszecki and Stiles, "Color Science: Concepts and Methods", Quantative Data and Formulae, 2.sup.nd Edition, 1982. pp. 179-183. cited by other . Jack, Keith, "Video Demystified", 3.sup.rd Edition. LLH Technology Publishing, 2001. pp. 17-19. cited by other . Shimizu, Jeffrey A., "Scrolling Color LCOS for HDTV Rear Projection", SID 01 Digest, pp. 1072-1075. cited by other . Ajito et al., "Color Conversion Method for Multiprimary Display using Matrix Switching", Optical Review, Springer-Verlag. BE, vol. 8, No. 3, May 1, 2001, pp. 191-197. cited by other . Supplementary European Search Report for Application No. EP 02 73 5931 dated Jul. 4, 2008. cited by other.

Primary Examiner: Ahmed; Samir A
Assistant Examiner: Newman; Michael A
Attorney, Agent or Firm: Pearl Cohen Zedek Latzer, LLP

---

Parent Case Text

---

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a National Phase Application of PCT International Application No. PCT/IL02/00410, International Filing Date May 23, 2002, claiming priority of U.S. Provisional Patent Application, 60/296,175, filed Jun. 7, 2001, and of U.S. Provisional Patent Application, 60/332,058, filed Nov. 23, 2001.

---

Claims

---

What is claimed is:

1. A method of converting color image data from a three-dimensional color space format to a format suitable for driving an n-primary display, wherein n is greater than or equal to three, the method comprising: defining a two-dimensional sub-space having a plurality of two-dimensional positions, each position representing a set of n primary color values and a third, scaleable coordinate value, the set of primary color values and the scaleable coordinate value corresponding to a distinct color combination in said three-dimensional color space; receiving an input signal representing color image data including a plurality of pixels in said three-dimensional color space; decomposing the three-dimensional color space data of each said pixel into a two-dimensional sub-space component which determines the position of the color of said pixel in said two-dimensional sub-space, and a third, scaling component; dividing the scaling component for each said pixel by the scaleable coordinate value corresponding to the position of the respective two-dimensional sub-space component of the pixel to produce a scaled component; and generating an n-primary display input signal representing n-primary input data for each said pixel by multiplying by said scaled component the set of n primary color values at the position of said two-dimensional sub-space component of said pixel in the two-dimensional sub-space.

2. A method according to claim 1 wherein said two-dimensional sub-space includes a predetermined number of positions spanning a predetermined range of color combinations of said three-dimensional color space.

3. A method according to claim 1 wherein said n-primary display input signal comprises n, respective channels, each channel representing image pixel data corresponding to one of a set of n primary colors reproducible by said n-primary display.

4. A method according to claim 1 wherein said third, scaleable coordinate value of each position in said two-dimensional sub-space is responsive to the level of saturation of the color corresponding to each said position.

5. A method according to claim 1 wherein said third, scaleable coordinate value of each position in said two-dimensional sub-space is responsive to the level of brightness of each said position.

6. A method according to claim 1 comprising storing the set of n primary color values and third, scalable component of all colors represented by said two-dimensional sub-space in at least one look-up-table (LUT) having a plurality of entries, each entry containing the set of n primary color values and the third, scaleable coordinate value of a corresponding position in said two-dimensional sub-space.

7. A method according to claim 6 wherein said n primary color values of each entry of said at least one LUT are computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum saturation level for predetermined hue and brightness levels.

8. A method according to claim 6 wherein said n primary color values of each said entry of said at least one LUT are computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum brightness for predetermined chromaticity coordinates.

9. A method according to claim 6 wherein said n primary color values of each said entry of said at least one LUT are computed to comply with the condition that a linear combination of the n primaries based on the computed values yields an optimal spectral match for predetermined chromaticity coordinates.

10. A method according to claim 6 wherein said at least one LUT comprises at least one two-dimensional LUT.

11. A method according to claim 6 wherein generating an n-primary input signal comprises: retrieving from said at least one LUT the set of n primary color values and the third, scalable coordinate value at the position of said two-dimensional sub-space component of said pixel in the two-dimensional sub-space.

12. A method according to claim 11 wherein said three-dimensional color space comprises a ROB color space.

13. A method according to claim 11 wherein said three-dimensional color space comprises a YCbCr color space.

14. A device for convening color image data from a three-dimensional color space format to a format usable by an n-primary display, wherein n is greater than or equal to three, the device comprising a converter able to define a two-dimensional sub-space having a plurality of two-dimensional positions, each position representing a set of n primary color values and a third, scalable coordinate value, the set of primary color values and the scaleable coordinate value corresponding to a distinct color combination in said three-dimensional color space, wherein said converter is able to receive an input signal representing color image data including a plurality of pixels in said three-dimensional color space, wherein said converter is able to decompose the three-dimensional color space data of each said pixel into a two-dimensional sub-space component, which determines the position of the color of said pixel in said two-dimensional sub-space, and a third, scaling component, and wherein said convener is able to generate an n-primary display input signal representing n-primary input data for each said pixel dividing the scaling component for each said pixel by the scaleable coordinate value corresponding to the position of the respective two-dimensional sub-space component of the pixel to produce a scaled component and by multiplying by said scaled component the set of n primary color values at the position of said two-dimensional sub-space component of said pixel in the two-dimensional sub-space.

15. A device according to claim 14 wherein said two-dimensional sub-space includes a predetermined number of positions spanning a predetermined range of color combinations of said three-dimensional color space.

16. A device according to claim 14 wherein said n-primary display input signal comprises n, respective channels, each channel representing image pixel data corresponding to one of a set of n primary colors reproducible by said n-primary display.

17. A device according to claim 14 wherein said third, scaleable coordinate value of each position in said two-dimensional sub-space is responsive to the level of saturation of the color corresponding to each said position.

18. A device according to claim 14 wherein said third, scaleable coordinate value of each position in said two-dimensional sub-space is responsive to the level of brightness of each said position.

19. A device according to claim 14 comprising at least one look-up-table (LUT) having a plurality of entries, each entry containing the set of n primary color values and the third, scaleable coordinate value of a corresponding position in said two-dimensional sub-space, said at least one LUT storing the set of n primary color values and third, scalable component of all colors represented by said two-dimensional sub-space.

20. A device according to claim 19 wherein said n primary color values of each entry of said at least one LUT are computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum saturation level for predetermined hue and brightness levels.

21. A device according to claim 19 wherein said n primary color values of each said entry of said at least one LUT are computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum brightness for predetermined chromaticity coordinates.

22. A device according to claim 19 wherein said n primary color values of each said entry of said at least one LUT are computed to comply with the condition that a linear combination of the n primaries based on the computed values yields an optimal spectral match for predetermined chromaticity coordinates.

23. A device according to claim 19 wherein said at least one LUT comprises at least one two-dimensional LUT.

24. A device according to claim 19 wherein said converter is capable of retrieving from said at least one LUT the set of n primary color values and the third, scaleable coordinate value at the position of said two-dimensional sub-space component of said pixel in the two-dimensional sub-space.

25. A color display system comprising: a device for converting color image data from a three-dimensional color space format to a format usable by an n-primary display, wherein n is greater than or equal to three, the device comprising a converter able to define a two-dimensional sub-space having a plurality of two-dimensional positions each position representing a set of n primary color values and a third, scaleable coordinate value, the set of primary color values and the sad cable coordinate value corresponding to a distinct color combination in said three-dimensional color space, wherein said converter is able to receive an input signal representing color image data including a plurality of pixels in said three-dimensional color space, wherein said convener is able to decompose the three-dimensional color space data of each said pixel into a two-dimensional sub-space component, which determines the position of the color of said pixel in said two-dimensional sub-space, and a third, scaling component, and wherein said converter is able to generate an n-primary display input signal representing n-primary input data for each said pixel dividing the scaling component for each said pixel by the scaleable coordinate value corresponding to the position of the respective two-dimensional sub-space component of the pixel to produce a scaled component and by multiplying by said scaled component the set of n primary color values at the position of said two-dimensional sub-space component of said pixel in the two-dimensional sub-space; and a color display arranged to receive said n-primary display input signal and to reproduces a color image based on said n-primary display input signal.

26. A system according to claim 25 wherein said color display comprises an n-primary color display.

27. A device according to claim 14, wherein said three-dimensional color space comprises a RGB color space.

28. A device according to claim 14, wherein said three-dimensional color space comprises a YCbCr color space.

---

Description

---

FIELD OF THE INVENTION

The invention is related generally to conversion and processing of data for display devices and monitors, more specifically, to methods, systems and devices for converting data to drive color displays.

BACKGROUND OF THE INVENTION

Standard computer monitors and TV displays are typically based on three additive primaries: red, green, and blue, collectively denoted RGB. These monitors may not be able to display many colors perceived by humans, since they are limited in the range of color they are capable of displaying. FIG. 1A schematically illustrates a chromaticity diagram as is known in the art. The closed area in a shape of horseshoe represents the chromaticity of colors that can be seen by humans. For each chromaticity, described as a point on the two-dimensional plane, different levels of brightness are possible, thus constructing a three-dimensional color space. The points on the border of the horseshoe, known as the spectrum locus, correspond to monochromatic excitations in the range from 400 nm to 780 nm as marked. A straight line closing the horseshoe from below, between the extreme monochromatic excitation at the long and short wavelengths, is named the purple line. All colors discernible by human eye are inside this closed area, which is called the color gamut of the eye. The triangular area enclosed by the color gamut in FIG. 1A represents the range of colors that can be produced by a standard RGB monitor. The area of the color gamut outside the RGB triangle indicates that many colors seen by humans are not discernible on standard monitors.

Existing display devices can be divided into two groups, namely, direct view devices and projection devices. The direct view devices group includes CRT, LCD, LED and other displays. In direct view devices, each display is composed of three-color sub-pixels, namely RGB, which are physically located at the screen. The color image is created by the viewer's visual system, which mentally integrates the colored light arriving from spatially neighboring sub-pixels to give a full color impression.

The light emission mechanism may be different in the different types of devices. In a CRT display, an electron beam accelerated by a scanning electron gun cause the different color phosphors at the screen to emit visible light. In LED devices, different color LED pixels are directly driven by electric current to emit light. In both cases the strength of the excitation determines the intensity of the emitted light. The input data modulates the intensity of the excitation of different pixels to create a desired image.

In LCD devices, color is created by filtering white light through an array of red, green and blue optical filters, which correspond to red, green and blue sub-pixels. The transparency of different color is modulated by an array of LC elements, which is placed juxtaposed and in registry with the color filter sub-pixel array. The transparency of the LC array cells, which control the intensity of respective sub-pixels, is modulated by controlling the voltage applied to the cells. These voltages are modulated in accordance with the input data to create the desired image.

Projection display systems create images by projecting light on a viewing screen. There are generally two types of projection display systems, namely, simultaneous displays and sequential displays. Simultaneous projection display systems are based on projecting light of all three primaries simultaneously onto to the viewing screen, whereby color combinations are perceived by spatial integration of the colors by the visual system of the viewer. Sequential projection display systems project separate images of the different primary colors onto the screen sequentially, at a sufficiently high frequency so that the human eye can perceive color combinations by temporal integration of the primary color images.

Standard video data is typically transferred in YCbCr or RGB related formats. The data is encoded, either digitally or analogously. Color is represented in a three-dimensional space suitable for presentation on a three-primaries monitor or display. The input data in YCbCr format is translated, using a conversion matrix, to corresponding RGB data. If RGB input data is used the matrix conversion is not required and the input RGB data is passed directly to the monitor. Signals responsive to the RGB data are used to drive the three-primaries display. The RGB data includes R, G and B signal components (channels): the R signal component represents the red primary; the G signal component represents the green primary; and the B signal component represents the blue primary. Three multipliers and/or one-dimensional look-up tables, one for each of the RGB channels, are used to adjust color temperature and other responses of the system. Certain processes can also be applied to the original YCbCr data, controlling the visual appearance using the YCbCr coordinates. For example, the Y channel might be manipulated in order to control the brightness and the contrast of the image. Alternatively, the Cb and Cr data can be manipulated to control the color saturation of the final image. A user of the display may perform such manipulations and adjustments, e.g., by adjusting the "brightness", "contrast" and "color" of a display monitor.

As described above, existing display monitors reproduce colors only within a limited portion of the full color gamut of the eye. Therefore, to improve image reproduction quality and richness, there is a need for a display monitor capable of reproducing a wider color gamut, including color ranges beyond the enclosed triangular area in FIG. 1A.

SUMMARY OF THE INVENTION

The range of colors that are reproduced by display monitors can be expanded using a monitor with more than three primary colors. It has been demonstrated by the inventors that a monitor with more than three primaries in accordance with the invention produces improved color images, spanning a significantly wider color gamut than that of conventional three-primary display systems.

Embodiments of the present invention provides systems, methods and devices for converting image data in three-primary video formats, for example, YCC, RGB or related formats, into a format suitable for driving n-primary displays, wherein n is greater than or equal to three, to reproduce a video image, for example, a wide color gamut video image. Further, systems, methods and devices according to embodiments of the invention may use various non-linear algorithms to achieve optimal performance of wide gamut display systems in processing images at video speeds.

An aspect of the invention provides a method of converting color image data into a form usable by a wide gamut color display. The method includes receiving a three-dimensional color space input signal representing color image pixel data, which data may include out-of-range pixel data not reproducible by a three-primary additive display. The method further includes converting the three-dimensional color space input data into a converted input signal, which represents wide gamut color image pixel data suitable for driving the wide gamut color display, wherein the wide gamut data includes data corresponding to at least some of the out-of-range pixel data. In an embodiment of this aspect of the invention, the wide gamut color display is an n-primary display, wherein n>3, and the converted input signal represents n-primary color image data suitable for driving the n-primary color display. In an embodiment of this aspect of the invention, the wide gamut input signal includes more than three, respective channels, each channel representing image data corresponding to one primary color in a set of more than three, respective, primary colors reproducible by the more-than-three-primary color display.

Further, in an embodiment of the invention, converting the three-dimensional input signal includes defining a conversion color space having a plurality of positions, each position corresponding to a distinct linear combination of the more than three primary colors, the linear combination representing a distinct color combination in the three-dimensional-color space, and, for each pixel of the three-dimensional color space input pixel data, constructing a corresponding wide gamut pixel based on the linear combination of primaries corresponding to the position of the pixel in the conversion color space.

Another aspect of the invention provides a method of converting color image data from a three-dimensional color space format to a format usable by an n-primary display, wherein n is greater than or equal to three. The method according to this aspect of the invention includes defining a two-dimensional sub-space having a plurality of two-dimensional positions, each position representing a set of n primary color values and a third, scaleable coordinate value, the set of primary color values and the scaleable coordinate value corresponding to a distinct color combination in the three-dimensional color space, receiving an input signal representing color image data including a plurality of pixels in the three-dimensional color space, decomposing the three-dimensional color space data of each the pixel into a two-dimensional sub-space component, which determines the position of the color of the pixel in the two-dimensional sub-space, and a third, scaling component, and generating an n-primary display input signal representing n-primary input data for each the pixel based on the set of n primary color values and the third scaleable coordinate value at the position of the two-dimensional sub-space component of the pixel in the two-dimensional sub-space, scaled by the third, scaling component of the pixel. According to an embodiment of this aspect of the invention, the two-dimensional sub-space includes a predetermined number of positions spanning a predetermined range of color combinations of the three-dimensional color space. Further, according to this aspect of the invention, the n-primary display input signal may include n, respective channels, each channel representing image pixel data corresponding to one of a set of n primary colors reproducible by the n-primary display. The third, scaleable coordinate value of each position in the two-dimensional sub-space is responsive to the level of saturation of the color corresponding to each the position. Alternatively, the third, scaleable coordinate value of each position in the two-dimensional sub-space is responsive to the level of brightness of each the position.

Further, in accordance with embodiments of the invention, the method may include storing the set of n primary color values and third, Scaleable component of all colors represented by the two-dimensional sub-space in at least one look-up-table (LUT) having a plurality of entries, each entry containing the set of n primary color values and the third, scaleable coordinate value of a corresponding position in the two-dimensional sub-space. The n primary color values of each entry of the at least one LUT may be computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum saturation level for predetermined hue and brightness levels. Alternatively, the n primary color values of each the entry of the at least one LUT may be computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum brightness for predetermined chromaticity coordinates. Alternatively, the n primary color values of each the entry of the at least one LUT may be computed to comply with the condition that a linear combination of the n primaries based on the computed values yields an optimal spectral match for predetermined chromaticity coordinates. In some embodiments of the invention, the at least one LUT includes at least one two-dimensional LUT.

In accordance with some embodiments of the invention, generating an n-primary input signal includes retrieving from the at least one LUT the set of n primary color values and the third, scaleable coordinate value at the position of the two-dimensional sub-space component of the pixel in the two-dimensional sub-space, scaling the retrieved third, scaleable coordinate value based on the third, scaling component of the decomposed input data, to produce a scaled third component, normalizing the retrieved n primary color values based on the scaled third component to produce n normalized primary color values, and generating the n-primary display input signal based on the n normalized primary color values.

A further aspect of the invention provides device for converting color image data to a form usable by a wide gamut color display, the device including means for receiving an input signal, in a three-dimensional color space, representing three-dimensional color image pixel data including out-of-range pixel data not reproducible by a three-primary additive display, means for converting the three-dimensional color space input data into wide color gamut image pixel data corresponding to at least some of the out-of-range pixel data, and means for generating, based on the wide color gamut image pixel data, a wide color gamut input signal suitable for driving the wide gamut color display. In embodiments of this aspect of the invention, the wide gamut color display includes a more-than-three-primary color display and wherein the wide gamut input signal represents more-than-three-primary color image pixel data suitable for driving the more-than-three-primary color display. Additionally, in some embodiments of this aspect of the invention, the wide gamut input signal includes more than three, respective channels, each channel representing image pixel data corresponding to one primary color in a set of more than three, respective, primary colors reproducible by the more-than-three-primary color display. Further, in some embodiments of this aspect of the invention, the means for converting the three-dimensional input signal includes means for defining a conversion color space having a plurality of positions, each position corresponding to a distinct linear combination of the more than three primary colors, the linear combination representing a distinct color combination in the three-dimensional-color space, and means for constructing, for each pixel of the three-dimensional color space input pixel data, a corresponding wide gamut pixel based on the linear combination of primaries corresponding to the position of the pixel in the conversion color space.

An additional aspect of the invention provides a device for converting color image data from a three-dimensional color space format to a format usable by an n-primary display, wherein n is greater than or equal to three, the device including means for defining a two-dimensional sub-space having a plurality of two-dimensional positions, each position representing a set of n primary color values and a third, scaleable coordinate value, the set of primary color values and the scaleable coordinate value corresponding to a distinct color combination in the three-dimensional color space, means for receiving an input signal representing color image data including a plurality of pixels in the three-dimensional color space, means for decomposing the three-dimensional color space data of each the pixel into a two-dimensional sub-space component, which determines the position of the color of the pixel in the two-dimensional sub-space, and a third, scaling component, and means for generating an n-primary display input signal representing n-primary input data for each the pixel based on the set of n primary color values and the third, scaleable coordinate value at the position of the two-dimensional sub-space component of the pixel in the two-dimensional sub-space, scaled by the third, scaling component of the pixel.

In embodiments of this aspect of the invention, the two-dimensional sub-space includes a predetermined number of positions spanning a predetermined range of color combinations of the three-dimensional color space. Additionally or alternatively, the n-primary display input signal may include n, respective channels, each channel representing image pixel data corresponding to one of a set of n primary colors reproducible by the n-primary display. In some embodiment of the invention, the third, scaleable coordinate value-of each position in the two-dimensional sub-space is responsive to the level of saturation of the color corresponding to each the position. In other embodiment of the invention, the third, scaleable coordinate value of each position in the two-dimensional sub-space is responsive to the level of brightness of each the position.

A device in accordance with embodiments of the invention may include at least one look-up-table (LUT) having a plurality of entries, each entry containing the set of n primary color values and the third, scaleable coordinate value of a corresponding position in the two-dimensional sub-space, the at least one LUT storing the set of n primary color values and third, scaleable component of all colors represented by the two-dimensional sub-space. The n primary color values of each entry of the at least one LUT may be computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum saturation level for predetermined hue and brightness levels. Alternatively, the n primary color values of each the entry of the at least one LUT may be computed to comply with the condition that a linear combination of the n primaries based on the computed values yields a maximum brightness for predetermined chromaticity coordinates. Alternatively, the n primary color values of each the entry of the at least one LUT may be computed to comply with the condition that a linear combination of the n primaries based on the computed values yields an optimal spectral match for predetermined chromaticity coordinates. In some embodiments of the invention, the at least one LUT includes at least one two-dimensional LUT.

In some embodiments of the invention, the means for generating an n-primary input signal includes means for retrieving from the at least one LUT the set of n primary color values and the third, scaleable coordinate value at the position of the two-dimensional sub-space component of the pixel in the two-dimensional sub-space, means for scaling the retrieved third, scaleable coordinate value based on the third, scaling component of the decomposed input data, to produce a scaled third component, means for normalizing the retrieved n primary color values based on the scaled third component to produce n normalized primary color values, and means for generating the n-primary display input signal based on the n normalized primary color values.

In some embodiments of the device of the invention, the three-dimensional color space includes a RGB color space. In other embodiments of the invention, the three-dimensional color space includes a YCbCr color space.

Yet another aspect of the invention provides a color display system including a device for converting color image data as described above, and a color display arranged to receive the wide color gamut or n-primary display input signal defined above, and to reproduces a color image based on the wide color gamut or n-primary display input signal. The color display may include a wide color gamut display, or an n-primary color display.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be understood more fully from the following detailed description of embodiments of the invention, taken in conjunction with the accompanying drawings in which:

FIG. 1A is a schematic illustration of a chromaticity diagram, as is known in the art, enclosing a prior art RGB gamut;

FIG. 1B is a schematic illustration of a chromaticity diagram enclosing a wide color gamut in accordance with an exemplary embodiment of the invention;

FIG. 2 is a schematic block diagram of a system in accordance with an exemplary embodiment of the invention;

FIG. 3 is a schematic depiction of an exemplary RGB space contained in a YCbCr space in accordance with an embodiment of the invention;

FIG. 4 is a schematic block diagram depicting the flow of data and processing steps of a system and method in accordance with an exemplary embodiment of the invention;

FIG. 5A is a schematic illustration of a two dimensional sub-space component, mapped from a three-dimensional color space input, in accordance with an embodiment of invention;

FIG. 5B is a block diagram illustrating a data flow scheme used in conjunction with a conversion method and system according to an exemplary embodiment of the invention;

FIG. 6 is a block diagram illustrating a data flow scheme used in conjunction with a conversion method and system according to a further exemplary embodiment of the invention;

FIG. 7 is a schematic block diagram illustrating part of a method in accordance with an exemplary embodiment of the invention, including mapping of a x-y or equivalent chromaticity sub-space;

FIG. 8A is a schematic illustration of data conversion in accordance with a further exemplary embodiment of the invention, using two-dimensional look-up-tables (LUTs); and

FIG. 8B is a schematic diagram illustrating conversion of indices in a chromaticity space in accordance with the embodiment of FIG. 8A.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION

Embodiments of the invention provide systems, methods and devices for encoding wide gamut data in three-primary formats, for example, YCC or RGB related formats, and translating the encoded three-primary values into a format suitable for driving an n-primaries color display, for example, a wide gamut display, wherein n is greater than or equal to three. Systems, methods and devices in accordance with embodiments of the invention may use non-linear algorithms, as described in detail below, to achieve optimal performance in processing images at video speed. Various aspects of the invention are described, with reference to specific embodiments that provide a thorough understanding of the invention; however, it will be apparent to one skilled in the art that the present invention is not limited to the specific embodiments and examples described herein. Further, to the extent that certain details of the systems and methods described herein relate to known aspects of digital image and video processing, such details may have been omitted or simplified for clarity.

According to an embodiment of the invention, the range of colors that can be reproduced by a display system may be expanded using a monitor with more than three primaries. FIG. 1B schematically illustrates a chromaticity diagram, as is known in the art, enclosing a wide color gamut in accordance with an exemplary embodiment of the invention. The six-sided shape in FIG. 1B represents an expanded gamut produced by a six-primaries display in accordance with an exemplary embodiment of the invention.

A monitor with more than three primaries can be constructed to reproduce improved color images. Examples of such monitors are disclosed in U.S. patent application Ser. No. 09/710,895, entitled "Device, System And Method For Electronic True Color Display", filed Nov. 14, 2000, assigned to the assignee of the present application the entire disclosure of which is incorporated herein by reference. Embodiments of monitors based on more than three primaries are also disclosed in International Application PCT/IL01/00527, entitled "Device, System and Method For Electronic True Color Display," filed Jun. 7, 2001, and published Dec. 13, 2001 as WO 01/95544, assigned to the assignee of the present application, the entire disclosure of which is incorporated herein by reference. While the methods and systems disclosed in these patent applications may be used in embodiments of the present invention, the system and method of the present invention may also be embodied in conjunction with other n-primary color display technology, wherein n is greater than or equal to three.

A direct view display system according to an embodiment of the invention includes more than three sub-pixels within each pixel, for example, more than three different color LEDs (in a LED display), more than three different color phosphors (in a CRT display), or more than three different color filters and respective LCD cells (in an LCD display). The input data, which is received in, for example, RGB or YCbCr format or other related formats, in either digital or analog form, is converted to values that represent the intensity of each of the more-than-three primaries for each of the pixels and signals corresponding to these new values are generated to drive the different sub-pixel elements of the display, e.g., by modulating the current applied to LED elements (in LED systems), by modulating the voltage applied to LC elements (in LCD systems), or by modulating a scanning electron beam (in CRT systems). Embodiments of the system and method of the present invention may receive and manipulate data in formats other than RGB or YCbCr formats.

Simultaneous projection display systems in accordance with the invention may be based on spatially modulating colored light of more than three primaries and projecting it onto the display screen. The spatial modulation can be performed, for example, by a liquid crystal spatial modulator used in conjunction with a source of polarized light. Alternatively, the spatial modulation can be performed by a digital micro-mirror device (DMD), such as that available from Texas Instruments (USA), which allows the use of non-polarized light. Other suitable types of devices for performing spatial modulation may also be used in conjunction with the invention.

Spatial modulation in accordance with embodiments of the invention may be based on either analog (gray-level) or binary gradations, depending on the type of modulator device being used. For example, Nematic liquid crystal modulators, such as those available from CRL Opto (United Kingdom), or Kopin Inc. (USA), allow for analog gray levels, while Ferroelectric liquid crystal modulators, such as those available from Micropix Technologies (United Kingdom) or LightCaster.TM. from Displaytech (USA), as well as DMD devices, are binary devices that do not allow gray-level graduation. If a binary modulator device is used for spatial modulation, gray levels may be achieved by controlling the duration of the illumination and/or the intensity of the light incident on the spatial modulator.

In a simultaneous projection devices in accordance with embodiments of the invention, the light received from a white light source is divided into more than three primary color components, using filters or dichroic mirrors or other optical means, and each color channel is spatially modulated according to the image data by a spatial light modulator. The different channels are subsequently combined and projected simultaneously on the viewing screen in registry. The intensity of light of a given primary color illuminating each pixel is modulated, for example, by controlling the voltage applied to a corresponding LC cell of the spatial light modulator of the given primary color.

In sequential projection display systems according to an embodiment of the invention, a spatial light modulator as described above is illuminated sequentially by light of more than three different primary colors, whereby the resultant primary color images are projected sequentially onto the viewing screen. The primary color images are projected sequentially at a sufficiently high frequency so that a human visual system can temporally integrate the different color images into a full color image. The colored light for the different primaries can be created by illuminating the spatial light modulator with white light, sequentially filtered through different color filters placed on a fast rotating wheel, or by a set of light emitting diodes (LEDs) or lasers devices of different colors that sequentially illuminate the spatial light modulator. The intensity of illumination for each primary color may be modulated, for example, by controlling the relative duration of the illumination, as in binary type spatial light modulators, or by modifying the intensity of the colored light as in gray-level type spatial light modulators.

In an embodiment of the system and method of the invention, the input data received in YCbCr or RGB or other formats, either digital or analog, is converted to values corresponding to the brightness of each of the more-than-three primaries for each of the pixels. These values may be arranged in a number of channels, each channel corresponding to one of the primary colors, and a signal corresponding to a full frame image is loaded onto the display device. In simultaneous projection type devices, full frame data for each primary may be loaded to a corresponding spatial light modulator. In sequential projection type display systems, the data for different primary color images may be loaded sequentially to the spatial light modulator, based on a timing signal synchronized with the rate at which sequential primary color illuminations are switched.

As described above, standard video data is typically transferred in YCbCr or RGB related formats, and is either digitally or analogically encoded. Colors are thus represented in a three-dimensional space suitable for presentation on a three-primaries monitor or display. The input data in YCbCr format is translated, using a conversion matrix, to corresponding RGB data. If RGB data is used as input, there is no need for matrix conversion and the input RGB data can be passed directly to the monitor. Signals responsive to the RGB data are used to drive the three-primaries display. The RGB data includes R, G and B signal components (channels): the R signal component represents the red primary; the G signal component represents the green primary; and the B signal component represents the blue primary. Three multipliers and/or one-dimensional look-up tables, one for each of the RGB channels, are used to adjust color temperature and other responses of the system. Certain processes can also be applied to the original YCbCr data, controlling the appearance using the YCbCr coordinates. For example, the Y channel might be manipulated in order to control the brightness and the contrast of the image. Alternatively, the Cb and Cr data can be manipulated to control the color saturation of the final image. A user of the display may perform such manipulations and adjustments, e.g., by adjusting the "brightness", "contrast" and "color" of a display monitor.

In multi-primary displays with more than three primaries, according to an embodiment of the invention, the RGB data flow may not be straightforward because the R, G and B signals may not relate directly to the n primaries. Unless the data is originally provided in terms of P.sub.1 . . . P.sub.n, i.e., a distinct channel for each primary, the standard YCC or RGB data formats must be converted to a format suitable for n-primaries (n>3) display devices. If a video image is to be reproduced, the process of converting the YCC or RGB input data into corresponding n-primaries data should be performed sufficiently fast to run at video speeds. The conversion process should also maintain consistent color reproduction properties, in the sense that an input signal from a source designed for standard RGB monitors would yield a similar appearance regardless of the set of primaries used.

Embodiments of the system and method of the present invention include several algorithms for transforming three-dimensional RGB data to a format suitable for n-primaries (n>3) displays. Most of the algorithms are based on analyzing the RGB data to find one or more triads of primaries that can represent the data The values for those primary triads are calculated using matrix multiplication, analogous to the matrix multiplication used for standard RGB displays. In some versions of this method, "artificial primaries" with a pre-defined composition of display primaries are used to create the triads. Some of the methods suggested are colorimetric in the sense that the input data is converted to XYZ or other absolute color spaces before the conversion to display primaries is performed. Other methods merely transform the RGB data to corresponding values of the primaries, without reference to an absolute colorimetric space. In all the methods discussed above, data transformation is linear, i.e., the RGB values are transformed linearly to the corresponding primary values.

Still, the methods described above may not cover the entire gamut of the n-primary displays for which they are used. For n>3 displays, using a combination of all n primaries should yield better results, in measurable terms, than any combination of three out of the n primaries. For example, by using all n primaries in certain regions of the display gamut, it is possible to reproduce a higher brightness than with any combination of only three primaries. However, since the methods described above are typically based on defining a triad of primaries (real or artificial), those methods may not provide optimal results.

According to an exemplary embodiment of the system and method of the present invention, illustrated schematically in FIG. 2, input data from a video source 200, which may contain data outside the gamut of standard RGB displays, is converted by a converter 204 into a format suitable for use in an n-primary display 206, for example, a wide color gamut display having more than three primary colors. In an embodiment of the invention, the input data may be in YCbCr format and may be processed in the YCbCr format (or equivalent/related formats) until being received by n-primaries converter 204. In alternate embodiments, data in other formats may be accepted and manipulated by the system and method of the invention. This is in contrast to prior systems and methods wherein color data processing algorithms are applied exclusively to RGB data. In an embodiment of the invention, converter 204 receives input data capable of representing wide gamut data, avoiding clipping of data outside the standard RGB color gamut, and converts the da