US4811084A - Video color detector and chroma key device and method - Google Patents

Video color detector and chroma key device and method Download PDF

Info

Publication number
US4811084A
US4811084A US06/939,600 US93960086A US4811084A US 4811084 A US4811084 A US 4811084A US 93960086 A US93960086 A US 93960086A US 4811084 A US4811084 A US 4811084A
Authority
US
United States
Prior art keywords
signals
color
video
detecting
passband
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
US06/939,600
Inventor
Armand Belmares-Sarabia
Stanley J. Chayka
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CINTEL Inc
Original Assignee
Corporate Communications Consultants Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US06/598,468 external-priority patent/US4679067A/en
Application filed by Corporate Communications Consultants Inc filed Critical Corporate Communications Consultants Inc
Priority to US06/939,600 priority Critical patent/US4811084A/en
Assigned to CORPORATE COMMUNICATIONS CONSULTANTS, INC. reassignment CORPORATE COMMUNICATIONS CONSULTANTS, INC. ASSIGNMENT OF ASSIGNORS INTEREST. Assignors: BELMARES-SARABIA, ARMAND, CHAYKA, STANLEY J.
Priority to CA000553276A priority patent/CA1320760C/en
Priority to PCT/US1987/003186 priority patent/WO1988004510A1/en
Priority to GB08818818A priority patent/GB2207025A/en
Priority to AU10809/88A priority patent/AU1080988A/en
Publication of US4811084A publication Critical patent/US4811084A/en
Application granted granted Critical
Assigned to INPROP, INC. reassignment INPROP, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CORPORATE COMMUNICATIONS CONSULTANTS, INC.
Assigned to RANK CINTEL INC., A CORP. OF DE reassignment RANK CINTEL INC., A CORP. OF DE ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INPROP, INC., A CORP. OF NJ
Assigned to CINTEL INC. reassignment CINTEL INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: RANK CINTEL INC.
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46Colour picture communication systems
    • H04N1/56Processing of colour picture signals
    • H04N1/60Colour correction or control
    • H04N1/6011Colour correction or control with simulation on a subsidiary picture reproducer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/142Detection of scene cut or scene change
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/179Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scene or a shot
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/87Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/147Scene change detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/73Colour balance circuits, e.g. white balance circuits or colour temperature control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/74Circuits for processing colour signals for obtaining special effects
    • H04N9/75Chroma key

Definitions

  • This invention relates to devices and methods for detecting the colors represented by video signals, and to devices and methods for selectively connecting an output circuit to a selected one of two or more video signal sources in response to the detection of signals representing a pre-determined color.
  • the latter devices and methods are commonly referred to as "chroma key” devices and methods.
  • Video color detectors have several different uses. The use of color detectors in color correction is described in the above-identified co-pending patent applications. The use of such detectors in chroma keying is described herein.
  • Chroma key devices and methods typically are used to insert images from one video source into the picture formed by signals from another source.
  • Either of the sources can be any of a variety of different types, e.g., a television camera viewing a "live" scene; a telecine device producing video signals from motion picture film; a video tape player reproducing video signals recorded on magnetic tape or other media; etc.
  • FIG. 8 of the accompanying drawings shows a video monitor or receiver 200 which displays a video picture 202.
  • a video camera (not shown) views a weather forecaster 204 standing in front of a large vertical blue surface called a "matte" which is not visible in FIG. 8. Instead, wherever the blue matte appears behind the forecaster 204, it has been replaced by the image of a weather map 206 showing the U.S. and parts of Canada and Mexico.
  • the forecaster sees the weather map image on a studio monitor (also not shown in FIG. 8) and points to areas of the matte to indicate areas on the map.
  • the weather map can have superimposed images, such as temperature data, etc.
  • Video signals forming the weather map are generated by a video source usually referred to as a "background source”, and the image of the weather forecaster is generated by the studio camera, which usually is called a "foreground source”.
  • a video source usually referred to as a "background source”
  • the image of the weather forecaster is generated by the studio camera, which usually is called a “foreground source”.
  • the insertion of a weather map in place of the blue matte is made by a chroma key device which detects the foreground signals from the video camera.
  • the chroma key device switches the broadcast signal from the foreground source to the background source.
  • the signals broadcast are switched to the foreground source, and then back again to the background source when the matte is detected again. This process is repeated for each horizontal line in the picture.
  • the background signal replaces the blue matte everywhere except where the forecaster is located.
  • a major problem with prior chroma key devices is that they often provide false key signals by responding erroneously to colors other than the matte color. For example, the device often produces key signals upon the detection of not only the blue matte signals, but also the blue eyes or clothing of the announcer. This is very undesirable.
  • the chroma key device will not respond to the matte color. Then the lighting in the television studio or the matte must be changed so that the apparent matte color is just right for the chroma key device. This can be very time-consuming and expensive.
  • FIG. 7 of the accompanying drawings is a schematic vector representation of the hue and saturation of a given color video signal, as it is shown on the familiar "vectorscope" used in video production equipment.
  • the angle “ ⁇ " of the vector represents the hue or color of the signals
  • the length "S” of the vector represents the saturation or intensity of the signals.
  • the keyer using this control actually responds to or "keys" on hues or colors far different from the desired matte color--at least when the colors are at anything less than high saturation levels.
  • the device does not accurately discriminate among similar colors. This tends to cause false keying in response to other hues appearing elsewhere than in the matte area of the television picture.
  • prior chroma key devices also places undesirable restraint on the location of the weather reporter or announcer in relation to the matte.
  • the announcer should be located at a relatively great distance from the matte so that blue matte color will not be reflected onto the announcer and cause false keying.
  • a video color detection device and method which are more accurate and flexible in use than in the past. It is a further object to provide a chroma key device and method which alleviate or solve the foregoing problems; a chroma key device and method in which the color to which the device responds can be controlled so as to prevent false switching or insufficient response to a desired color, and in which the color detection is more accurate and flexible than in the past.
  • An additional objective of the invention is to provide a color detection and chroma key device and method in which the degree of discrimination among hues can be adjusted so as to best adapt the operation of the device to the circumstances at hand.
  • Another object of the invention is to provide an improved hue detection device and method which is compatible with existing keying or switching devices having means for handling other chroma keying problems such as those caused by shadows, and the problem of providing either "soft" or “hard” edges for the key areas by providing either gradual or abrupt transition in switching between video sources, etc.
  • a chroma key device with excellent hue discrimination and other known chroma key features.
  • the foregoing objects ar satisfied by the provision of a color detection and chroma key devices and methods which are capable of discriminating among similar hues by limiting the band width of the hues and/or hue and saturation combinations which can be recognized by the device.
  • this feature is provided in combination with a device which is capable of varying the center hue of the pass band in substantially infinitely small steps throughout the visible light spectrum.
  • the vector representing the center of the pass band can be rotated through an angle of substantially 360° in the vector plane so that substantially any hue can be used for the matte.
  • the device will not key falsely upon detecting any hue except those the same as or very close to the center hue of the pass band.
  • the band width of the color detector of the device can be varied by the operator.
  • the device can be made to discriminate against all but a narrow range of hues, as described above, or it can be made to respond to a relatively wide range of hues, if this is best for the particular scene involved.
  • the invention not only makes it possible to use almost any hue as a matte color, and to minimize false keying by selecting a narrow pass band, but it also eliminates or reduces the need for the use of very intense or saturated matte colors.
  • an optional feature of the device makes it possible to limit the video signals to be detected to those having saturation values below a predetermined level. By this means, if two areas having the same hue but different saturation levels are present in the same picture, the keyer will discriminate between the two areas and make the required insertion in the low-saturation area. For example, if a motion picture film frame has both a light blue sky in one area and an intense or saturated blue automobile of the same hue in a different area of the frame, the device will make the insertion in the blue sky area only.
  • another optional feature can be used to limit the signals detected to those having saturation values above a pre-determined level so that, in the foregoing example, the insertion would be made only in the area occupied by the intense blue automobile.
  • a plurality of detectors can be used to provide simultaneously a plurality of inserts into a given scene or frame of a video or motion picture. Since each detector can be adjusted to detect signals having a very limited range of hues and/or saturation values, the tendency towards false keying which would be created by the use of two or more prior chroma key devices in a single frame would be substantially alleviated.
  • the matte color detector uses the same circuitry as that used in the color connector described in the aforementioned U.S. patent application Ser. No. 851,164, and can be used either as a component of a chroma key device, or in discriminating among different objects or areas of a frame of a motion picture or video tape so that only the color of the desired object or area will be corrected.
  • the detector circuitry can be used for multiple purposes in film-to-tape, tape-to-tape, or tape-to-film transfers.
  • the chroma keyer is used with film or tape, an additional advantage is realized in that the matte area itself less frequently requires color correction to enable it to actuate the keyer. This saves color correction labor and time.
  • a device and method in which controls are provided for defining a limited area or "window" in a video picture and limiting the colors sampled by a chroma key device to those within the limited area.
  • This has the effect of limiting the appearance of the background picture to only a portion of the matte area.
  • the limited area is variable in both position and size, and can be programmed to move gradually from one frame to the next in order to follow movement of an object in tape-to-tape or film-to-tape transfers. This feature is particularly advantageous when combined with the improved color detector of the invention.
  • the chroma keyer of the invention also can be incorporated advantageously into production studio switchers, or video tape or film editing equipment, or it can be supplied as a stand-alone device cabled to cameras or other studio equipment.
  • FIG. 1 is a schematic circuit diagram of the preferred embodiment of the invention
  • FIG. 2 is a schematic circuit diagram of an alternative embodiment of the invention.
  • FIG. 3 is a schematic circuit diagram of a component of the device shown in FIG. 1;
  • FIG. 4A and 4B are more detailed schematic circuit diagram of the device shown in FIG. 1;
  • FIG. 5 is a schematic circuit diagram of the keyer which is part of the device shown in FIG. 1;
  • FIGS. 6A-6D are waveform diagrams illustrating the principles of operation of the circuit of FIG. 4;
  • FIG. 7 is a vector diagram representing some of the variables in the operation of the device shown in FIG. 1;
  • FIG. 8 is a drawing of a typical video picture of the type in which the invention is used.
  • FIG. 9 is a diagram illustrating the operational characteristics of a typical prior art device.
  • FIGS. 10 and 11 are schematic circuit diagrams of alternative embodiments of the invention.
  • FIG. 1 shows a chroma key system 10 constructed according to the invention.
  • the system 10 includes a foreground video signal source 12, a color detector circuit 14, a keyer device 16, and a background video source 18.
  • the color detector 14 is shown in greater detail in FIGS. 3, 4 and 6.
  • the keyer 16 is shown in greater detail in FIG. 5.
  • the output signals of the foreground video signal source 12 are in "component” form; that is, the signals are the red, green and blue components “R", “G", and “B” making up the video signal.
  • the red green and blue signals are delivered to the detector 14 and the keyer 16 over lines 24.
  • the background video signal source 18 delivers the red, green and blue signals to the keyer 16.
  • the keyer is of the type adapted to operate on component video signals.
  • color detector 14 Upon detection of the key color signal from the foreground video source, color detector 14 generates a key signal on an output line 20 which is delivered to the keyer 16. This causes the keyer 16 to switch from the foreground video signal source 12 to the background video source 18.
  • the red, green and blue video output signals from the keyer 16 enter an encoder 22 which converts them to composite video form.
  • the composite video signals are caused to create a video picture on a monitor 28. If the signal from the encoder 22 is broadcast, the unit 28 is a receiver in a television viewer's home.
  • FIG. 2 An alternate embodiment of the invention is shown in FIG. 2.
  • the chroma key system 11 has a keyer 17 which is of the type adapted to operate with composite video signals. Therefore, an encoder 23 is connected between the output of the source 12 and the keyer 17 to convert the component signals to composite form. Also, a delay circuit 26 is connected in the line 20 delivering the key signal from the detector 14 to the keyer 17 in order to compensate for the time delay created by the encoder 23. Also, the background video source 21 is of the type delivering composite video signals. The output of the keyer 17 is a composite video signal which is delivered to the video output monitor or receiver 28, as described above. The color detector circuit is described in greater detail in FIGS. 3 and 4.
  • FIG. 4 is a schematic diagram of the color detector circuit 14 used in the chroma key devices of FIGS. 1 and 2.
  • Red (“R"), green (“G”), and blue (“B”) signals from the foreground video signal source enter a standard luminance matrix 38 which produces a luminance signal ("Y") at its output.
  • a coefficient processor circuit 39 (in the lower part of FIG. 4) generates four d.c. signals proportional to sin ⁇ , cos ⁇ , D cos ⁇ and D sin ⁇ , respectively. These signals are supplied as inputs to four-quadrant multiplier circuits 40, 42, 46, and 48.
  • the red signal R and the luminance signal Y are delivered, respectively, to the (+) and (-) input terminals of the first four-quadrant multiplier circuit 40, thus forming (R-Y) as one input signal to the multiplier.
  • FIG. 3 is an enlarged and more detailed view of the multiplier circuit 40.
  • the circuit 40 is an integrated circuit including a pair of differential amplifiers 41 and 43 which deliver their outputs to an analog multiplier circuit 45, which delivers to an amplifier 47 a signal proportional to the product of its two input signals X and Z.
  • Amplifier 47 delivers an amplified signal proportional to the product (X)(Z) on one output line 51, and an inverted signal (X)(Z) on line 49.
  • the input signal (R-Y) is formed by the differential amplifier 41 which has (R) applied to its (+) input terminal and (Y) to its (-) terminal.
  • Each multiplier circuit shown in the upper portion of FIG. 4; that is, each of the multipliers 42, 44, 46, 48 and 50, has the same structure as the multiplier 40 shown in FIG. 3.
  • a (B-Y) signal is formed as one input to the four-quadrant multiplier circuit 42.
  • the (R-Y) and (B-Y) signals are defined to be in quadrature.
  • the vector "S" of FIG. 7 is the resultant of the (R-Y) and (B-Y) vectors.
  • the angle ⁇ formed by the vector "S" is the measure of the hue of the video signals.
  • the angle ⁇ corresponding to the hue to be detected by the detector 14 can be selected at any angle from 0° to 360°. This is accomplished, in effect, by the use of a variable, selectable passband filter circuit which filters out all signals other than those within a certain pass-band around the selected hue corresponding to the angle ⁇ .
  • the signal (sin ⁇ ) is supplied as a second input to the multiplier 40, and the signal (cos ⁇ ) as a second input to the multiplier 42.
  • the output of multiplier 40 is proportional to (R-Y) sin ⁇ , and that from multiplier 42 is proportional to (B-Y) cos ⁇ .
  • the output from multiplier 40 is delivered to the (+) input terminal of another multiplier 44 so as to form the input signal (R-Y) sin ⁇ -(B-Y) cos ⁇ .
  • a level discriminator 52 produces a "key" output signal only when the output of the multiplier 44 is either above a first pre-set level or below a second pre-set level.
  • the curve 212 expresses the relationship between hue and the output of the multiplier circuit 44 due solely to the input signals described so far; that is, without consideration of the signals applied to the lower pair of terminals of the multiplier circuit 44.
  • the curve 212 is relatively broad and crosses the zero-axis at two points, one of which leads ⁇ by 90°, and one of which lags ⁇ by 90°; that is, the curve 212 covers an area spanning 180° of the color spectrum.
  • a second curve is shown at 216. This curve results from a shift of the angle ⁇ to a new value ⁇ '.
  • a level detector circuit is used to discriminate against all signals lower in magnitude than a pre-set level 214.
  • the range of hues detected by the circuit is narrowed to the area between points A and B where the level detector level 214 crosses the curve 212, without affecting the passband of the detector circuit itself.
  • the shape of the curve 212 remains very broad, usually the range of hues between points A and B also is relatively broad.
  • the shape of the curve 212 makes the detector circuit largely dependent on saturation levels rather than hue.
  • the passband of the hue selector circuit itself is narrowed by the use of three four-quadrant multiplier circuit devices 46, 48 and 50, together with the multiplier 44.
  • the passband can be made as narrow as 2° and as broad as 90° on either side of the center, or principal color, substantially independently of the saturation of the input signals.
  • Multiplier 46 develops a signal of (R-Y) on its upper terminals.
  • a signal (D cos ⁇ ) is developed on its lower terminals from a delta control signal source 39 which multiplies the cos ⁇ signal by a "delta" factor "D".
  • multipliers 46 and 48 are subtracted from one another by the input differential amplifiers in a multiplier circuit 50 which is used as a squarer.
  • the quantity (R-Y) D cos ⁇ -(B-Y) D sin ⁇ is formed at the output of each input differential amplifier.
  • Those outputs are multiplied by one another to square that quantity and produce a signal N:
  • This signal is sent to the lower negative input terminal of multiplier 44 where it is subtracted from a reference signal "REF.”
  • FIGS. 6A-6D are diagrams illustrating the operation of the circuitry.
  • the angle ⁇ or hue is plotted horizontally against the d.c. output voltage in response to the successive receipt of numerous signals of equal magnitude but whose hues vary throughout the visible spectrum, when a specific center hue ⁇ has been selected for the pass-band of the circuit.
  • FIG. 6B shows the output of the squarer 50. It is 90° out of phase with the wave shown in FIG. 6A.
  • the purpose of squaring the wave input to the squarer 50 is to make all peaks of the wave positive.
  • FIG. 6B basically is made up of positive sine loops.
  • FIG. 6C shows the result of subtracting the signal N shown in FIG. 6B from the reference signal.
  • the wave form in FIG. 6C has positive-going spikes 208 formed by the cusps between the inverted sine loops formed by the subtraction process.
  • the wave form resulting from multiplying signal M (FIG. 6A) by the signal shown in FIG. 6C is shown in solid lines in FIG. 6D.
  • the negative-going portion of the wave form between the first and third half-cycles is eliminated by a negative signal clipper in the level discriminator circuit 52, so that only positive peaks remain.
  • the wave forms in FIG. 6D also express the transmission characteristics for input signals of variable hue. That is, signals having a phase angle equal to ⁇ , the selected phase angle defining the desired hue, are transmitted with maximum values; other signals are attenuated to a degree depending upon the shape of the transmission curve, which depends on the delta "D" factor, and the number of degrees that the signal is distant from ⁇ .
  • FIGS. 6A, 6B and 6D show the waveforms resulting from a change of the selected hue from ⁇ to ⁇ '.
  • the waveform for ⁇ ' has been omitted from FIG. 6C to avoid cluttering the drawing, and the waveform for ⁇ ' in FIG. 6D has been separated from the waveform for ⁇ 0 more than it actually would be, for the sake of clarity in the drawings.
  • the change of the selected hue from ⁇ to ⁇ ' merely shifts the waveforms to the right in FIGS. 6A-6D. This changes the selected hue from near red to a hue around magenta. If the knob 59 is turned in the opposite direction by the same amount as it was turned to created the change from ⁇ to ⁇ ', shifting the vector "S" counterclockwise from the reference burst axis, then the waveforms shift to the left by a corresponding amount to select a color between green and cyan. The angle ⁇ can be changed in very small steps or increments, thus making the hue selection essentially infinitely variable.
  • the amplitude of the signal transmitted to the level discrimination circuit 52 is proportional to the saturation of the color being detected.
  • the level discriminator circuit 52 is capable of rejecting all signals whose saturation falls either above or below a preset level such as levels 211 and 213 shown in the right-hand portion of FIG. 6D.
  • the details of the circuit 52 are shown in the above-identified patent application Ser. No. 851,164. However, the discrimination levels are adjustable at will.
  • the signals are delivered over one of two output leads 56 and 58, depending on whether a low or high saturation signal has been detected.
  • the device 14 By setting the discriminator to pass only those signals whose saturation is below a certain level, the device 14 detects and differentiates low-saturation signals from high-saturation signals of the same hue.
  • low saturation colors can be used as matte colors without any significant degradation of selectivity in color detection. If preferred for a particular job, high-saturation colors also can be used as matte colors, and the saturation selection process avoids the possibility of developing a key signal in response to the detection of a signal of the same hue but lower saturation.
  • the chroma keyer using the color detector circuit 14 can be adjusted to select virtually any hue, any one of a number of different saturation levels, and a passband width so as to adjust the keyer to compensate for varying matte colors, lighting, etc., and to eliminate or alleviate many of the problems mentioned above with prior chroma key devices.
  • the signals output on lines 56 and 58 pass through a matte control circuit 54.
  • the output signal from that circuit is delivered on line 20 to the keyer, as it is shown in FIGS. 1 and 2.
  • the user of the chroma key device of the invention can select essentially any hue in the visible light spectrum to detect by operation of a wavelength or variable vector position control unit 59 (see lower left-hand portion of FIG. 4). Similarly, the delta or "D" factor determining the passband of the circuit is controlled by a control unit 57.
  • Units 57 and 59 can be simple potentiometers delivering a variable D.C. output signal to the coefficient processor circuit 39, or they can be digital shaft position encoders with digital-to-analog converters for delivering the same kind of signal.
  • the coefficient processor circuit 39 generates the sin 0, cos ⁇ , D cos ⁇ , and D sin ⁇ signals which are supplied to multipliers 40, 42, 46, and 48 respectively.
  • the coefficient processor circuit 39 includes a square wave generator 60, which produces a 2-MHz square wave signal.
  • the 2-MHz signal from the square wave generator 60 is sent to a divide-by-four circuit 62.
  • the output of the divide-by-four circuit 62 is sent to another divide-by-four circuit 64 and to a fundamental frequency filter 70.
  • the output signal from the divide-by-four circuit 64 is delivered to a one-shot circuit 66, which triggers a ramp generator 68.
  • the output signal from the fundamental frequency filter 70 is a 500-KHz sine wave, while the output signal from the ramp generator 68 is a ramp which extends for four cycles of the 500-KHz sine wave.
  • variable vector position control signal is compared to two different reference signals by one of two comparator circuits 72 and 74.
  • the "plus" inputs of the comparators 72 and 74 are supplied by the summation circuits 76 and 78, respectively, and the wavelength or variable vector position control signal is applied to the "minus" inputs of the comparators.
  • the summation circuit 76 adds the ramp signal to a reference signal
  • the summation circuit 78 adds the ramp signal to a different reference signal.
  • Each comparator detects equality between its input signals when the sum of the ramp signal plus the reference signal equals the wavelength control signal.
  • the two different reference signals are selected to produce a difference of time equal to 90 degrees with respect to the 500-KHz sine wave. Accordingly, the output signals from the comparators 72 and 74 change from positive to negative at points 90 degrees apart along the sine wave produced by the fundamental frequency filter 70.
  • the output signals from the comparators 72 and 74 trigger one-shot circuits 80 and 82, respectively.
  • the one-shot circuits 80 and 82 trigger sample-and-hold circuits 84 and 86, respectively.
  • the sample-and-hold circuits 84 and 86 sample the 500-KHz sine wave from the fundamental frequency filter 70. Because the reference signals at the summation circuits 76 and 78 are set to correspond to a 90 degree phase difference, the sample-and-hold circuits 84 and 86 sample the 500-KHz sine wave at points which are 90 degrees apart. As a result, the sample-and-hold circuits 84 and 86 produce d.c. output signals which correspond to a phase difference of 90 degrees, and these signals are referred to as sin ⁇ and cos ⁇ , respectively.
  • variable vector position control signal determines when the output of the comparators 72 and 74 change from positive to negative. Consequently, the variable position control signal determines the sin ⁇ and cos ⁇ signals, and thereby determines ⁇ , the phase angle of the color in the range of colors selected by the wavelength control 59.
  • Two additional sample-and-hold circuits 88 and 90 are provided. They operate similarly to the sample-and-hold circuits 84 and 86 in order to determine the d.c. signals D cos ⁇ and D sin ⁇ . However, the sample-and-hold circuits 88 and 90 do not directly sample the 500-KHz sine wave from the output of the fundamental frequency filter 70. Rather, the sample-and-hold circuits 88 and 90 sample the output signal from a multiplier 92. One input of the multiplier 92 is the 500-KHz sine wave from the fundamental frequency filter 70, while the other input of the multiplier 92 is the delta or passband control signal from the delta control 57. Accordingly, the output signal from the multiplier 92 is a 500-KHz sine wave which has its amplitude modified by the delta control signal.
  • the one-shot circuits 80 and 82 trigger the sample-and-hold circuits 84 and 86
  • the one-shot circuits 80 and 82 simultaneously trigger the sample-and-hold circuits 88 and 90.
  • the sample-and-hold circuits 88 and 90 sample a 500-KHz sine wave whose amplitude has been modified by the delta control signal to produce the D cos ⁇ and D sin ⁇ signals, respectively.
  • the delta control signal therefore, determines the value D, which sets the passband width or the range of detectable colors around the center color at ⁇ .
  • the sin ⁇ signal from the sample-and-hold circuit 84, the cos ⁇ signal from the sample-and-hold circuit 86, and the D cos ⁇ signal from the sample-and-hold circuit 88, and the D sin ⁇ signal from the sample-and-hold circuit 90 are delivered to multipliers 40, 42, 46 and 48, respectively.
  • the matte control circuit 54 is a circuit for forming in a picture a limited area or "window" within which or outside of which the colors can be detected by the color detector circuit 14.
  • the window is movable and can be changed in size. This can be useful in eliminating a particularly troublesome area of foreground color from detection so as to prevent false keying. Also, the variable window can be used to limit the area of the inserted background signal.
  • circuitry of the device 54 is described in detail in U.S. Pat. No. 4,679.067, issued on July 7, 1987 , and that description is incorporated herein by reference.
  • the window can be programmed to move with objects changing position from one scene to the next, so as to produce a "traveling" window.
  • the techniques for doing this are described in greater detail in our co-pending U.S. patent application Ser. No. 851,164 and will not be repeated herein.
  • the keying device 16 or 17 shown in FIGS. 1 or 2 does not form a part of this invention. Any device capable of rapidly switching back and forth between the foreground and background sources in response to key signals from the color detector circuit 14 can be used as a keyer, as long as it is capable of operating with, or can be modified to operate with, either composite or component video signals, as required.
  • a very simple prior art keyer 17 which is suitable for use with composite video is the Grass Valley model 930 video insert keyer, whose schematic circuit diagram is shown in FIG. 5.
  • the keyer 17 of FIG. 5 has four input leads 19, 21, 25 and 100.
  • line 21 receives the key signal;
  • line 100 receives the video synch signal.
  • Emitter-follower circuits 102, 104, 106 and 108 couple the signals from the four inputs to an FET switch 11 through D.C. restorer circuits 110, 112 and 114.
  • the emitter-follower circuits are for impedance matching purposes, and the D.C. restorer circuits clamp the signals to a D.C. potential and, in essence, set a zero level for black signals.
  • the FET switch 118 is a very fast switch which rapidly switches between one condition in which the foreground source is connected to deliver output signals over the output leads 128, to the other in which the background source is so connected.
  • the operation of the FET switch 118 is controlled by the key signal, which is delivered to the switch 118 through an optional level detector circuit 120 whose detection level is controlled by a potentiometer 122.
  • FIG. 10 shows a chroma key system for providing multiple keys in a single picture frame.
  • three color detector circuits K 1 , K 2 and K 3 are used to detect three different matte colors K 1 , K 2 and K 3 appearing on the monitor picture 132.
  • These three matte colors are used to insert one of three different background signals from one of three sources 134, 136 and 138 in each area K 1 , K 2 and K 3 .
  • the keyer 16 is specially adapted to switch between the foreground and any of the three background sources in response to key signals from the color detector circuits K 1 , K 2 and K 3 .
  • each of the three key colors can be similar to the others, so that standard detectors can be used to detect several similar matte colors in a single frame to provide multiple keys.
  • a computer it is believed to be possible to program a computer to switch automatically between two or more different color detector circuit settings for one frame in a system using only one color detector, thus avoiding the use of two or more color detector circuits.
  • the different settings could be stored in a first run through a recorded image source such as motion picture film or videotape, with the different settings being read out and applied to the color detector during a second run for recording a videotape or other record.
  • the computer advantageously can be one used in a color correction system, as it will be described below.
  • the matte color appears in the background, and a chroma key device can be used to detect the color and replace it with background source signals in making the final videotape for broadcast.
  • the matte color itself in the film or tape sometimes had to be corrected before the chroma key device would work properly. It is believed that the chroma key device of the invention will reduce or eliminate the need for such color correction because it can be adjusted and fine tuned to key in the color despite its deviations from the desired hue and saturation levels.
  • FIG. 11 of the drawings shows a color correction system 150 including a foreground source 152 such as a telecine, and two background sources 154 and 156.
  • the output of a selected one of the sources 152 (a telecine), 154 and 156 is delivered through the keyer 16 to the color correction control unit 158, which includes all the controls and circuits necessary for color correction.
  • the resulting picture is displayed on the monitor 28.
  • the CPU and RAM memory of the color correction computer of the system are shown at 166 and 168, respectively. As it is well known, the CPU and memory cooperate to store scene location information and color correction values for each scene of the film being run on the telecine.
  • the output of the color detector circuit 14 which forms a part of the control unit 158 is switched to a terminal 161 which allows it to perform its normal function--to select specific colors to correct. Then, when operation as a chroma key device is desired, the switch 160 is operated to connect the output of circuit 14 to the line 20 to deliver key signals to the keyer 16.
  • the same color detector circuit 14 is used for two functions. This reduces the cost and size of the color correction system 150.
  • a separate color detector circuit 14 can be provided solely for use in the chroma key device.
  • the wavelength control, delta control, and saturation level control knobs are operated to adjust those parameters for the scene. Then, when the adjustments are complete, signals corresponding to the adjustments are stored in the memory 168 of the computer, in association with the scene location data. As the settings of the wavelength, etc. knobs are changed for different scenes, the new values are also stored. If color corrections are made, they also are stored in the same way.
  • Both the chroma key and color correction values stored for a prior scene or frame can be recalled from the RAM memory 168, applied to and used for the current scene or frame, either with or without modifications. Recall can be done by use of a keypad to call up the prior scene or frame number, or by the use of other techniques discussed in the co-pending application Ser. No. 851,164.
  • the film is rewound, and a switch 162 enabling a videotape recorder 164 is closed, the telecine is re-started, and the film is transferred to videotape.
  • the settings for the controls of the chroma key device, as well as the color correction values are read out of memory.
  • the stored chroma key settings are used to set the wavelength and delta controls to the desired value to insert signals from one or more of the background sources 154, 156 in place of the matte color signals.
  • the coefficient processor circuit 39 has analog signal processing circuits.
  • suitably programmed general purpose computer or microprocessor may be employed in lieu of the analog signal processing circuits.
  • digital circuits may be used for other components in the variable vector control circuits as well.

Abstract

The color detector circuit can be adjusted with essentially infinite variability to cause it to detect virtually any color in the visible spectrum, and to define a narrow passband or range of colors which the device will transmit. The device can be used to provide accurate color key signals with a variable passband in chroma key equipment. The device can be used to provide multiple chroma key signals for a single picture frame. A color correction system using the chroma key device also is shown.

Description

This application is a continuation-in-part of U.S. patent application Ser. No. 598,468, filed on Apr. 9, 1984,which has issued as U.S. Pat. No. 4,679,067, on July 7, 1987, and U.S. patent application Ser. No. 851,164 filed on Apr. 14, 1986. The disclosures of those applications hereby are incorporated herein by reference.
FIELD OF THE INVENTION
This invention relates to devices and methods for detecting the colors represented by video signals, and to devices and methods for selectively connecting an output circuit to a selected one of two or more video signal sources in response to the detection of signals representing a pre-determined color. The latter devices and methods are commonly referred to as "chroma key" devices and methods.
BACKGROUND OF THE INVENTION
Video color detectors have several different uses. The use of color detectors in color correction is described in the above-identified co-pending patent applications. The use of such detectors in chroma keying is described herein.
Chroma key devices and methods typically are used to insert images from one video source into the picture formed by signals from another source. Either of the sources can be any of a variety of different types, e.g., a television camera viewing a "live" scene; a telecine device producing video signals from motion picture film; a video tape player reproducing video signals recorded on magnetic tape or other media; etc.
A typical use of a chroma key device during a live television broadcast is illustrated in FIG. 8 of the accompanying drawings, which shows a video monitor or receiver 200 which displays a video picture 202. A video camera (not shown) views a weather forecaster 204 standing in front of a large vertical blue surface called a "matte" which is not visible in FIG. 8. Instead, wherever the blue matte appears behind the forecaster 204, it has been replaced by the image of a weather map 206 showing the U.S. and parts of Canada and Mexico. The forecaster sees the weather map image on a studio monitor (also not shown in FIG. 8) and points to areas of the matte to indicate areas on the map. The weather map can have superimposed images, such as temperature data, etc.
Video signals forming the weather map are generated by a video source usually referred to as a "background source", and the image of the weather forecaster is generated by the studio camera, which usually is called a "foreground source".
The insertion of a weather map in place of the blue matte is made by a chroma key device which detects the foreground signals from the video camera. When, during each horizontal scan, signals representing the blue color of the matte are detected, the chroma key device switches the broadcast signal from the foreground source to the background source. Then, when the non-blue color of the forecaster is detected, the signals broadcast are switched to the foreground source, and then back again to the background source when the matte is detected again. This process is repeated for each horizontal line in the picture. Thus, the background signal replaces the blue matte everywhere except where the forecaster is located.
A major problem with prior chroma key devices is that they often provide false key signals by responding erroneously to colors other than the matte color. For example, the device often produces key signals upon the detection of not only the blue matte signals, but also the blue eyes or clothing of the announcer. This is very undesirable.
Sometimes the chroma key device will not respond to the matte color. Then the lighting in the television studio or the matte must be changed so that the apparent matte color is just right for the chroma key device. This can be very time-consuming and expensive.
Variation in the matte color to which the chroma key device will respond is provided in some prior art devices by means of a variable hue or color control in which the color or hue to which the keyer will respond can be varied throughout the entire spectrum of visible light. FIG. 7 of the accompanying drawings is a schematic vector representation of the hue and saturation of a given color video signal, as it is shown on the familiar "vectorscope" used in video production equipment. The angle "θ" of the vector represents the hue or color of the signals, and the length "S" of the vector represents the saturation or intensity of the signals. Although the hue or color control of such prior equipment theoretically makes it possible to select any hue as the matte color by, in effect, making it possible to rotate the vector in FIG. 7 through 360°, the keyer using this control actually responds to or "keys" on hues or colors far different from the desired matte color--at least when the colors are at anything less than high saturation levels. In other words, the device does not accurately discriminate among similar colors. This tends to cause false keying in response to other hues appearing elsewhere than in the matte area of the television picture.
The use of highly saturated or intense matte colors tends to somewhat alleviate the above problem, but places severe restraints on the colors usable in the studio, on lighting and other artistic variables, and on the variety of usable matte colors.
The use of prior chroma key devices also places undesirable restraint on the location of the weather reporter or announcer in relation to the matte. When using such prior devices, the announcer should be located at a relatively great distance from the matte so that blue matte color will not be reflected onto the announcer and cause false keying.
The use of bright or saturated blue as a matte color often causes "flare". Furthermore, the announcers usually must be smoothly coifed because the straggling hairs of a bouffant or other hair style with ragged edges sometimes will cause erroneous keying of the chroma key device.
Accordingly, it is an object of the invention to provide a video color detection device and method which are more accurate and flexible in use than in the past. It is a further object to provide a chroma key device and method which alleviate or solve the foregoing problems; a chroma key device and method in which the color to which the device responds can be controlled so as to prevent false switching or insufficient response to a desired color, and in which the color detection is more accurate and flexible than in the past.
It is another object of the invention to make it possible and practical to provide a plurality of different "keys" or insertions in a single television picture by switching among three or more video signal sources, one providing foreground and the others providing background signals for the multiple inserts.
It is a further object to provide a chroma key system and method capable of providing multiple keys in response to hues closely similar to one another.
An additional objective of the invention is to provide a color detection and chroma key device and method in which the degree of discrimination among hues can be adjusted so as to best adapt the operation of the device to the circumstances at hand.
Another object of the invention is to provide an improved hue detection device and method which is compatible with existing keying or switching devices having means for handling other chroma keying problems such as those caused by shadows, and the problem of providing either "soft" or "hard" edges for the key areas by providing either gradual or abrupt transition in switching between video sources, etc. Thus, it is an object to provide a chroma key device with excellent hue discrimination and other known chroma key features.
In accordance with the present invention, the foregoing objects ar satisfied by the provision of a color detection and chroma key devices and methods which are capable of discriminating among similar hues by limiting the band width of the hues and/or hue and saturation combinations which can be recognized by the device.
Preferably, this feature is provided in combination with a device which is capable of varying the center hue of the pass band in substantially infinitely small steps throughout the visible light spectrum. Thus, in essence, the vector representing the center of the pass band can be rotated through an angle of substantially 360° in the vector plane so that substantially any hue can be used for the matte. However, if a narrow band width is selected, the device will not key falsely upon detecting any hue except those the same as or very close to the center hue of the pass band.
Preferably, the band width of the color detector of the device can be varied by the operator. Thus, the device can be made to discriminate against all but a narrow range of hues, as described above, or it can be made to respond to a relatively wide range of hues, if this is best for the particular scene involved.
The invention not only makes it possible to use almost any hue as a matte color, and to minimize false keying by selecting a narrow pass band, but it also eliminates or reduces the need for the use of very intense or saturated matte colors. In fact, an optional feature of the device makes it possible to limit the video signals to be detected to those having saturation values below a predetermined level. By this means, if two areas having the same hue but different saturation levels are present in the same picture, the keyer will discriminate between the two areas and make the required insertion in the low-saturation area. For example, if a motion picture film frame has both a light blue sky in one area and an intense or saturated blue automobile of the same hue in a different area of the frame, the device will make the insertion in the blue sky area only.
Conversely, if preferred, another optional feature can be used to limit the signals detected to those having saturation values above a pre-determined level so that, in the foregoing example, the insertion would be made only in the area occupied by the intense blue automobile.
By making it possible to use matte colors of relatively low saturation, several of the problems mentioned above are solved or alleviated. For example, colors of low saturation will reduce the reflection problems, with the result that the foreground object (e.g., the announcer) can be located closer to the matte. "Flare" and problems due to ragged coiffures also are alleviated, improving the flexibility of casting, hairstyles, etc.
The ability of the invention to discriminate between closely similar hues, or between high and low saturation signals of the same hues, greatly enhances the versatility of the chroma keyer.
In accordance with another feature of the invention, a plurality of detectors can be used to provide simultaneously a plurality of inserts into a given scene or frame of a video or motion picture. Since each detector can be adjusted to detect signals having a very limited range of hues and/or saturation values, the tendency towards false keying which would be created by the use of two or more prior chroma key devices in a single frame would be substantially alleviated.
In one embodiment of the invention, the matte color detector uses the same circuitry as that used in the color connector described in the aforementioned U.S. patent application Ser. No. 851,164, and can be used either as a component of a chroma key device, or in discriminating among different objects or areas of a frame of a motion picture or video tape so that only the color of the desired object or area will be corrected. Thus, the detector circuitry can be used for multiple purposes in film-to-tape, tape-to-tape, or tape-to-film transfers. Actually, when the chroma keyer is used with film or tape, an additional advantage is realized in that the matte area itself less frequently requires color correction to enable it to actuate the keyer. This saves color correction labor and time.
Further advantages are obtained by the use of a device and method in which controls are provided for defining a limited area or "window" in a video picture and limiting the colors sampled by a chroma key device to those within the limited area. This has the effect of limiting the appearance of the background picture to only a portion of the matte area. Preferably, the limited area is variable in both position and size, and can be programmed to move gradually from one frame to the next in order to follow movement of an object in tape-to-tape or film-to-tape transfers. This feature is particularly advantageous when combined with the improved color detector of the invention.
The chroma keyer of the invention also can be incorporated advantageously into production studio switchers, or video tape or film editing equipment, or it can be supplied as a stand-alone device cabled to cameras or other studio equipment.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other objects, features, and advantages of the present invention will become apparent upon consideration of the following detailed description of the illustrative embodiments thereof, especially when taken in conjunction with the accompanying drawings, wherein:
FIG. 1 is a schematic circuit diagram of the preferred embodiment of the invention;
FIG. 2 is a schematic circuit diagram of an alternative embodiment of the invention;
FIG. 3 is a schematic circuit diagram of a component of the device shown in FIG. 1;
FIG. 4A and 4B are more detailed schematic circuit diagram of the device shown in FIG. 1;
FIG. 5 is a schematic circuit diagram of the keyer which is part of the device shown in FIG. 1;
FIGS. 6A-6D are waveform diagrams illustrating the principles of operation of the circuit of FIG. 4;
FIG. 7 is a vector diagram representing some of the variables in the operation of the device shown in FIG. 1;
FIG. 8 is a drawing of a typical video picture of the type in which the invention is used;
FIG. 9 is a diagram illustrating the operational characteristics of a typical prior art device; and
FIGS. 10 and 11 are schematic circuit diagrams of alternative embodiments of the invention.
GENERAL DESCRIPTION
FIG. 1 shows a chroma key system 10 constructed according to the invention. The system 10 includes a foreground video signal source 12, a color detector circuit 14, a keyer device 16, and a background video source 18. The color detector 14 is shown in greater detail in FIGS. 3, 4 and 6. The keyer 16 is shown in greater detail in FIG. 5.
In the preferred embodiment shown in FIG. 1, the output signals of the foreground video signal source 12 are in "component" form; that is, the signals are the red, green and blue components "R", "G", and "B" making up the video signal. The red green and blue signals are delivered to the detector 14 and the keyer 16 over lines 24. The background video signal source 18 delivers the red, green and blue signals to the keyer 16. The keyer is of the type adapted to operate on component video signals. Upon detection of the key color signal from the foreground video source, color detector 14 generates a key signal on an output line 20 which is delivered to the keyer 16. This causes the keyer 16 to switch from the foreground video signal source 12 to the background video source 18. The red, green and blue video output signals from the keyer 16 enter an encoder 22 which converts them to composite video form. The composite video signals are caused to create a video picture on a monitor 28. If the signal from the encoder 22 is broadcast, the unit 28 is a receiver in a television viewer's home.
An alternate embodiment of the invention is shown in FIG. 2. In FIG. 2, the chroma key system 11 has a keyer 17 which is of the type adapted to operate with composite video signals. Therefore, an encoder 23 is connected between the output of the source 12 and the keyer 17 to convert the component signals to composite form. Also, a delay circuit 26 is connected in the line 20 delivering the key signal from the detector 14 to the keyer 17 in order to compensate for the time delay created by the encoder 23. Also, the background video source 21 is of the type delivering composite video signals. The output of the keyer 17 is a composite video signal which is delivered to the video output monitor or receiver 28, as described above. The color detector circuit is described in greater detail in FIGS. 3 and 4.
COLOR DETECTOR CIRCUIT
FIG. 4 is a schematic diagram of the color detector circuit 14 used in the chroma key devices of FIGS. 1 and 2. Red ("R"), green ("G"), and blue ("B") signals from the foreground video signal source enter a standard luminance matrix 38 which produces a luminance signal ("Y") at its output. A coefficient processor circuit 39 (in the lower part of FIG. 4) generates four d.c. signals proportional to sin θ, cos θ, D cos θ and D sin θ, respectively. These signals are supplied as inputs to four- quadrant multiplier circuits 40, 42, 46, and 48.
The red signal R and the luminance signal Y are delivered, respectively, to the (+) and (-) input terminals of the first four-quadrant multiplier circuit 40, thus forming (R-Y) as one input signal to the multiplier.
FIG. 3 is an enlarged and more detailed view of the multiplier circuit 40. The circuit 40 is an integrated circuit including a pair of differential amplifiers 41 and 43 which deliver their outputs to an analog multiplier circuit 45, which delivers to an amplifier 47 a signal proportional to the product of its two input signals X and Z. Amplifier 47 delivers an amplified signal proportional to the product (X)(Z) on one output line 51, and an inverted signal (X)(Z) on line 49.
One satisfactory integrated circuit chip for this use is the MC1595L multiplier sold by Motorola, Inc.
Thus, the input signal (R-Y) is formed by the differential amplifier 41 which has (R) applied to its (+) input terminal and (Y) to its (-) terminal.
Each multiplier circuit shown in the upper portion of FIG. 4; that is, each of the multipliers 42, 44, 46, 48 and 50, has the same structure as the multiplier 40 shown in FIG. 3.
In a similar manner, a (B-Y) signal is formed as one input to the four-quadrant multiplier circuit 42. As it is shown in FIG. 7, the (R-Y) and (B-Y) signals are defined to be in quadrature. The vector "S" of FIG. 7 is the resultant of the (R-Y) and (B-Y) vectors. The angle θ formed by the vector "S" is the measure of the hue of the video signals.
The angle θ corresponding to the hue to be detected by the detector 14 can be selected at any angle from 0° to 360°. This is accomplished, in effect, by the use of a variable, selectable passband filter circuit which filters out all signals other than those within a certain pass-band around the selected hue corresponding to the angle θ. Thus, the signal (sin θ) is supplied as a second input to the multiplier 40, and the signal (cos θ) as a second input to the multiplier 42. The output of multiplier 40 is proportional to (R-Y) sin θ, and that from multiplier 42 is proportional to (B-Y) cos θ.
The output from multiplier 40 is delivered to the (+) input terminal of another multiplier 44 so as to form the input signal (R-Y) sin θ-(B-Y) cos θ. A level discriminator 52 produces a "key" output signal only when the output of the multiplier 44 is either above a first pre-set level or below a second pre-set level.
Although the resultant color vector to be detected effectively can be rotated through an angle of 360° or more by varying θ, the operation of the circuit described so far as a color discriminator is unsatisfactory because the range of hues it recognizes or "keys" on is so broad that it tends to recognize colors substantially different from the matte color.
The latter problem is illustrated in FIG. 9 in which the curve 212 expresses the relationship between hue and the output of the multiplier circuit 44 due solely to the input signals described so far; that is, without consideration of the signals applied to the lower pair of terminals of the multiplier circuit 44. The curve 212 is relatively broad and crosses the zero-axis at two points, one of which leads θ by 90°, and one of which lags θ by 90°; that is, the curve 212 covers an area spanning 180° of the color spectrum. A second curve is shown at 216. This curve results from a shift of the angle θ to a new value θ'.
In the prior art, a level detector circuit is used to discriminate against all signals lower in magnitude than a pre-set level 214. By this means, the range of hues detected by the circuit is narrowed to the area between points A and B where the level detector level 214 crosses the curve 212, without affecting the passband of the detector circuit itself. Because the shape of the curve 212 remains very broad, usually the range of hues between points A and B also is relatively broad. Furthermore, the shape of the curve 212 makes the detector circuit largely dependent on saturation levels rather than hue.
In accordance with a valuable feature of the invention, the passband of the hue selector circuit itself is narrowed by the use of three four-quadrant multiplier circuit devices 46, 48 and 50, together with the multiplier 44.
With this feature, the passband can be made as narrow as 2° and as broad as 90° on either side of the center, or principal color, substantially independently of the saturation of the input signals.
Multiplier 46 develops a signal of (R-Y) on its upper terminals. A signal (D cos θ) is developed on its lower terminals from a delta control signal source 39 which multiplies the cos θ signal by a "delta" factor "D".
Similarly, (B-Y) and (D sin θ) signals are developed at the input terminals of the multiplier 48.
The outputs from multipliers 46 and 48 are subtracted from one another by the input differential amplifiers in a multiplier circuit 50 which is used as a squarer. Thus, the quantity (R-Y) D cos θ-(B-Y) D sin θ is formed at the output of each input differential amplifier. Those outputs are multiplied by one another to square that quantity and produce a signal N:
N=[(R-Y)D cos θ-(B-Y) D sin θ].sup.2,
at the output of the squarer 50.
This signal is sent to the lower negative input terminal of multiplier 44 where it is subtracted from a reference signal "REF." The resulting signal (1-N) is multiplied with M=(R-Y) sin θ-(B-Y) cos θ and that product is sent to the level discriminator circuit 52.
The effects of this signal processing are shown in FIGS. 6A-6D, which are diagrams illustrating the operation of the circuitry. The angle θ or hue is plotted horizontally against the d.c. output voltage in response to the successive receipt of numerous signals of equal magnitude but whose hues vary throughout the visible spectrum, when a specific center hue θ has been selected for the pass-band of the circuit.
FIG. 6A shows the variation of the signal M=(R-Y) sin θ-(B-Y) cos θ which is developed at one input to the multiplier 44. It is a sine wave whose period represents 360° of the color vector circle, with the selected hue located at θ, the positive peak of the sine wave.
FIG. 6B shows the output of the squarer 50. It is 90° out of phase with the wave shown in FIG. 6A. The purpose of squaring the wave input to the squarer 50 is to make all peaks of the wave positive. FIG. 6B basically is made up of positive sine loops.
FIG. 6C shows the result of subtracting the signal N shown in FIG. 6B from the reference signal. The reference signal is a D.C. level which preferably is selected to produce a multiplication of one when N=0. The wave form in FIG. 6C has positive-going spikes 208 formed by the cusps between the inverted sine loops formed by the subtraction process.
The effects on the wave forms of a large delta factor "D", and medium and small delta factors are indicated, respectively, by dashed-line curve 210, solid curve 209, and dashed-line curve 207 in FIG. 6C.
The wave form resulting from multiplying signal M (FIG. 6A) by the signal shown in FIG. 6C is shown in solid lines in FIG. 6D. The negative-going portion of the wave form between the first and third half-cycles is eliminated by a negative signal clipper in the level discriminator circuit 52, so that only positive peaks remain.
The wave forms in FIG. 6D also express the transmission characteristics for input signals of variable hue. That is, signals having a phase angle equal to θ, the selected phase angle defining the desired hue, are transmitted with maximum values; other signals are attenuated to a degree depending upon the shape of the transmission curve, which depends on the delta "D" factor, and the number of degrees that the signal is distant from θ.
It can be seen in FIG. 6D that, as the delta factor "D" is increased, the passband λ of the circuit decreases. With a large "D" factor, the passband λ is relatively small. θ is the center frequency or hue of all of the passbands. The passband λ2 formed by the use of a medium "D" factor is wider, thus providing for the detection of a wider range of hues around the center hue at θ. Finally, the passband formed by a small "D" factor is very wide, almost 180°.
FIGS. 6A, 6B and 6D show the waveforms resulting from a change of the selected hue from θ to θ'. The waveform for θ' has been omitted from FIG. 6C to avoid cluttering the drawing, and the waveform for θ' in FIG. 6D has been separated from the waveform for θ0 more than it actually would be, for the sake of clarity in the drawings.
It can be seen that the change of the selected hue from θ to θ' merely shifts the waveforms to the right in FIGS. 6A-6D. This changes the selected hue from near red to a hue around magenta. If the knob 59 is turned in the opposite direction by the same amount as it was turned to created the change from θ to θ', shifting the vector "S" counterclockwise from the reference burst axis, then the waveforms shift to the left by a corresponding amount to select a color between green and cyan. The angle θ can be changed in very small steps or increments, thus making the hue selection essentially infinitely variable.
The amplitude of the signal transmitted to the level discrimination circuit 52 is proportional to the saturation of the color being detected. The level discriminator circuit 52 is capable of rejecting all signals whose saturation falls either above or below a preset level such as levels 211 and 213 shown in the right-hand portion of FIG. 6D. The details of the circuit 52 are shown in the above-identified patent application Ser. No. 851,164. However, the discrimination levels are adjustable at will. The signals are delivered over one of two output leads 56 and 58, depending on whether a low or high saturation signal has been detected.
By setting the discriminator to pass only those signals whose saturation is below a certain level, the device 14 detects and differentiates low-saturation signals from high-saturation signals of the same hue.
Quite significantly, low saturation colors can be used as matte colors without any significant degradation of selectivity in color detection. If preferred for a particular job, high-saturation colors also can be used as matte colors, and the saturation selection process avoids the possibility of developing a key signal in response to the detection of a signal of the same hue but lower saturation.
By permitting the passband to thus be variable in both phase angle and width, the chroma keyer using the color detector circuit 14 can be adjusted to select virtually any hue, any one of a number of different saturation levels, and a passband width so as to adjust the keyer to compensate for varying matte colors, lighting, etc., and to eliminate or alleviate many of the problems mentioned above with prior chroma key devices.
The signals output on lines 56 and 58 pass through a matte control circuit 54. The output signal from that circuit is delivered on line 20 to the keyer, as it is shown in FIGS. 1 and 2.
WAVELENGTH AND PASSBAND SELECTION CONTROLS
The user of the chroma key device of the invention can select essentially any hue in the visible light spectrum to detect by operation of a wavelength or variable vector position control unit 59 (see lower left-hand portion of FIG. 4). Similarly, the delta or "D" factor determining the passband of the circuit is controlled by a control unit 57.
Units 57 and 59 can be simple potentiometers delivering a variable D.C. output signal to the coefficient processor circuit 39, or they can be digital shaft position encoders with digital-to-analog converters for delivering the same kind of signal.
The coefficient processor circuit 39 generates the sin 0, cos θ, D cos θ, and D sin θ signals which are supplied to multipliers 40, 42, 46, and 48 respectively.
The coefficient processor circuit 39 includes a square wave generator 60, which produces a 2-MHz square wave signal. The 2-MHz signal from the square wave generator 60 is sent to a divide-by-four circuit 62. The output of the divide-by-four circuit 62 is sent to another divide-by-four circuit 64 and to a fundamental frequency filter 70. The output signal from the divide-by-four circuit 64 is delivered to a one-shot circuit 66, which triggers a ramp generator 68. The output signal from the fundamental frequency filter 70 is a 500-KHz sine wave, while the output signal from the ramp generator 68 is a ramp which extends for four cycles of the 500-KHz sine wave.
In order to develop the sin θ and cos θ signals, the variable vector position control signal is compared to two different reference signals by one of two comparator circuits 72 and 74. The "plus" inputs of the comparators 72 and 74 are supplied by the summation circuits 76 and 78, respectively, and the wavelength or variable vector position control signal is applied to the "minus" inputs of the comparators. The summation circuit 76 adds the ramp signal to a reference signal, while the summation circuit 78 adds the ramp signal to a different reference signal. Each comparator detects equality between its input signals when the sum of the ramp signal plus the reference signal equals the wavelength control signal. The two different reference signals are selected to produce a difference of time equal to 90 degrees with respect to the 500-KHz sine wave. Accordingly, the output signals from the comparators 72 and 74 change from positive to negative at points 90 degrees apart along the sine wave produced by the fundamental frequency filter 70.
The output signals from the comparators 72 and 74 trigger one- shot circuits 80 and 82, respectively. The one- shot circuits 80 and 82, in turn, trigger sample-and- hold circuits 84 and 86, respectively. The sample-and- hold circuits 84 and 86 sample the 500-KHz sine wave from the fundamental frequency filter 70. Because the reference signals at the summation circuits 76 and 78 are set to correspond to a 90 degree phase difference, the sample-and- hold circuits 84 and 86 sample the 500-KHz sine wave at points which are 90 degrees apart. As a result, the sample-and- hold circuits 84 and 86 produce d.c. output signals which correspond to a phase difference of 90 degrees, and these signals are referred to as sin θ and cos θ, respectively.
The variable vector position control signal determines when the output of the comparators 72 and 74 change from positive to negative. Consequently, the variable position control signal determines the sin θ and cos θ signals, and thereby determines θ, the phase angle of the color in the range of colors selected by the wavelength control 59.
Two additional sample-and- hold circuits 88 and 90 are provided. They operate similarly to the sample-and- hold circuits 84 and 86 in order to determine the d.c. signals D cos θ and D sin θ. However, the sample-and- hold circuits 88 and 90 do not directly sample the 500-KHz sine wave from the output of the fundamental frequency filter 70. Rather, the sample-and- hold circuits 88 and 90 sample the output signal from a multiplier 92. One input of the multiplier 92 is the 500-KHz sine wave from the fundamental frequency filter 70, while the other input of the multiplier 92 is the delta or passband control signal from the delta control 57. Accordingly, the output signal from the multiplier 92 is a 500-KHz sine wave which has its amplitude modified by the delta control signal.
When the one- shot circuits 80 and 82 trigger the sample-and- hold circuits 84 and 86, the one- shot circuits 80 and 82 simultaneously trigger the sample-and- hold circuits 88 and 90. Thus, the sample-and- hold circuits 88 and 90 sample a 500-KHz sine wave whose amplitude has been modified by the delta control signal to produce the D cos θ and D sin θ signals, respectively. The delta control signal, therefore, determines the value D, which sets the passband width or the range of detectable colors around the center color at θ.
The sin θ signal from the sample-and-hold circuit 84, the cos θ signal from the sample-and-hold circuit 86, and the D cos θ signal from the sample-and-hold circuit 88, and the D sin θ signal from the sample-and-hold circuit 90 are delivered to multipliers 40, 42, 46 and 48, respectively.
MATTE CONTROL CIRCUIT
The matte control circuit 54 is a circuit for forming in a picture a limited area or "window" within which or outside of which the colors can be detected by the color detector circuit 14. The window is movable and can be changed in size. This can be useful in eliminating a particularly troublesome area of foreground color from detection so as to prevent false keying. Also, the variable window can be used to limit the area of the inserted background signal.
The circuitry of the device 54 is described in detail in U.S. Pat. No. 4,679.067, issued on July 7, 1987 , and that description is incorporated herein by reference.
If the chroma keyer device is used as a part of a scene-by-scene color corrector in a film-to-tape, tape-to-tape, or other such transfer system, the window can be programmed to move with objects changing position from one scene to the next, so as to produce a "traveling" window. The techniques for doing this are described in greater detail in our co-pending U.S. patent application Ser. No. 851,164 and will not be repeated herein.
KEYER
The keying device 16 or 17 shown in FIGS. 1 or 2 does not form a part of this invention. Any device capable of rapidly switching back and forth between the foreground and background sources in response to key signals from the color detector circuit 14 can be used as a keyer, as long as it is capable of operating with, or can be modified to operate with, either composite or component video signals, as required.
A very simple prior art keyer 17 which is suitable for use with composite video is the Grass Valley model 930 video insert keyer, whose schematic circuit diagram is shown in FIG. 5.
The keyer 17 of FIG. 5 has four input leads 19, 21, 25 and 100. Lines 19 and 25, which also are shown in FIG. 2, respectively receive the background and foreground signals; line 21 receives the key signal; and line 100 receives the video synch signal. Emitter- follower circuits 102, 104, 106 and 108 couple the signals from the four inputs to an FET switch 11 through D.C. restorer circuits 110, 112 and 114. The emitter-follower circuits are for impedance matching purposes, and the D.C. restorer circuits clamp the signals to a D.C. potential and, in essence, set a zero level for black signals.
The FET switch 118 is a very fast switch which rapidly switches between one condition in which the foreground source is connected to deliver output signals over the output leads 128, to the other in which the background source is so connected. The operation of the FET switch 118 is controlled by the key signal, which is delivered to the switch 118 through an optional level detector circuit 120 whose detection level is controlled by a potentiometer 122.
Of course, other, more sophisticated keyers also can be used--keyers which solve or alleviate other keying problems such as those caused by shadows, and which provide either "hard" or "soft" edges for the key areas. Typical of the more sophisticated keyers are those shown in Vlahos U.S. Pat. Nos. 4,100,569 and 4,589,012.
MULTIPLE KEYING
FIG. 10 shows a chroma key system for providing multiple keys in a single picture frame. For example, three color detector circuits K1, K2 and K3, each having the construction shown in FIG. 4, are used to detect three different matte colors K1, K2 and K3 appearing on the monitor picture 132. These three matte colors are used to insert one of three different background signals from one of three sources 134, 136 and 138 in each area K1, K2 and K3. The keyer 16 is specially adapted to switch between the foreground and any of the three background sources in response to key signals from the color detector circuits K1, K2 and K3.
Advantageously, each of the three key colors can be similar to the others, so that standard detectors can be used to detect several similar matte colors in a single frame to provide multiple keys.
It is believed to be possible to program a computer to switch automatically between two or more different color detector circuit settings for one frame in a system using only one color detector, thus avoiding the use of two or more color detector circuits. The different settings could be stored in a first run through a recorded image source such as motion picture film or videotape, with the different settings being read out and applied to the color detector during a second run for recording a videotape or other record. The computer advantageously can be one used in a color correction system, as it will be described below.
USE IN COLOR CORRECTION
When the insertion of background signals is to be done during editing or color correction of motion picture film or videotape, the matte color appears in the background, and a chroma key device can be used to detect the color and replace it with background source signals in making the final videotape for broadcast.
In the past, the matte color itself in the film or tape sometimes had to be corrected before the chroma key device would work properly. It is believed that the chroma key device of the invention will reduce or eliminate the need for such color correction because it can be adjusted and fine tuned to key in the color despite its deviations from the desired hue and saturation levels.
FIG. 11 of the drawings shows a color correction system 150 including a foreground source 152 such as a telecine, and two background sources 154 and 156. The output of a selected one of the sources 152 (a telecine), 154 and 156 is delivered through the keyer 16 to the color correction control unit 158, which includes all the controls and circuits necessary for color correction. The resulting picture is displayed on the monitor 28. The CPU and RAM memory of the color correction computer of the system are shown at 166 and 168, respectively. As it is well known, the CPU and memory cooperate to store scene location information and color correction values for each scene of the film being run on the telecine.
During normal color correction, the output of the color detector circuit 14 which forms a part of the control unit 158 is switched to a terminal 161 which allows it to perform its normal function--to select specific colors to correct. Then, when operation as a chroma key device is desired, the switch 160 is operated to connect the output of circuit 14 to the line 20 to deliver key signals to the keyer 16. Thus, the same color detector circuit 14 is used for two functions. This reduces the cost and size of the color correction system 150.
Of course, if preferred, a separate color detector circuit 14 can be provided solely for use in the chroma key device.
During color correction of each scene in which the chroma key device is to be used, the wavelength control, delta control, and saturation level control knobs are operated to adjust those parameters for the scene. Then, when the adjustments are complete, signals corresponding to the adjustments are stored in the memory 168 of the computer, in association with the scene location data. As the settings of the wavelength, etc. knobs are changed for different scenes, the new values are also stored. If color corrections are made, they also are stored in the same way.
Both the chroma key and color correction values stored for a prior scene or frame can be recalled from the RAM memory 168, applied to and used for the current scene or frame, either with or without modifications. Recall can be done by use of a keypad to call up the prior scene or frame number, or by the use of other techniques discussed in the co-pending application Ser. No. 851,164.
After the foregoing parameters have been set and stored, the film is rewound, and a switch 162 enabling a videotape recorder 164 is closed, the telecine is re-started, and the film is transferred to videotape. As each scene-change signal is read out of memory, the settings for the controls of the chroma key device, as well as the color correction values, are read out of memory. The stored chroma key settings are used to set the wavelength and delta controls to the desired value to insert signals from one or more of the background sources 154, 156 in place of the matte color signals.
Although particular illustrative embodiments of the present invention have been described herein with reference to the accompanying drawings, the present invention is not limited to these particular embodiments.
For example, the coefficient processor circuit 39 has analog signal processing circuits. However, suitably programmed general purpose computer or microprocessor may be employed in lieu of the analog signal processing circuits. In addition, digital circuits may be used for other components in the variable vector control circuits as well. Various other changes and modifications may be made thereto by those skilled in the art without departing from the spirit of scope of the invention.

Claims (43)

We claim:
1. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, and passband width control means for varying the width of said passband independently of the saturation of the transmitted signals.
2. A device as in claim 1 including level detector means connected to the output of said filter means to discriminate against output signal levels other than those falling within a predetermined range.
3. A device as in claim 2 in which the magnitude of said video signals is representative of the saturation of the color, and said level detector is adapted to discriminate against signals whose saturation is greater than a predetermined level.
4. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, and passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, said device including means for creating at least one barrier to form a window of variable position in a video picture formed from said signals and for disabling said detector when detecting video signals on one side of the barrier forming said window.
5. A device as in claim 4 including means for varying the size of said window.
6. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, and passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, in which said video signals include red (R), green (G), and blue (B) component signals, and a luminance (Y) signal, means for forming the signals (R-Y) and (B-Y), and means for modulating said R-Y signal with a signal corresponding to sine θ and modulating said (B-Y) signal with a signal corresponding to cos θ, where θ is said predetermined phase angle, subtracting the latter modulation product from the former modulation product, forming signals proportional to D(R-Y) cos θ and D(B-Y) sin θ, where D is a bandwidth factor, adding the latter signals together and rectifying the result, subtracting the result of the rectifying operation from a reference signal and multiplying that result times the result of subtracting the two modulation products from one another, said passband width control means comprising means for varying the value of D.
7. A device as in claim 6 in which said hue selector means comprises means for pre-selecting the angle θ.
8. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including electrical circuit means for transmitting only those video signals having phase angles within a relatively narrow passband but having a substantially full range of saturation values.
9. A device as in claim 8 in which a curve representing the variation of the magnitude of the transmitted signals with hue has a substantially spike form.
10. A device as in claim 8 including passband control means for varying the width of said passband independently of saturation values and thereby varying the range of hue detected.
11. A device as in claim 10 including hue selector means for varying the relative position of said passband around a color vector circle to select the predominant hue to be detected.
12. A device as in claim 8 including level detector means connected to the output of said electrical circuit means to discriminate against signals whose saturation is above a predetermined level.
13. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including electrical circuit means for transmitting only those video signals having phase angles within a relatively narrow passband but having a substantially full range of saturation values, said device including means for creating at least one barrier to form a window of variable position in a video picture formed from said signals and for disabling said detector when detecting video signals on one side of the barrier forming said window.
14. A chroma key device, said device comprising a video color detector for producing a color detection signal, said detector including detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including electrical circuit means for transmitting only those video signals having phase angles within a relatively narrow passband but having a substantially full range of saturation values, and switching means for switching an output circuit from a first video signal source to a second video signal source in response to said color detection signal.
15. A device as in claim 14 passband control means for varying the width of said passband independently of saturation values and thereby varying the range of hues detected.
16. A device as in claim 15 including hue selector means for varying the relative position of said passband around said color vector circle to select the predominant hue to be detected.
17. A device as in claim 14 including level detector means connected to the output of said electrical circuit means to discriminate against signals whose saturation is above a predetermined level.
18. A device as in claim 17 including means for discriminating against signals whose saturation is below a second predetermined level.
19. A chroma key device comprising a video color detector for producing a color detection signal, said detector including detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including electrical circuit means for transmitting only those video signals having phase angles within a relatively narrow passband but having a substantially full range of saturation values, switching means for switching an output circuit from a first video signal source to a second video signal source in response to said color detection signal, and passband control means for varying the width of said passband independently of saturation values and thereby varying the range of hues detected; said device including hue selector means for varying the relative position of said passband around said color vector circle to select the predominant hue to be detected; said device further including a plurality of said color detectors, each being capable of being set to detect a different predetermined hue, said switching means being adapted to respond separately to each color detection signal to switch from one to another of a plurality of video signal sources, whereby multiple key areas can be formed in a single video picture.
20. A chroma key device, said device comprising a video color detector for producing a color detection signal, said detector including detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, and passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, and switching means for switching an output circuit from a first video signal source to a second video signal source in response to said color detection signal.
21. A device as in claim 20 including level detector means connected to the output of said filter means to discriminate against output signal levels other than those falling within a predetermined range in which the magnitude of said video signals is representative of the saturation of the color, and said level detector is adapted to discriminate against signals whose saturation is above a predetermined level.
22. A chroma key device comprising a video color detector for producing a color detection signal, said detector including detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, and switching means for switching an output circuit from a first video signal source to a second video signal source in response to said color detection signal, said device including means for creating at least one barrier to form a window of variable position in a video picture formed from said signals and for disabling said detector when detecting video signals on one side of the barrier forming said window.
23. A device as in claim 22 including means for varying the size of said window.
24. A chroma key device comprising a video color detector for producing a color detection signal, said detector including detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, and switching means for switching the output circuit from a first video signal source to a second video signal source in response to said color detection signal, in which said video signals include red (R), green (G), and blue (B) component signals, and a luminance (Y) signal, means for forming the signals (R-Y) and (B-Y), and means for modulating said R-Y signal with a signal corresponding to sine θ and modulating said (B-Y) signal with a signal corresponding to cos θ, where θ is said predetermined phase angle, subtracting the latter modulation product from the former modulation product, forming signals proportional to D(R-Y) cos θ and D(B-Y) sine θ, where D is a bandwidth factor, adding the latter signals together and rectifying the result, subtracting the result of the rectifying operation from a reference signal and multiplying that result times the result of subtracting the two modulation products from one another, said passband width control means comprising means for varying the value of D.
25. A device as in claim 24 in which said hue selector means comprises means for pre-selecting the angle θ.
26. Apparatus for switching video signals at an output terminal by switching between a first video signal source producing first video signals and a second video signal source producing second video signals, comprising: detecting means for detecting the ones of said first video signals which are within a predetermined range of colors adjacent a variable principal color; first control means for varying said principal color; switching means responsive to said detecting means for switching said output terminal from said first video signal source to said second video signal source when the detected ones of said first video signals are within said predetermined color range; said first video signal source being adapted to reproduce video signals stored on an image storage medium in frames, means for developing frame identification signals for said frames, memory means, means for storing said frame identification signals in said memory means, means for storing data corresponding to the setting of said first control means in said memory for each frame for which it is to be used, and means responsive to said frame identification signals for reading said data out of said memory and applying said data to control the settings of said first control means during reproduction of the images of the corresponding frame.
27. Apparatus as in claim 26 and including second control means for narrowing or widening the response characteristic curve of said detecting means to narrow or widen said range, means for storing data corresponding to the settings of said second control means and means responsive to said frame identification signals for retrieving the latter data and applying it to control the settings of said second control means during reproduction of the images of the corresponding frame.
28. Apparatus as in claim 26 including means for making color corrections for signals from said first source, storing data corresponding to said corrections in said memory, and means responsive to said frame identification signals for retrieving the latter data and applying it to control signals representing the colors of the reproduced images during reproduction of the images of the corresponding frame.
29. Apparatus as in claim 26 including means for adapting said detecting means to operate selectively to perform in color correction or to perform in switching between video sources, and for storing color correction data and/or chroma key control settings data.
30. Apparatus as in claim 26 including level detector means connected to the output of said detecting means to discriminate against output signal levels other than those falling within a predetermined range.
31. Apparatus as in claim 26 including means for creating at least one barrier to form a window of variable position in a video picture formed from said signals and for disabling said detector when detecting video signals on one side of the barriers forming said window.
32. Apparatus as in claim 26 in which said memory means is random access memory means with means for recalling data stored for prior scenes by retrieval based on use of the frame identification information, applying the recalled data to images in a frame currently being analyzed, and modifying the recalled data to the extent necessary to adapt it for use with the current frame.
33. A method of switching video signals at an output terminal by switching between a first video signal source producing first video signals and a second video signal source producing second video signals, said method comprising the steps of:
providing detecting means for detecting signals within a predetermined range of colors;
setting a variable principal color;
narrowing or widening the response characteristic curve of said detecting means, while maintaining a substantially full range of saturation values, to narrow or widen the range of detectable colors adjacent said principal color;
detecting the ones of said first video signals which are within said range of colors adjacent said variable principal color; and
providing switching means responsive to said detecting means for switching said output terminal from said first video signal source to said second video signal source when the detected ones of said first video signals are within said color range.
34. A method as in claim 33 in which said setting step comprises operating a substantially infinitely variable control means for varying said principal color.
35. A method as in claim 33 including the step of limiting the response of said switching means to those signals from said detecting means which are below a predetermined range.
36. A method as in claim 33 including the step of providing a plurality of color detecting means and setting each to detect a different color and to cause switching between different video sources when the corresponding colors are detected.
37. A method of switching video signals at an output terminal by switching between a first video signal source producing first video signals and a second video signal source producing second video signals, said method comprising the steps of:
providing detecting means for detecting signals within a predetermined range of colors;
setting a variable principal color;
narrowing or widening the response characteristic curve of said detecting means to narrow or widen the range of detectable colors adjacent said principal color;
detecting the ones of said first video signals which are within said range of colors adjacent said variable principal color; and
providing switching means responsive to said detecting means for switching said output terminal from said first video signal source to said second video signal source when the detected ones of said first video signals are within said color range;
in which said first video source is a reproduction device for reproducing images stored on a storage medium in frames, said method further including the steps of:
providing memory means, means for developing frame identification signals for said frames, and means for storing said frame identification signals in said memory means;
storing data corresponding to the setting of said first control means in said memory for each frame for which it is to be used;
providing means responsive to said frame identification signals for storing in said memory means data corresponding to the control settings for said detecting means; and
causing the data to be read out under control of the frame identification signals and applied to said detecting means during reproduction of corresponding images.
38. A method as in claim 37 including forming a window in a video picture produced on a monitor from the video signals from said first source, sizing and positioning said window to encompass a desired object, and limiting the action of said detecting means to the area inside or outside of said window.
39. A method as in claim 38 including providing a computer and programming said computer to cause said window to move with the motion of an object it encompasses from one scene or frame to another.
40. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, and passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, in which said detecting means includes means for combining quadrature signals proportional to the sine and cosine of an angle corresponding to the color vector to be detected, and including sine wave voltage generator means, and means for sampling said sine wave voltage and storing signals proportional to the voltages of said sine wave at points in the wave separated by ninety degrees in phase to produce said quadrature signals.
41. A video color detector device comprising detecting means for detecting the color phase angle representing the hue of color information-bearing video signals, said detecting means including electrical circuit means for transmitting only those video signals having phase angles within a relatively narrow passband but having a substantially full range of saturation values, in which said detecting means includes means for combining quadrature signals proportional to the sine and cosine of an angle corresponding to the color vector to be detected, and including sine wave voltage generator means, and means for sampling said sine wave voltage and storing signals proportional to the voltages of said sine wave at points in the wave separated by ninety degrees in phase to produce said quadrature signals.
42. A chroma key device, said device comprising a video color detector for producing a color detection signal, said detector including detecting means for detecting the color phase angle representing the hue color information-bearing video signals, said detecting means including filter means for transmitting only those video signals having a phase angle within a predetermined passband relative to a variable predetermined phase angle, hue selection means for pre-selecting said predetermined phase angle, passband width control means for varying the width of said passband independently of the saturation of the transmitted signals, and switching means for switching an output circuit from a first video signal source to a second video signal source in response to said color detection signal, in which said detecting means includes means for combining quadrature signals proportional to the sine and cosine of an angle corresponding to the color vector to be detected, and including sine wave voltage generator means, and means for sampling said sine wave voltage and storing signals proportional to the voltages of said sine wave at points in the wave separated by ninety degrees in phase to produce said quadrature signals.
43. A device as in claim 40 or 41 or 42 including means for producing further signals proportional to the sine and cosine of said angle, each being multiplied by a band width factor D, and being combined with said quadrature signals to give said device a bandwidth proportional to D.
US06/939,600 1984-04-09 1986-12-09 Video color detector and chroma key device and method Expired - Lifetime US4811084A (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US06/939,600 US4811084A (en) 1984-04-09 1986-12-09 Video color detector and chroma key device and method
CA000553276A CA1320760C (en) 1986-12-09 1987-12-01 Video color detector and chroma key device and method
AU10809/88A AU1080988A (en) 1986-12-09 1987-12-03 Video color detector and chroma key device and method
GB08818818A GB2207025A (en) 1986-12-09 1987-12-03 Video color detector and chroma key device and method
PCT/US1987/003186 WO1988004510A1 (en) 1986-12-09 1987-12-03 Video color detector and chroma key device and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US06/598,468 US4679067A (en) 1984-04-09 1984-04-09 Color correction system and method with localized color sampling
US06/939,600 US4811084A (en) 1984-04-09 1986-12-09 Video color detector and chroma key device and method

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US06/598,468 Continuation-In-Part US4679067A (en) 1984-04-09 1984-04-09 Color correction system and method with localized color sampling
US85116486A Continuation-In-Part 1984-04-09 1986-04-14

Publications (1)

Publication Number Publication Date
US4811084A true US4811084A (en) 1989-03-07

Family

ID=25473437

Family Applications (1)

Application Number Title Priority Date Filing Date
US06/939,600 Expired - Lifetime US4811084A (en) 1984-04-09 1986-12-09 Video color detector and chroma key device and method

Country Status (5)

Country Link
US (1) US4811084A (en)
AU (1) AU1080988A (en)
CA (1) CA1320760C (en)
GB (1) GB2207025A (en)
WO (1) WO1988004510A1 (en)

Cited By (60)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4882622A (en) * 1987-09-18 1989-11-21 Toppan Printing Co., Ltd. Silhouette cutting apparatus
US4953008A (en) * 1986-09-08 1990-08-28 Encore Video, Inc. Method and apparatus for uniform saturation, hue and luminance correction
US4954881A (en) * 1986-09-08 1990-09-04 Encore Video, Inc. Method and apparatus for correcting video color signals
US5008754A (en) * 1988-03-23 1991-04-16 Du Pont Pixel Systems, Limited Analog controlled mixer
US5179642A (en) * 1987-12-14 1993-01-12 Hitachi, Ltd. Image synthesizing apparatus for superposing a second image on a first image
DE4228532A1 (en) * 1991-08-30 1993-03-04 Samsung Electronics Co Ltd FADER CIRCUIT FOR DISPLAYING INFORMATION ON A SCREEN
US5249039A (en) * 1991-11-18 1993-09-28 The Grass Valley Group, Inc. Chroma key method and apparatus
US5255083A (en) * 1991-06-05 1993-10-19 Sony Corporation Of America Digital color correction system and method
US5381184A (en) * 1991-12-30 1995-01-10 U.S. Philips Corporation Method of and arrangement for inserting a background signal into parts of a foreground signal fixed by a predetermined key color
US5382980A (en) * 1991-12-30 1995-01-17 U.S. Philips Corporation Method of and arrangement for inserting a background signal into parts of a foreground signal fixed by a predetermined key color
US5422674A (en) * 1993-12-22 1995-06-06 Digital Equipment Corporation Remote display of an image by transmitting compressed video frames representing background and overlay portions thereof
US5450500A (en) * 1993-04-09 1995-09-12 Pandora International Ltd. High-definition digital video processor
US5459823A (en) * 1990-07-05 1995-10-17 Canon Kabushiki Kaisha Graphics engine for true colour 2D graphics
US5469536A (en) * 1992-02-25 1995-11-21 Imageware Software, Inc. Image editing system including masking capability
WO1996001027A1 (en) * 1994-06-28 1996-01-11 Sigma Designs, Incorporated Analog video chromakey mixer
US5577179A (en) * 1992-02-25 1996-11-19 Imageware Software, Inc. Image editing system
US5630037A (en) * 1994-05-18 1997-05-13 Schindler Imaging, Inc. Method and apparatus for extracting and treating digital images for seamless compositing
US5646750A (en) * 1991-06-05 1997-07-08 Sony Corporation Method and apparatus for compressing video in a manner characteristic of photographic film
US5687306A (en) * 1992-02-25 1997-11-11 Image Ware Software, Inc. Image editing system including sizing function
US5710602A (en) * 1995-09-29 1998-01-20 Intel Corporation Gain correction for encoding video images
US5719640A (en) * 1994-09-10 1998-02-17 U.S. Philips Corporation Chromakey method and associated circuit arrangement
EP0870295A1 (en) * 1994-12-12 1998-10-14 Auravision Corporation Multimedia overlay system for graphics and video
US5874988A (en) * 1996-07-08 1999-02-23 Da Vinci Systems, Inc. System and methods for automated color correction
US5886747A (en) * 1996-02-01 1999-03-23 Rt-Set Prompting guide for chroma keying
US5912700A (en) * 1996-01-10 1999-06-15 Fox Sports Productions, Inc. System for enhancing the television presentation of an object at a sporting event
US5915044A (en) * 1995-09-29 1999-06-22 Intel Corporation Encoding video images using foreground/background segmentation
US5917553A (en) * 1996-10-22 1999-06-29 Fox Sports Productions Inc. Method and apparatus for enhancing the broadcast of a live event
US5923365A (en) * 1993-10-12 1999-07-13 Orad Hi-Tech Systems, Ltd Sports event video manipulating system for highlighting movement
WO1999040562A1 (en) * 1998-02-09 1999-08-12 Joseph Lev Video camera computer touch screen system
US5953077A (en) * 1997-01-17 1999-09-14 Fox Sports Productions, Inc. System for displaying an object that is not visible to a camera
US5986718A (en) * 1996-09-19 1999-11-16 Video Magic, Inc. Photographic method using chroma-key and a photobooth employing the same
US6020931A (en) * 1996-04-25 2000-02-01 George S. Sheng Video composition and position system and media signal communication system
US6072537A (en) * 1997-01-06 2000-06-06 U-R Star Ltd. Systems for producing personalized video clips
US6124897A (en) * 1996-09-30 2000-09-26 Sigma Designs, Inc. Method and apparatus for automatic calibration of analog video chromakey mixer
US6229550B1 (en) 1998-09-04 2001-05-08 Sportvision, Inc. Blending a graphic
US6252632B1 (en) 1997-01-17 2001-06-26 Fox Sports Productions, Inc. System for enhancing a video presentation
US6266100B1 (en) 1998-09-04 2001-07-24 Sportvision, Inc. System for enhancing a video presentation of a live event
US6288753B1 (en) * 1999-07-07 2001-09-11 Corrugated Services Corp. System and method for live interactive distance learning
EP1143745A2 (en) * 2000-02-29 2001-10-10 Canon Kabushiki Kaisha Image processing apparatus
US6351557B1 (en) 1998-04-03 2002-02-26 Avid Technology, Inc. Method and apparatus for color manipulation
US6417891B1 (en) 1999-04-16 2002-07-09 Avid Technology, Inc. Color modification on a digital nonlinear editing system
US20020122046A1 (en) * 2001-03-01 2002-09-05 Dischert Lee R. Method and apparatus for keying of secondary video into primary video
US6477271B1 (en) 2000-04-07 2002-11-05 Avid Technology, Inc. Secondary color modification of a digital image
US6545726B2 (en) * 1995-01-18 2003-04-08 Sony Corporation Color conversion apparatus for image data and color conversion method for image data
US20030071824A1 (en) * 1999-04-16 2003-04-17 Robert Gonsalves Multi-tone representation of a digital image on a digital nonlinear editing system
US6571255B1 (en) 1999-04-16 2003-05-27 Robert Gonsalves Modification of media with common attributes on a digital nonlinear editing system
US20030197710A1 (en) * 1999-04-16 2003-10-23 Avid Technology, Inc. Graphical user interface for color correction
US20040240729A1 (en) * 2000-04-07 2004-12-02 Cooper Brian C. Secondary color modification of a digital image
US6909438B1 (en) 2000-02-04 2005-06-21 Sportvision, Inc. Video compositor
US20060055707A1 (en) * 2004-09-10 2006-03-16 Fayan Randy M Graphical user interface for a keyer
US20060087504A1 (en) * 1999-10-21 2006-04-27 Meier Kevin R Telestrator system
US20070085908A1 (en) * 1996-10-22 2007-04-19 Fox Sports Production, Inc. A method and apparatus for enhancing the broadcast of a live event
US20080084508A1 (en) * 2006-10-04 2008-04-10 Cole James R Asynchronous camera/ projector system for video segmentation
US20080111922A1 (en) * 2006-07-28 2008-05-15 International Business Machines Corporation Mapping of presentation material
US20100329547A1 (en) * 2007-04-13 2010-12-30 Ipharro Media Gmbh Video detection system and methods
US20130198615A1 (en) * 2006-08-01 2013-08-01 Abbyy Software Ltd. Creating Flexible Structure Descriptions
US20150109463A1 (en) * 2013-10-19 2015-04-23 Motorola Solutions, Inc Method and system for generating modified display data
US9148639B2 (en) * 2005-12-20 2015-09-29 Savant Systems, Llc Apparatus and method for mixing graphics with video images
US9215383B2 (en) 2011-08-05 2015-12-15 Sportsvision, Inc. System for enhancing video from a mobile camera
US11593947B2 (en) 2020-03-10 2023-02-28 Cisco Technology, Inc. Automatic adjusting background

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5488429A (en) * 1992-01-13 1996-01-30 Mitsubishi Denki Kabushiki Kaisha Video signal processor for detecting flesh tones in am image
AUPN184595A0 (en) * 1995-03-21 1995-04-13 Animal Logic Research Pty Ltd Improvements in image compositing
WO2019195932A1 (en) * 2018-04-09 2019-10-17 John Alistair Quee Particles for use in color keying

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3560638A (en) * 1968-04-22 1971-02-02 Central Dynamics Chroma deying system utilizing remote controlled chroma keyer
US3959813A (en) * 1973-12-08 1976-05-25 Robert Bosch G.M.B.H. Generation of a switching signal for the chroma keying of color video signals
US4007487A (en) * 1975-09-25 1977-02-08 The Association Of Motion Picture And Television Producers Inc. Electronic composite photography with color control
US4051520A (en) * 1975-08-20 1977-09-27 U.S. Philips Corporation Color television chroma keying signal generator
US4096523A (en) * 1976-06-29 1978-06-20 Belmares Sarabia Armand Color correction system
US4109278A (en) * 1975-03-21 1978-08-22 Sonex International Corp. Video traveling matte system
US4386363A (en) * 1981-04-10 1983-05-31 Ampex Corporation Chroma key switching signal generator
US4394680A (en) * 1980-04-01 1983-07-19 Matsushita Electric Industrial Co., Ltd. Color television signal processing apparatus
US4396939A (en) * 1980-06-09 1983-08-02 Nippon Electric Co., Ltd. Chromakey effect apparatus
US4409611A (en) * 1981-09-24 1983-10-11 Vlahos-Gottschalk Research Corp., (Now) Ultimatte Corp. Encoded signal color image compositing
US4500919A (en) * 1982-05-04 1985-02-19 Massachusetts Institute Of Technology Color reproduction system
US4525736A (en) * 1982-09-13 1985-06-25 Ventures Research & Development Group Selective color modification
US4533938A (en) * 1982-12-20 1985-08-06 Rca Corporation Color modifier for composite video signals
US4589013A (en) * 1983-06-13 1986-05-13 501 Ultimatte Corporation Automated encoded signal color image compositing
US4609916A (en) * 1983-05-10 1986-09-02 Thomson Csf Method and device for displaying primary colors utilizing input values representative of brightness, saturation and hue of a colored background
US4621280A (en) * 1984-03-15 1986-11-04 Kabushiki Kaisha Toshiba Digital chromakey apparatus
US4625231A (en) * 1984-04-27 1986-11-25 Ultimatte Corporation Comprehensive electronic compositing system
US4630101A (en) * 1982-10-18 1986-12-16 Nec Corporation Chromakey signal producing apparatus
US4667221A (en) * 1984-08-16 1987-05-19 Quantel Limited Video editing systems with allowable range for key signal set by detecting the range in a selected area

Patent Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3560638A (en) * 1968-04-22 1971-02-02 Central Dynamics Chroma deying system utilizing remote controlled chroma keyer
US3959813A (en) * 1973-12-08 1976-05-25 Robert Bosch G.M.B.H. Generation of a switching signal for the chroma keying of color video signals
US4109278A (en) * 1975-03-21 1978-08-22 Sonex International Corp. Video traveling matte system
US4051520A (en) * 1975-08-20 1977-09-27 U.S. Philips Corporation Color television chroma keying signal generator
US4007487A (en) * 1975-09-25 1977-02-08 The Association Of Motion Picture And Television Producers Inc. Electronic composite photography with color control
US4096523A (en) * 1976-06-29 1978-06-20 Belmares Sarabia Armand Color correction system
US4394680A (en) * 1980-04-01 1983-07-19 Matsushita Electric Industrial Co., Ltd. Color television signal processing apparatus
US4396939A (en) * 1980-06-09 1983-08-02 Nippon Electric Co., Ltd. Chromakey effect apparatus
US4386363A (en) * 1981-04-10 1983-05-31 Ampex Corporation Chroma key switching signal generator
US4409611A (en) * 1981-09-24 1983-10-11 Vlahos-Gottschalk Research Corp., (Now) Ultimatte Corp. Encoded signal color image compositing
US4500919A (en) * 1982-05-04 1985-02-19 Massachusetts Institute Of Technology Color reproduction system
US4525736A (en) * 1982-09-13 1985-06-25 Ventures Research & Development Group Selective color modification
US4630101A (en) * 1982-10-18 1986-12-16 Nec Corporation Chromakey signal producing apparatus
US4533938A (en) * 1982-12-20 1985-08-06 Rca Corporation Color modifier for composite video signals
US4609916A (en) * 1983-05-10 1986-09-02 Thomson Csf Method and device for displaying primary colors utilizing input values representative of brightness, saturation and hue of a colored background
US4589013A (en) * 1983-06-13 1986-05-13 501 Ultimatte Corporation Automated encoded signal color image compositing
US4621280A (en) * 1984-03-15 1986-11-04 Kabushiki Kaisha Toshiba Digital chromakey apparatus
US4625231A (en) * 1984-04-27 1986-11-25 Ultimatte Corporation Comprehensive electronic compositing system
US4667221A (en) * 1984-08-16 1987-05-19 Quantel Limited Video editing systems with allowable range for key signal set by detecting the range in a selected area

Cited By (91)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4953008A (en) * 1986-09-08 1990-08-28 Encore Video, Inc. Method and apparatus for uniform saturation, hue and luminance correction
US4954881A (en) * 1986-09-08 1990-09-04 Encore Video, Inc. Method and apparatus for correcting video color signals
US4882622A (en) * 1987-09-18 1989-11-21 Toppan Printing Co., Ltd. Silhouette cutting apparatus
US5179642A (en) * 1987-12-14 1993-01-12 Hitachi, Ltd. Image synthesizing apparatus for superposing a second image on a first image
US5008754A (en) * 1988-03-23 1991-04-16 Du Pont Pixel Systems, Limited Analog controlled mixer
US5459823A (en) * 1990-07-05 1995-10-17 Canon Kabushiki Kaisha Graphics engine for true colour 2D graphics
US5677644A (en) * 1990-07-05 1997-10-14 Canon Kabushiki Kaisha Ramp generating structure for producing color graphics
US5646750A (en) * 1991-06-05 1997-07-08 Sony Corporation Method and apparatus for compressing video in a manner characteristic of photographic film
US5255083A (en) * 1991-06-05 1993-10-19 Sony Corporation Of America Digital color correction system and method
DE4228532B4 (en) * 1991-08-30 2005-12-29 Samsung Electronics Co., Ltd., Suwon Video signal processor for superimposing on-screen information
DE4228532A1 (en) * 1991-08-30 1993-03-04 Samsung Electronics Co Ltd FADER CIRCUIT FOR DISPLAYING INFORMATION ON A SCREEN
US5249039A (en) * 1991-11-18 1993-09-28 The Grass Valley Group, Inc. Chroma key method and apparatus
US5382980A (en) * 1991-12-30 1995-01-17 U.S. Philips Corporation Method of and arrangement for inserting a background signal into parts of a foreground signal fixed by a predetermined key color
US5381184A (en) * 1991-12-30 1995-01-10 U.S. Philips Corporation Method of and arrangement for inserting a background signal into parts of a foreground signal fixed by a predetermined key color
US5469536A (en) * 1992-02-25 1995-11-21 Imageware Software, Inc. Image editing system including masking capability
US5577179A (en) * 1992-02-25 1996-11-19 Imageware Software, Inc. Image editing system
US5687306A (en) * 1992-02-25 1997-11-11 Image Ware Software, Inc. Image editing system including sizing function
US5850471A (en) * 1993-04-09 1998-12-15 Pandora International, Ltd. High-definition digital video processing system
US5450500A (en) * 1993-04-09 1995-09-12 Pandora International Ltd. High-definition digital video processor
US5923365A (en) * 1993-10-12 1999-07-13 Orad Hi-Tech Systems, Ltd Sports event video manipulating system for highlighting movement
US5422674A (en) * 1993-12-22 1995-06-06 Digital Equipment Corporation Remote display of an image by transmitting compressed video frames representing background and overlay portions thereof
US5493638A (en) * 1993-12-22 1996-02-20 Digital Equipment Corporation Remote display of an image by transmitting compressed video frames representing back-ground and overlay portions thereof
US5630037A (en) * 1994-05-18 1997-05-13 Schindler Imaging, Inc. Method and apparatus for extracting and treating digital images for seamless compositing
US5528309A (en) * 1994-06-28 1996-06-18 Sigma Designs, Incorporated Analog video chromakey mixer
US6501512B2 (en) 1994-06-28 2002-12-31 Sigma Designs, Inc. Method and apparatus for automatic calibration of analog video chromakey mixer
US6421096B1 (en) 1994-06-28 2002-07-16 Sigman Designs, Inc. Analog video chromakey mixer
WO1996001027A1 (en) * 1994-06-28 1996-01-11 Sigma Designs, Incorporated Analog video chromakey mixer
US5719640A (en) * 1994-09-10 1998-02-17 U.S. Philips Corporation Chromakey method and associated circuit arrangement
EP0870295A1 (en) * 1994-12-12 1998-10-14 Auravision Corporation Multimedia overlay system for graphics and video
EP0870295A4 (en) * 1994-12-12 1998-12-02 Auravision Corp Multimedia overlay system for graphics and video
US6545726B2 (en) * 1995-01-18 2003-04-08 Sony Corporation Color conversion apparatus for image data and color conversion method for image data
US5710602A (en) * 1995-09-29 1998-01-20 Intel Corporation Gain correction for encoding video images
US5915044A (en) * 1995-09-29 1999-06-22 Intel Corporation Encoding video images using foreground/background segmentation
US5912700A (en) * 1996-01-10 1999-06-15 Fox Sports Productions, Inc. System for enhancing the television presentation of an object at a sporting event
US5886747A (en) * 1996-02-01 1999-03-23 Rt-Set Prompting guide for chroma keying
US6020931A (en) * 1996-04-25 2000-02-01 George S. Sheng Video composition and position system and media signal communication system
US5874988A (en) * 1996-07-08 1999-02-23 Da Vinci Systems, Inc. System and methods for automated color correction
US5986718A (en) * 1996-09-19 1999-11-16 Video Magic, Inc. Photographic method using chroma-key and a photobooth employing the same
US6124897A (en) * 1996-09-30 2000-09-26 Sigma Designs, Inc. Method and apparatus for automatic calibration of analog video chromakey mixer
US20010026319A1 (en) * 1996-10-22 2001-10-04 Fox Sports Productions, Inc. Method and apparatus for enhancing the broadcast of a live event
US5917553A (en) * 1996-10-22 1999-06-29 Fox Sports Productions Inc. Method and apparatus for enhancing the broadcast of a live event
US6141060A (en) * 1996-10-22 2000-10-31 Fox Sports Productions, Inc. Method and apparatus for adding a graphic indication of a first down to a live video of a football game
US20070085908A1 (en) * 1996-10-22 2007-04-19 Fox Sports Production, Inc. A method and apparatus for enhancing the broadcast of a live event
US7154540B2 (en) 1996-10-22 2006-12-26 Fox Sports Productions, Inc. System for enhancing video
US6072537A (en) * 1997-01-06 2000-06-06 U-R Star Ltd. Systems for producing personalized video clips
US5953077A (en) * 1997-01-17 1999-09-14 Fox Sports Productions, Inc. System for displaying an object that is not visible to a camera
US6252632B1 (en) 1997-01-17 2001-06-26 Fox Sports Productions, Inc. System for enhancing a video presentation
WO1999040562A1 (en) * 1998-02-09 1999-08-12 Joseph Lev Video camera computer touch screen system
US6351557B1 (en) 1998-04-03 2002-02-26 Avid Technology, Inc. Method and apparatus for color manipulation
US6597406B2 (en) 1998-09-04 2003-07-22 Sportvision, Inc. System for enhancing a video presentation of a live event
US6266100B1 (en) 1998-09-04 2001-07-24 Sportvision, Inc. System for enhancing a video presentation of a live event
US6229550B1 (en) 1998-09-04 2001-05-08 Sportvision, Inc. Blending a graphic
US6417891B1 (en) 1999-04-16 2002-07-09 Avid Technology, Inc. Color modification on a digital nonlinear editing system
US20070046688A1 (en) * 1999-04-16 2007-03-01 Robert Gonsalves Source color modification on a digital nonlinear editing system
US6933948B2 (en) 1999-04-16 2005-08-23 Avid Technology, Inc. Multi-tone representation of a digital image on a digital nonlinear editing system
US7973800B2 (en) 1999-04-16 2011-07-05 Avid Technology, Inc. Source color modification on a digital nonlinear editing system
US20030071824A1 (en) * 1999-04-16 2003-04-17 Robert Gonsalves Multi-tone representation of a digital image on a digital nonlinear editing system
US6552731B1 (en) 1999-04-16 2003-04-22 Avid Technology, Inc. Multi-tone representation of a digital image on a digital nonlinear editing system
US6571255B1 (en) 1999-04-16 2003-05-27 Robert Gonsalves Modification of media with common attributes on a digital nonlinear editing system
US20030197710A1 (en) * 1999-04-16 2003-10-23 Avid Technology, Inc. Graphical user interface for color correction
US6288753B1 (en) * 1999-07-07 2001-09-11 Corrugated Services Corp. System and method for live interactive distance learning
US7492363B2 (en) 1999-10-21 2009-02-17 Sportsvision, Inc. Telestrator system
US7928976B2 (en) 1999-10-21 2011-04-19 Sportvision, Inc. Telestrator system
US20100238163A1 (en) * 1999-10-21 2010-09-23 Sportvision, Inc. Telestrator System
US20060087504A1 (en) * 1999-10-21 2006-04-27 Meier Kevin R Telestrator system
US7075556B1 (en) 1999-10-21 2006-07-11 Sportvision, Inc. Telestrator system
US7750901B2 (en) 1999-10-21 2010-07-06 Sportvision, Inc. Telestrator system
US20090128580A1 (en) * 1999-10-21 2009-05-21 Sportvision, Inc. Telestrator System
US6909438B1 (en) 2000-02-04 2005-06-21 Sportvision, Inc. Video compositor
EP1143745A2 (en) * 2000-02-29 2001-10-10 Canon Kabushiki Kaisha Image processing apparatus
EP1143745A3 (en) * 2000-02-29 2005-03-23 Canon Kabushiki Kaisha Image processing apparatus
US6763134B2 (en) 2000-04-07 2004-07-13 Avid Technology, Inc. Secondary color modification of a digital image
US6477271B1 (en) 2000-04-07 2002-11-05 Avid Technology, Inc. Secondary color modification of a digital image
US20040240729A1 (en) * 2000-04-07 2004-12-02 Cooper Brian C. Secondary color modification of a digital image
US6928187B2 (en) 2000-04-07 2005-08-09 Avid Technology, Inc. Secondary color modification of a digital image
US20020122046A1 (en) * 2001-03-01 2002-09-05 Dischert Lee R. Method and apparatus for keying of secondary video into primary video
US20060055707A1 (en) * 2004-09-10 2006-03-16 Fayan Randy M Graphical user interface for a keyer
US9148639B2 (en) * 2005-12-20 2015-09-29 Savant Systems, Llc Apparatus and method for mixing graphics with video images
US8098330B2 (en) 2006-07-28 2012-01-17 International Business Machines Corporation Mapping of presentation material
US20080111922A1 (en) * 2006-07-28 2008-05-15 International Business Machines Corporation Mapping of presentation material
US20130198615A1 (en) * 2006-08-01 2013-08-01 Abbyy Software Ltd. Creating Flexible Structure Descriptions
US8908969B2 (en) * 2006-08-01 2014-12-09 Abbyy Development Llc Creating flexible structure descriptions
US8045060B2 (en) * 2006-10-04 2011-10-25 Hewlett-Packard Development Company, L.P. Asynchronous camera/projector system for video segmentation
US20080084508A1 (en) * 2006-10-04 2008-04-10 Cole James R Asynchronous camera/ projector system for video segmentation
US8326043B2 (en) * 2007-04-13 2012-12-04 Ipharro Media Gmbh Video detection system and methods
US20130163864A1 (en) * 2007-04-13 2013-06-27 Ipharro Media Gmbh Video detection system and methods
US20100329547A1 (en) * 2007-04-13 2010-12-30 Ipharro Media Gmbh Video detection system and methods
US8731286B2 (en) * 2007-04-13 2014-05-20 Ipharro Media Gmbh Video detection system and methods
US9215383B2 (en) 2011-08-05 2015-12-15 Sportsvision, Inc. System for enhancing video from a mobile camera
US20150109463A1 (en) * 2013-10-19 2015-04-23 Motorola Solutions, Inc Method and system for generating modified display data
US11593947B2 (en) 2020-03-10 2023-02-28 Cisco Technology, Inc. Automatic adjusting background

Also Published As

Publication number Publication date
AU1080988A (en) 1988-06-30
WO1988004510A1 (en) 1988-06-16
CA1320760C (en) 1993-07-27
GB8818818D0 (en) 1988-10-05
GB2207025A (en) 1989-01-18

Similar Documents

Publication Publication Date Title
US4811084A (en) Video color detector and chroma key device and method
US4763186A (en) Color correction system with monitor for use in recalling color corrections and corresponding method
CA2062631C (en) Image sensing apparatus having plurality of optical systems and method of operating such apparatus
US4393394A (en) Television image positioning and combining system
US4862251A (en) Color correction system and method
EP0171829B1 (en) Improvements relating to video editing systems
US5179449A (en) Scene boundary detecting apparatus
EP0942608B1 (en) Video signal processor and color video camera
US3778542A (en) Blue screen travelling matte system
US5412487A (en) Video camera and apparatus for extracting an object
US4954883A (en) Interweave picture comparison apparatus and method
US4386363A (en) Chroma key switching signal generator
NL8101432A (en) WHITE BALANCE SCHEME FOR A COLOR TV.
US5305094A (en) Digital video signal color detector, corrector and method
JP2002135789A (en) Imaging apparatus, its signal processing method and storage medium with module for perform signal processing
US5473371A (en) Window generating apparatus for use in a video camera
AU597657B2 (en) Color correction with programmable window area
US4636838A (en) Generating a chroma keying signal
EP1215677A1 (en) Video editing apparatus selecting representative video images
US6704045B1 (en) Method of automatically identifying and modifying the appearance of an object in successive frames of a video sequence
GB2349030A (en) Automatic gain control
CA1326288C (en) Color correction system and method
CA1340165C (en) Color correction system and method
CA1088199A (en) Contrast correction arrangements
CA1326071C (en) Color correction system and method

Legal Events

Date Code Title Description
AS Assignment

Owner name: CORPORATE COMMUNICATIONS CONSULTANTS, INC., 64 CLI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNORS:BELMARES-SARABIA, ARMAND;CHAYKA, STANLEY J.;REEL/FRAME:004730/0342

Effective date: 19861209

Owner name: CORPORATE COMMUNICATIONS CONSULTANTS, INC.,NEW JER

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BELMARES-SARABIA, ARMAND;CHAYKA, STANLEY J.;REEL/FRAME:004730/0342

Effective date: 19861209

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

SULP Surcharge for late payment
REMI Maintenance fee reminder mailed
REMI Maintenance fee reminder mailed
AS Assignment

Owner name: INPROP, INC., NEW JERSEY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CORPORATE COMMUNICATIONS CONSULTANTS, INC.;REEL/FRAME:006607/0140

Effective date: 19930623

AS Assignment

Owner name: RANK CINTEL INC., A CORP. OF DE, GEORGIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INPROP, INC., A CORP. OF NJ;REEL/FRAME:007492/0133

Effective date: 19950518

FEPP Fee payment procedure

Free format text: PAT HLDR NO LONGER CLAIMS SMALL ENT STAT AS SMALL BUSINESS (ORIGINAL EVENT CODE: LSM2); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 8

AS Assignment

Owner name: CINTEL INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RANK CINTEL INC.;REEL/FRAME:008307/0208

Effective date: 19960928

REMI Maintenance fee reminder mailed
FPAY Fee payment

Year of fee payment: 12

SULP Surcharge for late payment

Year of fee payment: 11