(54) METHOD AND SYSTEM FOR EXTRACTING KEY FRAMES FROM VIDEO USING A TRIANGLE MODEL OF MOTION BASED ON PERCEIVED MOTION ENERGY
(75) Inventors: HongJiang Zhang, Beijing (CN);
Tianming Liu, Upper Darby, PA (US)
(73) Assignee: Microsoft Corporation, Redmond, WA (US)
( * ) Notice: Subject to any disclaimer, the term of this patent is extended or adjusted under 35 U.S.C. 154(b) by 165 days.
(21) Appl. No.: 11/305,909
(22) Filed: Dec. 17, 2005
(65) Prior Publication Data
US 2006/0093040 Al May 4, 2006
Related U.S. Application Data
(63) Continuation of application No. 10/346,160, filed on Jan. 15, 2003, now Pat. No. 7,027,513.
(51) Int. CI.
H04B 1/66 (2006.01)
(52) U.S. CI 375/240.16; 375/240.13;
375/240.08; 375/240.01; 348/699; 348/222; 382/173; 382/107; 382/190; 382/243
(58) Field of Classification Search 375/240.16,
375/240.13, 240.08, 240.01; 348/699, 222;
382/173, 107, 190, 243 See application file for complete search history.
A key frame extraction system and method for extracting key frames from a video based on motion analysis of frames within the video. Key frames are highlight frames that are effective in summarizing a video sequence. This allows a user to quickly find a desired spot in a video is long and contains differing subject matter. The key frame extraction system and method uses a triangle model of the motion energy in each frame and extracts key frames based on this model. More specifically, motion analysis is performed on the video frames in order to identify motion acceleration and motion deceleration points within the frames. A triangle model of motion then is constructed based on results of the motion analysis. The apex of the triangle represents a turning point between motion acceleration and motion deceleration. Frames corresponding to this apex are selected as key frames.
20 Claims, 15 Drawing Sheets
