US20010012062A1 - System and method for automatic analysis and categorization of images in an electronic imaging device - Google Patents

System and method for automatic analysis and categorization of images in an electronic imaging device Download PDF

Info

Publication number
US20010012062A1
US20010012062A1 US09/121,760 US12176098A US2001012062A1 US 20010012062 A1 US20010012062 A1 US 20010012062A1 US 12176098 A US12176098 A US 12176098A US 2001012062 A1 US2001012062 A1 US 2001012062A1
Authority
US
United States
Prior art keywords
images
analysis module
analysis
image data
different categories
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US09/121,760
Inventor
Eric C. Anderson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IPAC SUB
Secure Cam LLC
IPAC Acquisition Subsidiary I LLC
KDL Scan Designs LLC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US09/121,760 priority Critical patent/US20010012062A1/en
Application filed by Individual filed Critical Individual
Assigned to FLASHPOINT TECHNOLOGY, INC. reassignment FLASHPOINT TECHNOLOGY, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ANDERSON, ERIC C.
Priority to PCT/US1999/016008 priority patent/WO2000005875A1/en
Priority to AU51036/99A priority patent/AU5103699A/en
Priority to US09/430,235 priority patent/US6914625B1/en
Publication of US20010012062A1 publication Critical patent/US20010012062A1/en
Assigned to IPAC SUB reassignment IPAC SUB ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FLASHPOINT TECHNOLOGY, INC.
Assigned to IPAC ACQUISITION SUBSIDIARY I, LLC reassignment IPAC ACQUISITION SUBSIDIARY I, LLC ASSIGNMENT CORRECTION,REEL/FRAME:013056/0062 Assignors: FLASHPOINT TECHNOLOGY, INC.
Assigned to IPAC ACQUISITION SUBSIDIARY I, LLC reassignment IPAC ACQUISITION SUBSIDIARY I, LLC CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY, FILED ON 07/05/2002, RECORDED ON REEL 013066 FRAME 0062. Assignors: FLASHPOINT TECHNOLOGY, INC.
Assigned to FLASHPOINT TECHNOLOGY, INC. reassignment FLASHPOINT TECHNOLOGY, INC. SECURITY AGREEMENT Assignors: IPAC ACQUISITION SUBSIDIARY I, LLC
Assigned to FLASHPOINT TECHNOLOGY, INC. reassignment FLASHPOINT TECHNOLOGY, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: IPAC ACQUISITION SUBSIDIARY I, LLC
Priority to US11/156,044 priority patent/US7567276B2/en
Priority to US11/158,658 priority patent/US7602424B2/en
Priority to US12/576,702 priority patent/US8350928B2/en
Assigned to KDL SCAN DESIGNS LLC reassignment KDL SCAN DESIGNS LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FOTOMEDIA TECHNOLOGIES, LLC
Priority to US13/401,462 priority patent/US8531555B2/en
Priority to US14/017,087 priority patent/US8836819B2/en
Priority to US14/465,572 priority patent/US9363408B2/en
Assigned to SECURE CAM, LLC reassignment SECURE CAM, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: INTELLECTUAL VENTURES ASSETS 48 LLC
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21Intermediate information storage
    • H04N1/2104Intermediate information storage for one or a few pictures
    • H04N1/2112Intermediate information storage for one or a few pictures using still video cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/63Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2101/00Still video cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/3226Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3225Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to an image, a page or a document
    • H04N2201/325Modified version of the image, e.g. part of the image, image reduced in size or resolution, thumbnail or screennail

Definitions

  • This invention relates generally to electronic data processing, and relates more particularly to a system and method for the automatic analysis and categorization of images in an electronic imaging device.
  • the present invention comprises a system and method for the automatic analysis and categorization of images in an electronic imaging device, such as a digital camera.
  • a digital camera captures a selected image as CCD raw data, stores the raw data as image data into an individual image file, and then propagates the image file through the digital camera for processing and formatting of the image data.
  • the image data is initially converted into an RGB format, and then, selected analysis modules may connect through an RGB insertion point to advantageously analyze the image data at an RGB transition point, in accordance with the present invention.
  • a particular analysis module analyzes the final line of the image data, then that analysis module preferably generates any appropriate category tags and stores the generated category tags into a blank category tag location in the image file.
  • the digital camera may then subsequently access the stored category tags to automatically categorize and utilize the individual stored images (which each correspond to a separate image file).
  • another image processing module preferably performs gamma correction and color space conversion on the image data.
  • the image processing module also preferably converts the color space format of the image data.
  • the image data is converted into YCC 444 format.
  • analysis modules may be plugged into a YCC insertion point to analyze the image data at a YCC transition point, in accordance with the present invention.
  • a particular analysis module analyzes the final line of the image data
  • that analysis module preferably generates any appropriate category tags and stores the generated category tags into a blank category tag location in the image file for subsequent use by the camera to automatically categorize captured images.
  • analysis modules may readily analyze image data at any other time or insertion point within the camera.
  • an image processing module preferably performs a sharpening procedure on the image data, and also may perform a variety of other processing options. Then, an image processing module preferably decimates the image data, and the image data is compressed into a final image format (preferably JPEG.) Next, a file formatter preferably formats the compressed image file, and the resulting image file is finally saved into a removable memory device.
  • a final image format preferably JPEG.
  • the image file thus includes any appropriate category tags, and the camera may then subsequently utilize the category tags to automatically access selected images, in accordance with the present invention.
  • the present invention therefore provides an efficient system and method for automatically analysis and categorization of captured images in an electronic imaging device.
  • FIG. 1 is a block diagram of one embodiment for a digital camera, according to the present invention.
  • FIG. 2 is a block diagram of one embodiment for the imaging device of FIG. 1, according to the present invention.
  • FIG. 3 is a block diagram of one embodiment for the camera computer of FIG. 1;
  • FIG. 4 is a rear elevation view of one embodiment for the FIG. 1 digital camera
  • FIG. 5 is a diagram one embodiment for the non-volatile memory of FIG. 3, according to the present invention.
  • FIG. 6 is a diagram of one embodiment for the dynamic random-access memory of FIG. 3, according to the present invention.
  • FIG. 7 is a diagram of one embodiment for a single analysis module of FIG. 6, according to the present invention.
  • FIG. 8 is a diagram of one embodiment for an image file, in accordance with the present invention.
  • FIG. 9 is a diagram of one embodiment for the image tags of FIG. 8.
  • FIG. 10 is a flowchart for one embodiment of method steps to automatically analyze and categorize images, according to the present invention.
  • the present invention relates to an improvement in digital imaging devices, including digital cameras.
  • digital imaging devices including digital cameras.
  • the following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements.
  • the present invention will be described in the context of a digital camera, various modifications to the preferred embodiment will be readily apparent to those skilled in the art and the generic principles herein may be applied to various other embodiments. That is, any imaging device, which captures image data, could incorporate the features described hereinbelow and that device would be within the spirit and scope of the present invention.
  • the present invention is not intended to be limited to the embodiment shown, but is to be accorded the widest scope consistent with the principles and features described herein.
  • the present invention comprises one or more analysis modules that examine captured image files for selected criteria.
  • the analysis modules then responsively generate and store appropriate category tags along with the image file to advantageously enable the imaging device to subsequently access the stored category tags and thereby automatically access desired categories of captured images.
  • Camera 110 preferably comprises an imaging device 114 , a system bus 116 , and a camera computer 118 .
  • Imaging capture device 114 may be optically coupled to an object 112 and electrically coupled via system bus 116 to camera computer 118 .
  • camera computer 118 commands imaging capture device 114 via system bus 116 to capture raw image data representing object 112 .
  • the captured raw image data is transferred over system bus 116 to camera computer 118 , which performs various image-processing functions on the image data.
  • System bus 116 also passes various status and control signals between imaging capture device 114 and camera computer 118 .
  • Imaging device 114 preferably comprises a lens 220 having an iris (not shown), a filter 222 , an image sensor 224 , a timing generator 226 , an analog signal processor (ASP) 228 , an analog-to-digital (A/D) converter 230 , an interface 232 , and one or more motors 234 to adjust focus of lens 220 .
  • a lens 220 having an iris (not shown), a filter 222 , an image sensor 224 , a timing generator 226 , an analog signal processor (ASP) 228 , an analog-to-digital (A/D) converter 230 , an interface 232 , and one or more motors 234 to adjust focus of lens 220 .
  • ASP analog signal processor
  • A/D analog-to-digital
  • Imaging capture device 114 captures an image of object 112 via reflected light impacting image sensor 224 along optical path 236 .
  • Image sensor 224 which is preferably a charged-coupled device (CCD) responsively generates a set of raw image data in CCD format representing the captured image 112 .
  • the raw image data is then routed through ASP 228 A/D converter 230 , and interface 232 .
  • Interface 232 has outputs for controlling ASP 228 , motors 234 and timing generator 226 . From interface 232 , the raw image data passes over system bus 116 to camera computer 118 .
  • System bus 116 provides communication between imaging capture device 114 , electrically-erasable programmable read-only memory (EEPROM) 341 , optional power manager 342 , central processing unit (CPU) 344 , dynamic random-access memory (DRAM) 346 , camera input/output (I/O) 348 , non-volatile memory 350 , and buffers/connector 352 .
  • Removable memory 354 connects to system bus 116 via buffers/connector 352 .
  • camera 110 may also readily be implemented without removable memory 354 or buffers/connector 352 .
  • Power manager 342 communicates via line 366 with power supply 356 and coordinates power management operations for camera 110 .
  • CPU 344 preferably includes a processor device for controlling the operation of camera 110 .
  • CPU 344 is capable of concurrently running multiple software routines to control the various processes of camera 110 within a multi-threading environment.
  • DRAM 346 is a contiguous block of dynamic memory, which may be selectively allocated to various storage functions.
  • LCD controller 390 accesses DRAM 346 and transfers processed image data to LCD screen 302 for display.
  • Camera I/O 348 is an interface device allowing communications to and from camera computer 118 .
  • camera I/O 348 permits an external host computer (not shown) to connect to and communicate with camera computer 118 .
  • Camera I/O 348 may also interface with a plurality of buttons and/or dials 304 , and an optional status LCD 306 , which, in addition to LCD screen 302 , are the hardware elements of the camera's user interface 308 .
  • Non-volatile memory 350 which preferably comprises a conventional read-only memory or flash memory, stores a set of computer-readable program instructions to control the operation of camera 110 .
  • Removable memory 354 serves as an additional image data storage area and is preferably a non-volatile device, readily removable and replaceable by a camera user via buffers/connector 352 . Thus, a user who possesses several removable memories 354 may replace a full removable memory 354 with an empty removable memory 354 to effectively expand the picture-taking capacity of camera 110 .
  • removable memory 354 is preferably implemented using a flash disk.
  • Power supply 356 provides operating power to the various components of camera 110 via main power bus 362 and secondary power bus 364 .
  • the main power bus 362 provides power to imaging capture device 114 , camera I/O 348 , non-volatile memory 350 and removable memory 354
  • secondary power bus 364 provides power to power manager 342 , CPU 344 and DRAM 346 .
  • Power supply 356 is connected to main batteries 358 and also to backup batteries 360 . Camera 110 user may also connect power supply 356 to an optional external power source. During normal operation of power supply 356 , main batteries 358 provide operating power to power supply 356 which then provides the operating power to camera 110 via both main power bus 362 and secondary power bus 364 . During a power failure mode where main batteries 358 have failed (i.e., when their output voltage has fallen below a minimum operational voltage level), backup batteries 360 provide operating power to power supply 356 which then provides operating power only to the secondary power bus 364 of camera 110 .
  • FIG. 4 a rear elevation view of one embodiment for camera 110 of FIG. 1 is shown.
  • the FIG. 4 representation depicts hardware components of user interface 308 of camera 110 , showing LCD screen 302 , user interface 308 , a four-way navigation control button 409 , an overlay button 412 , a menu button 414 , and a set of programmable soft keys 416 .
  • User interface 308 includes several operating modes for supporting various camera functions.
  • operating modes may include capture mode, review mode, play mode, and PC-connect mode.
  • capture mode menu options are available to set-up the categories used during image capture. The user preferably switches between the camera modes by selecting a mode dial (not shown).
  • FIG. 5 a diagram one embodiment for the non-volatile memory 350 of FIG. 3 is shown.
  • the FIG. 5 diagram includes control application 500 , toolbox 502 , drivers 504 , kernel 506 , and system configuration 508 .
  • Control application 500 comprises program instructions for controlling and coordinating the various functions of camera 110 .
  • Toolbox 502 contains selected function modules including image processing backplane 510 , image processing modules 512 , menu and dialog manager 514 , and file formatter 516 .
  • Image processing backplane 510 includes software routines that coordinate the functioning and communication of various image processing modules 512 and handle the data flow between the various modules.
  • Image processing modules 512 preferably include selectable plug-in software routines that manipulate captured image data in a variety of ways, depending on the particular modules selected.
  • Menu and dialog manager 514 includes software routines which provide information for controlling access to camera control menus and camera control menu items for access to features in camera 1 10 .
  • File formatter 516 includes software routines for creating an image file from the processed image data.
  • Drivers 504 control various hardware devices within camera 110 (for example, motors 234 ).
  • Kernel 506 provides basic underlying services for the camera 110 operating system.
  • System configuration 508 performs initial start-up routines for camera 110 , including the boot routine and initial system diagnostics.
  • DRAM 346 includes RAM disk 532 , system area 534 , analysis modules 540 and working memory 530 .
  • RAM disk 532 is a memory area used for storing raw and compressed image data and is organized in a “sectored” format similar to that of conventional hard disk drives.
  • a conventional and standardized file system permits external host computer systems, via I/O 348 , to recognize and access the data stored on RAM disk 532 .
  • System area 534 stores data regarding system errors (e.g., why a system shutdown occurred) for use by CPU 344 to restart computer 118 .
  • Working memory 530 includes stacks, data structures and variables used by CPU 344 while executing the software routines used within camera computer 118 .
  • Working memory 530 also includes input buffers 538 for initially storing sets of image data received from imaging device 114 for image conversion, and frame buffers 536 for storing data to display on LCD screen 302 .
  • analysis modules 540 preferably each include one or more software routines for automatically analyzing and categorizing images.
  • analysis modules 540 may be loaded into RAM 346 from removable memory 354 or another external source. Analysis modules 540 further discussed below in conjunction with FIGS. 7 through 10.
  • Analysis module 540 includes text category list 610 , combination logic 615 , analysis algorithms 630 , and parametric control 635 .
  • Text category list 610 is a listing of the various possible image categories available for a given analysis module 540 .
  • Combination logic 615 determines how to resolve the results of the image analysis when multiple analysis algorithms 630 are utilized.
  • Parametric control 635 is used to control settable parameters for analysis module 540 .
  • analysis module may be turned on/off, or sensitivity settings for analysis module 540 may be controlled with parametric control 635 .
  • Analysis algorithms 630 are a series of software routines ranging from analysis algorithm 1 ( 620 ) through analysis algorithm n ( 625 .) Analysis algorithms 630 are each designed to allow analysis module 540 to access and analyze images at various stages in the processing chain of camera 110 , in order to gather information about the image for later categorization.
  • each analysis algorithm 630 is designed to detect at least one image category.
  • individual analysis algorithms 630 may be designed to detect a person or groups of people based on characteristics like substantial amounts of flesh tones within the image.
  • Individual analysis algorithms 630 may likewise be designed to detect nature scenes from characteristics like substantial green content in the image combined with the relative lack of hard edges.
  • categories like city images, water images or indoor images may be detected by characteristic features contained in those images.
  • image file 835 includes a header 805 , image data 810 , a screennail 815 , a thumbnail 820 , and image tags 825 .
  • Header 805 preferably includes information that identifies and describes the various contents of image file 835 .
  • Image data 810 contains actual captured image data. Image data 810 exists in whichever format that is appropriate for the current location of image file 835 within the image processing chain of camera 110 .
  • Screennail 815 and thumbnail 820 are each different versions of image data 810 that have varying degrees of reduced resolution for a number of special viewing applications.
  • Image tags 825 includes various types of information that correspond and relate to particular captured image data 810 . Image tags 825 are further discussed below in conjunction with FIG. 9.
  • image tags 825 include capture information tags 710 , user tags 715 , product tags 720 , and category tags 735 .
  • Capture information tags 710 preferably include various types of information that correlate with the captured image data 810 (FIG. 8). For example, capture information tags 710 may indicate focus setting, aperture setting, and other relevant information that may be useful for effectively processing or analyzing the corresponding image data 810 . User tags 715 and product tags 720 typically contain various other information that may be needed for use with camera 110 .
  • Category tags 735 are each preferably generated by analysis modules 540 after analysis modules 540 individually examine image data 810 from image file 835 , in accordance with the present invention. Camera 110 may thus advantageously access and utilize category tags 735 to identify one or more categories to which a given set of image data 810 may likely relate. As discussed above in conjunction with FIG. 7, category tags 735 may correspond to a wide variety of possible image categories. In the preferred embodiment, image tags 825 initially contains sixteen empty locations to which various analysis modules 540 may write appropriate category tags 735 for automatically categorizing the corresponding image data 810 , in accordance with the present invention.
  • FIG. 10 a flowchart is shown for one embodiment of method steps to automatically analyze and categorize images, according to the present invention.
  • FIG. 10 also details the operation of a series of plug-in image processing modules 512 for processing and formatting image data 810 .
  • plug-in image processing modules 512 for processing and formatting image data 810 .
  • various other modules may readily be substituted or added to those modules discussed in below conjunction with the FIG. 10 embodiment.
  • camera 110 preferably captures a selected image as CCD raw data, stores the raw data as image data 810 into image file 835 , and then propagates image file 835 through camera 110 for processing and formatting of the image data 810 .
  • an image processing module 512 preferably replaces any defective pixels in image data 810 , and also performs white balance and color correction on image data 810 .
  • step 925 another image processing module 512 preferably performs interpolation (edge enhancement) on image data 810 , and then converts image data 810 into an intermediate format.
  • step 925 converts image data 810 into an RGB (Red, Blue, Green) format.
  • selected analysis modules 540 may be plugged into an RGB insertion point 940 to advantageously analyze image data 810 at RGB transition point 930 , in accordance with the present invention.
  • One, some, or all of the analysis modules 540 may analyze image data 810 at RGB transition point 930 .
  • analysis modules 540 are selected for optimal compatibility and effectiveness with the current format of image data 810 at RGB transition point 930 .
  • that analysis module 540 preferably generates any appropriate category tags 735 and stores the generated category tags 735 into a blank category tag location in image file 835 .
  • camera 110 may subsequently access the stored category tags 735 to automatically categorize and utilize the individual stored images (which each correspond to a separate image file 835 ).
  • step 945 another image processing module 512 preferably performs gamma correction and color space conversion on image data 810 .
  • the image processing module 512 also preferably converts the color space format of image data 810 .
  • image data 810 is converted to YCC 444 (Luminance, Chrominance-red, and Chrominance-blue) format.
  • selected analysis modules 540 may be plugged into a YCC insertion point 960 to analyze image data 810 at YCC transition point 950 , in accordance with the present invention.
  • One, some, or all of the analysis modules 540 may analyze image data 810 at YCC transition point 950 .
  • that analysis module 540 preferably generates any appropriate category tags 735 and stores the generated category tags 735 into a blank category tag location in image file 835 for subsequent use by camera 110 to automatically categorize captured images.
  • analysis modules 540 may readily analyze image data 810 at any other time or insertion point within camera 110 .
  • analysis modules 540 may readily be configured to examine image data 810 at capture time, and to specifically recognize and identify the capture of any image that matches one or more selectable parameters.
  • analysis modules 540 may advantageously access image files 835 that have been processed and stored onto removable memory 354 . Analysis modules 540 may then automatically categorize the image files 835 by analyzing image data 810 and responsively generating corresponding category tags 735 , in accordance with the present invention.
  • an image processing module 512 preferably performs a sharpening procedure on image data 810 , and also may perform a variety of other processing options. Then, in step 970 , an image processing module 512 preferably decimates image data 810 . In the preferred embodiment, the decimation process reduces image resolution by decimating the YCC 444 image data to produce YCC 422 or YCC 411 image data
  • step 975 the image data 810 is preferably compressed into a final image format (preferably JPEG.)
  • file formatter 516 preferably formats the compressed image file 835 , and the resulting image file 835 is finally saved into removable memory 354 in step 985 .
  • image file 835 thus includes any appropriate category tags which camera 110 may then subsequently automatically access to sort selected images, in accordance with the present invention.

Abstract

A system and method for the automatic analysis and categorization of images in an electronic imaging device comprises one or more analysis modules that examine captured image files for selected criteria. The analysis modules then responsively generate and store appropriate category tags with the image file to enable the imaging device to subsequently access the stored category tags and automatically access desired categories of captured images.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is related to co-pending U.S. patent application Ser. No. 08/735,705, entitled “System And Method For Correlating Processing Data And Image Data Within A Digital Camera Device,” filed on Oct. 23, 1996, which is hereby incorporated by reference. The related applications are commonly assigned. [0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • This invention relates generally to electronic data processing, and relates more particularly to a system and method for the automatic analysis and categorization of images in an electronic imaging device. [0003]
  • 2. Description of the Background Art [0004]
  • The efficient manipulation of captured image data is a significant consideration for designers, manufacturers, and users of electronic imaging devices. Contemporary imaging devices such as digital cameras effectively enable users to capture images, assemble or edit the captured images, exchange the captured images electronically, or print a hard copy of the captured images. [0005]
  • As a camera user captures a number of digital images, it typically becomes necessary to sort and categorize the digital images. In some systems, a camera user must resort to the cumbersome and time-consuming task of individually viewing each captured image, identifying various groupings of image categories, and somehow manually tagging each image to specify the particular image category. For example, in [0006] Parulski, U.S. Pat. No. 5,633,678, a camera user manually selects a category for a group of images prior to the capture of the images. The camera user must select a new category for each new group of images. Such a manual categorization system is awkward to use and, therefore, does not provide as efficient an imaging device as a camera that features an automatic categorization system.
  • In other systems, software programs are available to permit the user to create thumbnails (smaller renditions of the captured image) and to place the thumbnails, with references to the original images, into various libraries or category systems. This process may also become very time consuming, especially as the number of captured images or the variety of category types increases. [0007]
  • From the preceding discussion, it becomes apparent that an electronic imaging system that manually analyzes and categorizes any significant number of captured images does not achieve an acceptable degree of efficiency. Therefore, an electronic imaging device that automatically analyzes captured images, and then responsively categorizes the analyzed images into one or more selected image groupings, would clearly provide a significant improvement in efficient functionality for various contemporary electronic imaging technologies. [0008]
  • For all the foregoing reasons, an improved system and method are needed for the automatic analysis and categorization of images in an electronic imaging device. [0009]
  • SUMMARY OF THE INVENTION
  • The present invention comprises a system and method for the automatic analysis and categorization of images in an electronic imaging device, such as a digital camera. In the preferred embodiment, a digital camera captures a selected image as CCD raw data, stores the raw data as image data into an individual image file, and then propagates the image file through the digital camera for processing and formatting of the image data. [0010]
  • In the preferred embodiment, the image data is initially converted into an RGB format, and then, selected analysis modules may connect through an RGB insertion point to advantageously analyze the image data at an RGB transition point, in accordance with the present invention. Once a particular analysis module analyzes the final line of the image data, then that analysis module preferably generates any appropriate category tags and stores the generated category tags into a blank category tag location in the image file. The digital camera may then subsequently access the stored category tags to automatically categorize and utilize the individual stored images (which each correspond to a separate image file). [0011]
  • Next, another image processing module preferably performs gamma correction and color space conversion on the image data. The image processing module also preferably converts the color space format of the image data. In the preferred embodiment, the image data is converted into YCC [0012] 444 format.
  • After the image data is converted into YCC [0013] 444 format, selected analysis modules may be plugged into a YCC insertion point to analyze the image data at a YCC transition point, in accordance with the present invention. As discussed above, once a particular analysis module analyzes the final line of the image data, then that analysis module preferably generates any appropriate category tags and stores the generated category tags into a blank category tag location in the image file for subsequent use by the camera to automatically categorize captured images. In other embodiments of the present invention, analysis modules may readily analyze image data at any other time or insertion point within the camera.
  • Next, an image processing module preferably performs a sharpening procedure on the image data, and also may perform a variety of other processing options. Then, an image processing module preferably decimates the image data, and the image data is compressed into a final image format (preferably JPEG.) Next, a file formatter preferably formats the compressed image file, and the resulting image file is finally saved into a removable memory device. [0014]
  • The image file thus includes any appropriate category tags, and the camera may then subsequently utilize the category tags to automatically access selected images, in accordance with the present invention. The present invention therefore provides an efficient system and method for automatically analysis and categorization of captured images in an electronic imaging device. [0015]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of one embodiment for a digital camera, according to the present invention; [0016]
  • FIG. 2 is a block diagram of one embodiment for the imaging device of FIG. 1, according to the present invention; [0017]
  • FIG. 3 is a block diagram of one embodiment for the camera computer of FIG. 1; [0018]
  • FIG. 4 is a rear elevation view of one embodiment for the FIG. 1 digital camera; [0019]
  • FIG. 5 is a diagram one embodiment for the non-volatile memory of FIG. 3, according to the present invention; [0020]
  • FIG. 6 is a diagram of one embodiment for the dynamic random-access memory of FIG. 3, according to the present invention; [0021]
  • FIG. 7 is a diagram of one embodiment for a single analysis module of FIG. 6, according to the present invention; [0022]
  • FIG. 8 is a diagram of one embodiment for an image file, in accordance with the present invention; [0023]
  • FIG. 9 is a diagram of one embodiment for the image tags of FIG. 8; and [0024]
  • FIG. 10 is a flowchart for one embodiment of method steps to automatically analyze and categorize images, according to the present invention. [0025]
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
  • The present invention relates to an improvement in digital imaging devices, including digital cameras. The following description is presented to enable one of ordinary skill in the art to make and use the invention and is provided in the context of a patent application and its requirements. Although the present invention will be described in the context of a digital camera, various modifications to the preferred embodiment will be readily apparent to those skilled in the art and the generic principles herein may be applied to various other embodiments. That is, any imaging device, which captures image data, could incorporate the features described hereinbelow and that device would be within the spirit and scope of the present invention. Thus, the present invention is not intended to be limited to the embodiment shown, but is to be accorded the widest scope consistent with the principles and features described herein. [0026]
  • The present invention comprises one or more analysis modules that examine captured image files for selected criteria. The analysis modules then responsively generate and store appropriate category tags along with the image file to advantageously enable the imaging device to subsequently access the stored category tags and thereby automatically access desired categories of captured images. [0027]
  • Referring now to FIG. 1, a block diagram of one embodiment for a [0028] digital camera 110 is shown. Camera 110 preferably comprises an imaging device 114, a system bus 116, and a camera computer 118. Imaging capture device 114 may be optically coupled to an object 112 and electrically coupled via system bus 116 to camera computer 118. Once a user has focused imaging capture device 114 on object 112 and instructed camera 110 to capture an image of object 112, camera computer 118 commands imaging capture device 114 via system bus 116 to capture raw image data representing object 112. The captured raw image data is transferred over system bus 116 to camera computer 118, which performs various image-processing functions on the image data. System bus 116 also passes various status and control signals between imaging capture device 114 and camera computer 118.
  • Referring now to FIG. 2, a block diagram of one embodiment for [0029] imaging device 114 of FIG. 1 is shown. Imaging device 114 preferably comprises a lens 220 having an iris (not shown), a filter 222, an image sensor 224, a timing generator 226, an analog signal processor (ASP) 228, an analog-to-digital (A/D) converter 230, an interface 232, and one or more motors 234 to adjust focus of lens 220.
  • [0030] Imaging capture device 114 captures an image of object 112 via reflected light impacting image sensor 224 along optical path 236. Image sensor 224, which is preferably a charged-coupled device (CCD), responsively generates a set of raw image data in CCD format representing the captured image 112. The raw image data is then routed through ASP 228 A/D converter 230, and interface 232. Interface 232 has outputs for controlling ASP 228, motors 234 and timing generator 226. From interface 232, the raw image data passes over system bus 116 to camera computer 118.
  • Referring now to FIG. 3, a block diagram of one embodiment for [0031] camera computer 118 of FIG. 1 is shown. System bus 116 provides communication between imaging capture device 114, electrically-erasable programmable read-only memory (EEPROM) 341, optional power manager 342, central processing unit (CPU) 344, dynamic random-access memory (DRAM) 346, camera input/output (I/O) 348, non-volatile memory 350, and buffers/connector 352. Removable memory 354 connects to system bus 116 via buffers/connector 352. In alternate embodiments, camera 110 may also readily be implemented without removable memory 354 or buffers/connector 352.
  • [0032] Power manager 342 communicates via line 366 with power supply 356 and coordinates power management operations for camera 110. CPU 344 preferably includes a processor device for controlling the operation of camera 110. In the preferred embodiment, CPU 344 is capable of concurrently running multiple software routines to control the various processes of camera 110 within a multi-threading environment. DRAM 346 is a contiguous block of dynamic memory, which may be selectively allocated to various storage functions. LCD controller 390 accesses DRAM 346 and transfers processed image data to LCD screen 302 for display.
  • Camera I/[0033] O 348 is an interface device allowing communications to and from camera computer 118. For example, camera I/O 348 permits an external host computer (not shown) to connect to and communicate with camera computer 118. Camera I/O 348 may also interface with a plurality of buttons and/or dials 304, and an optional status LCD 306, which, in addition to LCD screen 302, are the hardware elements of the camera's user interface 308.
  • [0034] Non-volatile memory 350, which preferably comprises a conventional read-only memory or flash memory, stores a set of computer-readable program instructions to control the operation of camera 110. Removable memory 354 serves as an additional image data storage area and is preferably a non-volatile device, readily removable and replaceable by a camera user via buffers/connector 352. Thus, a user who possesses several removable memories 354 may replace a full removable memory 354 with an empty removable memory 354 to effectively expand the picture-taking capacity of camera 110. In the preferred embodiment of the present invention, removable memory 354 is preferably implemented using a flash disk.
  • [0035] Power supply 356 provides operating power to the various components of camera 110 via main power bus 362 and secondary power bus 364. The main power bus 362 provides power to imaging capture device 114, camera I/O 348, non-volatile memory 350 and removable memory 354, while secondary power bus 364 provides power to power manager 342, CPU 344 and DRAM 346.
  • [0036] Power supply 356 is connected to main batteries 358 and also to backup batteries 360. Camera 110 user may also connect power supply 356 to an optional external power source. During normal operation of power supply 356, main batteries 358 provide operating power to power supply 356 which then provides the operating power to camera 110 via both main power bus 362 and secondary power bus 364. During a power failure mode where main batteries 358 have failed (i.e., when their output voltage has fallen below a minimum operational voltage level), backup batteries 360 provide operating power to power supply 356 which then provides operating power only to the secondary power bus 364 of camera 110.
  • Referring now to FIG. 4, a rear elevation view of one embodiment for [0037] camera 110 of FIG. 1 is shown. The FIG. 4 representation depicts hardware components of user interface 308 of camera 110, showing LCD screen 302, user interface 308, a four-way navigation control button 409, an overlay button 412, a menu button 414, and a set of programmable soft keys 416.
  • [0038] User interface 308 includes several operating modes for supporting various camera functions. In the preferred embodiment, operating modes may include capture mode, review mode, play mode, and PC-connect mode. Within capture mode, menu options are available to set-up the categories used during image capture. The user preferably switches between the camera modes by selecting a mode dial (not shown).
  • Referring now to FIG. 5, a diagram one embodiment for the [0039] non-volatile memory 350 of FIG. 3 is shown. The FIG. 5 diagram includes control application 500, toolbox 502, drivers 504, kernel 506, and system configuration 508. Control application 500 comprises program instructions for controlling and coordinating the various functions of camera 110. Toolbox 502 contains selected function modules including image processing backplane 510, image processing modules 512, menu and dialog manager 514, and file formatter 516.
  • [0040] Image processing backplane 510 includes software routines that coordinate the functioning and communication of various image processing modules 512 and handle the data flow between the various modules. Image processing modules 512 preferably include selectable plug-in software routines that manipulate captured image data in a variety of ways, depending on the particular modules selected. Menu and dialog manager 514 includes software routines which provide information for controlling access to camera control menus and camera control menu items for access to features in camera 1 10. File formatter 516 includes software routines for creating an image file from the processed image data.
  • [0041] Drivers 504 control various hardware devices within camera 110 (for example, motors 234). Kernel 506 provides basic underlying services for the camera 110 operating system. System configuration 508 performs initial start-up routines for camera 110, including the boot routine and initial system diagnostics.
  • Now referring to FIG. 6, a diagram of one embodiment for dynamic random-access-memory (DRAM) [0042] 346 is shown. DRAM 346 includes RAM disk 532, system area 534, analysis modules 540 and working memory 530.
  • In the preferred embodiment, [0043] RAM disk 532 is a memory area used for storing raw and compressed image data and is organized in a “sectored” format similar to that of conventional hard disk drives. A conventional and standardized file system permits external host computer systems, via I/O 348, to recognize and access the data stored on RAM disk 532. System area 534 stores data regarding system errors (e.g., why a system shutdown occurred) for use by CPU 344 to restart computer 118.
  • Working [0044] memory 530 includes stacks, data structures and variables used by CPU 344 while executing the software routines used within camera computer 118. Working memory 530 also includes input buffers 538 for initially storing sets of image data received from imaging device 114 for image conversion, and frame buffers 536 for storing data to display on LCD screen 302.
  • In accordance with the present invention, [0045] analysis modules 540 preferably each include one or more software routines for automatically analyzing and categorizing images. In the FIG. 6 embodiment, analysis modules 540 may be loaded into RAM 346 from removable memory 354 or another external source. Analysis modules 540 further discussed below in conjunction with FIGS. 7 through 10.
  • Referring now to FIG. 7, a diagram of one embodiment for a [0046] single analysis module 540 of FIG. 6 is shown. Analysis module 540 includes text category list 610, combination logic 615, analysis algorithms 630, and parametric control 635.
  • [0047] Text category list 610 is a listing of the various possible image categories available for a given analysis module 540. Combination logic 615 determines how to resolve the results of the image analysis when multiple analysis algorithms 630 are utilized. Parametric control 635 is used to control settable parameters for analysis module 540. For example, analysis module may be turned on/off, or sensitivity settings for analysis module 540 may be controlled with parametric control 635.
  • [0048] Analysis algorithms 630 are a series of software routines ranging from analysis algorithm 1 (620) through analysis algorithm n (625.) Analysis algorithms 630 are each designed to allow analysis module 540 to access and analyze images at various stages in the processing chain of camera 110, in order to gather information about the image for later categorization.
  • Typically, each [0049] analysis algorithm 630 is designed to detect at least one image category. For example, individual analysis algorithms 630 may be designed to detect a person or groups of people based on characteristics like substantial amounts of flesh tones within the image. Individual analysis algorithms 630 may likewise be designed to detect nature scenes from characteristics like substantial green content in the image combined with the relative lack of hard edges. Similarly, categories like city images, water images or indoor images may be detected by characteristic features contained in those images. Once the last line of image data from a given image is processed, analysis module 540 then preferably generates one or more category tags that correspond to the particular image, and the generated category tags are stored as part of the image file. A user of camera 110 may thus readily utilize the category tags to efficiently access and sort images into selected categories.
  • Referring now to FIG. 8, a diagram of one embodiment for an [0050] image file 835 is shown, in accordance with the present invention. In the FIG. 8 embodiment, image file 835 includes a header 805, image data 810, a screennail 815, a thumbnail 820, and image tags 825.
  • [0051] Header 805 preferably includes information that identifies and describes the various contents of image file 835. Image data 810 contains actual captured image data. Image data 810 exists in whichever format that is appropriate for the current location of image file 835 within the image processing chain of camera 110. Screennail 815 and thumbnail 820 are each different versions of image data 810 that have varying degrees of reduced resolution for a number of special viewing applications.
  • Image tags [0052] 825 includes various types of information that correspond and relate to particular captured image data 810. Image tags 825 are further discussed below in conjunction with FIG. 9.
  • Referring now to FIG. 9, a diagram of one embodiment for the image tags of FIG. 8 is shown. In the FIG. 9 embodiment, image tags [0053] 825 include capture information tags 710, user tags 715, product tags 720, and category tags 735.
  • Capture information tags [0054] 710 preferably include various types of information that correlate with the captured image data 810 (FIG. 8). For example, capture information tags 710 may indicate focus setting, aperture setting, and other relevant information that may be useful for effectively processing or analyzing the corresponding image data 810. User tags 715 and product tags 720 typically contain various other information that may be needed for use with camera 110.
  • Category tags [0055] 735 are each preferably generated by analysis modules 540 after analysis modules 540 individually examine image data 810 from image file 835, in accordance with the present invention. Camera 110 may thus advantageously access and utilize category tags 735 to identify one or more categories to which a given set of image data 810 may likely relate. As discussed above in conjunction with FIG. 7, category tags 735 may correspond to a wide variety of possible image categories. In the preferred embodiment, image tags 825 initially contains sixteen empty locations to which various analysis modules 540 may write appropriate category tags 735 for automatically categorizing the corresponding image data 810, in accordance with the present invention.
  • Referring now to FIG. 10, a flowchart is shown for one embodiment of method steps to automatically analyze and categorize images, according to the present invention. FIG. 10 also details the operation of a series of plug-in [0056] image processing modules 512 for processing and formatting image data 810. However, in other embodiments of camera 110, various other modules may readily be substituted or added to those modules discussed in below conjunction with the FIG. 10 embodiment.
  • Initially, in [0057] step 910, camera 110 preferably captures a selected image as CCD raw data, stores the raw data as image data 810 into image file 835, and then propagates image file 835 through camera 110 for processing and formatting of the image data 810. In step 920, an image processing module 512 preferably replaces any defective pixels in image data 810, and also performs white balance and color correction on image data 810.
  • Next, in [0058] step 925, another image processing module 512 preferably performs interpolation (edge enhancement) on image data 810, and then converts image data 810 into an intermediate format. In the preferred embodiment, step 925 converts image data 810 into an RGB (Red, Blue, Green) format.
  • In the FIG. 10 embodiment, following [0059] step 925, selected analysis modules 540 may be plugged into an RGB insertion point 940 to advantageously analyze image data 810 at RGB transition point 930, in accordance with the present invention. One, some, or all of the analysis modules 540 may analyze image data 810 at RGB transition point 930. Preferably, analysis modules 540 are selected for optimal compatibility and effectiveness with the current format of image data 810 at RGB transition point 930. Once a particular analysis module 540 analyzes the final line of image data 810, then that analysis module 540 preferably generates any appropriate category tags 735 and stores the generated category tags 735 into a blank category tag location in image file 835. Then, camera 110 may subsequently access the stored category tags 735 to automatically categorize and utilize the individual stored images (which each correspond to a separate image file 835).
  • Next, in [0060] step 945, another image processing module 512 preferably performs gamma correction and color space conversion on image data 810. During step 945, the image processing module 512 also preferably converts the color space format of image data 810. In the FIG. 10 embodiment, image data 810 is converted to YCC 444 (Luminance, Chrominance-red, and Chrominance-blue) format.
  • In the FIG. 10 embodiment, following [0061] step 945, selected analysis modules 540 may be plugged into a YCC insertion point 960 to analyze image data 810 at YCC transition point 950, in accordance with the present invention. One, some, or all of the analysis modules 540 may analyze image data 810 at YCC transition point 950. As discussed above, once a particular analysis module 540 analyzes the final line of image data 810, then that analysis module 540 preferably generates any appropriate category tags 735 and stores the generated category tags 735 into a blank category tag location in image file 835 for subsequent use by camera 110 to automatically categorize captured images.
  • This discussion of the FIG. 10 embodiment specifically refers only [0062] RGB insertion point 940 and YCC insertion point 960. However, in other embodiments of the present invention, analysis modules 540 may readily analyze image data 810 at any other time or insertion point within camera 110. For example, in an alternate embodiment, analysis modules 540 may readily be configured to examine image data 810 at capture time, and to specifically recognize and identify the capture of any image that matches one or more selectable parameters.
  • Furthermore, in another embodiment, [0063] analysis modules 540 may advantageously access image files 835 that have been processed and stored onto removable memory 354. Analysis modules 540 may then automatically categorize the image files 835 by analyzing image data 810 and responsively generating corresponding category tags 735, in accordance with the present invention.
  • In [0064] step 965, an image processing module 512 preferably performs a sharpening procedure on image data 810, and also may perform a variety of other processing options. Then, in step 970, an image processing module 512 preferably decimates image data 810. In the preferred embodiment, the decimation process reduces image resolution by decimating the YCC 444 image data to produce YCC 422 or YCC 411 image data
  • In [0065] step 975, the image data 810 is preferably compressed into a final image format (preferably JPEG.) Next, in step 980, file formatter 516 preferably formats the compressed image file 835, and the resulting image file 835 is finally saved into removable memory 354 in step 985. As discussed above, image file 835 thus includes any appropriate category tags which camera 110 may then subsequently automatically access to sort selected images, in accordance with the present invention.
  • The invention has been explained above with reference to a preferred embodiment. Other embodiments will be apparent to those skilled in the art in light of this disclosure. For example, the present invention may readily be implemented using configurations other than those described in the preferred embodiment above. Additionally, the present invention may effectively be used in conjunction with systems other than the one described above as the preferred embodiment. Therefore, these and other variations upon the preferred embodiments are intended to be covered by the present invention, which is limited only by the appended claims. [0066]

Claims (42)

What is claimed is:
1. A system for categorizing images, comprising:
an analysis module configured to analyze said images;
a processor coupled to said system for controlling said analysis module; and
category tags attached by said analysis module to each of said images, thereby enabling said processor to sort said images into different categories.
2. The system of
claim 1
wherein said processor automatically sorts said images into said different categories.
3. The system of
claim 1
wherein said images are captured by an electronic imaging device.
4. The system of
claim 2
wherein said electronic imaging device is a digital camera.
5. The system of
claim 1
wherein said analysis module includes one or more analysis algorithms for identifying said different categories.
6. The system of
claim 5
wherein said analysis module includes combination logic for combining analysis results from said analysis algorithms.
7. The system of
claim 1
wherein said analysis module includes parametric controls for controlling said analysis module.
8. The system of
claim 1
wherein said analysis module is selectively loaded into a volatile memory from a removable memory.
9. The system of
claim 1
further comprising a plurality of analysis modules.
10. The system of
claim 1
wherein said images each are stored as image data contained in individual image files.
11. The system of
claim 10
wherein said category tags are stored with said image data in said individual image files.
12. The system of
claim 1
further comprising an image processing backplane communicating with image processing modules.
13. The system of
claim 12
further comprising one or more insertion points between said image processing modules for inserting said analysis module to analyze said images.
14. The system of
claim 13
wherein a selectable plurality of analysis modules are inserted into said one or more insertion points.
15. The system of
claim 13
further comprising an RGB insertion point and a YCC insertion point.
16. The system of
claim 1
wherein said analysis module is configured to recognize and label said images that match predetermined criteria.
17. The system of
claim 1
wherein said analysis module is configured to access and categorize said images after said images have been processed and stored into a storage device.
18. The system of
claim 1
wherein said processor sorts said images by accessing and analyzing said category tags attached to each of said images.
19. The system of
claim 1
wherein said different categories include human images and nature images.
20. The system of
claim 1
wherein said different categories include city images and water images.
21. A method for automatically categorizing images, comprising the steps of:
analyzing said images with an analysis module;
controlling said analysis module with a processor coupled to said system; and
attaching category tags to each of said images with said analysis module, thereby enabling said processor to sort said images into different categories.
22. The method of
claim 21
wherein said processor automatically sorts said images into said different categories.
23. The method of
claim 21
wherein said images are captured by an electronic imaging device.
24. The method of
claim 21
wherein said electronic imaging device is a digital camera.
25. The method of
claim 21
wherein said analysis module includes one or more analysis algorithms for identifying said different categories.
26. The method of
claim 25
wherein said analysis module includes combination logic for combining analysis results from said analysis algorithms.
27. The method of
claim 21
wherein said analysis module includes parametric controls for controlling said analysis module.
28. The method of
claim 21
wherein said analysis module is selectively loaded into a volatile memory from a flash disk.
29. The method of
claim 21
further comprising a plurality of analysis modules.
30. The method of
claim 21
wherein said images each are stored as image data contained in individual image files.
31. The method of
claim 30
wherein said category tags are stored with said image data in said individual image files.
32. The method of
claim 21
further comprising an image processing backplane communicating with image processing modules.
33. The method of
claim 32
further comprising one or more insertion points between said image processing modules for inserting said analysis module to analyze said images.
34. The method of
claim 33
wherein a selectable plurality of analysis modules are inserted into said one or more insertion points.
35. The method of
claim 33
further comprising an RGB insertion point and a YCC insertion point.
36. The method of
claim 21
wherein said analysis module is configured to initially recognize and label said images that match predetermined criteria immediately upon capture of said images.
37. The method of
claim 21
wherein said analysis module is configured to access and categorize said images after said images have been processed and stored into a storage device.
38. The method of
claim 21
wherein said processor sorts said images by accessing and analyzing said category tags attached to each of said images.
39. The method of
claim 21
wherein said different categories include human images and nature images.
40. The method of
claim 21
wherein said different categories include city images and water images.
41. A system for automatically categorizing images, comprising:
means for analyzing said images;
means for controlling said means for analyzing; and
means for attaching category tags to each of said images, thereby enabling said means for controlling to sort said images into different categories.
42. A computer-readable medium comprising program instructions for automatically categorizing images by performing the steps of:
analyzing said images with an analysis module;
controlling said analysis module with a processor coupled to said system; and
attaching category tags to each of said images with said analysis module, thereby enabling said processor to sort said images into different categories.
US09/121,760 1998-07-23 1998-07-23 System and method for automatic analysis and categorization of images in an electronic imaging device Abandoned US20010012062A1 (en)

Priority Applications (10)

Application Number Priority Date Filing Date Title
US09/121,760 US20010012062A1 (en) 1998-07-23 1998-07-23 System and method for automatic analysis and categorization of images in an electronic imaging device
PCT/US1999/016008 WO2000005875A1 (en) 1998-07-23 1999-07-14 System and method for automatic analysis and categorization of images in an electronic imaging device
AU51036/99A AU5103699A (en) 1998-07-23 1999-07-14 System and method for automatic analysis and categorization of images in an electronic imaging device
US09/430,235 US6914625B1 (en) 1998-07-23 1999-10-29 Method and apparatus for managing image categories in a digital camera to enhance performance of a high-capacity image storage media
US11/156,044 US7567276B2 (en) 1998-07-23 2005-06-17 Method and apparatus for managing categorized images in a digital camera
US11/158,658 US7602424B2 (en) 1998-07-23 2005-06-21 Method and apparatus for automatically categorizing images in a digital camera
US12/576,702 US8350928B2 (en) 1998-07-23 2009-10-09 Method and apparatus for automatically categorizing images in a digital camera
US13/401,462 US8531555B2 (en) 1998-07-23 2012-02-21 Method and apparatus for automatically categorizing images in a digital camera
US14/017,087 US8836819B2 (en) 1998-07-23 2013-09-03 Method and apparatus for automatically categorizing images in a digital camera
US14/465,572 US9363408B2 (en) 1998-07-23 2014-08-21 Method and apparatus for automatically categorizing images in a digital camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US09/121,760 US20010012062A1 (en) 1998-07-23 1998-07-23 System and method for automatic analysis and categorization of images in an electronic imaging device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US09/430,235 Continuation-In-Part US6914625B1 (en) 1998-07-23 1999-10-29 Method and apparatus for managing image categories in a digital camera to enhance performance of a high-capacity image storage media

Publications (1)

Publication Number Publication Date
US20010012062A1 true US20010012062A1 (en) 2001-08-09

Family

ID=22398620

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/121,760 Abandoned US20010012062A1 (en) 1998-07-23 1998-07-23 System and method for automatic analysis and categorization of images in an electronic imaging device
US09/430,235 Expired - Lifetime US6914625B1 (en) 1998-07-23 1999-10-29 Method and apparatus for managing image categories in a digital camera to enhance performance of a high-capacity image storage media
US11/156,044 Expired - Fee Related US7567276B2 (en) 1998-07-23 2005-06-17 Method and apparatus for managing categorized images in a digital camera

Family Applications After (2)

Application Number Title Priority Date Filing Date
US09/430,235 Expired - Lifetime US6914625B1 (en) 1998-07-23 1999-10-29 Method and apparatus for managing image categories in a digital camera to enhance performance of a high-capacity image storage media
US11/156,044 Expired - Fee Related US7567276B2 (en) 1998-07-23 2005-06-17 Method and apparatus for managing categorized images in a digital camera

Country Status (3)

Country Link
US (3) US20010012062A1 (en)
AU (1) AU5103699A (en)
WO (1) WO2000005875A1 (en)

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030021468A1 (en) * 2001-04-30 2003-01-30 Jia Charles Chi Automatic generation of frames for digital images
US6538698B1 (en) * 1998-08-28 2003-03-25 Flashpoint Technology, Inc. Method and system for sorting images in an image capture unit to ease browsing access
US20040090655A1 (en) * 2002-11-12 2004-05-13 Murata Kikai Kabushiki Kaisha Color image transmitting device
US20040174434A1 (en) * 2002-12-18 2004-09-09 Walker Jay S. Systems and methods for suggesting meta-information to a camera user
US6833865B1 (en) * 1998-09-01 2004-12-21 Virage, Inc. Embedded metadata engines in digital capture devices
US6877134B1 (en) 1997-08-14 2005-04-05 Virage, Inc. Integrated data and real-time metadata capture system and method
US20050231610A1 (en) * 1998-07-23 2005-10-20 Anderson Eric C Method and apparatus for automatically categorizing images in a digital camera
US20050231611A1 (en) * 1998-07-23 2005-10-20 Anderson Eric C Method and apparatus for managing categorized images in a digital camera
US20060115111A1 (en) * 2002-09-30 2006-06-01 Malone Michael F Apparatus for capturing information as a file and enhancing the file with embedded information
US20060209089A1 (en) * 2005-02-15 2006-09-21 Sony Corporation Information processing apparatus, information processing method, and information processing system
US20060221199A1 (en) * 2004-09-30 2006-10-05 Seiko Epson Corporation Digital camera and image processing method
US20070150517A1 (en) * 2002-09-30 2007-06-28 Myport Technologies, Inc. Apparatus and method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US20070297786A1 (en) * 2006-06-22 2007-12-27 Eli Pozniansky Labeling and Sorting Items of Digital Data by Use of Attached Annotations
US20080028047A1 (en) * 2000-04-07 2008-01-31 Virage, Inc. Interactive video application hosting
US20080089591A1 (en) * 2006-10-11 2008-04-17 Hui Zhou Method And Apparatus For Automatic Image Categorization
US20080166072A1 (en) * 2007-01-09 2008-07-10 Kang-Huai Wang Methods to compensate manufacturing variations and design imperfections in a capsule camera
US20080165248A1 (en) * 2007-01-09 2008-07-10 Capso Vision, Inc. Methods to compensate manufacturing variations and design imperfections in a capsule camera
US20090322893A1 (en) * 2008-06-30 2009-12-31 Verizon Data Services Llc Camera data management and user interface apparatuses, systems, and methods
US20100026841A1 (en) * 2008-08-01 2010-02-04 Samsung Digital Imaging Co., Ltd. Methods and apparatuses for providing photographing information in digital image processing device
US20100110222A1 (en) * 2004-09-03 2010-05-06 Texas Instruments Incorporated Digital camera front-end architecture
US20110025713A1 (en) * 2001-06-26 2011-02-03 Mcintyre Dale F System and method for managing images over a communication network
US20110050726A1 (en) * 2009-09-01 2011-03-03 Fujifilm Corporation Image display apparatus and image display method
US7962948B1 (en) 2000-04-07 2011-06-14 Virage, Inc. Video-enabled community building
US8102457B1 (en) 1997-07-09 2012-01-24 Flashpoint Technology, Inc. Method and apparatus for correcting aspect ratio in a camera graphical user interface
US8127232B2 (en) 1998-12-31 2012-02-28 Flashpoint Technology, Inc. Method and apparatus for editing heterogeneous media objects in a digital imaging device
US8171509B1 (en) 2000-04-07 2012-05-01 Virage, Inc. System and method for applying a database to video multimedia
US8548978B2 (en) 2000-04-07 2013-10-01 Virage, Inc. Network video guide and spidering
US8988563B2 (en) 2010-06-04 2015-03-24 Apple Inc. Dual parallel processing of frames of raw image data
US9224145B1 (en) 2006-08-30 2015-12-29 Qurio Holdings, Inc. Venue based digital rights using capture device with digital watermarking capability
US10499029B2 (en) 2007-01-09 2019-12-03 Capso Vision Inc Methods to compensate manufacturing variations and design imperfections in a display device
US10721066B2 (en) 2002-09-30 2020-07-21 Myport Ip, Inc. Method for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval
US10951668B1 (en) 2010-11-10 2021-03-16 Amazon Technologies, Inc. Location based community

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH114408A (en) * 1997-04-16 1999-01-06 Seiko Epson Corp Digital camera and processing sequence revision method for image data recorded by the same
US7262778B1 (en) 2000-02-11 2007-08-28 Sony Corporation Automatic color adjustment of a template design
US7810037B1 (en) 2000-02-11 2010-10-05 Sony Corporation Online story collaboration
JP3862474B2 (en) * 2000-05-16 2006-12-27 キヤノン株式会社 Image processing apparatus, image processing method, and storage medium
US20020039141A1 (en) * 2000-09-11 2002-04-04 Koichi Washisu Image sensing apparatus usable in combination with printer and control method therefor
US6629104B1 (en) * 2000-11-22 2003-09-30 Eastman Kodak Company Method for adding personalized metadata to a collection of digital images
JP2002314803A (en) * 2001-01-17 2002-10-25 Seiko Epson Corp Generation and output of image file
US7262797B2 (en) * 2001-02-22 2007-08-28 Ge Inspection Technologies Lp Method and system for storing calibration data within image files
JP2002354327A (en) * 2001-05-30 2002-12-06 Minolta Co Ltd Image-photographing device, operation device and image- photographing system thereof
JP4193378B2 (en) * 2001-06-27 2008-12-10 セイコーエプソン株式会社 Image file generator
JP4717299B2 (en) * 2001-09-27 2011-07-06 キヤノン株式会社 Image management apparatus, image management apparatus control method, and computer program
JP2003125251A (en) * 2001-10-16 2003-04-25 Minolta Co Ltd Digital camera and reproduction program
US20030107660A1 (en) * 2001-12-10 2003-06-12 Olympus Optical Co., Ltd. Electronic imaging camera
US7302118B2 (en) * 2002-02-07 2007-11-27 Microsoft Corporation Transformation of images
US20030156207A1 (en) * 2002-02-20 2003-08-21 Creo Il. Ltd Image capture apparatus with backup memory
JP4007052B2 (en) 2002-05-07 2007-11-14 セイコーエプソン株式会社 Image processing control data update device
US20040075743A1 (en) * 2002-05-22 2004-04-22 Sony Computer Entertainment America Inc. System and method for digital image selection
US20030227553A1 (en) * 2002-06-11 2003-12-11 Steve Mattis Systems and methods for image indexing
JP4093544B2 (en) * 2002-06-19 2008-06-04 カシオ計算機株式会社 IMAGING DEVICE, ALBUM FILE CREATION METHOD AND ALBUM FILE CREATION PROGRAM IN IMAGING DEVICE
US20040032509A1 (en) * 2002-08-15 2004-02-19 Owens James W. Camera having audio noise attenuation capability
CN1249984C (en) * 2002-09-20 2006-04-05 佳能株式会社 Image shooting device
JP4250442B2 (en) * 2003-03-25 2009-04-08 キヤノン株式会社 Information processing apparatus, information input apparatus, information processing apparatus control method, information input apparatus control method, program, and computer-readable recording medium
JP2004333957A (en) * 2003-05-09 2004-11-25 Hitachi Ltd Personal terminal
US7127164B1 (en) 2003-08-06 2006-10-24 Eastman Kodak Company Method for rating images to facilitate image retrieval
EP1665764A2 (en) * 2003-08-15 2006-06-07 Dice America, Inc. Apparatus for communicating over a network images captured by a digital camera
EP1704710A4 (en) 2003-12-24 2007-09-19 Walker Digital Llc Method and apparatus for automatically capturing and managing images
US20050166149A1 (en) * 2004-01-23 2005-07-28 Microsoft Corporation Table of contents display
US7683942B2 (en) * 2004-05-18 2010-03-23 Canon Kabushiki Kaisha Information recording apparatus and control method thereof
US20060080286A1 (en) * 2004-08-31 2006-04-13 Flashpoint Technology, Inc. System and method for storing and accessing images based on position data associated therewith
JP4208805B2 (en) * 2004-09-15 2009-01-14 キヤノン株式会社 Electronic device, control method thereof, and program
KR100606742B1 (en) * 2005-04-27 2006-08-01 엘지전자 주식회사 Method for storing and searching pictures, and apparatus for the same
JP4499609B2 (en) * 2005-05-17 2010-07-07 富士フイルム株式会社 Image capturing apparatus, image capturing method, and image storage apparatus
JP2006345029A (en) * 2005-06-07 2006-12-21 Pentax Corp Image recording apparatus
JP2007013574A (en) * 2005-06-30 2007-01-18 Toshiba Corp File access means, specific image file reproduction method, and camera device capable of reproducing the image file
US7665028B2 (en) 2005-07-13 2010-02-16 Microsoft Corporation Rich drag drop user interface
US7822746B2 (en) * 2005-11-18 2010-10-26 Qurio Holdings, Inc. System and method for tagging images based on positional information
US7916201B2 (en) * 2006-03-31 2011-03-29 Nokia Corporation Mobile device, method and computer program product for displaying images on a display screen
JP4859599B2 (en) 2006-09-13 2012-01-25 Hoya株式会社 Imaging device
JP4850645B2 (en) * 2006-09-14 2012-01-11 キヤノン株式会社 Image reproducing apparatus and image reproducing method
US20080068641A1 (en) * 2006-09-19 2008-03-20 Xerox Corporation Document processing system
US7895275B1 (en) * 2006-09-28 2011-02-22 Qurio Holdings, Inc. System and method providing quality based peer review and distribution of digital content
US8615778B1 (en) 2006-09-28 2013-12-24 Qurio Holdings, Inc. Personalized broadcast system
KR101314827B1 (en) * 2006-12-05 2013-10-04 삼성전자주식회사 Method for controlling digital photographing apparatus, and digital photographing apparatus adopting the method
US8515460B2 (en) * 2007-02-12 2013-08-20 Microsoft Corporation Tagging data utilizing nearby device information
JP5245260B2 (en) * 2007-02-27 2013-07-24 富士通セミコンダクター株式会社 File processing program, file processing method, file processing apparatus, and function program
US9232042B2 (en) * 2007-07-20 2016-01-05 Broadcom Corporation Method and system for utilizing and modifying user preference information to create context data tags in a wireless system
CN101399895B (en) * 2007-09-28 2010-10-06 佛山普立华科技有限公司 Storage space fast organizing system and method for digital camera
US9110927B2 (en) * 2008-11-25 2015-08-18 Yahoo! Inc. Method and apparatus for organizing digital photographs
US9237294B2 (en) 2010-03-05 2016-01-12 Sony Corporation Apparatus and method for replacing a broadcasted advertisement based on both heuristic information and attempts in altering the playback of the advertisement
US9832528B2 (en) 2010-10-21 2017-11-28 Sony Corporation System and method for merging network-based content with broadcasted programming content
JP5871629B2 (en) * 2012-01-20 2016-03-01 キヤノン株式会社 Information processing apparatus, control method thereof, and program
JP5895756B2 (en) * 2012-07-17 2016-03-30 富士ゼロックス株式会社 Information classification program and information processing apparatus
CN104267918B (en) * 2014-09-17 2017-09-29 深圳市九洲电器有限公司 A kind of image display method and system
US10984373B2 (en) * 2016-03-07 2021-04-20 Sony Corporation System and method for information processing

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4685001A (en) * 1984-08-24 1987-08-04 Eastman Kodak Company Method for retrieving unedited video still pictures
US5153729A (en) 1988-10-24 1992-10-06 Fuji Photo Film Co., Ltd. Digital electronic still camera automatically determining conditions of a memory cartridge
JP3143110B2 (en) 1989-07-24 2001-03-07 株式会社リコー Image input device
US5335072A (en) * 1990-05-30 1994-08-02 Minolta Camera Kabushiki Kaisha Photographic system capable of storing information on photographed image data
DE69117805T2 (en) * 1990-06-07 1996-09-19 Canon Kk Facsimile machine
US5402170A (en) 1991-12-11 1995-03-28 Eastman Kodak Company Hand-manipulated electronic camera tethered to a personal computer
US5806072A (en) 1991-12-20 1998-09-08 Olympus Optical Co., Ltd. Electronic imaging apparatus having hierarchical image data storage structure for computer-compatible image data management
JP2757668B2 (en) 1992-03-11 1998-05-25 国際電信電話株式会社 Image analysis device
US5475441A (en) 1992-12-10 1995-12-12 Eastman Kodak Company Electronic camera with memory card interface to a computer
US5493335A (en) 1993-06-30 1996-02-20 Eastman Kodak Company Single sensor color camera with user selectable image record size
JP3528214B2 (en) 1993-10-21 2004-05-17 株式会社日立製作所 Image display method and apparatus
US5889578A (en) 1993-10-26 1999-03-30 Eastman Kodak Company Method and apparatus for using film scanning information to determine the type and category of an image
US5477264A (en) * 1994-03-29 1995-12-19 Eastman Kodak Company Electronic imaging system using a removable software-enhanced storage device
US5805215A (en) * 1994-04-21 1998-09-08 Canon Kabushiki Kaisha Information processing method and apparatus for storing additional data about an image
US5496106A (en) 1994-12-13 1996-03-05 Apple Computer, Inc. System and method for generating a contrast overlay as a focus assist for an imaging device
US5872865A (en) * 1995-02-08 1999-02-16 Apple Computer, Inc. Method and system for automatic classification of video images
US5633678A (en) * 1995-12-20 1997-05-27 Eastman Kodak Company Electronic still camera for capturing and categorizing images
US6154755A (en) * 1996-07-31 2000-11-28 Eastman Kodak Company Index imaging system
JP3996962B2 (en) * 1996-08-02 2007-10-24 キヤノン株式会社 Digital camera
US6028611A (en) 1996-08-29 2000-02-22 Apple Computer, Inc. Modular digital image processing via an image processing chain
US6985248B2 (en) 1997-11-24 2006-01-10 Eastman Kodak Company Printing digital images using a print utilization file
US5924090A (en) * 1997-05-01 1999-07-13 Northern Light Technology Llc Method and apparatus for searching a database of records
US20020071028A1 (en) * 1997-05-28 2002-06-13 Nikon Corporation Image display and recording apparatus and a recording medium on which a category control program is recorded
US6215523B1 (en) * 1997-06-10 2001-04-10 Flashpoint Technology, Inc. Method and system for accelerating a user interface of an image capture unit during review mode
US6532039B2 (en) * 1997-09-17 2003-03-11 Flashpoint Technology, Inc. Method and system for digital image stamping
US5872875A (en) * 1997-12-11 1999-02-16 Cooper Cameron Corporation Hydrodynamic shaft bearing with concentric outer hydrostatic bearing
JP3096684B2 (en) 1998-03-25 2000-10-10 三洋電機株式会社 Digital camera
US20010012062A1 (en) 1998-07-23 2001-08-09 Eric C. Anderson System and method for automatic analysis and categorization of images in an electronic imaging device
US6538698B1 (en) * 1998-08-28 2003-03-25 Flashpoint Technology, Inc. Method and system for sorting images in an image capture unit to ease browsing access
US6796428B1 (en) * 2002-09-23 2004-09-28 Bon S. Ong Expanding envelope with built-in divider

Cited By (76)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8970761B2 (en) 1997-07-09 2015-03-03 Flashpoint Technology, Inc. Method and apparatus for correcting aspect ratio in a camera graphical user interface
US8102457B1 (en) 1997-07-09 2012-01-24 Flashpoint Technology, Inc. Method and apparatus for correcting aspect ratio in a camera graphical user interface
US6877134B1 (en) 1997-08-14 2005-04-05 Virage, Inc. Integrated data and real-time metadata capture system and method
US7602424B2 (en) 1998-07-23 2009-10-13 Scenera Technologies, Llc Method and apparatus for automatically categorizing images in a digital camera
US8350928B2 (en) 1998-07-23 2013-01-08 KDL Scan Deisgns LLC Method and apparatus for automatically categorizing images in a digital camera
US8531555B2 (en) 1998-07-23 2013-09-10 Kdl Scan Designs Llc Method and apparatus for automatically categorizing images in a digital camera
US20100026846A1 (en) * 1998-07-23 2010-02-04 Anderson Eric C Method And Apparatus For Automatically Categorizing Images In A Digital Camera
US20050231610A1 (en) * 1998-07-23 2005-10-20 Anderson Eric C Method and apparatus for automatically categorizing images in a digital camera
US20050231611A1 (en) * 1998-07-23 2005-10-20 Anderson Eric C Method and apparatus for managing categorized images in a digital camera
US7567276B2 (en) 1998-07-23 2009-07-28 Scenera Technologies, Llc Method and apparatus for managing categorized images in a digital camera
US9363408B2 (en) 1998-07-23 2016-06-07 Chemtron Research Llc Method and apparatus for automatically categorizing images in a digital camera
US8836819B2 (en) 1998-07-23 2014-09-16 Kdl Scan Designs Llc Method and apparatus for automatically categorizing images in a digital camera
US6538698B1 (en) * 1998-08-28 2003-03-25 Flashpoint Technology, Inc. Method and system for sorting images in an image capture unit to ease browsing access
US20050033760A1 (en) * 1998-09-01 2005-02-10 Charles Fuller Embedded metadata engines in digital capture devices
US6833865B1 (en) * 1998-09-01 2004-12-21 Virage, Inc. Embedded metadata engines in digital capture devices
US8127232B2 (en) 1998-12-31 2012-02-28 Flashpoint Technology, Inc. Method and apparatus for editing heterogeneous media objects in a digital imaging device
US8972867B1 (en) 1998-12-31 2015-03-03 Flashpoint Technology, Inc. Method and apparatus for editing heterogeneous media objects in a digital imaging device
US8387087B2 (en) 2000-04-07 2013-02-26 Virage, Inc. System and method for applying a database to video multimedia
US8548978B2 (en) 2000-04-07 2013-10-01 Virage, Inc. Network video guide and spidering
US9684728B2 (en) 2000-04-07 2017-06-20 Hewlett Packard Enterprise Development Lp Sharing video
US8495694B2 (en) 2000-04-07 2013-07-23 Virage, Inc. Video-enabled community building
US7962948B1 (en) 2000-04-07 2011-06-14 Virage, Inc. Video-enabled community building
US20080028047A1 (en) * 2000-04-07 2008-01-31 Virage, Inc. Interactive video application hosting
US9338520B2 (en) 2000-04-07 2016-05-10 Hewlett Packard Enterprise Development Lp System and method for applying a database to video multimedia
US8171509B1 (en) 2000-04-07 2012-05-01 Virage, Inc. System and method for applying a database to video multimedia
US7769827B2 (en) 2000-04-07 2010-08-03 Virage, Inc. Interactive video application hosting
US20030021468A1 (en) * 2001-04-30 2003-01-30 Jia Charles Chi Automatic generation of frames for digital images
US7092564B2 (en) * 2001-04-30 2006-08-15 Hewlett-Packard Development Company, L.P. Automatic generation of frames for digital images
US8621047B2 (en) 2001-06-26 2013-12-31 Intellectual Ventures Fund 83 Llc System and method for managing images over a communication network
US20110025713A1 (en) * 2001-06-26 2011-02-03 Mcintyre Dale F System and method for managing images over a communication network
US9979683B2 (en) 2001-06-26 2018-05-22 Monument Peak Ventures, Llc System and method for managing images over a communication network
US20070150517A1 (en) * 2002-09-30 2007-06-28 Myport Technologies, Inc. Apparatus and method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US8687841B2 (en) 2002-09-30 2014-04-01 Myport Technologies, Inc. Apparatus and method for embedding searchable information into a file, encryption, transmission, storage and retrieval
US9922391B2 (en) 2002-09-30 2018-03-20 Myport Technologies, Inc. System for embedding searchable information, encryption, signing operation, transmission, storage and retrieval
US7778440B2 (en) 2002-09-30 2010-08-17 Myport Technologies, Inc. Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval
US8135169B2 (en) 2002-09-30 2012-03-13 Myport Technologies, Inc. Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US7778438B2 (en) 2002-09-30 2010-08-17 Myport Technologies, Inc. Method for multi-media recognition, data conversion, creation of metatags, storage and search retrieval
US9070193B2 (en) 2002-09-30 2015-06-30 Myport Technologies, Inc. Apparatus and method to embed searchable information into a file, encryption, transmission, storage and retrieval
US8983119B2 (en) 2002-09-30 2015-03-17 Myport Technologies, Inc. Method for voice command activation, multi-media capture, transmission, speech conversion, metatags creation, storage and search retrieval
US20060115111A1 (en) * 2002-09-30 2006-06-01 Malone Michael F Apparatus for capturing information as a file and enhancing the file with embedded information
US10237067B2 (en) 2002-09-30 2019-03-19 Myport Technologies, Inc. Apparatus for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval
US9832017B2 (en) 2002-09-30 2017-11-28 Myport Ip, Inc. Apparatus for personal voice assistant, location services, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatag(s)/ contextual tag(s), storage and search retrieval
US10721066B2 (en) 2002-09-30 2020-07-21 Myport Ip, Inc. Method for voice assistant, location tagging, multi-media capture, transmission, speech to text conversion, photo/video image/object recognition, creation of searchable metatags/contextual tags, storage and search retrieval
US8068638B2 (en) 2002-09-30 2011-11-29 Myport Technologies, Inc. Apparatus and method for embedding searchable information into a file for transmission, storage and retrieval
US8509477B2 (en) 2002-09-30 2013-08-13 Myport Technologies, Inc. Method for multi-media capture, transmission, conversion, metatags creation, storage and search retrieval
US7184573B2 (en) 2002-09-30 2007-02-27 Myport Technologies, Inc. Apparatus for capturing information as a file and enhancing the file with embedded information
US9159113B2 (en) 2002-09-30 2015-10-13 Myport Technologies, Inc. Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval
US9589309B2 (en) 2002-09-30 2017-03-07 Myport Technologies, Inc. Apparatus and method for embedding searchable information, encryption, transmission, storage and retrieval
US20040090655A1 (en) * 2002-11-12 2004-05-13 Murata Kikai Kabushiki Kaisha Color image transmitting device
US8558921B2 (en) 2002-12-18 2013-10-15 Walker Digital, Llc Systems and methods for suggesting meta-information to a camera user
US20040174434A1 (en) * 2002-12-18 2004-09-09 Walker Jay S. Systems and methods for suggesting meta-information to a camera user
US20100110222A1 (en) * 2004-09-03 2010-05-06 Texas Instruments Incorporated Digital camera front-end architecture
US20060221199A1 (en) * 2004-09-30 2006-10-05 Seiko Epson Corporation Digital camera and image processing method
US20060209089A1 (en) * 2005-02-15 2006-09-21 Sony Corporation Information processing apparatus, information processing method, and information processing system
US8279319B2 (en) * 2005-02-15 2012-10-02 Sony Corporation Information processing apparatus, information processing method, and information processing system
US20070297786A1 (en) * 2006-06-22 2007-12-27 Eli Pozniansky Labeling and Sorting Items of Digital Data by Use of Attached Annotations
US8301995B2 (en) * 2006-06-22 2012-10-30 Csr Technology Inc. Labeling and sorting items of digital data by use of attached annotations
US9224145B1 (en) 2006-08-30 2015-12-29 Qurio Holdings, Inc. Venue based digital rights using capture device with digital watermarking capability
US20080089591A1 (en) * 2006-10-11 2008-04-17 Hui Zhou Method And Apparatus For Automatic Image Categorization
US20080166072A1 (en) * 2007-01-09 2008-07-10 Kang-Huai Wang Methods to compensate manufacturing variations and design imperfections in a capsule camera
US8405711B2 (en) * 2007-01-09 2013-03-26 Capso Vision, Inc. Methods to compensate manufacturing variations and design imperfections in a capsule camera
US9307233B2 (en) 2007-01-09 2016-04-05 Capso Vision, Inc. Methods to compensate manufacturing variations and design imperfections in a capsule camera
US20080165248A1 (en) * 2007-01-09 2008-07-10 Capso Vision, Inc. Methods to compensate manufacturing variations and design imperfections in a capsule camera
US10499029B2 (en) 2007-01-09 2019-12-03 Capso Vision Inc Methods to compensate manufacturing variations and design imperfections in a display device
US9007478B2 (en) * 2007-01-09 2015-04-14 Capso Vision, Inc. Methods to compensate manufacturing variations and design imperfections in a capsule camera
US9456023B2 (en) 2008-06-30 2016-09-27 Verizon Patent And Licensing Inc. Camera data management and user interface apparatuses, systems, and methods
US8477228B2 (en) * 2008-06-30 2013-07-02 Verizon Patent And Licensing Inc. Camera data management and user interface apparatuses, systems, and methods
US9832326B2 (en) 2008-06-30 2017-11-28 Verizon Patent And Licensing Inc. Camera data management and user interface apparatuses, systems, and methods
US10158772B2 (en) 2008-06-30 2018-12-18 Verizon Patent And Licensing Inc. Camera data management and user interface apparatuses, systems, and methods
US20090322893A1 (en) * 2008-06-30 2009-12-31 Verizon Data Services Llc Camera data management and user interface apparatuses, systems, and methods
US8743261B2 (en) * 2008-06-30 2014-06-03 Verizon Patent And Licensing Inc. Camera data management and user interface apparatuses, systems, and methods
US20100026841A1 (en) * 2008-08-01 2010-02-04 Samsung Digital Imaging Co., Ltd. Methods and apparatuses for providing photographing information in digital image processing device
US8558920B2 (en) * 2009-09-01 2013-10-15 Fujifilm Corporation Image display apparatus and image display method for displaying thumbnails in variable sizes according to importance degrees of keywords
US20110050726A1 (en) * 2009-09-01 2011-03-03 Fujifilm Corporation Image display apparatus and image display method
US8988563B2 (en) 2010-06-04 2015-03-24 Apple Inc. Dual parallel processing of frames of raw image data
US10951668B1 (en) 2010-11-10 2021-03-16 Amazon Technologies, Inc. Location based community

Also Published As

Publication number Publication date
US6914625B1 (en) 2005-07-05
AU5103699A (en) 2000-02-14
US20050231611A1 (en) 2005-10-20
WO2000005875A1 (en) 2000-02-03
US7567276B2 (en) 2009-07-28

Similar Documents

Publication Publication Date Title
US20010012062A1 (en) System and method for automatic analysis and categorization of images in an electronic imaging device
US7602424B2 (en) Method and apparatus for automatically categorizing images in a digital camera
US6249316B1 (en) Method and system for creating a temporary group of images on a digital camera
US6177957B1 (en) System and method for dynamically updating features in an electronic imaging device
US5861918A (en) Method and system for managing a removable memory in a digital camera
US6154576A (en) System and method for anti-aliasing of text overlays on electronic images
US6765612B1 (en) Method and system for naming images captured by a digital camera
US5903309A (en) Method and system for displaying images and associated multimedia types in the interface of a digital camera
US6978051B2 (en) System and method for capturing adjacent images by utilizing a panorama mode
US6177958B1 (en) System and method for the automatic capture of salient still images
US7035462B2 (en) Apparatus and method for processing digital images having eye color defects
US7373017B2 (en) System and method for capturing adjacent images by utilizing a panorama mode
US6163816A (en) System and method for retrieving capability parameters in an electronic imaging device
US20030088557A1 (en) Image-taking apparatus, image-taking method, image-taking program, and storage medium having image-taking program stored thereon
US20050140803A1 (en) Image processing apparatus, method thereof, and image sensing apparatus
US20050089218A1 (en) Digital camera having subject judgment function
US6564282B1 (en) Method and system for increasing storage capacity in a digital image capture device
US7405753B2 (en) Data storage management system for camera and camera system
JP2003134530A (en) Image processing apparatus, image processing system, image processing method, storage medium, and program
JP2005142745A (en) Image processing program, image processing method, and recording medium
KR100280325B1 (en) Digital still camera capable of connecting or disconcerting multi feature card and method thereof
JP3765205B2 (en) Document reading apparatus and document reading system using the same
JPH0918818A (en) Electronic camera and external control system for camera

Legal Events

Date Code Title Description
AS Assignment

Owner name: FLASHPOINT TECHNOLOGY, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:ANDERSON, ERIC C.;REEL/FRAME:009351/0311

Effective date: 19980713

AS Assignment

Owner name: IPAC SUB, NEW HAMPSHIRE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FLASHPOINT TECHNOLOGY, INC.;REEL/FRAME:013056/0062

Effective date: 20020614

AS Assignment

Owner name: IPAC ACQUISITION SUBSIDIARY I, LLC, NEW HAMPSHIRE

Free format text: ASSIGNMENT CORRECTION,REEL/FRAME;ASSIGNOR:FLASHPOINT TECHNOLOGY, INC.;REEL/FRAME:013323/0484

Effective date: 20020614

Owner name: IPAC ACQUISITION SUBSIDIARY I, LLC, NEW HAMPSHIRE

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY, FILED ON 07/05/2002, RECORDED ON REEL 013066 FRAME 0062;ASSIGNOR:FLASHPOINT TECHNOLOGY, INC.;REEL/FRAME:013258/0731

Effective date: 20020614

Owner name: IPAC ACQUISITION SUBSIDIARY I, LLC, NEW HAMPSHIRE

Free format text: ASSIGNMENT CORRECTION,REEL/FRAME:013056/0062;ASSIGNOR:FLASHPOINT TECHNOLOGY, INC.;REEL/FRAME:013323/0484

Effective date: 20020614

AS Assignment

Owner name: FLASHPOINT TECHNOLOGY, INC., NEW HAMPSHIRE

Free format text: SECURITY AGREEMENT;ASSIGNOR:IPAC ACQUISITION SUBSIDIARY I, LLC;REEL/FRAME:013913/0138

Effective date: 20020617

AS Assignment

Owner name: FLASHPOINT TECHNOLOGY, INC., NEW HAMPSHIRE

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:IPAC ACQUISITION SUBSIDIARY I, LLC;REEL/FRAME:014402/0231

Effective date: 20031203

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION

AS Assignment

Owner name: KDL SCAN DESIGNS LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:FOTOMEDIA TECHNOLOGIES, LLC;REEL/FRAME:027511/0401

Effective date: 20111212

AS Assignment

Owner name: SECURE CAM, LLC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES ASSETS 48 LLC;REEL/FRAME:044032/0091

Effective date: 20170726