US20090184942A1 - Optical sensor based user interface for a portable electronic device - Google Patents

Optical sensor based user interface for a portable electronic device Download PDF

Info

Publication number
US20090184942A1
US20090184942A1 US12/177,460 US17746008A US2009184942A1 US 20090184942 A1 US20090184942 A1 US 20090184942A1 US 17746008 A US17746008 A US 17746008A US 2009184942 A1 US2009184942 A1 US 2009184942A1
Authority
US
United States
Prior art keywords
optical
display
electronic device
optical sensor
portable electronic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/177,460
Inventor
Yoon Kean Wong
William Robert Hanson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Palm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Palm Inc filed Critical Palm Inc
Priority to US12/177,460 priority Critical patent/US20090184942A1/en
Publication of US20090184942A1 publication Critical patent/US20090184942A1/en
Assigned to JPMORGAN CHASE BANK, N.A. reassignment JPMORGAN CHASE BANK, N.A. SECURITY AGREEMENT Assignors: PALM, INC.
Assigned to PALM, INC. reassignment PALM, INC. RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Assigned to HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. reassignment HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PALM, INC.
Assigned to PALM, INC. reassignment PALM, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Assigned to PALM, INC. reassignment PALM, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.
Assigned to HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. reassignment HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PALM, INC.
Assigned to HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. reassignment HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PALM, INC.
Assigned to QUALCOMM INCORPORATED reassignment QUALCOMM INCORPORATED ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HEWLETT-PACKARD COMPANY, HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P., PALM, INC.
Priority to US15/712,115 priority patent/US20180013875A1/en
Assigned to PALM, INC. reassignment PALM, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HANSON, WILLIAM ROBERT, WONG, YOON KEAN
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1626Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1632External expansion units, e.g. docking stations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1698Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/26Devices for calling a subscriber
    • H04M1/27Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467Methods of retrieving data
    • H04M1/2747Scrolling on a display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163Indexing scheme relating to constructional details of the computer
    • G06F2200/1632Pen holder integrated in the computer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/23Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
    • H04M1/233Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof including a pointing device, e.g. roller key, track ball, rocker switch or joystick
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/02Details of telephonic subscriber devices including a Bluetooth interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/12Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W88/00Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02Terminal devices

Definitions

  • the present invention relates to the field of portable electronic devices such as personal digital assistants or pentop computer systems. Specifically, the present invention relates to an apparatus and method for utilizing an optical sensor based user interlace for registering user input.
  • Palmtop computer systems such as “palmtop” computer systems, or personal digital assistants (PDA) have become commonplace and extraordinarily useful electronic devices.
  • a palmtop computer system includes a hand-held device and a cradle device to which it ports and which connects and synchronizes it to other computers. Owing to their portability, capability, and versatility, hand-held computer devices are designed to be used in a wide variety of environments, for many applications.
  • Portable computers are usually robustly packaged devices, designed for simplicity of operation and durability. Few penetrations expose their interiors, wherein their operational components reside. However, function/field selection buttons, on/off, interconnection, and other switching components expose the interior to some degree to allow accessibility for switching and other operations.
  • Mechanical switching components such as switches, buttons, and, especially, thumbwheels and associated potentiometers, variable capacitors, and the like, while ostensibly durable, have definite physical vulnerabilities and finite operational lifespans. Further, although designed for operational simplicity, using a portable computer system by manipulating these switching components requires some degree of tactile skill.
  • Portable computer systems may be used in harsh environments, unlike other computers designed with less of a degree of mobility, such as desktop computer systems.
  • desktop computer systems most often find application in offices, classrooms, and similar milieus, with environments subject to some relatively satisfactory degree of control.
  • Portable computer systems while indeed they may also be used in such environments, are designed for use almost anywhere, contributing to their versatility and usefulness, e.g., a vehicle, outside, etc.
  • Portable computer systems are frequently and reliably deployed in-transit, in private and public modes of transportation of almost every kind.
  • Portable computer systems find operational deployment in the field in, for example, industrial, urban, marine, construction, and even military application. Under these circumstances, their operational environment may vary widely and change rapidly, often subject to little or no control. These environments may also be quite rugged, extreme, wet, dirty, contaminated, and dusty.
  • Manipulation enables, for example, choosing a screen, scrolling through various screens, selecting an on-screen icon, field, menu, listing, or data entry, or “writing to” or “typing on” an on-board touch-sensitive writing pad-like surface with a stylus, or other touch-enabling probe.
  • portable computer systems may be operated by a user who is purposefully multi-tasking, or otherwise engaged in other activities besides operating the portable computer.
  • Portable computer systems are routinely utilized to, for example, access telephone numbers from an on-board telephone list, reminders from an on-board list of memoranda, gaming, portable internet browsing or email access, and a host of other computer-enabled and/or enhanced activities, all while the user is fully engaged in some other task.
  • Rotary dial-type mechanisms rotate about a shaft, which penetrates the package of the portable computer system to actuate the rotationally variable electrical components contained within. This shaft penetration is potentially a route for incursion of environmental contamination to the sensitive interior of the portable computer device. Exacerbating this problem is the size of the rotary dial, itself. Normally, such dials are larger than other switches penetrating the portable computer device package. Further, the dial has a lower surface facing the portable computer device package, yet not quite abutting it.
  • the space beneath the dial, between the dial and the portable computer device package is especially susceptible to the accumulation of moisture, detritus, dirt, dust, debris, oil, and chemicals. This is particularly problematic for three reasons. First, because the potential environmental contaminants remain there, proximate to a potential incursion route to the portable computer system interior even after the portable computer system is removed from the contaminating environment. Second, it increases the time of exposure to the potential environmental contaminants, thus increasing the probability of incursion. Third, the space between the dial and the portable computer device package is very hard to clean, and attempts to clean it may actually force contaminants into the shaft incursion route and into the interior of the portable computer.
  • the conventional art is problematic therefore for two related reasons. First, because attempts to promote ease of use of portable computer devices threaten increased risk of internal exposure thereof to environmental contamination. Second, because attempts to reduce risk of internal exposure of portable computer devices to environmental contamination complicate their use and increase their cost.
  • What is needed is a method and/or apparatus that promotes a positive computing experience for users of portable computer systems and/or increases overall durability an War Longevity thereof. What is also needed is a method and/or apparatus that promotes the operational simplicity of portable computer systems. Further, what is needed is a method and/or apparatus that enables efficient portable computer function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. Further still, what is needed is a method and/or apparatus that achieves the foregoing accomplishments while allowing the full range of both portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without complete redesign.
  • An apparatus and method are described herein, which simultaneously promote a positive computing experience for users of portable computer systems and increases overall durability and longevity thereof.
  • An apparatus and method are described herein, which also promote the operational simplicity of portable computer systems.
  • an apparatus and method are described herein, which enable efficient portable computer function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination.
  • an apparatus and method are described herein, which achieve the foregoing accomplishments while allowing the full range of bath portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without completely redesigning portable computer system packaging and operation.
  • the present invention is directed to an apparatus and method, which promote a positive computing experience for users of portable computer systems. Simultaneously, the present embodiment promotes overall portable computer device durability and longevity.
  • an optical apparatus and a method for using it enhance the experience of a user attempting to compute. Further, the optical apparatus is much more durable and long-lasting than mechanical switch and dial type devices it may replace.
  • the present invention is directed to an apparatus and method, which also promote the operational simplicity of portable computer systems.
  • an optical apparatus and method of using it simplify operations such as function, field, and data selection, gaming, input, interconnection, browsing, scrolling, and other switching-related functions. This promotes use of the device while engaged in activities beside computing, enhancing versatility.
  • the present invention is directed to an apparatus and method, which enable efficient portable computer device function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination.
  • an optical apparatus obviates openings in portable computer which were conventionally required, in the prior art, for mechanically manipulated switches.
  • the present invention is directed to an apparatus and method, which achieve the foregoing advantages while allowing the full range of both portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without completely redesigning portable computer system packaging and operation.
  • the same basic portable computer device package is still applicable.
  • an optical apparatus obviating mechanically manipulated switch openings deters incursion of contaminants into portable computer device interiors. With no package redesign, portable computer devices may continue to be deployed in all environments, now with greatly reduced risk of damage and/or contamination.
  • FIG. 1 is a system illustration of a portable computing system connected to other computer systems and the Internet via a cradle device.
  • FIG. 2A is a perspective illustration of the top face of an exemplary portable computer system.
  • FIG. 2B is a perspective illustration of one embodiment of a bottom side of the portable computer system of FIG. 2A .
  • FIG. 3 is a block diagram of exemplary circuitry of a portable computing system in accordance with one embodiment of the present invention.
  • FIG. 4 is a perspective view of the cradle device for connecting the portable computing system to other systems via a communication interface.
  • FIG. 5A is a perspective view of the top face of an exemplary portable computer device incorporating an optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 5B is a perspective view of the side edge of an exemplary portable computer device incorporating an optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 5C is a perspective view of the side edge of an exemplary portable computer device, depicting an array of visually formatted information, including text and highlighted text, on a display screen, and incorporating an optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 6A is a concentric top view of an exemplary optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 6B is a block diagram of electrical elements of an exemplary optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 6C is a block diagram of electrical elements of an exemplary combination optical-electromechanical user interface, in accordance with one embodiment of the present invention.
  • FIG. 7A is a schematic diagram of an exemplary combination optical-electromechanical user interface, in accordance with one embodiment of the present invention.
  • FIG. 7B is a schematic diagram of en exemplary combination optical-electromechanical user interface, incorporating an exemplary flexible digitizer element, in accordance with one embodiment of the present invention.
  • FIG. 8 is a flow chart of steps in an exemplary process for implementing an optical user interface for an electronic device, in accordance with one embodiment of the present invention.
  • FIG. 9A is a flow chart of steps in an exemplary process for implementing a variable optical scan rate, in accordance with one embodiment of the present invention.
  • FIG. 9B is a flow chart of steps in an exemplary process for implementing a scan rate power usage protocol, in accordance with one embodiment of the present invention.
  • FIG. 10 is a flow chart of steps in an exemplary process for changing visually formatted information, in accordance with one embodiment of the present invention.
  • the present invention is discussed in one example in the context of a portable computer system, such as a portable computer device, palmtop computer, or personal digital assistant.
  • a portable computer system such as a portable computer device, palmtop computer, or personal digital assistant.
  • the present invention can be used with other types of devices that require user interfacing with a computer, e.g., cell phones, remote control devices, portable web browsers, pagers, etc.
  • optical sensor based user interface of the present invention may be implemented in a variety of different electronic systems such as a pager, a mobile phone, a calculator, a personal digital assistant (PDA), etc.
  • one exemplary embodiment includes the optical sensor based user interface with a portable computing system. It should be understood that the descriptions corresponding to FIGS. 1-4 provide some general information about an exemplary portable computing system.
  • FIG. 1 illustrates a system 50 that may be used in conjunction with an exemplary portable computing device 100 .
  • system 50 comprises a host computer system 56 which can either be a desktop unit as shown, or, alternatively, can be a laptop system 58 .
  • host computer systems can be used within system 50 .
  • Host computer systems 56 and 58 are shown connected to a communication bus 54 , which in one embodiment can be a serial communication bus, but could be of any of a number of well known communication standards and protocols, e.g., a parallel bus, Ethernet, Local Area Network (LAN), and the like.
  • bus 54 can provide communication with the Internet 52 using a number of well known protocols.
  • Bus 54 is also coupled to a cradle 60 for receiving and initiating communication with portable computing device 100 .
  • Cradle 60 provides an electrical and mechanical communication interface between bus 54 (and anything coupled to bus 54 ) and the portable computer system 100 for two way communications.
  • Computer system 100 also contains a wireless infrared communication mechanism 64 for sending and receiving information from other devices.
  • FIG. 2A is a perspective illustration of the top face 100 a of an exemplary portable computer system 100 .
  • the top face 100 a contains a display screen 105 surrounded by a top cover 110 .
  • a removable stylus 80 is also shown.
  • the display screen 105 is a touch screen able to register contact between the screen and the tip of the stylus 80 .
  • the stylus 80 can be fabricated of any material to make contact with the screen 105 .
  • the top face 100 a also contains one or more dedicated and/or programmable buttons 75 for selecting information and causing the computer system 100 to implement functions.
  • the on/off button 95 is also shown.
  • FIG. 2A also illustrates a handwriting recognition pad or “digitizer” containing two regions 106 a and 106 b .
  • region 106 a is for the drawing of alpha characters therein for automatic recognition while region 106 b is for the drawing of numeric characters therein for automatic recognition.
  • the stylus 80 is used for stroking a character within one of the regions 106 a and 106 b .
  • the stroke information is then fed to an internal processor for automatic character recognition. Once characters are—recognized, they are typically displayed on the screen 105 for verification and/or modification.
  • FIG. 2B is a perspective illustration of one embodiment of a bottom side 100 b of portable computer system 100 .
  • An optional extendible antenna 85 is shown and also a battery storage compartment door 90 is shown.
  • a communication interface 108 is also shown.
  • the communication interface 108 is a serial communication port but could also alternatively be of any of a number of well known communication standards and protocols, e.g., parallel, small computer system interface (SCSI), Ethernet, FireWire (IEEE 1394), Universal Serial Bus (USB), etc.
  • SCSI small computer system interface
  • Ethernet Ethernet
  • FireWire IEEE 1394
  • USB Universal Serial Bus
  • FIG. 3 is a block diagram of exemplary circuitry of portable computing system 100 in accordance with one embodiment of the present invention.
  • the computer system 100 includes an address/data bus 99 for communicating information, a central processor 101 coupled with the bus 99 for processing information and instructions. It is appreciated that central processor unit 101 may be a microprocessor or any other type of processor.
  • the computer system 100 also includes data storage features such as a volatile memory 102 (e.g., random access memory, static RAM, dynamic RAM, etc.) coupled with the bus 99 for storing information and instructions for the central processor 101 and a non-volatile memory 103 (e.g., read only memory, programmable ROM, flash memory, EPROM, EEPROM, etc.) coupled with the bus 99 for storing static information and instructions for the processor 101 .
  • volatile memory 102 e.g., random access memory, static RAM, dynamic RAM, etc.
  • non-volatile memory 103 e.g., read only memory, programmable ROM, flash memory, EPROM, EEP
  • Computer system 100 may also include an optional data storage device 104 (e.g., thin profile removable memory) coupled with the bus 99 for storing information and instructions. It should be understood that device 104 may be removable. Furthermore, device 104 may also be a secure digital (SD) card-reader or equivalent removable memory reader.
  • SD secure digital
  • an alphanumeric input device 106 which in one implementation is a handwriting recognition pad (“digitizer”) and may include integrated push buttons in one embodiment
  • Device 106 can communicate information (spatial data and pressure data) and command selections to the central processor 101 .
  • the digitizer 106 records both the (x, y) coordinate value of the current location of the stylus 80 and also simultaneously records the pressure that the stylus 80 exerts on the face of the digitizer pad 106 .
  • the coordinate values (spatial information) and pressure data are then output on separate channels for sampling by the processor 101 . In one implementation, there are roughly 256 different discrete levels of pressure that can be detected by the digitizer 106 . Since the digitizer's channels are sampled serially by the processor 101 , the stroke spatial data are sampled “pseudo” simultaneously with the associated pressure data. The sampled data is then stored in a memory by the processor 101 for later analysis.
  • System 100 of FIG. 3 also includes an optional cursor control or directing device 107 coupled to the bus 99 for communicating user input information and command selections to the central processor 101 .
  • device 107 is a touch screen device (also a digitizer) incorporated with screen 105 .
  • Device 107 is capable of registering a position on the screen 105 where the stylus 80 makes contact and the pressure of the contact.
  • the digitizer of 106 or 107 may be implemented using well known devices, for instance, using the ADS-7846 device by Buff-Brown that provides separate channels for spatial stroke information and pressure information.
  • Computer system 100 also contains a flat panel display device 105 coupled to the bus 99 for displaying information to the computer user.
  • the display device 105 utilized with the computer system 100 may be a liquid crystal device (LCD), cathode ray tube (CRT), field emission device (FED, also called flat panel CRT), plasma or other display technology suitable for creating graphic images and alphanumeric characters recognizable to the user.
  • the display 105 is a flat panel multi-mode display capable of both monochrome and color display modes.
  • a signal communication device 108 coupled to bus 99 that may be a serial port (or USB port) for enabling system 100 to communicate with the cradle 60 .
  • the communication interface 108 is a serial communication port, but could also alternatively be of any of a number of well known communication standards and protocols, e.g., parallel, SCSI, Ethernet, FireWire (IEEE 1394), USB, etc.
  • wireless communication links can be established between the device 100 and a host computer system (or another portable computer system) using a Bluetooth wireless device 112 , an infrared (IR) device 64 , or a Global System for Messaging (GSM) radio device 114 .
  • IR infrared
  • GSM Global System for Messaging
  • System 100 may also include a wireless modem device 114 and/or a wireless radio, e.g., a GSM wireless radio with supporting chip set.
  • the wireless modem device 114 is coupled to communicate with the central processor 101 but may not be directly coupled to port 108 .
  • the Mobitex wireless communication system may be used to provide two way communication between computer system 100 and other networked computers and/or the Internet (e.g., via a proxy server).
  • transmission control protocol TCP
  • SMS Short Message Service
  • System 100 of FIG. 3 may also contain batteries for providing electrical power.
  • Optical User Interface 75 is coupled to Processor 101 by bus 99 .
  • processor 101 sends an optical signal generation demand signal 770 to optical user interface 75 .
  • optical user interface 75 generates an optical signal 555 accordingly.
  • Signal 770 controls the optical scan rate of optical user interface 75 .
  • optical signal 555 is redetected by optical user interface 75 , which generates a corresponding interface signal 771 , which is sent to processor 101 , in one embodiment, with a scan rate power usage signal 772 .
  • optical user interface 75 interacts with display device 105 for control of the exhibition of visually formatted information.
  • optical user interface 75 interacts with on-screen cursor control 107 and display device 105 for control and positioning of an on-screen cursor.
  • optical user interface 75 interacts with digitizer 106 .
  • digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75 , in an optical-electromechanical user interaction enabling implementation.
  • the optical user interaction is controlled by a program implemented by computer readable and executable instructions distributed to varying degrees in various implementations between processor 101 , RAM 102 , ROM 103 , and storage device 104 .
  • FIG. 4 is a perspective illustration of one embodiment of the cradle 60 for receiving the portable computer system 100 .
  • the cradle 60 contains a mechanical and electrical interface 260 for interfacing with communication interlace 108 ( FIG. 2B ) of computer system 100 when system 100 is slid into the cradle 60 in an upright position. Once inserted, button 270 can be pressed to initiate two way communication between portable computer system 100 and other computer systems coupled to communication bus 54 .
  • FIG. 5A is a perspective illustration of the top face 100 a of one embodiment of a palmtop computer system 100 , that can be used with the present invention.
  • Optical user interface 75 is depicted as mounted, in one embodiment, in the center of the lower portion of top face 100 a , below screen 105 and digitizer 106 .
  • optical user interface 75 interacts with digitizer 106 , and may be mounted beneath it.
  • digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75 , in an optical-electromechanical user interaction enabling implementation.
  • optical user interface 75 may be mounted in any user accessible position on system 100 .
  • Such positions are illustrated, for example only, and not limited to, possible other positions 75 p.
  • FIG. 5B a perspective illustration of the side edge of exemplary system 100 is depicted.
  • Optical User interface 75 is depicted, for example only, and not limited, in a position low on the upper face 100 a .
  • Lower face 100 b is depicted opposite to upper face 100 a , for perspective.
  • FIG. 5C a perspective of the top face 100 a of one embodiment of a palmtop computer system 100 , that can be used with the present invention.
  • Optical user interface 75 is depicted as mounted, in one embodiment, in the center of the lower portion of top face 100 a , below screen 105 and digitizer 106 . In one embodiment, optical user interface 75 interacts with digitizer 106 , and may be mounted beneath it.
  • Screen 105 displays an exemplary array of visually formatted information 105 d .
  • the array of visually formatted information 105 d includes text. It is appreciated that array of visually formatted information 105 d is not limited to text, but may include graphics, combinations of text and graphics, and any other visually formatted information.
  • the text constituting array of visually formatted information 105 d is a portion of an imaginary telephone list including names and corresponding telephone numbers, a common and useful portable computer system feature. It is appreciated that the text constituting array of visually formatted information 105 d may include any textual information not to be construed as delimited by the present example.
  • the text constituting array of visually formatted information 105 d includes a highlighted portion 105 h .
  • Highlighted portions of text or other forms of visually formatted information may be used to focus a user's attention, to target data for selection, and other purposes.
  • highlighting can be moved through scrolling.
  • highlighting and scrolling may be performed by a user interacting with system 100 through manipulation of optical user interface 75 .
  • FIG. 6A a detailed concentric top view of an exemplary optical user interface 75 , in accordance with one embodiment of the present invention, is described.
  • a transparent covering 75 . 1 covers optical user interface 75 .
  • transparent covering 75 . 1 is flexible and mounted beneath digitizer 106 , which, in the present embodiment, is flexible and transparent, likewise. In one embodiment, transparent covering 75 . 1 forms a part of flexible and transparent digitizer 106 . In one embodiment, flexible and transparent digitizer 106 constitutes transparent covering 75 . 1 . In one embodiment, flexible and transparent digitizer 106 is embedded within transparent cover 75 . 1 (e.g., as depicted in FIG. 7B ). In any of the present embodiments, digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75 , in an optical-electromechanical user interaction enabling implementation.
  • transparent covering 75 . 1 covers optical user interface 75 , yet allows optical interaction with a user. Further, transparent covering 75 . 1 seals optical user interface 75 , and system 100 about optical user interface 75 . Advantageously, this prevents the incursion of environmental contaminants to seals optical user interface 75 , and system 100 .
  • Optical user interlace enclosure 75 . 2 forms a package about optical user interface 75 optical and electrical components to be described next.
  • Optical user interface package foundation 752 mounts an optical source 75 . 4 and an optical sensor 75 . 5 . Further, optical user interlace package foundation 75 . 3 forms an optical portal 75 . 6 , such as an optically transmissive channel with precisely reflective and focusing contours capable of coupling optical source 75 . 4 and an optical sensor 75 . 5 .
  • optical sensor 75 . 5 is a solid state photosensitive electro-optical device which generates an electrical output corresponding to an optical input.
  • optical sensor 75 . 5 is a quantum photodetector.
  • optical sensor 75 . 5 is a radiometer.
  • optical sensor 75 . 5 is a pyroelectric detector.
  • optical sensor 75 . 5 works photoconductively.
  • optical sensor 75 . 5 works photovoltaically.
  • optical source 75 . 4 is a light emitting diode (LED). In one embodiment, optical source 75 . 4 is a laser diode (LD). In one embodiment, optical source 75 . 4 is a quantum dot. For simplicity, optical source 75 . 4 will herein be referred to as an exemplary LED 75 . 4 . LED 75 . 4 and optical detector 75 . 5 operate at frequencies which enable their interoperation and coupling.
  • optical user interface operation is at visible wavelengths. In one embodiment, optical user interface 75 operation is in the infrared. In one implementation, operation of the optical user interlace 75 is in the near infrared.
  • Optical portal 75 . 6 couples LED 75 . 4 and optical sensor 75 . 5 in such a way that a user interaction, such as touching transparent covering 75 . 1 , optically modifies the optical coupling between LED 75 . 4 and optical sensor 75 . 5 .
  • Optically coupled scanning between LED 75 . 4 and optical sensor 75 . 5 occurs at a rate controlled by processor 101 ( FIG. 3 ).
  • Optically coupled scanning between LED 75 . 4 and optical sensor 75 . 5 enables detection of commencement, progression, development and modification, and termination of interactions with users.
  • the user touches transparent covering 75 . 1 .
  • the touch may be implemented by the user's thumb or fingertips, for example.
  • the changes in optical coupling between LED 75 . 4 and optical detector 75 . 5 corresponding to the touch and detected by scanning result in the generation of an interaction signal (interaction signal 771 ; FIG. 6B ).
  • the optical coupling between LED 75 . 4 and optical detector 75 . 5 corresponding to the touch and detected by scanning can be further, stochastically, and/or continually changed by the user varying the touch to transparent cover 75 . 1 , for example, by movement of the thumb or fingertips touching transparent cover 75 .
  • Scan rates may be variable, in one embodiment.
  • variable scan rates may implement a scan rate power usage protocol, transmitted by scan rate power usage signals 772 .
  • the optical user interface 75 may also, in one embodiment, enable further and/or other user interaction by, for example, an electromechanical modality.
  • optical and electrical interrelationship 75 E between elements constituting optical user interface 75 , system bus 99 , and processor 101 are depicted.
  • Optical user interface package foundation 75 . 3 mounts and electrically interconnects LED 75 . 4 and optical sensor 75 . 5 .
  • Optical user interface package foundation 75 . 3 mounts LED 75 . 4 and optical sensor 75 . 5 in such a configuration as to delineate optical portal 75 . 6 , optically coupling LED 75 . 4 and optical sensor 75 . 5 . LED 75 . 4 and optical sensor 75 . 5 are optically coupled through optical portal 75 . 6 such that optical signal 655 , emitted by LED 75 . 4 , may be detected by optical sensor 75 . 5 .
  • Optical user interface sub-bus 75 . 9 electrically interconnects LED 75 . 4 and optical sensor 75 . 5 , through optical user interface packaging foundation 75 . 3 , to bus 99 , which is electrically interconnected with processor 101 . Signals interflow between these elements as follows.
  • Optical signal generation demand signal 770 generated by processor 101 flows over busses 99 and 75 . 9 , through optical user interface packaging foundation 75 . 3 interconnection, to LED 75 . 4 , stimulating LED 75 . 4 to emit optical signal 555 accordingly.
  • Processor 101 thus controls signal 555 and corresponding optical scanning via optical portal 75 . 6 .
  • Interface signal 771 generated by optical. sensor 75 . 5 responsive to detection and conversion of optical signal 555 , flows through optical user interface packaging foundation 75 . 3 interconnection, over busses 75 . 9 and 99 , sequentially, to processor 101 .
  • Processor 101 processes interface signal 771 programmatically.
  • processor 101 controls the optical scan rate employed by optical user interface 75 ( FIG. 6A ) by and according to scan rate power usage signal 772 .
  • Scan rate power usage signal 772 transmits information corresponding to the scan rate power usage from optical user interface 75 to processor 101 , and transmits responsive scan rate control from processor 101 to optical user interface 75 .
  • optical user interface 75 functions as an optical sensor operable to sense movement of an object over a surface thereof, and a processor is responsive to said optical sensor for altering said selected item according to said movement, In one embodiment, optical user interface 75 functions as an optical sensor operable to sense tactile contact of said object with said surface. In one embodiment ⁇ optical user interface 75 functions as an optical sensor operable to sense the speed of said movement of said object. In one embodiment, optical user interface 75 functions as an optical sensor operable to sense the direction of said movement of said object. In the present embodiment, control circuitry coupled to optical user interface 75 is operable to vary a rate at which optical sensor 75 . 5 is scanned in response to detected user activity.
  • Processor 101 in the present embodiment, is responsive to optical sensor 75 . 5 sensing user interactive movement at a first speed to perform a first display update of the array of visually formatted information (e.g., text 105 . d ; FIG. 50 ) Further, processor 101 is responsive to optical sensor 75 . 5 sensing user interactive movement at a second speed to perform a second update of said Information. In the present embodiment, this enables coarse scroll operation, in the first processor response, and a fine scroll operation in the second. The user's finger may establish the optical contact with optical user interface 75 to implement these interactions.
  • optical and electrical interrelationship 7SEM between elements of an exemplary combination optical-electromechanical user interface 75 m is depicted, in accordance with one embodiment of the present invention.
  • Optical user interface package foundation 75 . 3 mounts LED 75 . 4 and optical sensor 75 . 5 in such a configuration as to delineate optical portal 75 . 6 , optically coupling LED 75 . 4 and optical sensor 75 . 5 .
  • LED 75 . 4 and optical sensor 75 . 5 are optically coupled through optical portal 75 . 6 such that optical signal 555 , emitted by LED 75 . 4 , may be detected by optical sensor 75 . 5 .
  • Optical user interface sub-bus 75 . 9 electrically interconnects LED 75 . 4 and optical sensor 75 . 5 , through optical user interface packaging foundation 75 . 3 , to user interface mid-bus 859 , which is electrically interconnected through bus 99 with processor 101 .
  • User interface opto-electromechanical package foundation 803 mounts optical user interface module 75 , and contains an electromechanical user interface enabling device such as a switch or dial (e.g., switch 804 , FIGS. 7A and 7B ).
  • User interface electromechanical package foundation 803 electrically interconnects the electromechanical user interface (e.g., switch 804 , FIGS. 7A and 7B ) contained within it via electromechanical interface sub-bus 809 b to user interface mid-bus 859 , which is electrically interconnected through bus 99 with processor 101 , and transmits electromechanical interface signal 866 thereon.
  • an exemplary combination optical-electromechanical user interface enables several modalities of user interaction, in accordance with one embodiment of the present invention.
  • An electronic device in the present illustration, exemplary portable computer system 100 , has a top face 100 a and a bottom face 100 b . Embedded within and sealing top face 100 a is transparent cover 75 . 1 .
  • Transparent cover 75 . 1 covers optical user interface enclosure 75 . 2 which contains optical user interface package foundation 75 . 3 mount in 9 LED 75 . 4 and optical sensor 75 . 5 ( FIG. 6 ). Further, optical user interface package foundation 75 . 3 forms an optical portal 75 . 6 ( FIG. 6C ), such as an optically transmissive channel with precisely reflective and focusing contours capable of coupling optical source 75 . 4 ( FIG. 6C ) and an optical sensor 75 . 5 ( FIG. 6C ). Optical user interface enclosure 75 . 2 forms a package about optical user interface 75 optical and electrical components ( FIG. 6C ). Optical user interface 75 ( FIGS. 6B and 6C ) generates an optical interface signal 711 ( FIG. 6B ).
  • Mounting optical user interface e.g., optical user interface 75 ; FIG. 6C
  • opto-electromechanical package foundation 803 also houses electromechanical user interface enabling components including, in the present embodiment, a switch assembly 804 .
  • Switch assembly 804 contains a lower, foundational and non-moving base 802 b , fixedly mounted on the upper (e.g., inner) surface of base 110 b (e.g., internal to exemplary computer 100 ).
  • Base 802 b mounts a set of fixed electrical contacts 801 b .
  • An upper plug 802 a mounts movable electrical contacts 801 a , is spring supported and guided by spring assembly 823 .
  • Upper plug 802 a and contacts 801 a move up and down in switch assembly 804 in such a way as to respond to the interaction of a user, for example, pressing down on transparent cover 75 . 1 , and make and break contact between movable contacts 801 a and fixed contacts 801 b accordingly.
  • movable contacts 801 a Upon contact by a sufficiently forcible user interaction, movable contacts 801 a will make and wipe sufficiently on and over fixed contacts 801 b to ensure a correspondingly sufficient electrical contact.
  • the making and breaking of movable contacts 801 a and fixed contacts 801 b in response to a mechanical user interaction generate an electromechanical user interface signal 866 ( FIG. 6C ).
  • Optical user interface signal 771 flows on optical user interface sub-bus 75 . 9 ( FIG. 6B ).
  • Electromechanical user interface signal 866 ( FIG. 6C ) flows on electromechanical sub-bus 809 b .
  • Sub-busses 75 . 9 and 809 b are electrically interconnected with user interface mid-bus 859 .
  • User interface mid-bus 859 is electrically interconnected with bus 99 ( FIGS. 3 , 6 C), enabling optical and electromechanical interface signals 771 and 866 , respectively, to be sent to processor 101 ( FIGS. 3 and 6C ), and control signals to flow from processor 101 back to the user interfaces 76 and 75 m ( FIG. 6C ).
  • digitizer 106 is also flexible and transparent.
  • the elements depicted in FIG. 7B are identical in form and function with those depicted in FIG. 7A .
  • digitizer 106 is integrated with transparent cover 75 . 1 .
  • the transparency of digitizer 106 , and its proximity to optical user interface package foundation 75 . 3 enables an interaction with a user for exemplary system 100 via the optical user interface (e.g., optical user interface 75 ; FIG. 6C ).
  • digitizer 106 and its proximity to and mechanical integration with opto-electromechanical package foundation 803 , enables an interaction with a user for exemplary system 100 via the electromechanical user interface (e.g., electromechanical user interface 75 m ; FIG. 6C ).
  • electromechanical user interface e.g., electromechanical user interface 75 m ; FIG. 6C .
  • flexible and transparent digitizer 106 is embedded within transparent cover 75 . 1 (e.g., as depicted in FIG. 7B ).
  • transparent covering 75 . 1 is flexible and mounted beneath digitizer 106 , which, in the present embodiment, is flexible and transparent, likewise.
  • transparent covering 75 . 1 forms a part of flexible and transparent digitizer 106 .
  • flexible and transparent digitizer 106 constitutes transparent covering 75 . 1 .
  • digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75 ( FIG. 6C ) and electromechanical user interface 75 m ( FIG. 6C ), in an optical-electromechanical user interaction enabling implementation.
  • Digitizer sub-bus 106 . 1 is electrically interconnected with bus 99 , interconnecting digitizer 106 with processor 101 ( FIG. 3 ).
  • FIGS. 8 , 9 A, 9 B, and 10 are flowcharts of the steps performed in processes 800 , 900 A, 900 B, and 1000 , respectively, each individually in accordance with single, separate individual embodiments of the present invention, as discussed separately below.
  • Flowcharted processes 800 , 900 A, 900 B, and 1000 each include a single, separate, individual process of the present invention which, in each embodiment, are carried out by processors and electrical components under the control of computer readable and computer executable instructions.
  • the computer readable and computer executable instructions reside, for example, in data storage features such as within processor 101 , computer usable volatile memory 102 , computer usable non-volatile memory 103 , and/or data storage device 104 , all of FIG. 3 .
  • the computer readable and computer executable instructions may reside In any type of computer readable medium.
  • specific steps are disclosed in each of flowcharts 800 , 900 A, 900 B, and 1000 , such steps are exemplary. That is, the present invention is well suited to performing various other steps or variations of the steps recited in FIGS. 8 , 9 A, 9 B, and 10 . Within these present embodiments, it should be appreciated that the steps of flowcharts 800 , 900 A, 900 B, and 1000 may be performed by software or hardware or any combination of software and hardware.
  • the steps in a process 800 enable the interaction of a user with a system (e.g., exemplary system 100 ; FIGS. 1 , 3 , 5 A, 5 B, 7 A, and 7 B)-using an optical user interface (e.g., 75 ; FIGS. 2A , 3 , 5 A, 5 B, 6 A, 6 B, 6 C), in accordance with one embodiment of the present invention.
  • a system e.g., exemplary system 100 ; FIGS. 1 , 3 , 5 A, 5 B, 7 A, and 7 B
  • an optical user interface e.g., 75 ; FIGS. 2A , 3 , 5 A, 5 B, 6 A, 6 B, 6 C
  • an optical signal e.g., optical signal 555 ; FIGS. 6B and 6C
  • the demand may be by a demand signal (e.g., 770 ; FIG. 6B ).
  • an optical signal (e.g., optical signal 555 ; FIGS. 6B and 6C ) is generated responsive to the demand (step 801 ).
  • the optical signal is generated by an optical source (e.g., optical source 75 . 4 ; FIGS. 6A , 6 B, and 6 C), which in one embodiment, is an LED.
  • step 803 the optical signal is coupled from the optical source into an optical portal (e.g., optical portal 75 . 6 ; FIGS. 6A , 6 B, and 6 C).
  • an optical portal e.g., optical portal 75 . 6 ; FIGS. 6A , 6 B, and 6 C.
  • the optical portal is scanned; step 804 .
  • Scanning 1 in one embodiment, may be performed by an optical sensor (e.g., optical detector 75 . 5 ; FIGS. 6A , 6 B, and 6 C).
  • an optical sensor e.g., optical detector 75 . 5 ; FIGS. 6A , 6 B, and 6 C.
  • Scanning the optical portal (step 804 ) enables the detection of a user interaction; step 805 . If no user interaction is detected, process 800 loops back to demanding an optical signal (step 801 ), and the process repeats itself.
  • step 805 If, however, a user interaction is detected in step 805 , the optical coupling characteristics of the optical portal are changed by the interaction of the user. This results in a corresponding change in the optical coupling characteristics of the optical portal coupling the source and detector; step 807 .
  • Any change in optical coupling results in the generation of an interface signal in step 808 .
  • Interface signals are sent to a processor (e.g., processor 101 ; FIGS. 3 , 6 B, and 6 C); step 809 .
  • the interface signals may be sent via an interconnecting bus (e.g., bus 99 ; FIGS. 3 , 6 B, and 6 C).
  • step 810 the processor processes the interface signal as information, and process 800 loops back to the step of demanding an optical signal (step 801 ).
  • the steps in a process 900 A are depicted wherein the scanning rate of an optical user interface is automatically adjusted, in accordance with one embodiment of the present invention.
  • the optical user interface e.g., OUI 75 ; FIGS. 3 , 6 A, 6 B, and 6 C
  • a processor e.g., processor 101 ; FIGS. 3 , 6 B, and 6 C
  • process 900 A continues the scanning at the first rate.
  • step 902 If however, an interaction with a user is detected in step 902 , the activation of a user interaction is sensed; step 903 .
  • the scan rate is increased accordingly to an initial, relatively higher rate; step 904 .
  • step 905 the speed with which the user interaction is occurring and/or varying (for example, the relative speed and any speed variation with which the user's thumb passes, rubs, or flicks over the transparent cover of the optical portal, e.g., cover 75 . 1 and portal 75 . 6 , respectively; FIGS. 6A , 6 B, and 6 C) is detected. If no variation in the speed with which the user interaction is occurring is detected, process 900 A loops back to step 904 , and continues to scan at the initial second rate.
  • varying for example, the relative speed and any speed variation with which the user's thumb passes, rubs, or flicks over the transparent cover of the optical portal, e.g., cover 75 . 1 and portal 75 . 6 , respectively; FIGS. 6A , 6 B, and 6 C
  • step 905 If, however, a variation in the speed with which the user interaction is occurring is detected in step 905 , the scan rate is adjusted accordingly; step 906 . Further, the speed with which the user interaction is occurring and/or varying is continually monitored, process 900 A looping back to step 905 .
  • process 900 A loops back to step 901 , with scanning resumed at the relatively slow first scan rate.
  • process 900 A enables implementation of a scan rate power usage protocol.
  • a process 900 B enables a processor (e.g., processor 101 ; FIGS. 3 , 6 B, and 6 C) to receive information regarding power usage by optical scanning processes (e.g., process 900 A; FIG. 9A ).
  • a processor e.g., processor 101 ; FIGS. 3 , 6 B, and 6 C
  • optical scanning processes e.g., process 900 A; FIG. 9A
  • Process 900 B begins with step 910 , wherein a fixed power usage signal is generated corresponding to a first scan rate (e.g., a relatively low initial scan rate, such as that scan rate generated instep 901 ; FIG. 9A ).
  • a first scan rate e.g., a relatively low initial scan rate, such as that scan rate generated instep 901 ; FIG. 9A .
  • Power usage signals generated in step 910 is sent to a processor; step 940 .
  • step 920 the scan rate is monitored, if scanning continues at the first scan rate (e.g., no user interaction is detected, as for example in step 902 ; FIG. 9A ), the corresponding power usage signal continues to be generated, process 900 B looping back to step 910 .
  • the first scan rate e.g., no user interaction is detected, as for example in step 902 ; FIG. 9A
  • the corresponding power usage signal continues to be generated, process 900 B looping back to step 910 .
  • step 920 If scanning at a second rate is detected in step 920 , a variable power usage signal corresponding to the second scan rate and its changes is generated; step 930 .
  • Power usage signals generated in step 920 is sent to a processor; step 940 .
  • Power usage signals and corresponding control signals enable implementation of a scan rate power usage protocol.
  • a process 1000 enables the control of visually formatted information displayed on a screen (e.g., display screen 105 ; FIGS. 2A , 3 , and 5 A).
  • a user manipulates an optical user interface (e.g., OUI 75 ; FIGS. 3 , 5 A, 53 , 6 A, 6 B, and 6 C) according to the user's intent to vary visibly formatted information on the display screen.
  • an optical user interface e.g., OUI 75 ; FIGS. 3 , 5 A, 53 , 6 A, 6 B, and 6 C
  • optical characteristics of the optical user interface are changed accordingly; step 1020 .
  • a display change signal is generated; step 1030 .
  • Generating a display change signal may be a combination and interaction between integrated activities conducted by different system elements.
  • a corresponding interface signal (e.g., signal 771 ; FIG. 6B ) is generated and sent to the processor (e.g., processor 101 ; FIGS. 3 , 6 B, and 6 C).
  • the processor programmatically responds to the interface signal by generating a responsive display control signal, which is transmitted to the display device to change the array of visibly formatted information thereon accordingly; step 1040 .
  • the programmatic response may be controlled by the processor under the direction of software or data stored, to varying degrees, in the processor itself, in memory, an and/or in a data storage device (e.g., RAM 102 , ROM 103 , and/or storage 104 , respectively; FIG. 3 ).
  • an cursor controller e.g., cursor control 107 ; FIG. 3
  • cursor controller 107 may also be involved.
  • step 1050 it is determined if the user intends to change the highlighting of any portion of the array of visually formatted information, by which portions of the array may be designated or selected for change of selection of displayed information, or a scrolling function. If so, the portion to be highlighted is selected by optical user interfacing; step 1051 .
  • the highlighting (e.g., the highlighted region of the array of visually formatted information on the display), or the highlighting itself, is moved; step 1052 . At this point, process 1000 may be complete.
  • step 1050 it is determined if the user intends to change the positioning of a cursor appearing within the array of visually formatted information, by which the attention and action of the user may be directed and/or focused; step 1060 . If so, the position for placement of the cursor is selected by optical user interfacing instep 1061 .
  • process 1000 may be complete.
  • step 1060 it is determined in step 1070 if the visually formatted information array is to be scrolled. If not, process 1000 may be complete.
  • step 1060 If scrolling is designated (step 1060 ), scrolling is initiated and controlled by optical user interfacing; step 1075 . At this point, process 1000 is complete.

Abstract

An apparatus and method are described herein, which simultaneously promotes a positive computing experience for users of portable computer systems and increases overall durability and longevity thereof. In one embodiment, an optical apparatus enhances the user computing experience, in one embodiment by simplifying operation, and is much more durable and long-lasting than mechanical switch and dial type devices it may replace. In one embodiment, the present invention is directed to an apparatus, which enables efficient portable computer device function, field, and data selection, gaming, input, interconnection, and other switching-related functions, simplifying operation and enhancing versatility thereof, yet without exposing the portable computer interior to any degree to incursion of environmental contamination. In one embodiment, an optical apparatus obviates openings in a portable computer package which would otherwise be required. In one embodiment, the apparatus, capable of sensing manipulation and directed by software, has a light source and corresponding light sensor.

Description

    RELATED U.S. PATENT APPLICATION
  • This Continuation Application claims the benefit and priority of the co-pending, commonly-owned US Patent Application with Attorney Docket No. PALM-3641.5G.CON, application Ser. No. 10/951,537, filed on Sep. 27, 2004, by Wong et al., and titled “OPTICAL SENSOR BASED USER INTERFACE FOR A PORTABLE ELECTRONIC DEVICE,” which is a Continuation Application that claims the benefit of the commonly-owned U.S. patent application Ser. No. 09/871,375 filed on May 30, 2001, now issued as a U.S. Pat. No. 6,816,154, by Wong et al., and titled “Optical Sensor Based User Interface For a Portable Electronic Device,” which are incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to the field of portable electronic devices such as personal digital assistants or pentop computer systems. Specifically, the present invention relates to an apparatus and method for utilizing an optical sensor based user interlace for registering user input.
  • 2. Related Art
  • Portable computer systems, such as “palmtop” computer systems, or personal digital assistants (PDA) have become commonplace and extraordinarily useful electronic devices. A palmtop computer system includes a hand-held device and a cradle device to which it ports and which connects and synchronizes it to other computers. Owing to their portability, capability, and versatility, hand-held computer devices are designed to be used in a wide variety of environments, for many applications.
  • Portable computers are usually robustly packaged devices, designed for simplicity of operation and durability. Few penetrations expose their interiors, wherein their operational components reside. However, function/field selection buttons, on/off, interconnection, and other switching components expose the interior to some degree to allow accessibility for switching and other operations. Mechanical switching components, such as switches, buttons, and, especially, thumbwheels and associated potentiometers, variable capacitors, and the like, while ostensibly durable, have definite physical vulnerabilities and finite operational lifespans. Further, although designed for operational simplicity, using a portable computer system by manipulating these switching components requires some degree of tactile skill.
  • Portable computer systems may be used in harsh environments, unlike other computers designed with less of a degree of mobility, such as desktop computer systems. For example, desktop computer systems most often find application in offices, classrooms, and similar milieus, with environments subject to some relatively satisfactory degree of control. Portable computer systems, on the other hand, while indeed they may also be used in such environments, are designed for use almost anywhere, contributing to their versatility and usefulness, e.g., a vehicle, outside, etc.
  • Portable computer systems are frequently and reliably deployed in-transit, in private and public modes of transportation of almost every kind. Portable computer systems find operational deployment in the field in, for example, industrial, urban, marine, construction, and even military application. Under these circumstances, their operational environment may vary widely and change rapidly, often subject to little or no control. These environments may also be quite rugged, extreme, wet, dirty, contaminated, and dusty.
  • When their operational environment is rugged, extreme, wet, dirty, dusty, or contaminated, operation of the portable computer system may contribute to or cause internal contamination or physical damage. Environmental contaminants such as moisture, dirt, dust, chemicals, and the like, may penetrate even the small openings for exposure of switching components to user manipulation, especially thumbwheels and their associated potentiometers. Once inside the portable computer, or a connector or button, they may cause fouling, damage, or destruction of its internal microelectronic and other components. And while switching components may be designed for durability, they all display some degree of physical vulnerability and aging degradation characteristics.
  • Although designed for operational simplicity, portable computer systems require same dexterity to operate properly. To operate the portable computer system to accomplish these tasks, controls and switching components must be manipulated. Manipulation enables, for example, choosing a screen, scrolling through various screens, selecting an on-screen icon, field, menu, listing, or data entry, or “writing to” or “typing on” an on-board touch-sensitive writing pad-like surface with a stylus, or other touch-enabling probe.
  • However, also owing to their versatility and portability, portable computer systems may be operated by a user who is purposefully multi-tasking, or otherwise engaged in other activities besides operating the portable computer. Portable computer systems are routinely utilized to, for example, access telephone numbers from an on-board telephone list, reminders from an on-board list of memoranda, gaming, portable internet browsing or email access, and a host of other computer-enabled and/or enhanced activities, all while the user is fully engaged in some other task.
  • When the circumstances under which portable computer systems are used become complex and distracting, operation of the portable computer system may become difficult. This may detract from the computing experience of the user, it may cause errors or loss of data, and/or require operational stops to be repeated. This is inconvenient and costly.
  • Conventionally, an approach to solving the problem of internal exposure of portable computers to environmental contaminants has been to attempt to minimize the interior exposure. This has been accomplished in one attempted solution by reducing the number and size of penetrations through their cases, and to seal the penetrations. Reducing the number of penetrations requires a concomitant reduction in the number of switching components. This requires switching components to have multiple, selectable functions. However, this has the undesirable effect of increasing operational complexity. Sealing the penetrations increases packaging complexity and increases unit costs, and interferes with switching component operations.
  • Conventionally, an approach to solving the problem of making portable computer device operation less complicated for engaged users, especially those simultaneously engaged in activities besides computing, has been to simplify the computer-user interface. This has been attempted, in one approach, by adding switching components. However, this has the undesirable effect of increasing package penetration with resulting increased internal exposure of the computer device to environmental contaminants.
  • Another conventional method of attempting to solve this problem has been-to change the characteristics of the switching components. For instance, in one approach, a “jog wheel,” “thumb wheel,” or similar of rotary dial-type mechanism. However, this particular approach is especially vulnerable to environmental contamination problems.
  • Rotary dial-type mechanisms rotate about a shaft, which penetrates the package of the portable computer system to actuate the rotationally variable electrical components contained within. This shaft penetration is potentially a route for incursion of environmental contamination to the sensitive interior of the portable computer device. Exacerbating this problem is the size of the rotary dial, itself. Normally, such dials are larger than other switches penetrating the portable computer device package. Further, the dial has a lower surface facing the portable computer device package, yet not quite abutting it.
  • The space beneath the dial, between the dial and the portable computer device package is especially susceptible to the accumulation of moisture, detritus, dirt, dust, debris, oil, and chemicals. This is particularly problematic for three reasons. First, because the potential environmental contaminants remain there, proximate to a potential incursion route to the portable computer system interior even after the portable computer system is removed from the contaminating environment. Second, it increases the time of exposure to the potential environmental contaminants, thus increasing the probability of incursion. Third, the space between the dial and the portable computer device package is very hard to clean, and attempts to clean it may actually force contaminants into the shaft incursion route and into the interior of the portable computer.
  • The conventional art is problematic therefore for two related reasons. First, because attempts to promote ease of use of portable computer devices threaten increased risk of internal exposure thereof to environmental contamination. Second, because attempts to reduce risk of internal exposure of portable computer devices to environmental contamination complicate their use and increase their cost.
  • What is needed is a method and/or apparatus that promotes a positive computing experience for users of portable computer systems and/or increases overall durability an War Longevity thereof. What is also needed is a method and/or apparatus that promotes the operational simplicity of portable computer systems. Further, what is needed is a method and/or apparatus that enables efficient portable computer function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. Further still, what is needed is a method and/or apparatus that achieves the foregoing accomplishments while allowing the full range of both portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without complete redesign.
  • SUMMARY OF THE INVENTION
  • An apparatus and method are described herein, which simultaneously promote a positive computing experience for users of portable computer systems and increases overall durability and longevity thereof. An apparatus and method are described herein, which also promote the operational simplicity of portable computer systems. Further, an apparatus and method are described herein, which enable efficient portable computer function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. Further still, an apparatus and method are described herein, which achieve the foregoing accomplishments while allowing the full range of bath portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without completely redesigning portable computer system packaging and operation.
  • In one embodiment, the present invention is directed to an apparatus and method, which promote a positive computing experience for users of portable computer systems. Simultaneously, the present embodiment promotes overall portable computer device durability and longevity. In the present embodiment, an optical apparatus and a method for using it enhance the experience of a user attempting to compute. Further, the optical apparatus is much more durable and long-lasting than mechanical switch and dial type devices it may replace.
  • In one embodiment, the present invention is directed to an apparatus and method, which also promote the operational simplicity of portable computer systems. In the present embodiment, an optical apparatus and method of using it simplify operations such as function, field, and data selection, gaming, input, interconnection, browsing, scrolling, and other switching-related functions. This promotes use of the device while engaged in activities beside computing, enhancing versatility.
  • In one embodiment, the present invention is directed to an apparatus and method, which enable efficient portable computer device function, field, and data selection, gaming, input, interconnection, and other switching-related functions without exposing the portable computer interior to any degree to incursion of environmental contamination. In the present embodiment, an optical apparatus obviates openings in portable computer which were conventionally required, in the prior art, for mechanically manipulated switches. Advantageously, this deters encroachment of environmental contaminants into the interior of the portable computer device.
  • In one embodiment, the present invention is directed to an apparatus and method, which achieve the foregoing advantages while allowing the full range of both portability and environmental exposure, and range and ease of use characteristic of portable computer devices, yet without completely redesigning portable computer system packaging and operation. The same basic portable computer device package is still applicable. In the present embodiment, an optical apparatus obviating mechanically manipulated switch openings deters incursion of contaminants into portable computer device interiors. With no package redesign, portable computer devices may continue to be deployed in all environments, now with greatly reduced risk of damage and/or contamination.
  • These and other objects and advantages of the present invention will become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiments, which are illustrated in the various drawing figures.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings which are incorporated in and form a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention,
  • FIG. 1 is a system illustration of a portable computing system connected to other computer systems and the Internet via a cradle device.
  • FIG. 2A is a perspective illustration of the top face of an exemplary portable computer system.
  • FIG. 2B is a perspective illustration of one embodiment of a bottom side of the portable computer system of FIG. 2A.
  • FIG. 3 is a block diagram of exemplary circuitry of a portable computing system in accordance with one embodiment of the present invention.
  • FIG. 4 is a perspective view of the cradle device for connecting the portable computing system to other systems via a communication interface.
  • FIG. 5A is a perspective view of the top face of an exemplary portable computer device incorporating an optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 5B is a perspective view of the side edge of an exemplary portable computer device incorporating an optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 5C is a perspective view of the side edge of an exemplary portable computer device, depicting an array of visually formatted information, including text and highlighted text, on a display screen, and incorporating an optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 6A is a concentric top view of an exemplary optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 6B is a block diagram of electrical elements of an exemplary optical user interface, in accordance with one embodiment of the present invention.
  • FIG. 6C is a block diagram of electrical elements of an exemplary combination optical-electromechanical user interface, in accordance with one embodiment of the present invention.
  • FIG. 7A is a schematic diagram of an exemplary combination optical-electromechanical user interface, in accordance with one embodiment of the present invention.
  • FIG. 7B is a schematic diagram of en exemplary combination optical-electromechanical user interface, incorporating an exemplary flexible digitizer element, in accordance with one embodiment of the present invention.
  • FIG. 8 is a flow chart of steps in an exemplary process for implementing an optical user interface for an electronic device, in accordance with one embodiment of the present invention.
  • FIG. 9A is a flow chart of steps in an exemplary process for implementing a variable optical scan rate, in accordance with one embodiment of the present invention.
  • FIG. 9B is a flow chart of steps in an exemplary process for implementing a scan rate power usage protocol, in accordance with one embodiment of the present invention.
  • FIG. 10 is a flow chart of steps in an exemplary process for changing visually formatted information, in accordance with one embodiment of the present invention.
  • The drawings referred to in this description should not be understood as being drawn to scale except if specifically noted.
  • DETAILED DESCRIPTION OF THE INVENTION
  • In the following detailed description of the present invention, an optical sensor based user interface for a handheld device, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be recognized by one skilled in the art that the present invention may be practiced without these specific details or with equivalents thereof. In other instances, well-known methods, procedures, components, and circuits have not been described in detail as not to unnecessarily obscure aspects of the present invention.
  • Notation and Nomenclature
  • Some portions of the detailed descriptions, which follow, are presented in terms of procedures, steps, logic blocks, processing, and other symbolic representations of operations on data bits that can be performed on computer memory. These descriptions and representations are the means used by those skilled in the electronic, computer, and data processing arts to most effectively convey the substance of their work to others skilled in the art. A procedure, computer executed step, logic block, process, etc., is here, and generally, conceived to be a self-consistent sequence of steps or instructions leading to a desired result. The steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated in a computer system. It has proven convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like.
  • It should be borne in mind, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities. Unless specifically stated otherwise as apparent from the following discussions, it is appreciated that throughout the present invention, discussions utilizing terms such as “generating” or “coupling” or “changing” or “scanning” or “sending” or “sensing” or “processing” or “repeating” or “adjusting” or “modifying” or “displaying” or “highlighting” or “scrolling” or “formatting” or “selecting” or “moving” or the like, refer to the action and processes of a computer system or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
  • The present invention is discussed in one example in the context of a portable computer system, such as a portable computer device, palmtop computer, or personal digital assistant. However, it is appreciated that the present invention can be used with other types of devices that require user interfacing with a computer, e.g., cell phones, remote control devices, portable web browsers, pagers, etc.
  • Reference will now be made in detail to the preferred embodiments of the invention, examples of which are illustrated in the accompanying drawings. While the invention will be described in conjunction with the preferred embodiments, it will be understood that they are not intended to limit the invention to these embodiments. On the contrary, the invention is intended to cover alternatives, modifications and equivalents, which may be included within the spirit and scope of the invention as defined by the appended claims. Furthermore, in the following detailed description of the present invention, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, it will be obvious to one of ordinary skill in the art that the present invention may be practiced without these specific details.
  • Although the optical sensor based user interface of the present invention may be implemented in a variety of different electronic systems such as a pager, a mobile phone, a calculator, a personal digital assistant (PDA), etc., one exemplary embodiment includes the optical sensor based user interface with a portable computing system. It should be understood that the descriptions corresponding to FIGS. 1-4 provide some general information about an exemplary portable computing system.
  • Exemplary Portable Computer System
  • FIG. 1 illustrates a system 50 that may be used in conjunction with an exemplary portable computing device 100. Specifically, system 50 comprises a host computer system 56 which can either be a desktop unit as shown, or, alternatively, can be a laptop system 58. Optionally, one or more host computer systems can be used within system 50. Host computer systems 56 and 58 are shown connected to a communication bus 54, which in one embodiment can be a serial communication bus, but could be of any of a number of well known communication standards and protocols, e.g., a parallel bus, Ethernet, Local Area Network (LAN), and the like. Optionally, bus 54 can provide communication with the Internet 52 using a number of well known protocols.
  • Bus 54 is also coupled to a cradle 60 for receiving and initiating communication with portable computing device 100. Cradle 60 provides an electrical and mechanical communication interface between bus 54 (and anything coupled to bus 54) and the portable computer system 100 for two way communications. Computer system 100 also contains a wireless infrared communication mechanism 64 for sending and receiving information from other devices.
  • FIG. 2A is a perspective illustration of the top face 100 a of an exemplary portable computer system 100. The top face 100 a contains a display screen 105 surrounded by a top cover 110. A removable stylus 80 is also shown. The display screen 105 is a touch screen able to register contact between the screen and the tip of the stylus 80. Additionally, the stylus 80 can be fabricated of any material to make contact with the screen 105. The top face 100 a also contains one or more dedicated and/or programmable buttons 75 for selecting information and causing the computer system 100 to implement functions. The on/off button 95 is also shown.
  • FIG. 2A also illustrates a handwriting recognition pad or “digitizer” containing two regions 106 a and 106 b. For example, region 106 a is for the drawing of alpha characters therein for automatic recognition while region 106 b is for the drawing of numeric characters therein for automatic recognition. The stylus 80 is used for stroking a character within one of the regions 106 a and 106 b. The stroke information is then fed to an internal processor for automatic character recognition. Once characters are—recognized, they are typically displayed on the screen 105 for verification and/or modification.
  • FIG. 2B is a perspective illustration of one embodiment of a bottom side 100 b of portable computer system 100. An optional extendible antenna 85 is shown and also a battery storage compartment door 90 is shown. A communication interface 108 is also shown. In one embodiment of the present invention, the communication interface 108 is a serial communication port but could also alternatively be of any of a number of well known communication standards and protocols, e.g., parallel, small computer system interface (SCSI), Ethernet, FireWire (IEEE 1394), Universal Serial Bus (USB), etc.
  • FIG. 3 is a block diagram of exemplary circuitry of portable computing system 100 in accordance with one embodiment of the present invention. The computer system 100 includes an address/data bus 99 for communicating information, a central processor 101 coupled with the bus 99 for processing information and instructions. It is appreciated that central processor unit 101 may be a microprocessor or any other type of processor. The computer system 100 also includes data storage features such as a volatile memory 102 (e.g., random access memory, static RAM, dynamic RAM, etc.) coupled with the bus 99 for storing information and instructions for the central processor 101 and a non-volatile memory 103 (e.g., read only memory, programmable ROM, flash memory, EPROM, EEPROM, etc.) coupled with the bus 99 for storing static information and instructions for the processor 101. Computer system 100 may also include an optional data storage device 104 (e.g., thin profile removable memory) coupled with the bus 99 for storing information and instructions. It should be understood that device 104 may be removable. Furthermore, device 104 may also be a secure digital (SD) card-reader or equivalent removable memory reader.
  • Also included in computer system 100 of FIG. 3 is an alphanumeric input device 106 which in one implementation is a handwriting recognition pad (“digitizer”) and may include integrated push buttons in one embodiment Device 106 can communicate information (spatial data and pressure data) and command selections to the central processor 101. The digitizer 106 records both the (x, y) coordinate value of the current location of the stylus 80 and also simultaneously records the pressure that the stylus 80 exerts on the face of the digitizer pad 106. The coordinate values (spatial information) and pressure data are then output on separate channels for sampling by the processor 101. In one implementation, there are roughly 256 different discrete levels of pressure that can be detected by the digitizer 106. Since the digitizer's channels are sampled serially by the processor 101, the stroke spatial data are sampled “pseudo” simultaneously with the associated pressure data. The sampled data is then stored in a memory by the processor 101 for later analysis.
  • System 100 of FIG. 3 also includes an optional cursor control or directing device 107 coupled to the bus 99 for communicating user input information and command selections to the central processor 101. In one implementation, device 107 is a touch screen device (also a digitizer) incorporated with screen 105. Device 107 is capable of registering a position on the screen 105 where the stylus 80 makes contact and the pressure of the contact. The digitizer of 106 or 107 may be implemented using well known devices, for instance, using the ADS-7846 device by Buff-Brown that provides separate channels for spatial stroke information and pressure information.
  • Computer system 100 also contains a flat panel display device 105 coupled to the bus 99 for displaying information to the computer user. The display device 105 utilized with the computer system 100 may be a liquid crystal device (LCD), cathode ray tube (CRT), field emission device (FED, also called flat panel CRT), plasma or other display technology suitable for creating graphic images and alphanumeric characters recognizable to the user. In one embodiment, the display 105 is a flat panel multi-mode display capable of both monochrome and color display modes.
  • Also included in computer system 100 of FIG. 3 is a signal communication device 108 coupled to bus 99 that may be a serial port (or USB port) for enabling system 100 to communicate with the cradle 60. As mentioned above, in one embodiment, the communication interface 108 is a serial communication port, but could also alternatively be of any of a number of well known communication standards and protocols, e.g., parallel, SCSI, Ethernet, FireWire (IEEE 1394), USB, etc. In addition to device 108, wireless communication links can be established between the device 100 and a host computer system (or another portable computer system) using a Bluetooth wireless device 112, an infrared (IR) device 64, or a Global System for Messaging (GSM) radio device 114. System 100 may also include a wireless modem device 114 and/or a wireless radio, e.g., a GSM wireless radio with supporting chip set. The wireless modem device 114 is coupled to communicate with the central processor 101 but may not be directly coupled to port 108.
  • In one implementation, the Mobitex wireless communication system may be used to provide two way communication between computer system 100 and other networked computers and/or the Internet (e.g., via a proxy server). In other embodiments, transmission control protocol (TCP) can be used or Short Message Service (SMS) can be used. System 100 of FIG. 3 may also contain batteries for providing electrical power.
  • In one embodiment, Optical User Interface 75 is coupled to Processor 101 by bus 99. In one embodiment, processor 101 sends an optical signal generation demand signal 770 to optical user interface 75. In the present embodiment, optical user interface 75 generates an optical signal 555 accordingly. Signal 770, in one embodiment, controls the optical scan rate of optical user interface 75. After a user interaction, optical signal 555 is redetected by optical user interface 75, which generates a corresponding interface signal 771, which is sent to processor 101, in one embodiment, with a scan rate power usage signal 772. In one implementation, optical user interface 75 interacts with display device 105 for control of the exhibition of visually formatted information. In one embodiment, optical user interface 75 interacts with on-screen cursor control 107 and display device 105 for control and positioning of an on-screen cursor. In one embodiment, optical user interface 75 interacts with digitizer 106. In one embodiment, digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75, in an optical-electromechanical user interaction enabling implementation. In one embodiment, the optical user interaction is controlled by a program implemented by computer readable and executable instructions distributed to varying degrees in various implementations between processor 101, RAM 102, ROM 103, and storage device 104.
  • FIG. 4 is a perspective illustration of one embodiment of the cradle 60 for receiving the portable computer system 100. The cradle 60 contains a mechanical and electrical interface 260 for interfacing with communication interlace 108 (FIG. 2B) of computer system 100 when system 100 is slid into the cradle 60 in an upright position. Once inserted, button 270 can be pressed to initiate two way communication between portable computer system 100 and other computer systems coupled to communication bus 54.
  • Exemplary User Interfaces Exemplary Optical User Interfaces
  • FIG. 5A is a perspective illustration of the top face 100 a of one embodiment of a palmtop computer system 100, that can be used with the present invention. Optical user interface 75 is depicted as mounted, in one embodiment, in the center of the lower portion of top face 100 a, below screen 105 and digitizer 106. In one embodiment, optical user interface 75 interacts with digitizer 106, and may be mounted beneath it. In the present embodiment, digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75, in an optical-electromechanical user interaction enabling implementation.
  • It is appreciated that the position depicted for optical user interface 75 herein is not intended to be limiting. For example, optical user interface 75 may be mounted in any user accessible position on system 100. Such positions are illustrated, for example only, and not limited to, possible other positions 75 p.
  • In FIG. 5B, a perspective illustration of the side edge of exemplary system 100 is depicted. Optical User interface 75 is depicted, for example only, and not limited, in a position low on the upper face 100 a. Lower face 100 b is depicted opposite to upper face 100 a, for perspective.
  • In FIG. 5C, a perspective of the top face 100 a of one embodiment of a palmtop computer system 100, that can be used with the present invention. Optical user interface 75 is depicted as mounted, in one embodiment, in the center of the lower portion of top face 100 a, below screen 105 and digitizer 106. In one embodiment, optical user interface 75 interacts with digitizer 106, and may be mounted beneath it.
  • Screen 105 displays an exemplary array of visually formatted information 105 d. In the present example, the array of visually formatted information 105 d includes text. It is appreciated that array of visually formatted information 105 d is not limited to text, but may include graphics, combinations of text and graphics, and any other visually formatted information. In the present example, the text constituting array of visually formatted information 105 d is a portion of an imaginary telephone list including names and corresponding telephone numbers, a common and useful portable computer system feature. It is appreciated that the text constituting array of visually formatted information 105 d may include any textual information not to be construed as delimited by the present example. In the present example, the text constituting array of visually formatted information 105 d includes a highlighted portion 105 h. Highlighted portions of text or other forms of visually formatted information may be used to focus a user's attention, to target data for selection, and other purposes. In one embodiment, highlighting can be moved through scrolling. In one embodiment, highlighting and scrolling may be performed by a user interacting with system 100 through manipulation of optical user interface 75.
  • Referring to FIG. 6A, a detailed concentric top view of an exemplary optical user interface 75, in accordance with one embodiment of the present invention, is described. A transparent covering 75.1 covers optical user interface 75.
  • In one embodiment, transparent covering 75.1 is flexible and mounted beneath digitizer 106, which, in the present embodiment, is flexible and transparent, likewise. In one embodiment, transparent covering 75.1 forms a part of flexible and transparent digitizer 106. In one embodiment, flexible and transparent digitizer 106 constitutes transparent covering 75.1. In one embodiment, flexible and transparent digitizer 106 is embedded within transparent cover 75.1 (e.g., as depicted in FIG. 7B). In any of the present embodiments, digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75, in an optical-electromechanical user interaction enabling implementation.
  • Importantly, transparent covering 75.1 covers optical user interface 75, yet allows optical interaction with a user. Further, transparent covering 75.1 seals optical user interface 75, and system 100 about optical user interface 75. Advantageously, this prevents the incursion of environmental contaminants to seals optical user interface 75, and system 100. Optical user interlace enclosure 75.2 forms a package about optical user interface 75 optical and electrical components to be described next.
  • Optical user interface package foundation 752 mounts an optical source 75.4 and an optical sensor 75.5. Further, optical user interlace package foundation 75.3 forms an optical portal 75.6, such as an optically transmissive channel with precisely reflective and focusing contours capable of coupling optical source 75.4 and an optical sensor 75.5.
  • In one embodiment, optical sensor 75.5 is a solid state photosensitive electro-optical device which generates an electrical output corresponding to an optical input. In one embodiment, optical sensor 75.5 is a quantum photodetector. In one embodiment, optical sensor 75.5 is a radiometer. In one embodiment, optical sensor 75.5 is a pyroelectric detector. In one embodiment, optical sensor 75.5 works photoconductively. In one embodiment, optical sensor 75.5 works photovoltaically.
  • In one embodiment, optical source 75.4 is a light emitting diode (LED). In one embodiment, optical source 75.4 is a laser diode (LD). In one embodiment, optical source 75.4 is a quantum dot. For simplicity, optical source 75.4 will herein be referred to as an exemplary LED 75.4. LED 75.4 and optical detector 75.5 operate at frequencies which enable their interoperation and coupling. In one embodiment, optical user interface operation is at visible wavelengths. In one embodiment, optical user interface 75 operation is in the infrared. In one implementation, operation of the optical user interlace 75 is in the near infrared.
  • Optical portal 75.6 couples LED 75.4 and optical sensor 75.5 in such a way that a user interaction, such as touching transparent covering 75.1, optically modifies the optical coupling between LED 75.4 and optical sensor 75.5. Optically coupled scanning between LED 75.4 and optical sensor 75.5 occurs at a rate controlled by processor 101 (FIG. 3). Optically coupled scanning between LED 75.4 and optical sensor 75.5 enables detection of commencement, progression, development and modification, and termination of interactions with users.
  • In one embodiment, the user touches transparent covering 75.1. The touch may be implemented by the user's thumb or fingertips, for example. In one embodiment, the changes in optical coupling between LED 75.4 and optical detector 75.5 corresponding to the touch and detected by scanning result in the generation of an interaction signal (interaction signal 771; FIG. 6B). In one embodiment, the optical coupling between LED 75.4 and optical detector 75.5 corresponding to the touch and detected by scanning can be further, stochastically, and/or continually changed by the user varying the touch to transparent cover 75.1, for example, by movement of the thumb or fingertips touching transparent cover 75.1 This correspondingly results in the optical scanning tracking the user transaction and further generating an interaction signal 771 accordingly transmitting the scan-tracking information to processor 101. Processor 101 may process the information to generate programmatic response. Scan rates may be variable, in one embodiment. In the present embodiment, variable scan rates may implement a scan rate power usage protocol, transmitted by scan rate power usage signals 772. It is appreciated that the optical user interface 75 may also, in one embodiment, enable further and/or other user interaction by, for example, an electromechanical modality.
  • In FIG. 63, the optical and electrical interrelationship 75E between elements constituting optical user interface 75, system bus 99, and processor 101 are depicted. Optical user interface package foundation 75.3 mounts and electrically interconnects LED 75.4 and optical sensor 75.5.
  • Optical user interface package foundation 75.3 mounts LED 75.4 and optical sensor 75.5 in such a configuration as to delineate optical portal 75.6, optically coupling LED 75.4 and optical sensor 75.5. LED 75.4 and optical sensor 75.5 are optically coupled through optical portal 75.6 such that optical signal 655, emitted by LED 75.4, may be detected by optical sensor 75.5.
  • Optical user interface sub-bus 75.9 electrically interconnects LED 75.4 and optical sensor 75.5, through optical user interface packaging foundation 75.3, to bus 99, which is electrically interconnected with processor 101. Signals interflow between these elements as follows.
  • Optical signal generation demand signal 770, generated by processor 101, flows over busses 99 and 75.9, through optical user interface packaging foundation 75.3 interconnection, to LED 75.4, stimulating LED 75.4 to emit optical signal 555 accordingly. Processor 101 thus controls signal 555 and corresponding optical scanning via optical portal 75.6. Interface signal 771, generated by optical. sensor 75.5 responsive to detection and conversion of optical signal 555, flows through optical user interface packaging foundation 75.3 interconnection, over busses 75.9 and 99, sequentially, to processor 101. Processor 101 processes interface signal 771 programmatically.
  • Further, in one embodiment, processor 101 controls the optical scan rate employed by optical user interface 75 (FIG. 6A) by and according to scan rate power usage signal 772. Scan rate power usage signal 772 transmits information corresponding to the scan rate power usage from optical user interface 75 to processor 101, and transmits responsive scan rate control from processor 101 to optical user interface 75.
  • In one embodiment, optical user interface 75 functions as an optical sensor operable to sense movement of an object over a surface thereof, and a processor is responsive to said optical sensor for altering said selected item according to said movement, In one embodiment, optical user interface 75 functions as an optical sensor operable to sense tactile contact of said object with said surface. In one embodiment˜optical user interface 75 functions as an optical sensor operable to sense the speed of said movement of said object. In one embodiment, optical user interface 75 functions as an optical sensor operable to sense the direction of said movement of said object. In the present embodiment, control circuitry coupled to optical user interface 75 is operable to vary a rate at which optical sensor 75.5 is scanned in response to detected user activity.
  • Processor 101, in the present embodiment, is responsive to optical sensor 75.5 sensing user interactive movement at a first speed to perform a first display update of the array of visually formatted information (e.g., text 105.d; FIG. 50) Further, processor 101 is responsive to optical sensor 75.5 sensing user interactive movement at a second speed to perform a second update of said Information. In the present embodiment, this enables coarse scroll operation, in the first processor response, and a fine scroll operation in the second. The user's finger may establish the optical contact with optical user interface 75 to implement these interactions.
  • Exemplary Optical-Electromechanical User Interfaces
  • With reference to FIG. 6C, the optical and electrical interrelationship 7SEM between elements of an exemplary combination optical-electromechanical user interface 75 m is depicted, in accordance with one embodiment of the present invention. Optical user interface package foundation 75.3 mounts LED 75.4 and optical sensor 75.5 in such a configuration as to delineate optical portal 75.6, optically coupling LED 75.4 and optical sensor 75.5. LED 75.4 and optical sensor 75.5 are optically coupled through optical portal 75.6 such that optical signal 555, emitted by LED 75.4, may be detected by optical sensor 75.5. Optical user interface sub-bus 75.9 electrically interconnects LED 75.4 and optical sensor 75.5, through optical user interface packaging foundation 75.3, to user interface mid-bus 859, which is electrically interconnected through bus 99 with processor 101.
  • User interface opto-electromechanical package foundation 803 mounts optical user interface module 75, and contains an electromechanical user interface enabling device such as a switch or dial (e.g., switch 804, FIGS. 7A and 7B). User interface electromechanical package foundation 803 electrically interconnects the electromechanical user interface (e.g., switch 804, FIGS. 7A and 7B) contained within it via electromechanical interface sub-bus 809 b to user interface mid-bus 859, which is electrically interconnected through bus 99 with processor 101, and transmits electromechanical interface signal 866 thereon.
  • With reference to FIG. 7A, an exemplary combination optical-electromechanical user interface enables several modalities of user interaction, in accordance with one embodiment of the present invention. An electronic device, in the present illustration, exemplary portable computer system 100, has a top face 100 a and a bottom face 100 b. Embedded within and sealing top face 100 a is transparent cover 75.1.
  • Transparent cover 75.1 covers optical user interface enclosure 75.2 which contains optical user interface package foundation 75.3 mount in 9 LED 75.4 and optical sensor 75.5 (FIG. 6). Further, optical user interface package foundation 75.3 forms an optical portal 75.6 (FIG. 6C), such as an optically transmissive channel with precisely reflective and focusing contours capable of coupling optical source 75.4 (FIG. 6C) and an optical sensor 75.5 (FIG. 6C). Optical user interface enclosure 75.2 forms a package about optical user interface 75 optical and electrical components (FIG. 6C). Optical user interface 75 (FIGS. 6B and 6C) generates an optical interface signal 711 (FIG. 6B).
  • Mounting optical user interface (e.g., optical user interface 75; FIG. 6C) components 75.1, 75.2, and 75.3, opto-electromechanical package foundation 803 also houses electromechanical user interface enabling components including, in the present embodiment, a switch assembly 804.
  • Switch assembly 804 contains a lower, foundational and non-moving base 802 b, fixedly mounted on the upper (e.g., inner) surface of base 110 b (e.g., internal to exemplary computer 100). Base 802 b mounts a set of fixed electrical contacts 801 b. An upper plug 802 a mounts movable electrical contacts 801 a, is spring supported and guided by spring assembly 823. Upper plug 802 a and contacts 801 a move up and down in switch assembly 804 in such a way as to respond to the interaction of a user, for example, pressing down on transparent cover 75.1, and make and break contact between movable contacts 801 a and fixed contacts 801 b accordingly.
  • Upon contact by a sufficiently forcible user interaction, movable contacts 801 a will make and wipe sufficiently on and over fixed contacts 801 b to ensure a correspondingly sufficient electrical contact. The making and breaking of movable contacts 801 a and fixed contacts 801 b in response to a mechanical user interaction generate an electromechanical user interface signal 866 (FIG. 6C).
  • Optical user interface signal 771 flows on optical user interface sub-bus 75.9 (FIG. 6B). Electromechanical user interface signal 866 (FIG. 6C) flows on electromechanical sub-bus 809 b. Sub-busses 75.9 and 809 b are electrically interconnected with user interface mid-bus 859. User interface mid-bus 859 is electrically interconnected with bus 99 (FIGS. 3, 6C), enabling optical and electromechanical interface signals 771 and 866, respectively, to be sent to processor 101 (FIGS. 3 and 6C), and control signals to flow from processor 101 back to the user interfaces 76 and 75 m (FIG. 6C).
  • Referring now to FIG. 7B, one embodiment of the present invention is depicted, wherein digitizer 106 is also flexible and transparent. In all other respects, the elements depicted in FIG. 7B are identical in form and function with those depicted in FIG. 7A. In the present embodiment, digitizer 106 is integrated with transparent cover 75.1. In the present embodiment, the transparency of digitizer 106, and its proximity to optical user interface package foundation 75.3, enables an interaction with a user for exemplary system 100 via the optical user interface (e.g., optical user interface 75; FIG. 6C). Further, the flexibility of digitizer 106, and its proximity to and mechanical integration with opto-electromechanical package foundation 803, enables an interaction with a user for exemplary system 100 via the electromechanical user interface (e.g., electromechanical user interface 75 m; FIG. 6C).
  • In the present embodiment, flexible and transparent digitizer 106 is embedded within transparent cover 75.1 (e.g., as depicted in FIG. 7B). In one embodiment, transparent covering 75.1 is flexible and mounted beneath digitizer 106, which, in the present embodiment, is flexible and transparent, likewise. In one embodiment, transparent covering 75.1 forms a part of flexible and transparent digitizer 106. In one embodiment, flexible and transparent digitizer 106 constitutes transparent covering 75.1. In any of these embodiments, digitizer 106 is a mechanically flexible and optically transparent pad, enabling both optical and mechanical user interaction via optical user interface 75 (FIG. 6C) and electromechanical user interface 75 m (FIG. 6C), in an optical-electromechanical user interaction enabling implementation. Digitizer sub-bus 106.1 is electrically interconnected with bus 99, interconnecting digitizer 106 with processor 101 (FIG. 3).
  • Exemplary Processes
  • FIGS. 8, 9A, 9B, and 10 are flowcharts of the steps performed in processes 800, 900A, 900B, and 1000, respectively, each individually in accordance with single, separate individual embodiments of the present invention, as discussed separately below. Flowcharted processes 800, 900A, 900B, and 1000 each include a single, separate, individual process of the present invention which, in each embodiment, are carried out by processors and electrical components under the control of computer readable and computer executable instructions. The computer readable and computer executable instructions reside, for example, in data storage features such as within processor 101, computer usable volatile memory 102, computer usable non-volatile memory 103, and/or data storage device 104, all of FIG. 3. However, the computer readable and computer executable instructions may reside In any type of computer readable medium. Although specific steps are disclosed in each of flowcharts 800, 900A, 900B, and 1000, such steps are exemplary. That is, the present invention is well suited to performing various other steps or variations of the steps recited in FIGS. 8, 9A, 9B, and 10. Within these present embodiments, it should be appreciated that the steps of flowcharts 800, 900A, 900B, and 1000 may be performed by software or hardware or any combination of software and hardware.
  • Exemplary Process for User Interaction
  • Referring to FIG. 8, the steps in a process 800 enable the interaction of a user with a system (e.g., exemplary system 100; FIGS. 1, 3, 5A, 5B, 7A, and 7B)-using an optical user interface (e.g., 75; FIGS. 2A, 3, 5A, 5B, 6A, 6B, 6C), in accordance with one embodiment of the present invention. Beginning with step 801, an optical signal (e.g., optical signal 555; FIGS. 6B and 6C) is demanded by a processor (e.g., processor 101; FIGS. 3, 6B, and 6C). The demand may be by a demand signal (e.g., 770; FIG. 6B).
  • In step 802, an optical signal (e.g., optical signal 555; FIGS. 6B and 6C) is generated responsive to the demand (step 801). The optical signal is generated by an optical source (e.g., optical source 75.4; FIGS. 6A, 6B, and 6C), which in one embodiment, is an LED.
  • In step 803, the optical signal is coupled from the optical source into an optical portal (e.g., optical portal 75.6; FIGS. 6A, 6B, and 6C).
  • The optical portal is scanned; step 804. Scanning1 in one embodiment, may be performed by an optical sensor (e.g., optical detector 75.5; FIGS. 6A, 6B, and 6C).
  • Scanning the optical portal (step 804) enables the detection of a user interaction; step 805. If no user interaction is detected, process 800 loops back to demanding an optical signal (step 801), and the process repeats itself.
  • If, however, a user interaction is detected in step 805, the optical coupling characteristics of the optical portal are changed by the interaction of the user. This results in a corresponding change in the optical coupling characteristics of the optical portal coupling the source and detector; step 807.
  • Any change in optical coupling results in the generation of an interface signal in step 808.
  • Interface signals are sent to a processor (e.g., processor 101; FIGS. 3, 6B, and 6C); step 809. The interface signals may be sent via an interconnecting bus (e.g., bus 99; FIGS. 3, 6B, and 6C).
  • In step 810, the processor processes the interface signal as information, and process 800 loops back to the step of demanding an optical signal (step 801).
  • Exemplary Scan Rate Adjustment Process
  • Referring to FIG. 9A, the steps in a process 900A are depicted wherein the scanning rate of an optical user interface is automatically adjusted, in accordance with one embodiment of the present invention. Beginning with step 901, the optical user interface (OUI) (e.g., OUI 75; FIGS. 3, 6A, 6B, and 6C) under the control of a processor (e.g., processor 101; FIGS. 3, 6B, and 6C), scans at a first, relatively slow rate.
  • If no interaction with a user is detected in step 902, process 900A continues the scanning at the first rate.
  • If however, an interaction with a user is detected in step 902, the activation of a user interaction is sensed; step 903.
  • Upon detecting activation of a user interaction (step 903), the scan rate is increased accordingly to an initial, relatively higher rate; step 904.
  • In step 905, the speed with which the user interaction is occurring and/or varying (for example, the relative speed and any speed variation with which the user's thumb passes, rubs, or flicks over the transparent cover of the optical portal, e.g., cover 75.1 and portal 75.6, respectively; FIGS. 6A, 6B, and 6C) is detected. If no variation in the speed with which the user interaction is occurring is detected, process 900A loops back to step 904, and continues to scan at the initial second rate.
  • If, however, a variation in the speed with which the user interaction is occurring is detected in step 905, the scan rate is adjusted accordingly; step 906. Further, the speed with which the user interaction is occurring and/or varying is continually monitored, process 900A looping back to step 905.
  • This continues as long as no interruption in the user interaction is detected in step 907. If an interruption in the user interaction is detected in step 907, process 900A loops back to step 901, with scanning resumed at the relatively slow first scan rate. In one embodiment, process 900A enables implementation of a scan rate power usage protocol.
  • Exemplary Scan Rate Power Usage Information Process
  • In one embodiment, a process 900B enables a processor (e.g., processor 101; FIGS. 3, 6B, and 6C) to receive information regarding power usage by optical scanning processes (e.g., process 900A; FIG. 9A).
  • Process 900B begins with step 910, wherein a fixed power usage signal is generated corresponding to a first scan rate (e.g., a relatively low initial scan rate, such as that scan rate generated instep 901; FIG. 9A).
  • Power usage signals generated in step 910 is sent to a processor; step 940.
  • In step 920, the scan rate is monitored, if scanning continues at the first scan rate (e.g., no user interaction is detected, as for example in step 902; FIG. 9A), the corresponding power usage signal continues to be generated, process 900B looping back to step 910.
  • If scanning at a second rate is detected in step 920, a variable power usage signal corresponding to the second scan rate and its changes is generated; step 930.
  • Power usage signals generated in step 920 is sent to a processor; step 940.
  • Power usage signals and corresponding control signals (e.g., signals 772; FIG. 6B) enable implementation of a scan rate power usage protocol.
  • Exemplary Process for Display Control
  • With reference to FIG. 10, a process 1000 enables the control of visually formatted information displayed on a screen (e.g., display screen 105; FIGS. 2A, 3, and 5A). Beginning with step 1010, a user manipulates an optical user interface (e.g., OUI 75; FIGS. 3, 5A, 53, 6A, 6B, and 6C) according to the user's intent to vary visibly formatted information on the display screen.
  • The optical characteristics of the optical user interface are changed accordingly; step 1020.
  • Resultantly, a display change signal is generated; step 1030. Generating a display change signal may be a combination and interaction between integrated activities conducted by different system elements.
  • Upon changing optical characteristics in the optical user interface (step 1020), a corresponding interface signal (e.g., signal 771; FIG. 6B) is generated and sent to the processor (e.g., processor 101; FIGS. 3, 6B, and 6C). The processor programmatically responds to the interface signal by generating a responsive display control signal, which is transmitted to the display device to change the array of visibly formatted information thereon accordingly; step 1040. The programmatic response may be controlled by the processor under the direction of software or data stored, to varying degrees, in the processor itself, in memory, an and/or in a data storage device (e.g., RAM 102, ROM 103, and/or storage 104, respectively; FIG. 3). If a cursor and/or scrolling, for example (discussed below in steps 1060 through 1075), is included in the array of visually formatted information displayed on the screen, an cursor controller (e.g., cursor control 107; FIG. 3) may also be involved.
  • In step 1050, it is determined if the user intends to change the highlighting of any portion of the array of visually formatted information, by which portions of the array may be designated or selected for change of selection of displayed information, or a scrolling function. If so, the portion to be highlighted is selected by optical user interfacing; step 1051.
  • The highlighting (e.g., the highlighted region of the array of visually formatted information on the display), or the highlighting itself, is moved; step 1052. At this point, process 1000 may be complete.
  • If no highlighting was determined for selection (step 1050), it is determined if the user intends to change the positioning of a cursor appearing within the array of visually formatted information, by which the attention and action of the user may be directed and/or focused; step 1060. If so, the position for placement of the cursor is selected by optical user interfacing instep 1061.
  • The cursor is thus moved to the designated location within the array of visually formatted information; step 1062. At this point, process 1000 may be complete.
  • If no cursor positioning was selected (step 1060), it is determined in step 1070 if the visually formatted information array is to be scrolled. If not, process 1000 may be complete.
  • If scrolling is designated (step 1060), scrolling is initiated and controlled by optical user interfacing; step 1075. At this point, process 1000 is complete.
  • An embodiment of the present invention, an optical sensor based user interface for a handheld device is thus described. While the present invention has been described in particular embodiments, it should be appreciated that the present invention should not be construed as limited by such embodiments, but rather construed according to the below claims.

Claims (20)

1. A portable electronic device comprising:
an optical sensor operable to detect user interaction with said portable electronic device, wherein said optical sensor detects variation in optics responsive to a user interaction with said portable electronic device;
a display operable to display information, wherein said display is further operable to display information in response to said detected user interaction, wherein said display and said optical sensor are part of a common housing; and
a processor coupled to said optical sensor, wherein said processor is operable to process said detected user interaction, and wherein said processor is responsive to said user interaction to control an operation of said portable electronic device dependent on a speed of said user interaction.
2. The portable electronic device as described in claim 1, wherein said optical sensor is selected from a group consisting of: a solid state photosensitive electro-optical device; a quantum photodetector; a radiometer; and a pyroelectric detector.
3. The portable electronic device as described in claim 2 further comprising:
an optical source, wherein said optical source is selected from a group consisting of: a light emitting diode (LED); a laser diode (LD); and a quantum dot.
4. The portable electronic device as described in claim 1, wherein said operation comprises scrolling, on said display, through a plurality of graphical items rendered on said display.
5. The portable electronic device as described in claim 1, wherein operation of said optical sensor varies in response to a user's varying touch.
6. The portable electronic device as described in claim 1, wherein said sensor comprises a surface, and wherein said optical sensor is further operable to detect speed and direction of movement of said user interaction over said surface.
7. The portable electronic device as described in claim 6, wherein said processor in response to said optical sensor detecting a first movement at a first speed performs a first display update at a first update rate, and wherein said processor in response to said optical sensor detecting a second movement at a second speed performs a second display update at a second update rate faster than said first update rate.
8. A method of optical detection within a mobile electronic device, said method comprising:
optically detecting a user interaction with a display of said mobile electronic device using an optical sensor coupled to said display, wherein said optical sensor and said display are integrated within a same housing;
processing information related to said user interaction; and
in response to said processing, controlling an operation of said mobile electronic device depending on a speed of said user interaction as detected by said optical sensor.
9. The method as described in claim 8 wherein said optically detecting comprises:
receiving optical signals via said optical sensor; and
determining variation in said optical signals, wherein said variation is in response to said user interaction with a surface of said optical sensor.
10. The method as described in claim 9 further comprising:
scanning between an optical source and said optical sensor.
11. The method as described in claim 9, wherein said variation in said optical signals is in response to a user's varying touch.
12. The method as described in claim 8, wherein said operation comprises scrolling through a plurality of graphical items rendered on said display wherein a speed of said scrolling and a direction of said scrolling depend on a speed and a direction, respectively of said user interaction.
13. The method as described in claim 8 wherein said processing and said controlling are performed by a processor that is also integrated within the same housing.
14. The method as described in claim 8 wherein said optically detecting comprises:
detecting speed and direction of movement of said user interaction over a surface of said optical sensor.
15. A portable electronic device comprising:
a display operable to display information comprising graphical items;
a sensor coupled to said display, wherein said display and said sensor are disposed within a same housing, and wherein said sensor is operable to detect a movement of a user's finger over a surface; and
a processor coupled to said sensor, wherein said processor is operable to alter a display of said graphical items in response to said sensor and based on a speed of said movement.
16. The portable electronic device as described in claim 15, wherein display of said graphical items is altered by scrolling through said graphical items wherein a speed of said scrolling is based on said speed of said movement.
17. The portable electronic device as described in claim 16, wherein said scrolling updates said display at a first rate responsive to said sensor sensing said movement of said user's finger at a first speed and updates said display at a second rate responsive to said sensor sensing said movement of said user's finger at a second rate.
18. The portable electronic device as described in claim 15, wherein a portion of said graphical items is user selectable.
19. The portable electronic device as described in claim 15, wherein said sensor is further operable to detect speed and direction of movement of said user's finger over a surface.
20. The portable electronic device as described in claim 15, wherein said sensor is optical.
US12/177,460 2001-05-30 2008-07-22 Optical sensor based user interface for a portable electronic device Abandoned US20090184942A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US12/177,460 US20090184942A1 (en) 2001-05-30 2008-07-22 Optical sensor based user interface for a portable electronic device
US15/712,115 US20180013875A1 (en) 2001-05-30 2017-09-21 Optical sensor based user interface for a portable electronic device

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US09/871,375 US6816154B2 (en) 2001-05-30 2001-05-30 Optical sensor based user interface for a portable electronic device
US10/951,537 US7411583B1 (en) 2001-05-30 2004-09-27 Optical sensor based user interface for a portable electronic device
US12/177,460 US20090184942A1 (en) 2001-05-30 2008-07-22 Optical sensor based user interface for a portable electronic device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/951,537 Continuation US7411583B1 (en) 2001-05-30 2004-09-27 Optical sensor based user interface for a portable electronic device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/712,115 Continuation US20180013875A1 (en) 2001-05-30 2017-09-21 Optical sensor based user interface for a portable electronic device

Publications (1)

Publication Number Publication Date
US20090184942A1 true US20090184942A1 (en) 2009-07-23

Family

ID=25357315

Family Applications (4)

Application Number Title Priority Date Filing Date
US09/871,375 Expired - Lifetime US6816154B2 (en) 2001-05-30 2001-05-30 Optical sensor based user interface for a portable electronic device
US10/951,537 Expired - Lifetime US7411583B1 (en) 2001-05-30 2004-09-27 Optical sensor based user interface for a portable electronic device
US12/177,460 Abandoned US20090184942A1 (en) 2001-05-30 2008-07-22 Optical sensor based user interface for a portable electronic device
US15/712,115 Abandoned US20180013875A1 (en) 2001-05-30 2017-09-21 Optical sensor based user interface for a portable electronic device

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US09/871,375 Expired - Lifetime US6816154B2 (en) 2001-05-30 2001-05-30 Optical sensor based user interface for a portable electronic device
US10/951,537 Expired - Lifetime US7411583B1 (en) 2001-05-30 2004-09-27 Optical sensor based user interface for a portable electronic device

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/712,115 Abandoned US20180013875A1 (en) 2001-05-30 2017-09-21 Optical sensor based user interface for a portable electronic device

Country Status (2)

Country Link
US (4) US6816154B2 (en)
WO (1) WO2002097597A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090154116A1 (en) * 2007-10-23 2009-06-18 Psion Teklogix Inc. Expansion system for portable electronic devices
US20130307799A1 (en) * 2012-05-16 2013-11-21 Siemens Aktiengesellschaft Touchscreen with analog pressure detection as user interface for industrial technical device
WO2014105144A1 (en) * 2012-12-28 2014-07-03 Intel Corporation Variable touch screen scanning rate based on user presence detection
US20140285446A1 (en) * 2013-03-25 2014-09-25 Panasonic Corporation Electronic device
WO2017075444A1 (en) * 2015-10-30 2017-05-04 Essential Products, Inc. Optically transmissive antenna break structures for wireless devices, and associated systems and processes
WO2017115891A1 (en) * 2015-12-30 2017-07-06 대구대학교 산학협력단 Industrial embedded device to which low power technique is applied

Families Citing this family (68)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE522769C2 (en) * 2001-07-02 2004-03-02 Tds Todos Data System Ab Portable card reader for communication with cards
EP1522078B1 (en) * 2002-07-08 2007-08-29 Nxp B.V. Erasable and programmable non-volatile cell
US7305631B1 (en) * 2002-09-30 2007-12-04 Danger, Inc. Integrated motion sensor for a data processing device
FI20022282A0 (en) * 2002-12-30 2002-12-30 Nokia Corp Method for enabling interaction in an electronic device and an electronic device
DE10341580A1 (en) * 2003-09-09 2005-03-31 Siemens Ag Input device for a data processing system
US7570247B2 (en) * 2003-11-24 2009-08-04 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Modular assembly for a self-indexing computer pointing device
US7429976B2 (en) * 2003-11-24 2008-09-30 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Compact pointing device
US7401300B2 (en) * 2004-01-09 2008-07-15 Nokia Corporation Adaptive user interface input device
EP1723505A4 (en) 2004-03-11 2007-04-18 Redsky Mobile Inc Restricted user interface navigation
US20050243658A1 (en) * 2004-04-30 2005-11-03 Joseph Mack Bible verse wristwatch
WO2005109160A1 (en) * 2004-05-12 2005-11-17 Redsky Mobile Inc. Navigation of an n-dimensional hierarchical structure using a 2-dimensional controller
TWI252421B (en) * 2004-11-10 2006-04-01 Darfon Electronics Corp Optical pointing sensor and cursor control method thereof
US7978173B2 (en) * 2005-01-14 2011-07-12 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Pointing device including a moveable puck with mechanical detents
US7586480B2 (en) 2005-02-28 2009-09-08 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Hybrid pointing device
JP5358865B2 (en) * 2005-06-23 2013-12-04 ソニー株式会社 Display terminal device
JP4564904B2 (en) * 2005-08-29 2010-10-20 パイオニア株式会社 Coordinate position detection apparatus, control method therefor, and control program
FI20051283A (en) * 2005-12-13 2007-06-14 Elcoteq Se Method and Arrangement for Managing a Graphical User Interface and a Portable Device with a Graphical User Interface
US7701440B2 (en) * 2005-12-19 2010-04-20 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Pointing device adapted for small handheld devices having two display modes
US7798407B2 (en) * 2006-04-07 2010-09-21 Marvell International Technology Ltd. Scanning apparatus and method for entering a user input into the apparatus using a non-electrical control device
US8297509B2 (en) 2006-04-07 2012-10-30 Marvell International Ltd. User interface feedback using scanner light source
ITMO20060129A1 (en) * 2006-04-21 2007-10-22 Geotech Lizenz A G BUILDING ELEMENT FOR THE REALIZATION OF WALLS WITH FILLING OF REPACKING MATERIAL, PARTICULARLY EARTH OR SIMILAR
US20070247446A1 (en) * 2006-04-25 2007-10-25 Timothy James Orsley Linear positioning input device
US20070247421A1 (en) * 2006-04-25 2007-10-25 Timothy James Orsley Capacitive-based rotational positioning input device
US7889176B2 (en) * 2006-07-18 2011-02-15 Avago Technologies General Ip (Singapore) Pte. Ltd. Capacitive sensing in displacement type pointing devices
KR20080023832A (en) * 2006-09-12 2008-03-17 삼성전자주식회사 Touch screen for mobile terminal and power saving method thereof
US7969426B2 (en) * 2006-10-31 2011-06-28 Hewlett-Packard Development Company, L.P. Light sensitive display interface for computing devices
US7732756B2 (en) * 2006-11-01 2010-06-08 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. User navigation device with a code wheel and an encoder
US7507950B2 (en) * 2006-11-09 2009-03-24 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Encoder with a combined position and index track
US7400269B2 (en) * 2006-11-09 2008-07-15 Avago Technologies Ecbu Ip Pte Ltd Coding element with integrated limit switch
US20080203283A1 (en) * 2007-02-23 2008-08-28 Yee Loong Chin Optical encoder with detector lens
US8232963B2 (en) * 2007-08-27 2012-07-31 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Control and data entry apparatus
US20090058802A1 (en) * 2007-08-27 2009-03-05 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Input device
US7978175B2 (en) * 2007-11-23 2011-07-12 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Magnetic re-centering mechanism for a capacitive input device
US20090135157A1 (en) * 2007-11-27 2009-05-28 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Capacitive Sensing Input Device with Reduced Sensitivity to Humidity and Condensation
US8106885B2 (en) * 2007-12-19 2012-01-31 Research In Motion Limited Input mechanism for handheld electronic communication device
US20090167702A1 (en) * 2008-01-02 2009-07-02 Nokia Corporation Pointing device detection
US8169420B2 (en) * 2008-02-05 2012-05-01 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Reporting optical tracking data based on integrated resolution switching and surface detection
US9225817B2 (en) * 2008-06-16 2015-12-29 Sony Corporation Method and apparatus for providing motion activated updating of weather information
KR101529916B1 (en) * 2008-09-02 2015-06-18 엘지전자 주식회사 Portable terminal
KR101554183B1 (en) * 2008-10-15 2015-09-18 엘지전자 주식회사 Mobile terminal and method for controlling output thereof
KR20100069086A (en) * 2008-12-16 2010-06-24 삼성전자주식회사 Apparatus and method for continual key input using a optical mouse sensor in a computing equipment
US8030914B2 (en) * 2008-12-29 2011-10-04 Motorola Mobility, Inc. Portable electronic device having self-calibrating proximity sensors
US20100164756A1 (en) * 2008-12-30 2010-07-01 Nokia Corporation Electronic device user input
US8275412B2 (en) 2008-12-31 2012-09-25 Motorola Mobility Llc Portable electronic device having directional proximity sensors based on device orientation
US20100271331A1 (en) * 2009-04-22 2010-10-28 Rachid Alameh Touch-Screen and Method for an Electronic Device
US8294105B2 (en) * 2009-05-22 2012-10-23 Motorola Mobility Llc Electronic device with sensing assembly and method for interpreting offset gestures
US8269175B2 (en) * 2009-05-22 2012-09-18 Motorola Mobility Llc Electronic device with sensing assembly and method for detecting gestures of geometric shapes
US8619029B2 (en) * 2009-05-22 2013-12-31 Motorola Mobility Llc Electronic device with sensing assembly and method for interpreting consecutive gestures
US8391719B2 (en) * 2009-05-22 2013-03-05 Motorola Mobility Llc Method and system for conducting communication between mobile devices
US8542186B2 (en) * 2009-05-22 2013-09-24 Motorola Mobility Llc Mobile device with user interaction capability and method of operating same
US8788676B2 (en) * 2009-05-22 2014-07-22 Motorola Mobility Llc Method and system for controlling data transmission to or from a mobile device
US8304733B2 (en) * 2009-05-22 2012-11-06 Motorola Mobility Llc Sensing assembly for mobile device
US8344325B2 (en) * 2009-05-22 2013-01-01 Motorola Mobility Llc Electronic device with sensing assembly and method for detecting basic gestures
US8319170B2 (en) 2009-07-10 2012-11-27 Motorola Mobility Llc Method for adapting a pulse power mode of a proximity sensor
US8665227B2 (en) * 2009-11-19 2014-03-04 Motorola Mobility Llc Method and apparatus for replicating physical key function with soft keys in an electronic device
GB0921216D0 (en) * 2009-12-03 2010-01-20 St Microelectronics Res & Dev Improved touch screen device
US8963845B2 (en) 2010-05-05 2015-02-24 Google Technology Holdings LLC Mobile device with temperature sensing capability and method of operating same
US8751056B2 (en) 2010-05-25 2014-06-10 Motorola Mobility Llc User computer device with temperature sensing capabilities and method of operating same
US9103732B2 (en) 2010-05-25 2015-08-11 Google Technology Holdings LLC User computer device with temperature sensing capabilities and method of operating same
US8525102B2 (en) 2011-02-15 2013-09-03 Avago Technologies General Ip (Singapore) Pte. Ltd. Optical encoding system and optical encoder having an array of incremental photodiodes and an index photodiode for use in an optical encoding system
US8963885B2 (en) 2011-11-30 2015-02-24 Google Technology Holdings LLC Mobile device for interacting with an active stylus
US9063591B2 (en) 2011-11-30 2015-06-23 Google Technology Holdings LLC Active styluses for interacting with a mobile device
US8913008B2 (en) 2012-06-22 2014-12-16 Blackberry Limited Image data generation using a handheld electronic device
US9569552B2 (en) * 2012-07-31 2017-02-14 D2L Corporation Code based configuration of mobile devices
US8929679B1 (en) * 2013-06-12 2015-01-06 Google Inc. Systems and methods for changing contrast based on brightness of an output for presentation on a display
JP6023153B2 (en) * 2014-11-17 2016-11-09 京セラ株式会社 Portable electronic devices
FI126990B (en) * 2016-05-19 2017-09-15 Oy Stop Noise Finland Ltd Actuator for communication device
JP6941300B2 (en) * 2017-12-08 2021-09-29 ブラザー工業株式会社 Printing device and connection processing program

Citations (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4345148A (en) * 1980-10-06 1982-08-17 Hughes Aircraft Company Automatic responsivity control for a CCD imager
US4386345A (en) * 1981-09-22 1983-05-31 Sperry Corporation Color and brightness tracking in a cathode ray tube display system
US4475240A (en) * 1980-11-10 1984-10-02 Asea Aktiebolag Device for simultaneous creation and detection of markings
US4982618A (en) * 1987-11-03 1991-01-08 Culver Craig F Multifunction tactile manipulatable control
US5126723A (en) * 1989-12-11 1992-06-30 Hewlett-Packard Company Keyboard-mounted cursor position controller
US5149963A (en) * 1990-07-03 1992-09-22 Parker Hannifin Corporation Fiber-optic position sensor including photovoltaic bi-cell
US5177802A (en) * 1990-03-07 1993-01-05 Sharp Kabushiki Kaisha Fingerprint input apparatus
US5249104A (en) * 1990-07-03 1993-09-28 Tatsuji Mizobe Optical display device
US5270690A (en) * 1989-05-08 1993-12-14 Harold C. Avila Bidimensional input control system
US5270818A (en) * 1992-09-17 1993-12-14 Alliedsignal Inc. Arrangement for automatically controlling brightness of cockpit displays
US5283432A (en) * 1992-09-18 1994-02-01 Rockwell International Corporation Optical control knob assembly incorporated on a flat panel display apparatus
US5306908A (en) * 1993-03-15 1994-04-26 Hewlett-Packard Company Manually operated hand-held optical scanner with tactile speed control assembly
US5374989A (en) * 1992-10-29 1994-12-20 Sumitomo Cement Co. Ltd. Apparatus for identifying an object utilizing a tracking means and an identification beam
US5452240A (en) * 1993-11-23 1995-09-19 Roca Productions, Inc. Electronically simulated rotary-type cardfile
US5502459A (en) * 1989-11-07 1996-03-26 Proxima Corporation Optical auxiliary input arrangement and method of using same
US5635926A (en) * 1994-08-02 1997-06-03 Li; Kenneth K. Pointing and/or directional control device for controlling the movement and positioning of an object
US5737643A (en) * 1994-06-07 1998-04-07 Nikon Corporation Motion compensation device having stabilizing motion detection unit that does not inhibit imaging operations in an imaging unit
US5760773A (en) * 1995-01-06 1998-06-02 Microsoft Corporation Methods and apparatus for interacting with data objects using action handles
US5785439A (en) * 1992-08-24 1998-07-28 Product Engineering & Manufacturing, Inc. Environmentally safe machine control security switch
US5844547A (en) * 1991-10-07 1998-12-01 Fujitsu Limited Apparatus for manipulating an object displayed on a display device by using a touch screen
US5886308A (en) * 1997-12-22 1999-03-23 Otis Elevator Company Rope speed monitoring assembly and method
US5900863A (en) * 1995-03-16 1999-05-04 Kabushiki Kaisha Toshiba Method and apparatus for controlling computer without touching input device
US5912661A (en) * 1997-01-14 1999-06-15 Microsoft Corp. Z-encoder mechanism
US5926780A (en) * 1997-10-09 1999-07-20 Tweed Fox System for measuring the initial velocity vector of a ball and method of use
US5933089A (en) * 1995-12-19 1999-08-03 Nec Corporation Pager with message display function
US5938772A (en) * 1997-06-11 1999-08-17 Compaq Computer Corporation Responsive backlit hardwire button array providing illumination and user feedback in a computer
US5952992A (en) * 1995-07-17 1999-09-14 Dell U.S.A., L.P. Intelligent LCD brightness control system
US6008486A (en) * 1997-12-31 1999-12-28 Gentex Corporation Wide dynamic range optical sensor
US6043809A (en) * 1997-09-23 2000-03-28 Compaq Computer Corporation Computer keyboard scroll bar control
US6057840A (en) * 1998-03-27 2000-05-02 Sony Corporation Of Japan Computer-implemented user interface having semi-transparent scroll bar tool for increased display screen usage
US6057540A (en) * 1998-04-30 2000-05-02 Hewlett-Packard Co Mouseless optical and position translation type screen pointer control for a computer system
US6075518A (en) * 1997-07-15 2000-06-13 Gateway 2000, Inc. Rotational X-axis pointing device
US6088025A (en) * 1995-08-24 2000-07-11 Matsushita Electric Industrial Co., Ltd. Terminal device with built-in image sensor
US6122075A (en) * 1996-10-28 2000-09-19 Fuji Xerox Co., Ltd. Image forming apparatus
US6153876A (en) * 1996-10-24 2000-11-28 Sharp Kabushiki Kaisha Optical sensor with concave mirror
US6157958A (en) * 1998-07-31 2000-12-05 Qubit, Llc Modular tablet computer system
US6211940B1 (en) * 1991-02-04 2001-04-03 Dolby Laboratories Licensing Corporation Selecting analog or digital motion picture sound tracks
US6243069B1 (en) * 1997-04-22 2001-06-05 Matsushita Electric Industrial Co., Ltd. Liquid crystal display with image reading function, image reading method and manufacturing method
US6243079B1 (en) * 1998-07-07 2001-06-05 Primax Electronics, Ltd. Initialization method for one-way communications and apparatus for use therewith
US6256016B1 (en) * 1997-06-05 2001-07-03 Logitech, Inc. Optical detection system, device, and method utilizing optical matching
US6278443B1 (en) * 1998-04-30 2001-08-21 International Business Machines Corporation Touch screen with random finger placement and rolling on screen to control the movement of information on-screen
US6287193B1 (en) * 1999-02-02 2001-09-11 Steven F. Rehkemper Hand-held game with visual display and feedback
US20010020932A1 (en) * 1997-10-14 2001-09-13 Merminod Antoine A. Optical-mechanical roller with ratchet
US20010032121A1 (en) * 1999-12-08 2001-10-18 Le Trien T. Method and apparatus for interactive focus marketing
US20010035854A1 (en) * 1998-06-23 2001-11-01 Rosenberg Louis B. Haptic feedback for touchpads and other touch controls
US6314066B1 (en) * 1999-07-21 2001-11-06 Lg Electronics Inc. Method for controlling track jump in optical recording medium
US6377341B1 (en) * 1999-08-03 2002-04-23 University Technology Corporation Refractive index based detector system for liquid chromatography
US20020130835A1 (en) * 2001-03-16 2002-09-19 Brosnan Michael John Portable electronic device with mouse-like capabilities
US20020135565A1 (en) * 2001-03-21 2002-09-26 Gordon Gary B. Optical pseudo trackball controls the operation of an appliance or machine
US20020140666A1 (en) * 2001-03-29 2002-10-03 Bradski Gary R. Intuitive mobile device interface to virtual spaces
US6463278B2 (en) * 1997-03-14 2002-10-08 Nokia Mobile Phones Ltd. Telephone automatic mode selection
US20020145588A1 (en) * 2001-01-18 2002-10-10 Mccahon Stephen William Optically based machine input control device
US20020158844A1 (en) * 2001-04-30 2002-10-31 Mcloone Hugh Input device including a wheel assembly for scrolling an image in multiple directions
US20020158883A1 (en) * 2001-04-25 2002-10-31 Palm, Inc. Control of brightness and contrast by averaging
US20020163524A1 (en) * 2000-12-07 2002-11-07 International Business Machines Corporation System and method for automatic adjustment of backlighting, contrast and color in a data processing system
US6480187B1 (en) * 1997-08-07 2002-11-12 Fujitsu Limited Optical scanning-type touch panel
US6504530B1 (en) * 1999-09-07 2003-01-07 Elo Touchsystems, Inc. Touch confirming touchscreen utilizing plural touch sensors
US6535190B2 (en) * 1998-05-29 2003-03-18 Silicon Graphics, Inc. Multiple light source color balancing system within a liquid crystal flat panel display
US6550683B1 (en) * 2000-02-24 2003-04-22 Telxon Corporation Hand held portable device with multiple functions
US20030076343A1 (en) * 1997-08-29 2003-04-24 Xerox Corporation Handedness detection for a physical manipulatory grammar
US6560150B2 (en) * 2000-08-25 2003-05-06 Micron Technology, Inc. Memory device testing
US6590547B2 (en) * 1992-07-27 2003-07-08 Elonex Ip Holdings Ltd. Removable computer display interface
US6590564B1 (en) * 1999-12-17 2003-07-08 Microsoft Corporation Ergonomic computer input device
US6597348B1 (en) * 1998-12-28 2003-07-22 Semiconductor Energy Laboratory Co., Ltd. Information-processing device
US6718115B1 (en) * 2000-09-29 2004-04-06 Palmone, Inc. Personal digital assistant display illumination method and system
US20040075637A1 (en) * 2002-10-17 2004-04-22 Sharp Kabushiki Kaisha Image input/output device and image information reading method therefor
US6762741B2 (en) * 2000-12-22 2004-07-13 Visteon Global Technologies, Inc. Automatic brightness control system and method for a display device using a logarithmic sensor
US6781570B1 (en) * 2000-11-09 2004-08-24 Logitech Europe S.A. Wireless optical input device
US6788286B2 (en) * 2001-05-03 2004-09-07 Interactive Imaging Systems, Inc. Controller for graphical display
US6833825B1 (en) * 2000-03-10 2004-12-21 Apple Computer, Inc. Apparatus for remotely controlling a digital processing system
US6956558B1 (en) * 1998-03-26 2005-10-18 Immersion Corporation Rotary force feedback wheels for remote control devices
US7006080B2 (en) * 2002-02-19 2006-02-28 Palm, Inc. Display system
US7088343B2 (en) * 2001-04-30 2006-08-08 Lenovo (Singapore) Pte., Ltd. Edge touchpad input device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4916308A (en) * 1988-10-17 1990-04-10 Tektronix, Inc. Integrated liquid crystal display and optical touch panel
JPH0778120A (en) * 1993-07-29 1995-03-20 Xerox Corp Hand-held arithmetic unit and processing method of input signal in hand-held arithmetic unit
JP3624070B2 (en) * 1997-03-07 2005-02-23 キヤノン株式会社 Coordinate input device and control method thereof
JPH113169A (en) * 1997-06-13 1999-01-06 Tokai Rika Co Ltd Touch operation information output device
US6058485A (en) * 1997-07-29 2000-05-02 Lsi Logic Corporation Method and apparatus for managing power consumption of a digitizing panel

Patent Citations (75)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4345148A (en) * 1980-10-06 1982-08-17 Hughes Aircraft Company Automatic responsivity control for a CCD imager
US4475240A (en) * 1980-11-10 1984-10-02 Asea Aktiebolag Device for simultaneous creation and detection of markings
US4386345A (en) * 1981-09-22 1983-05-31 Sperry Corporation Color and brightness tracking in a cathode ray tube display system
US4982618A (en) * 1987-11-03 1991-01-08 Culver Craig F Multifunction tactile manipulatable control
US5270690A (en) * 1989-05-08 1993-12-14 Harold C. Avila Bidimensional input control system
US5502459A (en) * 1989-11-07 1996-03-26 Proxima Corporation Optical auxiliary input arrangement and method of using same
US5126723A (en) * 1989-12-11 1992-06-30 Hewlett-Packard Company Keyboard-mounted cursor position controller
US5177802A (en) * 1990-03-07 1993-01-05 Sharp Kabushiki Kaisha Fingerprint input apparatus
US5249104A (en) * 1990-07-03 1993-09-28 Tatsuji Mizobe Optical display device
US5149963A (en) * 1990-07-03 1992-09-22 Parker Hannifin Corporation Fiber-optic position sensor including photovoltaic bi-cell
US6211940B1 (en) * 1991-02-04 2001-04-03 Dolby Laboratories Licensing Corporation Selecting analog or digital motion picture sound tracks
US5844547A (en) * 1991-10-07 1998-12-01 Fujitsu Limited Apparatus for manipulating an object displayed on a display device by using a touch screen
US6590547B2 (en) * 1992-07-27 2003-07-08 Elonex Ip Holdings Ltd. Removable computer display interface
US5785439A (en) * 1992-08-24 1998-07-28 Product Engineering & Manufacturing, Inc. Environmentally safe machine control security switch
US5270818A (en) * 1992-09-17 1993-12-14 Alliedsignal Inc. Arrangement for automatically controlling brightness of cockpit displays
US5283432A (en) * 1992-09-18 1994-02-01 Rockwell International Corporation Optical control knob assembly incorporated on a flat panel display apparatus
US5374989A (en) * 1992-10-29 1994-12-20 Sumitomo Cement Co. Ltd. Apparatus for identifying an object utilizing a tracking means and an identification beam
US5306908A (en) * 1993-03-15 1994-04-26 Hewlett-Packard Company Manually operated hand-held optical scanner with tactile speed control assembly
US5452240A (en) * 1993-11-23 1995-09-19 Roca Productions, Inc. Electronically simulated rotary-type cardfile
US5737643A (en) * 1994-06-07 1998-04-07 Nikon Corporation Motion compensation device having stabilizing motion detection unit that does not inhibit imaging operations in an imaging unit
US5635926A (en) * 1994-08-02 1997-06-03 Li; Kenneth K. Pointing and/or directional control device for controlling the movement and positioning of an object
US5760773A (en) * 1995-01-06 1998-06-02 Microsoft Corporation Methods and apparatus for interacting with data objects using action handles
US5900863A (en) * 1995-03-16 1999-05-04 Kabushiki Kaisha Toshiba Method and apparatus for controlling computer without touching input device
US5952992A (en) * 1995-07-17 1999-09-14 Dell U.S.A., L.P. Intelligent LCD brightness control system
US6088025A (en) * 1995-08-24 2000-07-11 Matsushita Electric Industrial Co., Ltd. Terminal device with built-in image sensor
US5933089A (en) * 1995-12-19 1999-08-03 Nec Corporation Pager with message display function
US6153876A (en) * 1996-10-24 2000-11-28 Sharp Kabushiki Kaisha Optical sensor with concave mirror
US6122075A (en) * 1996-10-28 2000-09-19 Fuji Xerox Co., Ltd. Image forming apparatus
US5912661A (en) * 1997-01-14 1999-06-15 Microsoft Corp. Z-encoder mechanism
US6463278B2 (en) * 1997-03-14 2002-10-08 Nokia Mobile Phones Ltd. Telephone automatic mode selection
US6243069B1 (en) * 1997-04-22 2001-06-05 Matsushita Electric Industrial Co., Ltd. Liquid crystal display with image reading function, image reading method and manufacturing method
US6256016B1 (en) * 1997-06-05 2001-07-03 Logitech, Inc. Optical detection system, device, and method utilizing optical matching
US5938772A (en) * 1997-06-11 1999-08-17 Compaq Computer Corporation Responsive backlit hardwire button array providing illumination and user feedback in a computer
US6075518A (en) * 1997-07-15 2000-06-13 Gateway 2000, Inc. Rotational X-axis pointing device
US6480187B1 (en) * 1997-08-07 2002-11-12 Fujitsu Limited Optical scanning-type touch panel
US20030076343A1 (en) * 1997-08-29 2003-04-24 Xerox Corporation Handedness detection for a physical manipulatory grammar
US6043809A (en) * 1997-09-23 2000-03-28 Compaq Computer Corporation Computer keyboard scroll bar control
US5926780A (en) * 1997-10-09 1999-07-20 Tweed Fox System for measuring the initial velocity vector of a ball and method of use
US20010020932A1 (en) * 1997-10-14 2001-09-13 Merminod Antoine A. Optical-mechanical roller with ratchet
US5886308A (en) * 1997-12-22 1999-03-23 Otis Elevator Company Rope speed monitoring assembly and method
US6008486A (en) * 1997-12-31 1999-12-28 Gentex Corporation Wide dynamic range optical sensor
US6956558B1 (en) * 1998-03-26 2005-10-18 Immersion Corporation Rotary force feedback wheels for remote control devices
US6057840A (en) * 1998-03-27 2000-05-02 Sony Corporation Of Japan Computer-implemented user interface having semi-transparent scroll bar tool for increased display screen usage
US6057540A (en) * 1998-04-30 2000-05-02 Hewlett-Packard Co Mouseless optical and position translation type screen pointer control for a computer system
US6278443B1 (en) * 1998-04-30 2001-08-21 International Business Machines Corporation Touch screen with random finger placement and rolling on screen to control the movement of information on-screen
US6535190B2 (en) * 1998-05-29 2003-03-18 Silicon Graphics, Inc. Multiple light source color balancing system within a liquid crystal flat panel display
US20010035854A1 (en) * 1998-06-23 2001-11-01 Rosenberg Louis B. Haptic feedback for touchpads and other touch controls
US6243079B1 (en) * 1998-07-07 2001-06-05 Primax Electronics, Ltd. Initialization method for one-way communications and apparatus for use therewith
US6157958A (en) * 1998-07-31 2000-12-05 Qubit, Llc Modular tablet computer system
US6597348B1 (en) * 1998-12-28 2003-07-22 Semiconductor Energy Laboratory Co., Ltd. Information-processing device
US6287193B1 (en) * 1999-02-02 2001-09-11 Steven F. Rehkemper Hand-held game with visual display and feedback
US6314066B1 (en) * 1999-07-21 2001-11-06 Lg Electronics Inc. Method for controlling track jump in optical recording medium
US6377341B1 (en) * 1999-08-03 2002-04-23 University Technology Corporation Refractive index based detector system for liquid chromatography
US6504530B1 (en) * 1999-09-07 2003-01-07 Elo Touchsystems, Inc. Touch confirming touchscreen utilizing plural touch sensors
US20010032121A1 (en) * 1999-12-08 2001-10-18 Le Trien T. Method and apparatus for interactive focus marketing
US6590564B1 (en) * 1999-12-17 2003-07-08 Microsoft Corporation Ergonomic computer input device
US6550683B1 (en) * 2000-02-24 2003-04-22 Telxon Corporation Hand held portable device with multiple functions
US6833825B1 (en) * 2000-03-10 2004-12-21 Apple Computer, Inc. Apparatus for remotely controlling a digital processing system
US6560150B2 (en) * 2000-08-25 2003-05-06 Micron Technology, Inc. Memory device testing
US6718115B1 (en) * 2000-09-29 2004-04-06 Palmone, Inc. Personal digital assistant display illumination method and system
US6781570B1 (en) * 2000-11-09 2004-08-24 Logitech Europe S.A. Wireless optical input device
US20020163524A1 (en) * 2000-12-07 2002-11-07 International Business Machines Corporation System and method for automatic adjustment of backlighting, contrast and color in a data processing system
US6762741B2 (en) * 2000-12-22 2004-07-13 Visteon Global Technologies, Inc. Automatic brightness control system and method for a display device using a logarithmic sensor
US20020145588A1 (en) * 2001-01-18 2002-10-10 Mccahon Stephen William Optically based machine input control device
US20020130835A1 (en) * 2001-03-16 2002-09-19 Brosnan Michael John Portable electronic device with mouse-like capabilities
US20020135565A1 (en) * 2001-03-21 2002-09-26 Gordon Gary B. Optical pseudo trackball controls the operation of an appliance or machine
US20020140666A1 (en) * 2001-03-29 2002-10-03 Bradski Gary R. Intuitive mobile device interface to virtual spaces
US20020158883A1 (en) * 2001-04-25 2002-10-31 Palm, Inc. Control of brightness and contrast by averaging
US6700564B2 (en) * 2001-04-30 2004-03-02 Microsoft Corporation Input device including a wheel assembly for scrolling an image in multiple directions
US20020158844A1 (en) * 2001-04-30 2002-10-31 Mcloone Hugh Input device including a wheel assembly for scrolling an image in multiple directions
US7088343B2 (en) * 2001-04-30 2006-08-08 Lenovo (Singapore) Pte., Ltd. Edge touchpad input device
US6788286B2 (en) * 2001-05-03 2004-09-07 Interactive Imaging Systems, Inc. Controller for graphical display
US7006080B2 (en) * 2002-02-19 2006-02-28 Palm, Inc. Display system
US20060279557A1 (en) * 2002-02-19 2006-12-14 Palm, Inc. Display system
US20040075637A1 (en) * 2002-10-17 2004-04-22 Sharp Kabushiki Kaisha Image input/output device and image information reading method therefor

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090154116A1 (en) * 2007-10-23 2009-06-18 Psion Teklogix Inc. Expansion system for portable electronic devices
US8154877B2 (en) * 2007-10-23 2012-04-10 Psion Teklogix Inc. Expansion system for portable electronic devices
US8737083B2 (en) 2007-10-23 2014-05-27 Psion Inc. Expansion system for portable electronic devices
US20130307799A1 (en) * 2012-05-16 2013-11-21 Siemens Aktiengesellschaft Touchscreen with analog pressure detection as user interface for industrial technical device
WO2014105144A1 (en) * 2012-12-28 2014-07-03 Intel Corporation Variable touch screen scanning rate based on user presence detection
US20140285446A1 (en) * 2013-03-25 2014-09-25 Panasonic Corporation Electronic device
US9189034B2 (en) * 2013-03-25 2015-11-17 Panasonic intellectual property Management co., Ltd Electronic device
WO2017075444A1 (en) * 2015-10-30 2017-05-04 Essential Products, Inc. Optically transmissive antenna break structures for wireless devices, and associated systems and processes
US9799948B2 (en) 2015-10-30 2017-10-24 Essential Products, Inc. Optically transmissive antenna break structures for wireless devices, and associated systems and processes
WO2017115891A1 (en) * 2015-12-30 2017-07-06 대구대학교 산학협력단 Industrial embedded device to which low power technique is applied

Also Published As

Publication number Publication date
US20020180691A1 (en) 2002-12-05
US6816154B2 (en) 2004-11-09
US20180013875A1 (en) 2018-01-11
US7411583B1 (en) 2008-08-12
WO2002097597A1 (en) 2002-12-05

Similar Documents

Publication Publication Date Title
US20180013875A1 (en) Optical sensor based user interface for a portable electronic device
US10331299B2 (en) Method and handheld electronic device having a graphical user interface which arranges icons dynamically
US9417702B2 (en) Method and apparatus for launching activities
US8289286B2 (en) Zooming keyboard/keypad
US8294670B2 (en) Optically based input mechanism for a handheld electronic communication device
CA2634098C (en) Electronic device and method of providing haptic feedback
US20100026631A1 (en) Scroll wheel with character input
EP2224325A1 (en) A handheld electronic device having a touchscreen and a method of using a touchscreen of a handheld electronic device
KR20070085631A (en) Portable electronic device having user interactive visual interface
US20090096749A1 (en) Portable device input technique
EP2211256A1 (en) A handheld electronic device having a touchscreen and a method of using a touchscreen of a handheld electronic device
KR20110066974A (en) Portable electronic device and method of secondary character rendering and entry
JP2011008424A (en) Electronic device, operation mode setting method, and program
US8064946B2 (en) Handheld wireless communication device
US20070254705A1 (en) Handheld wireless communication device
US20070254690A1 (en) Handheld wireless communication device
US20070254688A1 (en) Handheld wireless communication device
EP2073103A1 (en) Input mechanism for handheld electronic communication device
US20070254702A1 (en) Handheld wireless communication device
US20090160775A1 (en) Trackball input for handheld electronic device
US20070254708A1 (en) Handheld wireless communication device
US20070254698A1 (en) Handheld wireless communication device
JP2004227365A (en) Optical input device and method
US20070254703A1 (en) Handheld wireless communication device
CA2641090C (en) Method and apparatus for launching activities

Legal Events

Date Code Title Description
AS Assignment

Owner name: JPMORGAN CHASE BANK, N.A., NEW YORK

Free format text: SECURITY AGREEMENT;ASSIGNOR:PALM, INC.;REEL/FRAME:023406/0671

Effective date: 20091002

Owner name: JPMORGAN CHASE BANK, N.A.,NEW YORK

Free format text: SECURITY AGREEMENT;ASSIGNOR:PALM, INC.;REEL/FRAME:023406/0671

Effective date: 20091002

AS Assignment

Owner name: PALM, INC., CALIFORNIA

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:024630/0474

Effective date: 20100701

AS Assignment

Owner name: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P., TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PALM, INC.;REEL/FRAME:025204/0809

Effective date: 20101027

AS Assignment

Owner name: PALM, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.;REEL/FRAME:030341/0459

Effective date: 20130430

AS Assignment

Owner name: PALM, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.;REEL/FRAME:031837/0544

Effective date: 20131218

Owner name: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P., TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PALM, INC.;REEL/FRAME:031837/0239

Effective date: 20131218

Owner name: HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P., TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PALM, INC.;REEL/FRAME:031837/0659

Effective date: 20131218

AS Assignment

Owner name: QUALCOMM INCORPORATED, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HEWLETT-PACKARD COMPANY;HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P.;PALM, INC.;REEL/FRAME:032132/0001

Effective date: 20140123

AS Assignment

Owner name: PALM, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WONG, YOON KEAN;HANSON, WILLIAM ROBERT;SIGNING DATES FROM 20010529 TO 20010530;REEL/FRAME:044677/0154

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION