WO2005084209A3 - Interactive virtual characters for training including medical diagnosis training - Google Patents

Interactive virtual characters for training including medical diagnosis training Download PDF

Info

Publication number
WO2005084209A3
WO2005084209A3 PCT/US2005/005950 US2005005950W WO2005084209A3 WO 2005084209 A3 WO2005084209 A3 WO 2005084209A3 US 2005005950 W US2005005950 W US 2005005950W WO 2005084209 A3 WO2005084209 A3 WO 2005084209A3
Authority
WO
WIPO (PCT)
Prior art keywords
trainee
training
virtual
image data
graphics
Prior art date
Application number
PCT/US2005/005950
Other languages
French (fr)
Other versions
WO2005084209A2 (en
Inventor
Benjamin Lok
Scott Lind
Original Assignee
Univ Florida
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Florida filed Critical Univ Florida
Publication of WO2005084209A2 publication Critical patent/WO2005084209A2/en
Publication of WO2005084209A3 publication Critical patent/WO2005084209A3/en

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B23/00Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
    • G09B23/28Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine

Abstract

An interactive training system includes computer vision provided by at least one video camera for obtaining trainee image data, and pattern recognition and image understanding algorithm to recognize features present in the trainee image data to detect gestures of the trainee. Graphics coupled to a display device is provide for rendering images of at least one virtual individual. The display device is viewable by the trainee. A computer receives the trainee image data or gestures of the trainee, and optionally the voice of the trainee, and implements an interaction algorithm. An output of the interaction algorithm provides data to the graphics and moves the virtual character to provide dynamically alterable images of the virtual character, as well as an optional virtual voice. The virtual individual can be a medical patient, where the trainee practices diagnosis on the patient.
PCT/US2005/005950 2004-02-27 2005-02-28 Interactive virtual characters for training including medical diagnosis training WO2005084209A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US54846304P 2004-02-27 2004-02-27
US60/548,463 2004-02-27

Publications (2)

Publication Number Publication Date
WO2005084209A2 WO2005084209A2 (en) 2005-09-15
WO2005084209A3 true WO2005084209A3 (en) 2006-12-21

Family

ID=34919365

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/005950 WO2005084209A2 (en) 2004-02-27 2005-02-28 Interactive virtual characters for training including medical diagnosis training

Country Status (2)

Country Link
US (1) US20050255434A1 (en)
WO (1) WO2005084209A2 (en)

Families Citing this family (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6990639B2 (en) 2002-02-07 2006-01-24 Microsoft Corporation System and process for controlling electronic components in a ubiquitous computing environment using multimodal integration
US20040085334A1 (en) * 2002-10-30 2004-05-06 Mark Reaney System and method for creating and displaying interactive computer charcters on stadium video screens
US8745541B2 (en) 2003-03-25 2014-06-03 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7665041B2 (en) * 2003-03-25 2010-02-16 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7038661B2 (en) * 2003-06-13 2006-05-02 Microsoft Corporation Pointing device and cursor for use in intelligent computing environments
US7394459B2 (en) 2004-04-29 2008-07-01 Microsoft Corporation Interaction between objects and a virtual environment display
US7787706B2 (en) * 2004-06-14 2010-08-31 Microsoft Corporation Method for controlling an intensity of an infrared source used to detect objects adjacent to an interactive display surface
US7593593B2 (en) 2004-06-16 2009-09-22 Microsoft Corporation Method and system for reducing effects of undesired signals in an infrared imaging system
US8560972B2 (en) 2004-08-10 2013-10-15 Microsoft Corporation Surface UI for gesture-based interaction
CA2586736C (en) * 2004-10-25 2015-12-22 Eastern Virginia Medical School System, method and medium for simulating normal and abnormal medical conditions
US20070015121A1 (en) * 2005-06-02 2007-01-18 University Of Southern California Interactive Foreign Language Teaching
US7911444B2 (en) 2005-08-31 2011-03-22 Microsoft Corporation Input method for surface of interactive display
US8060840B2 (en) * 2005-12-29 2011-11-15 Microsoft Corporation Orientation free user interface
US9224303B2 (en) 2006-01-13 2015-12-29 Silvertree Media, Llc Computer based system for training workers
US8797327B2 (en) * 2006-03-14 2014-08-05 Kaon Interactive Product visualization and interaction systems and methods thereof
EP2050086A2 (en) * 2006-07-12 2009-04-22 Medical Cyberworlds, Inc. Computerized medical training system
US8021160B2 (en) * 2006-07-22 2011-09-20 Industrial Technology Research Institute Learning assessment method and device using a virtual tutor
US7907117B2 (en) * 2006-08-08 2011-03-15 Microsoft Corporation Virtual controller for visual displays
US8212857B2 (en) 2007-01-26 2012-07-03 Microsoft Corporation Alternating light sources to reduce specular reflection
US20080280662A1 (en) * 2007-05-11 2008-11-13 Stan Matwin System for evaluating game play data generated by a digital games based learning game
US20090004633A1 (en) * 2007-06-29 2009-01-01 Alelo, Inc. Interactive language pronunciation teaching
US8144780B2 (en) * 2007-09-24 2012-03-27 Microsoft Corporation Detecting visual gestural patterns
US9171454B2 (en) * 2007-11-14 2015-10-27 Microsoft Technology Licensing, Llc Magic wand
US9881520B2 (en) * 2008-01-08 2018-01-30 Immersion Medical, Inc. Virtual tool manipulation system
US9396669B2 (en) * 2008-06-16 2016-07-19 Microsoft Technology Licensing, Llc Surgical procedure capture, modelling, and editing interactive playback
US20100031202A1 (en) * 2008-08-04 2010-02-04 Microsoft Corporation User-defined gesture set for surface computing
US8847739B2 (en) 2008-08-04 2014-09-30 Microsoft Corporation Fusing RFID and vision for surface object tracking
US20100105479A1 (en) 2008-10-23 2010-04-29 Microsoft Corporation Determining orientation in an external reference frame
US20100112528A1 (en) * 2008-10-31 2010-05-06 Government Of The United States As Represented By The Secretary Of The Navy Human behavioral simulator for cognitive decision-making
WO2010093780A2 (en) 2009-02-13 2010-08-19 University Of Florida Research Foundation, Inc. Communication and skills training using interactive virtual humans
US9377857B2 (en) 2009-05-01 2016-06-28 Microsoft Technology Licensing, Llc Show body position
US8803889B2 (en) 2009-05-29 2014-08-12 Microsoft Corporation Systems and methods for applying animations or motions to a character
US20110172550A1 (en) 2009-07-21 2011-07-14 Michael Scott Martin Uspa: systems and methods for ems device communication interface
WO2011041262A2 (en) 2009-09-30 2011-04-07 University Of Florida Research Foundation, Inc. Real-time feedback of task performance
US20110212428A1 (en) * 2010-02-18 2011-09-01 David Victor Baker System for Training
US20120200667A1 (en) * 2011-02-08 2012-08-09 Gay Michael F Systems and methods to facilitate interactions with virtual content
US8811938B2 (en) 2011-12-16 2014-08-19 Microsoft Corporation Providing a user interface experience based on inferred vehicle state
WO2014032248A1 (en) * 2012-08-30 2014-03-06 忠欣股份有限公司 Learning system and method for clinical diagnosis
WO2014052802A2 (en) 2012-09-28 2014-04-03 Zoll Medical Corporation Systems and methods for three-dimensional interaction monitoring in an ems environment
US10275876B2 (en) 2015-06-12 2019-04-30 International Business Machines Corporation Methods and systems for automatically selecting an implant for a patient
DE102016104186A1 (en) * 2016-03-08 2017-09-14 Rheinmetall Defence Electronics Gmbh Simulator for training a team of a helicopter crew
CN106502390B (en) * 2016-10-08 2019-05-14 华南理工大学 A kind of visual human's interactive system and method based on dynamic 3D Handwritten Digit Recognition
US10810907B2 (en) 2016-12-19 2020-10-20 National Board Of Medical Examiners Medical training and performance assessment instruments, methods, and systems
US10832808B2 (en) 2017-12-13 2020-11-10 International Business Machines Corporation Automated selection, arrangement, and processing of key images
US11315692B1 (en) * 2019-02-06 2022-04-26 Vitalchat, Inc. Systems and methods for video-based user-interaction and information-acquisition
CN111450511A (en) * 2020-04-01 2020-07-28 福建医科大学附属第一医院 System and method for limb function assessment and rehabilitation training of cerebral apoplexy
US20210312833A1 (en) * 2020-04-05 2021-10-07 VxMED, LLC Virtual reality platform for training medical personnel to diagnose patients

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6181343B1 (en) * 1997-12-23 2001-01-30 Philips Electronics North America Corp. System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs
US6570555B1 (en) * 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US6697783B1 (en) * 1997-09-30 2004-02-24 Medco Health Solutions, Inc. Computer implemented medical integrated decision support system

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5347306A (en) * 1993-12-17 1994-09-13 Mitsubishi Electric Research Laboratories, Inc. Animated electronic meeting place
JP2552427B2 (en) * 1993-12-28 1996-11-13 コナミ株式会社 Tv play system
US5563988A (en) * 1994-08-01 1996-10-08 Massachusetts Institute Of Technology Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment
US6031934A (en) * 1997-10-15 2000-02-29 Electric Planet, Inc. Computer vision system for subject characterization
US6692258B1 (en) * 2000-06-26 2004-02-17 Medical Learning Company, Inc. Patient simulator
US7071914B1 (en) * 2000-09-01 2006-07-04 Sony Computer Entertainment Inc. User input device and method for interaction with graphic images

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6697783B1 (en) * 1997-09-30 2004-02-24 Medco Health Solutions, Inc. Computer implemented medical integrated decision support system
US6181343B1 (en) * 1997-12-23 2001-01-30 Philips Electronics North America Corp. System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs
US6570555B1 (en) * 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device

Also Published As

Publication number Publication date
US20050255434A1 (en) 2005-11-17
WO2005084209A2 (en) 2005-09-15

Similar Documents

Publication Publication Date Title
WO2005084209A3 (en) Interactive virtual characters for training including medical diagnosis training
CN101408800B (en) Method for performing three-dimensional model display control by CCD camera
WO2006023268A3 (en) Portable augmented reality device and method
US9001036B2 (en) Systems and methods of camera-based fingertip tracking
WO2004095370A3 (en) Image data set with embedded pre-subpixel rendered image
US20130321390A1 (en) Augmented books in a mixed reality environment
KR101563312B1 (en) System for gaze-based providing education content
EP1857910A3 (en) Device having display buttons and display method and medium for the device
WO2006086223A3 (en) Augmented reality device and method
WO2007070733A3 (en) Voice and video control of interactive electronically simulated environment
EP1404126A3 (en) Video combining apparatus and method
EP2224402A3 (en) Image display apparatus and short film generation apparatus
WO2008046057A3 (en) Enhanced image display in head-mounted displays
WO2009124028A3 (en) Estimating pose of photographic images in 3d earth model using human assistance
JP2006198202A (en) Visual training apparatus and visual training method
EP1744260A3 (en) Image processing device and method for design
EP1939849A3 (en) Image display device for displaying small-sized image and method thereof
EP2001005A3 (en) Training system, training device, and program recording medium and playback control method
KR102077607B1 (en) Augmented Reality Projection Method For The First Aid Training To The Patient
EP1892959A3 (en) Moving image reproducing apparatus
EP1777950A3 (en) Display apparatus
JP2012073299A (en) Language training device
JP2011044061A (en) Image display device, input device and image display method
CN109613982A (en) Wear-type AR shows the display exchange method of equipment
WO2007057855A3 (en) Method for displaying high resolution image data together with time-varying low resolution image data

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

122 Ep: pct application non-entry in european phase