INTERNET-BASED MULTI-MEDIA PRESENTATION SYSTEM FOR CUSTOMIZED INFORMATION
The present application claims priority to U.S. Provisional Patent Application Serial No. 60/144,258, entitled Internet-Based Multi-Media Presentation System For Customized Information, filed on July 19, 1999, the entire disclosure of which is incorporated herein by reference.
BACKGROUND OF THE INVENTION
1. Field of the Invention
The present invention is directed to an information retrieval and presentation system, and more particularly to such a system that is able to provide a user with customized information content in a real-time fashion.
The Related Art
The increasing use of the Internet for access to data from a variety of sources, coupled with more traditional techniques for the dissemination of news and the like, provide users with a multitude of types of information in a variety of different forms. This increasing wealth of information, however, poses a related dilemma, namely the ability of the user to obtain information of interest in a real-time, or quasi real-time, manner without having to deal with other information that is of no particular interest. For instance, in the area of broadcast news programs, a viewer may be frustrated by having to watch an hour-long show in order to obtain a few minutes of news in which he or she is truly interested.
To overcome the need to sift through large amounts of unwanted information, various forms of filtering are provided by many types of computer-based information dissemination systems. One system of this type is described, for example, in U.S. Patent No. 5,740,549 to Reilly, et al. In this system, a user can establish a profile which indicates the type of information in which that user is interested. An information display controller examines a database of information, and extracts only those items of information which conform to the user's profile, for display to the user on a computer's monitor. While approaches of this type, which employ a filtering technique, spare a user from having to wade through large amounts of undesired
information, they may offer limited ability to obtain such information in a real-time manner. For instance, in a work environment the user may only have the opportunity to access the computer to view the information at relatively infrequent intervals, e.g., during lunch or a coffee break. While delays of a few hours may be acceptable for many types of information, in some cases it is desirable to obtain the information in a real-time fashion. For instance, if a user is interested in a stock that is being heavily traded, the price of the stock might change significantly over the course of a few hours. In such a case, the user is interested in obtaining updates of the stock price as soon as they become available. Of course, in this latter situation, the user could have the information dissemination program constantly running on his or her computer, so as to become aware of changes in the stock price as soon as such information becomes available. In this case, however, the user is not able to utilize other applications while he or she is occupied with the task of monitoring the changing stock prices. In effect, therefore, these types of systems only permit the user to obtain information quickly ifthe user is actively monitoring the information, which prevents him or her from effectively carrying out other tasks.
It is desirable, therefore, to provide an information dissemination system that permits a user to obtain real-time information in a passive manner that enables a user to be actively engaged in other tasks while the information is being presented. It is further desirable to provide such a system which enables the user to quickly access information items of particular interest when they are presented.
SUMMARY OF THE INVENTION
In accordance with preferred embodiments of the present invention, a user generates a request for information items of interest. In one example, for instance, the user might generate a list of the ticker symbols for stocks that are of interest. In response to this request, a search engine or similar type of information retrieval system examines an appropriate information source to obtain data pertaining to the request, e.g., the current quotes for the identified stocks. Upon retrieval of the relevant data, a multi-media presentation is created and delivered to the requestor, for example via a streaming media player.
One component of the multi-media presentation is an audio track that is created by means of a text-to-speech synthesizer. Alphanumeric information that is retrieved from the data source, such as a change in the price of a stock, is spoken to the user. As a result, the user can listen to the information in a passive manner, and is freed from the need to read the information on a display monitor. Since an audio stream occupies a relatively small percentage of the bandwidth that is typically available over the Internet and similar types of communication media, the user can employ a browser to visit other information sites while the desired data is being spoken in the background. Alternatively, other application programs might be used, such as a word processing program, while the information is being presented.
Another portion of the multi-media presentation might constitute a graphical image that pertains to the audio information being presented to the user. For instance, in the case of a stock quote, the graphic could include a chart of the recent price history for the stock. In the case of a news item, the graphic might include still images or video clips relating to the news story. In some cases, the graphic component could also include text or written information. In some cases, the graphic information might include a uniform resource location (URL), or other form of address, which enables the user to quickly access a related information site. Thus, when the user hears an information item of particular interest, he or she can switch to a web browser or multi-media player program to view the graphic or connect to a site identified by a URL, to view more detailed information.
The preferred embodiments of present invention provide information to a user in real time, or quasi real time, that is customized to the specific interests of the individual user. This approach is applicable to a variety of different types of information, such as sports, politics, news and stocks. The user is presented with the information in a passive manner which permits other tasks to be attended to, while at the same time being provided with instant access to more detailed information when desired. The preferred embodiments can enable a large number of users to concurrently receive, in real time or quasi real time, individually selected information in a passive manner.
The foregoing and other preferred features of the invention, and the advantages attained thereby, are described in greater detail hereinafter with reference to specific embodiments of the invention illustrated in the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The preferred embodiments of the present invention are illustrated by way of example and not limitation in the accompanying drawings, in which:
Figure 1 is a block diagram of an information dissemination system in accordance with the invention;
Figure 2 is a block diagram of a first alternate embodiment of the invention;
Figure 3 is a block diagram of a second alternate embodiment of the invention;
Figure 4 is a block diagram of an embodiment of the invention having an indexed information source database;
Figure 5 is a block diagram illustrating the assembly of a multi-media presentation; and
Figure 6 is a front view of a system web page displayed on a monitor of a user's local computer via browser software executing thereon.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS OF THE INVENTION
Generally speaking, the preferred embodiments of the present invention are directed to a multi-media information presentation system that enables a user to passively receive alphanumeric-based information in a real-time manner that permits the user to concurrently attend to other tasks. To facilitate an understanding of the invention, it is described hereinafter with specific reference to examples such as wherein a user obtains real-time information about stock prices. It will be appreciated, however, that the practical applications of the invention are not limited to this particular implementation. Rather, the principles of the invention are generally applicable to any type of alphanumeric-based information that can be obtained from a variety of different sources. Examples of such information include news, sports, weather, political commentary, and the like. This information can be obtained from any appropriate information source as would be understood by those in the art based on this disclosure, such as in some illustrative and non-limiting examples, via newswires or the like from one or more of the following sources: PR NEWS WIRE (see http://www.prnewswire.com); CCN DISCLOSURE (formerly Canadian Corporate News)(see http://www.cdn-news.com); REUTERS (see
http://www.reuters.com); ASSOCIATED PRESS (see http://www.ap.org); DOW JONES & COMPANY (see http://www.dowjones.com); BUSINESS WIRE (see http://www.businesswire.com); and other sources, such as any sources identified in any of the patents incorporated herein by reference in this patent application. The present invention operates within a network of connected computers, at least some of which function as providers of desired information. One example of such a networked computer system, which provides access to a variety of different types of information, is the Internet. In this example, the user typically gains access to the information sources by means of a browser application that is executing on the user's local computer. Since the Internet serves as a particularly pertinent example of a system in which the present invention might be implemented, the following discussion of preferred embodiments of the invention will be presented in the context of such an implementation. Again, however, it will be appreciated that the practical applications of the invention are not limited to this particular embodiment. Rather, the invention can be employed in other types of information retrieval systems as well, such as for example an Intranet or a dedicated information source within an enterprise.
An example of one embodiment of the invention is illustrated in the block diagram of Figure 1. In this example, a user employs a browser application 10 that is running on his or her local computer to access other computers, such as servers, which function as hosts for various Internet sites. In the illustrated example, the browser application is connected to a host server 12 that is associated with the system of the present invention.
Upon connecting to the host server 12, the user's browser 10 displays a web page, or other suitable user interface, which permits the user to enter an identification of information in which the user is interested. For example, ifthe user desires to obtain real-time information about the prices of selected stocks, the ticker symbols for these stocks can be entered in a suitable window.
In some non-limiting examples, upon connecting to the host server 12, the user's browser 10 can display a web page having a region 101, shown in Figure 6, which a user can designate or "click" (e.g., using a mouse or other user manipulated pointer means) to present another window or web page for entering a particular user profile. Preferably, the user profile includes selections of: a) categories of items (e.g., news, sports, weather, stocks, technology, etc.) and/or selections of sub-categories
(e.g., with respect to news: local news, world news, particular news stories, etc.; with respect to sports: specific teams, specific stories, etc.; with respect to weather: daily forecasts, weekly forecasts, local, specific regions, etc.; with respect to stocks: company names and/or ticker symbols, etc.; with respect to technology: specific technologies such as biotechnology, electronics, software, etc.; and the like); b) hierarchies of categories and/or sub-categories (e.g., designating orders in which to present categories and/or sub-categories and/or rankings of importance of categories and/or sub-categories, whereby certain items may be included or excluded depending on designations); c) numbers of items per category and/or sub-category and/or percent of time to spend on categories and/or sub-categories; d) time periods for entire presentations (e.g., total length of presentation, start time of presentation, etc.); and e) other information. In some illustrative embodiments, the profiles can be formed and structured to include features as in one or more of the profiles described in U.S. Patent Nos.: 5,740,549 to Reilly, et al., entitled Information and Advertising Distribution System and Method; 5,761,662 to Dasan, entitled Personalized Information Retrieval Using User-Defined Profile, 5,915,238 to Tjaden, entitled Personalized Audio Information Delivery System; 5,953,732 to Meske, Jr., et al., entitled Hypertext Information Retrieval Using Profiles and Topics, the entire disclosures of each of which patents are incorporated herein in their entireties, in relation to their profile aspects and to all other aspects therein, as though recited herein in full.
Once the profile or identification of the information has been completed, it is forwarded to the host server 12 as a request. When the request is received at the host server, it is presented to a search engine 14, which constructs a query for the information of interest. This query is then presented to an information source 16 that is associated with the type of information being requested. In the case of stock quotes, for example, the information source might include a database that is continually updated to reflect the most recent price for stocks on one or more exchanges, as well as other appropriate information that may be of interest, such as the starting price for the day, recent highs and lows, etc. This database might be located on the host server 12, or it could be accessed via one or more other servers. In response to the query, the information source 16 returns textual data relating to the stocks that were identified.
In a preferred implementation of the invention, the information source 16 also provides graphical information associated with the alphanumeric data. In the case of
stock quotes, for example, the graphical information could be a chart which indicates the price of the stock over a relevant period. For other forms of information, different types of graphics may be provided. For instance, in the case of news, a still image or a video clip that pertains to the news item might be transmitted. In some illustrative and non-limiting embodiments, the information source 16 can include one or more database provided by one or more newswire source such as PR NEWSWIRE, CCN DISCLOSURE, REUTERS, ASSOCIATED PRESS, DOW JONES & COMPANY, BUSINESS WIRE or the like. As illustrated in Figure 4, some existing newswire sources provide substantially real-time or near to real-time updated items (e.g., stories or the like) that are already Indexed. For example, an individual item "I" written by an author or reporter "A" may include identification markers for categorization as well as specific markers such as start and end markers. These codes or identifiers can be used to categorize or index the items within the information source database on a substantially real-time basis. Accordingly, the search engine 14 of the present invention can be made to search these pre-established categories or indexes far pertinent items. In addition and/or alternately, the search engine 14 of the present invention can be made to conduct textual searches within the actual text of the items to locate pertinent items. In some embodiments, the search engine 14 can run queries against one outside information source 16, against multiple outside information sources 16, and/or against one or more database(s) of stored items located on the server 12 and/or on another machine accessed dynamically from the network. In some embodiments, the server 12 can store data collected within temporary files for handling of individual user requests. In other simplified embodiments, the server 12 can merely redirect the data without storage, live and in real time. In some embodiments, the search engine 14 can include functions and structures like that shown in any of the patents incorporated herein by reference in this patent application.
The alphanumeric data that is retrieved from the information source 16 is presented to a text-to-speech synthesizer 18. This data is converted into a speech waveform file, which is transmitted to the user's local computer as an audio stream, in response to the request. Ifthe system is intended to operate in several different countries, several synthesizers can be employed, each of which is directed to a specific language that is to be supported. The appropriate audio stream from one of the synthesizers is sent to each user's computer, for example in accordance with a
preference setting or the like. While the software processing steps — e.g., from text to stream — can be effected via multiple executables or processing steps (e.g., such as for illustrative purposes: retrieving text; cleaning up text [e.g., where desired, such as, for example, in U.S. Patent No. 5,915,238]; converting text to speech; converting waveform to stream; adding markers and/or links to stream [e.g., where desired]; and the like steps), programming can be written to combine two or more of the processing steps into one executable (providing, for example, a text to stream program).
In some illustrative and non-limiting embodiments, the server can arrange and present the items located in accordance with the profile of the user. For example, the server can arrange the items for presentation in a specific order based on hierarchy designated by the user. Figure 5 shows one illustrative, and non-limiting, example wherein a world news item is presented first, then a sports item, then another sports item, and then a local news item. The length of the total presentation and/or the number of presented items will preferably depend on the length of time selected by the user (e.g., this can be entered as part of their profile). As shown in Figure 5, the administrator of the server 12 can also add or assemble additional items into the presentation if so desired. For example, as shown, the administrator can add an introduction 30 at the beginning or statements elsewhere in the presentation, or can add supplemental information to certain items or can add any additional information as desired into the presentation. The administrator can enter this as audio data and/or can enter a textual data that is similarly synthesized into audio data.
Additionally, in some embodiments, advertisements can be incorporated into the multi-media presentation. These advertisements are preferably purchased by entities rendering payments to the owner of the server 12. Inone illustrative embodiment, advertisements can be submitted via on-line forms provided on a web page provided via the server. Preferably, the advertisements include audio and graphic components. As shown in Figure 5, one or more advertisements (one advertisement is shown at Ad #1) can be included within the presentation at a particular position depending on a variety of factors, such as to correspond in time to similar item categories, to set time placement based on advertisement purchase price (e.g., higher fees may be charged in relation to a "first-in-time" advertisements placement or the like). In some embodiments, the advertisements can be omitted from the "audio" components of the presentation and maintained only in the graphic component. In this manner, an advertisement can be less intrusive and may appear
only when a user views the browser application for further information. In other embodiments, the audio component of the advertisement can be very short and provide, for example, limited statement such as: "a special offer by Company A is available on screen!" In this manner, the advertisement can be less intrusive because specific information is only needed at the graphic portion. In some embodiments, the advertisement can be presented as a "limited-time" offer — e.g., available only to those who "click" on the advertisement during the advertisement or shortly thereafter so as to encourage viewing. As shown in Figure 6, the graphic component of the advertisement 150 preferably includes an embedded code or hyperlink to direct the user to the advertising merchant's web site or to another URL related to the advertisement, such as for purchases.
Additionally, the presentation can also include music that is provided as filler in between item presentations or the like. For example, if a user only desires to hear information in relation to a particular stock, there may be time periods between desired items which can be filled with music, advertisements and/or other filler material (preferably, based on user selection).
At the user's computer, the audio stream is played back to the user via speakers connected to the computer. The playback of the audio stream can be carried out by a suitable streaming media player 20, which could be executing on the user's computer as a plug-in module for the browser application. Examples of suitable streaming media players include the MICROSOFT MEDIAPLAYER, the APPLE COMPUTER QUICKTIME and the REALVIDEO or REALPLAYER programs provided by REAL NETWORKS. In addition, the present invention could use other available streaming players. The graphical information that is supplied with the streaming audio can be displayed on the user's screen, within a window provided by the browser. In one illustrative and non-limiting example, Figure 6 shows a web page having text graphics 120 and/or video and/or image graphics 130. The web page shown in Figure 6 is merely illustrative. The web page shown has two "frames" 160 and 170 such that functional elements (discussed below) are available along the left side during the graphic presentation in region 170, but various other web-page designs can be used.
Since, in the preferred embodiments, the alphanumeric data retrieved from the information source 16 is presented to the user in the form of audio information, it is not necessary for the user to actively view the browser in order to receive that
information. Rather, the user can attend to other tasks at hand, while listening to the information in the background. The browser 10 can be configured to automatically refresh the web page on a regular basis, so that updated information is always provided to the user. In some non-limiting examples, the browser 10 can be configured to update or refresh the web page or a component thereof on a substantially continuous bases (for example, providing continually changing images or animation coordinated with the speech of the audio component), or the browser can be configured to automatically refresh the web page periodically or at designated times such as the start of presenting a new item within the presentation to concurrently present corresponding graphic information. The refreshing of the web page can be achieved in a variety of ways as would be apparent to those in the art based on this disclosure, such as, e.g., using programming along the lines of, for example, MACROMEDIA'S SHOCKWAVE plug-in, other plug-ins, JAVA applets, client pull programming, server push programming, and the like. As one example, a JAVA applet can initiate a requestfor items in succession (e.g., http://www.Road-Show-
Server.com/cgi/name.cgi?id=variable&request=next), and the server can return a URL pair, one URL to be displayed by the browser and the other URL to be played by the streaming audio player. Ifthe user hears an item of particular interest, the user's attention can then be turned to the browser program to view the graphics associated with that item of information.
Preferably, the graphic information that accompanies the audio stream also includes the address of a site that contains additional information about the item of interest. This address information, which might be in the form of a uniform resource location (URL), provides the user with a link to additional information site(s) 22, such as Internet web pages. Thus, when the user hears an item of particular interest, he or she can employ the browser application 10 to connect to the indicated site 22.
One advantage associated with the use of an audio stream to present the information is the fact that it requires a relatively small portion of the overall bandwidth that is typically available in networked communication systems. For instance, an audio stream might require about 4-28 kilobits per second, depending on the type of compression applied to the data. As a result, a large portion of the bandwidth is available for other uses. Hence, the user can initiate the audio streaming via the browser application 10, and then minimize or hide the window associated with
this function, or shift it to the background area on the display, and continue to use the browser to connect to other available sites. Alternatively, the user can switch to a different application, such as a word processing program, or the like. While working in the other application, the audio information can continue to be presented. In the preferred embodiments, at any time that the user hears an item of particular interest, he or she can switch back to the browser application to view the associated graphics and/or link to a related site, such as described above.
In the embodiment of Figure 1, the text-to-speech synthesizer is located on at the remote server 12, and the data is transmitted to the user in the form of an audio stream. In an alternative embodiment of the invention, illustrated in Figure 2, the bandwidth requirements of the information presentation system can be further reduced by transmitting the data from the information source in its original alphanumeric form. In this embodiment, the text-to-speech synthesizer is located at the user's local computer, rather than the host server. Again, the synthesizer might operate as a plug- in module 24 for the browser application 10. By means of this approach, the transmission bandwidth requirements could be reduced by, for example, a factor of 25 to 100.
In the embodiment of Figure 1, each user's request is preferably handled in real time by the host server 12, so that the most up-to-date information is presented to the user. In periods of high usage, the real-time processing of individual user's requests could result in delays. In a further embodiment of the invention, depicted in Figure 3, a daemon application 26 can be executing on the host server to retrieve information ahead of time, and thereby have it readily available in response to individual requests. For example, in the case of stock quotes, the daemon application might identify a number of the most frequently requested stocks, and command the search engine 14 to retrieve information about these stocks on a regular basis, e.g. every few minutes. As each item of stock information is retrieved, it is presented to a text-to-speech synthesizer 18 to create a file of speech waveform data. This file can be stored in a cache memory 28, to be transmitted to the user immediately upon receiving a request for information pertaining to a given stock. As long as the daemon causes the waveform files to be updated on a sufficiently frequent basis, the information that is presented to the user will be quasi real-time in nature, and therefore retain its value to them.
From the foregoing, it can be seen that the preferred embodiments of the present invention provide a system that generates a customized information program in real time, or quasi real time. The program can be specific to the interests of the individual user. By converting alphanumeric data to, for example, a speech presentation, the user is able to obtain the information in a passive manner, rather than having to actively monitor a computer screen, or the like, as the information is received. As a result, the user is free to concentrate on other tasks, while still having access to the real-time data. Furthermore, by providing the information in the context of a multi-media presentation, additional information about topics of particular interest can be made readily available to the user.
In some exemplary embodiments, the multi-media presentation can be set so as to provide an updated presentation on a cyclic or repetitive basis. For example, the search engine 14 can be made to search on a recurring basis (e.g., every 10 minutes, or 15 minutes, or 20 minutes or the like), and the server can collect approximately 10 or 15 or to 20 reports or the like for presentation. The search engine 14 could also be made to search on a continuous basis in some instances. Based on the search results, the system could generate 5 minute to 10 minute reports on a cyclical basis or the like. The user can preferably select the length of the cycle intervals and other user identification as noted. Preferably, for each category and/or sub-category, items are pulled first in time based on most recent time data. Accordingly, a very orderly presentation assembly process is achieved. Notably, on subsequent cycles, the system can be set so as not to duplicate presentation of the same reports where few new reports are received.
As noted, in the preferred embodiments, at any time that the user hears an item of particular interest, he or she can switch back to the browser application to view the associated graphics and/or link to a related site, such as described above. For example, as shown in Figure 6, one or more hyperlinks 125, 135, 155 can be provided to redirect the user via the user's browser to a particular location. In some non- limiting examples with stock item information, the graphics can include at least one link to at least one online brokerage company, such as ETRADE.COM or the like, so that the user can render quick transactions in response to information received, or the web page 170 can provide such transaction ability (e.g., via a sub-window provided concurrently from a server of a brokerage company or by having brokerage abilities at that site).
FIG. 6 illustrates a number of optional graphics component elements and web page functional elements that can be provided. To begin with, a region 80 can be provided that can be clicked on by the user in order to initiate the running of the multi-media presentation. In addition, a region 81 can be provided to end the presentation. In addition, if desired, one or more of the following functional elements can be provided for the user during the multi-media presentation: a region 103 to click on during a particular item presentation to save that portion into a memory of the user's local computer (or to save a number of items or the entire presentation); a region 104 to delete or cancel an item (e.g., to prevent the server from continuing presentation or resending that item); a region 105 to cause the server to skip over the remainder of the item presented and go to the next item; a region 106 to cause the server to go back to the last item; a region 107 to cause the server to repeat or start over from the beginning of an item; a region 108 to present a window allowing entry of a particular item to go to so as to change the presentation timing; a region 109 to attach the item or components thereof in an e-mail or other electronic communication to another individual; a region 1 10 to print the item or components thereof (e.g., graphics components and/or text version of synthesized audio); a region 1 1 1 to present a list of a number of other items related to an item but which were not included within the presentation due to hierarchy and the like profile information, whereby a user can specifically select items from the list to be included in the presentation; a region 112 to designate that the server should add to the presentation more related items; region 113 to click on during a particular item presentation to save an advertisement or a coupon therefore into a memory of the user's local computer (or to perform any other function identified above with respect to items); and/or a region 1 14 that a user can click to change the length of the presentation (e.g., to add time or the like). Other functions could also be provided, such as pause presentation to allow a user to stop and start the presentation, if necessary. In addition, if desired, some items can be designated as "highest priority" such as if a stock price hits a certain level, and these items can be "flashed in" during a presentation. In addition, if desired, the graphic component could also include a window 140 to display an Item Summary (i.e., a presentation schedule) so that a user can see what is to be presented. In the latter case, preferably the item summary includes an arrow highlighting the item presented at that time (e.g., item #3 as shown). In the latter case, preferably, the
summary also identifies the time remaining (e.g., for a particular item and/or for the total presentation.).
It will be appreciated by those of ordinary skill in the art that the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. For example, while the invention has been described with particular reference to the presentation of stock quotes from Internet sources, it will be readily understood that the principles can be equally applied to other types of information, as well as other forms of information retrieval. The presently disclosed embodiments are therefore considered in all respects to be illustrative, and not restrictive.