Live video stream display packing and system based on the information display platform
Technical field
The present invention relates to that Video processing, ultrahigh resolution show, the multi-screen image is handled, magnanimity information shows technical fields such as synchronous, particularly relate to live video stream display packing and system based on the information display platform.
Background technology
Along with popularizing of the Internet, the develop rapidly of video coding and decoding technology, the live video stream related application is increasingly extensive, as video conference, long-distance education, remote monitoring, safety monitoring etc.In recent years, along with the appearance of HD video, the whole video industry was just welcoming the epoch of marching to high definition, and real-time video also just moves towards digitlization, networking by simulation, becomes video flowing.Especially the arrival of the structure safe city climax that starts along with China, high definition video steaming shows the emphasis that has become safe city, needs the tens of roads of centralized displaying even the high-definition real-time video flowing in road up to a hundred simultaneously, this is great challenge to present display system.
Current display system, the display unit that mostly connects splicing by Centralized Controller, there are very high requirement this processing speed to Centralized Controller, response time, this class of high definition video steaming application high to delay requirement especially in real time, and contradiction is more obvious.The centralized displaying system of main flow in the market, the support that high definition video steaming more than hundred tunnel is shown is difficult to satisfy actual needs, this is because central controlled system architecture inadequate natural endowment converges the pressure of all properties, rather than an open framework.Simultaneously, show, stride screen and freely drag, stride operation such as the free convergent-divergent of screen and be difficult to support for striding screen, when need were introduced new live video stream and shown, its set-up procedure is suitable complexity and loaded down with trivial details also.In a word, existing Display Technique exists following problem and defective:
1) can't handle and show user's big data message, simultaneously, can't compatible market on novel video flowing input mode;
2) systemic-function combination, demonstration, subregion, image exchange ability, Video Controller is many in display screen quantity, when having disposed many Video Controllers, between the input and output image between the different video controller a little less than the matrix switch function; The general utility functions subregion is core with the Video Controller, does not support the combination in any of input and output, any subregion between the different video controller basically;
3) stability of system and reliability are not high, the Video Controller of main flow producer still is based on industrial computer at present, therefore stability and the reliability to system is an acid test, especially for extensive display system, a Video Controller (for example exporting 32 tunnel) breaks down and just may cause 32 display screens normally not show, maintaining bothers very much, needs all images card in this Video Controller is taken out; Another aspect, system is difficult to realize online real-time control;
4) autgmentability is poor, can't satisfy the requirement that display system is transformed in customer upgrade, when the user proposes requiring of expansion on the original basis, and the prior art reconstruction of can only dismantling.
5) not easy care and upgrading of system.Owing to the amplification of traditional Video Controller image, dwindle, the conversion of picture format, the mode that image is handled is finished by image card basically, so its software is to be solidificated in the image card, can not realize the upgrading of system by software upgrading.
Summary of the invention
In order to overcome the shortcomings and deficiencies of prior art, the invention provides the live video stream stream display packing based on the information display platform, provide the distributed type assemblies platform to solve live video stream decoding and technique for displaying means, solved live video stream and striden screen demonstration and control problem, high definition video steaming provides technical support more than hundred the tunnel in order to decode simultaneously.
Display packing of the present invention adopts following technical scheme: based on the live video stream display packing of information display platform, described information display platform comprises host node machine and a plurality of child node machine, host node machine and a plurality of child node machine interconnect by computer network, and every estrade node machine also disposes a plurality of display units; Described live video stream display packing comprises the steps:
S1, the IP video flowing multicast address, the port that need real-time decoding to show are set, check the legitimacy of IP video flowing multicast address and port then, if IP video flowing multicast address and port are invalid, then filter; If IP video flowing multicast address and port are legal data, then enter step S2;
S2, begin to monitor IP video flowing multicast address, port by host node machine, child node machine, receive video stream data after, analyze the video stream data form, and the effective video flow data cushioned;
S3, by host node machine, the child node machine effective video flow data that cushions of read step S2 respectively, to the effective video flow data unpack draw the original video flow data after, video stream data is decoded, obtain decoded video stream data;
S4, processing is controlled in the demonstration of video stream data:
The first, from step S3, get access to decoded video stream data after, judge earlier its form, call corresponding converting algorithm then, decoded video stream data is converted into the information display platform shows that the form that needs prepares to show;
The second, the host node machine is monitored the control operation instruction of video flowing, and multicast sent to all child node machines after the control operation instruction that listens to carried out preliminary treatment; Each child node machine is finished the control operation (as amplifying, dwindle, stride screen etc.) in the instruction after the preliminary treatment concurrently, and the back of finishing dealing with is to the completed instruction of host node machine transmission preparation; After the host node machine is received the completed instruction of preparation of all child node machines transmissions, send synchronous idsplay order again to all child node machines;
S5, the video flowing that transforms by child node machine obtaining step S4 show data, video flowing is shown that data export to respectively in the video card buffering area of every estrade node machine, wait behind the idsplay order of receiving the host node machine video flowing is shown that data sync shows to a plurality of display units that are connected with the child node machine.
Preferably, the described control operation instruction of step S4 is for striding screen control operation instruction, the process of striding the screen demonstration is: the host node machine is by comparing the size of video flowing viewing area and the size of all display units, find related child node machine, the video flowing viewing area is shielded the child node machine that instruction sends to association by the size of the display unit of child node machine connection by striding, after associated child node machine is received and is striden screen control operation instruction, parse the size that needs demonstration, feedback response instructs to the host node machine then, after the host node machine is received the feedback response instruction of relevant child node machine, send idsplay order, the related synchronous display video stream picture of child node machine.
Preferably, the described control operation instruction of step S4 shows the control operation instruction for amplifying, amplifying the process that shows is: the host node machine records the video flowing viewing area original size that need amplify earlier, record amplifies the size of rear video stream viewing area then, calculate video flowing viewing area size and original video stream viewing area magnitude proportion value after the amplification, by computer network this ratio value is sent to all child node machines, each child node machine obtains behind the ratio value video display area of own display part being carried out the amplification of equal proportion, transmitter ready instructs to the host node machine then, after the host node machine is received the ready instruction of all child node machines, send synchronous idsplay order again, all child node machines show synchronously.
Preferably, the described control operation instruction of step S4 shows the control operation instruction for dwindling, the process of dwindling demonstration is: the video flowing viewing area original size that host node machine elder generation record need dwindle, record dwindles the size of rear video stream viewing area then, calculate video flowing viewing area size and original video stream viewing area magnitude proportion value after dwindling, by computer network this ratio value is sent to all child node machines, each child node machine obtains behind the ratio value video display area of own display part being carried out dwindling of equal proportion, transmitter ready instructs to the host node machine then, after the host node machine is received the ready instruction of all child node machines, send synchronous idsplay order again, all child node machines show synchronously.
Preferably, the described control operation instruction of step S4 is stacked demonstration control operation instruction, the process of stacked demonstration is: the information display platform generates ID number next corresponding each video flowing viewing area of an integer automatically, when a plurality of video flowings viewing area is superimposed demonstration, the machine-readable ID that needs the video flowing of top set viewing area that gets of host node is sent to all child node machines to the ID that reads by computer network; Find corresponding video flowing viewing area by ID behind the ID that each child node machine obtains reading, and reduce this video flowing viewing area play up the degree of depth make it reach the top shows, and then transmitter ready instructs to the host node machine; The host node machine receives that the ready instruction back of all child node machines sends synchronous idsplay order, and all child node machines show synchronously.
Display system of the present invention adopts following technical scheme: based on the live video stream display system of information display platform, described information display platform comprises host node machine and a plurality of child node machine, host node machine and a plurality of child node machine interconnect by computer network, and every estrade node machine also disposes a plurality of display units; Described live video stream display system comprises:
Configuration module is used for obtaining IP video flowing multicast address, the port that needs real-time decoding to show, checks the legitimacy of IP video flowing multicast address and port then, if IP video flowing multicast address and port are invalid, then filters; If IP video flowing multicast address and port are legal data, then enter the live video stream receiver module;
The live video stream receiver module is used for monitoring IP video flowing multicast address, port by host node machine, child node machine, receive video stream data after, analyze the video stream data form, and the effective video flow data cushioned;
The decoding video stream module, be used for reading the effective video flow data from the buffering area of live video stream receiver module respectively by host node machine, child node machine, to the effective video flow data unpack draw the original video flow data after, video stream data is decoded, obtain decoded video stream data;
The control processing module, be used for: after the first, getting access to decoded video stream data from the decoding video stream module, judge its form earlier, call corresponding converting algorithm then, decoded video stream data is converted into the information display platform shows that the form preparation that needs shows; The second, the host node machine is monitored the control operation instruction of video flowing, and multicast sent to all child node machines after the control operation instruction that listens to carried out preliminary treatment; Each child node machine is finished the control operation (as amplifying, dwindle, stride screen etc.) in the instruction after the preliminary treatment concurrently, and the back of finishing dealing with is to the completed instruction of host node machine transmission preparation; After the host node machine is received the completed instruction of preparation of all child node machines transmissions, send synchronous idsplay order again to all child node machines;
Display module, obtain the video flowing demonstration data that the control processing module transforms by the child node machine, video flowing is shown that data export to respectively in the video card buffering area of every estrade node machine, Deng the mode of passing through to share the video memory content behind the idsplay order of receiving the host node machine, show to a plurality of display units that are connected with the child node machine synchronously.
Information display platform of the present invention is based on computer network, the parallel cluster processing platform that becomes with child node mechanism by the host node machine, can solve control problems such as striding screen demonstration, movement, convergent-divergent, and for the flexible adding of video flowing good support is arranged, live video stream in the network enabled can enter the information display platform and show, and the advantage of integrate information display platform solves, and control is handled, concurrent problem such as synchronously.The more important thing is that along with the continuous increase of display unit, the child node machine also will constantly increase, the disposed of in its entirety ability of information display platform will constantly rise, thereby solve the problem of live video stream disposal ability deficiency.
Compared with prior art, the present invention has following advantage and beneficial effect:
1, taken full advantage of the cluster parallel processing advantage of information display platform, need not to increase extra hardware device, only just can realize multihead display and control to the multichannel live video stream by network and host node machine, child node machine, for decode simultaneously magnanimity multichannel live video stream and demonstration provide reliable assurance, system has higher extensibility and maintainability.
2, under the information display platform, the real-time video stream information is decoded, shown and controls, given full play to the parallel disposal ability that shows of computer cluster that information display platform host node machine, a child node group of planes and display unit thereof constitute, the live video stream of decoding fast and efficiently, system's display resolution can reach more than hundred million pixels, realized that video flowing shows stride screen synchronously, movement, convergent-divergent, function such as stacked.
Description of drawings
Fig. 1 is method flow diagram of the present invention;
Fig. 2 is system module pie graph of the present invention;
Fig. 3 is the live video stream display system pie graph of the present invention under the information display platform.
Embodiment
For making purpose of the present invention, technical scheme and advantage more concrete and clear, below in conjunction with accompanying drawing embodiments of the invention are described in detail.
Embodiment
Information display platform of the present invention (also being the SPIDer platform) comprises host node machine and some child node machines, and host node machine and a plurality of child node machine interconnect by computer network, and is respectively every estrade node machine and disposes a plurality of display units.The information display platform is an integrated multi-screen image processing techniques, the signal switch technology, network technology, the integrated system platform of the information processing of magnanimity information processing technology, analysis, management and displaying, based on cloud computing, support magnanimity information processing and demonstration, have characteristics such as good flexibility, autgmentability and high performance-price ratio, given full play to the disposal ability of computer, by making up parallel Presentation Function at the node machine, set up the distributed demonstration cluster drawing system of a high Collaboration, realized high performance information display function.
As shown in Figure 1, live video stream display packing of the present invention is worked under the information display platform, may further comprise the steps:
S1, the IP video flowing multicast address, the port that need real-time decoding to show are set, check the legitimacy of IP video flowing multicast address and port then, if IP video flowing multicast address and port are invalid, then filter, provide corresponding information simultaneously; If IP video flowing multicast address and port are legal data, then enter step S2.
S2, begin to monitor IP video flowing multicast address, port by host node machine, child node machine, after receiving video stream data, at first carry out the video stream data format analysis, draw the encapsulation format of video stream data, utilize the video stream data continuity verification principle that defines in the encapsulation format, carry out the data check analysis, if the video stream data of receiving is discontinuous, illustrating then that video stream data has loses, and is incomplete video stream data, abandons this incomplete video stream data; Then carry out suitable buffering for the effective video flow data.
S3, by host node machine, the child node machine effective video flow data that cushions of read step S2 respectively, resolve the encapsulation format of video stream data, call the flow process of unpacking of corresponding encapsulation format then, split out the original video flow data, enter decoding process at last, video stream data is decoded, obtain decoded video stream data.
S4, processing is controlled in the demonstration of video stream data, specifically comprise: after the first, from step S3, getting access to decoded video stream data, judge its form earlier, call corresponding converting algorithm then, decoded video stream data is converted into the information display platform shows that the form preparation that needs shows; The second, the host node machine is monitored the control operation instruction that video flowing is striden screen demonstration, amplification demonstration, dwindled demonstration, stacked demonstration, and the control operation that listens to instruction carried out preliminary treatment (being about to the idsplay order that the control operation instruction is converted into information display platform inside), then pretreated instruction is sent to all child node machines by multicast, each child node machine from network, receive the control operation finished concurrently after the instruction in the instruction (as amplify, dwindle, stacked demonstration etc.), the back of finishing dealing with sends the completed instruction of preparation to the host node machine.After the host node machine is received the completed instruction of preparation of all child node machines transmissions, send synchronous idsplay order again to all child node machines.
S5, the video flowing that transforms by child node machine obtaining step S4 show data, video flowing is shown that data export to respectively in the video card buffering area of every estrade node machine, wait behind the idsplay order of receiving the host node machine by the mode of sharing the video memory content video flowing to be shown that data sync shows to a plurality of display units that are connected with the child node machine.
Shown in Fig. 2,3, live video stream display system of the present invention is worked under the information display platform, comprises configuration module, live video stream receiver module, decoding video stream module, control processing module and display module.System is by the reception of configuration module configuration video flowing, and after configuration was finished, live video stream receiver module receiver, video flow data was given the decoding video stream module, is decoded by the decoding video stream module, and exports to the control processing module.The control processing module as movement, convergent-divergent etc., is carried out format conversion to video stream data according to relevant control operation instruction, and prepares to show, further monitors the control command of autonomous node machine simultaneously, and displaying contents is handled accordingly.Display module is exported video memory to displaying contents, by refreshing modes such as video memory displaying contents is exported on a plurality of display units that are attached thereto.
Described configuration module obtains the IP video flowing multicast address, the port that need real-time decoding to show, checks the legitimacy of IP video flowing multicast address and port then, if IP video flowing multicast address and port are invalid, then filters, and provides corresponding information simultaneously; If IP video flowing multicast address and port are legal data, then enter the live video stream receiver module.
Described live video stream receiver module, begin to monitor IP video flowing multicast address, port by host node machine, child node machine, after receiving video stream data, at first carry out the video stream data format analysis, draw the encapsulation format of video stream data, utilize the video stream data continuity verification principle that defines in the encapsulation format, carry out the data check analysis, if the video stream data of receiving is discontinuous, illustrating then that video stream data has loses, be invalid video stream data, abandon this invalid video stream data; Then carry out suitable buffering for the effective video flow data.
Described decoding video stream module, from the buffering area of live video stream receiver module, read the effective video flow data respectively by host node machine, child node machine, because the employing udp protocol of real-time video flow network transmission, message speed is fast, time-delay is little, packet loss or data entanglement easily, therefore, for correctness and the continuity that guarantees data, packing transmission again after video flowing encapsulates through certain format.Before decoding video stream, must carry out the parsing of encapsulation format, parse encapsulation format after, call the flow process of unpacking of corresponding format again, split out the original video flow data, enter decoding process at last.Because the coded format of video flowing is various, so video stream data of different-format, need different coding/decoding methods, the main flow coded format of video flowing that the decoding video stream module is integrated, and codec format method commonly used is optimized, to adapt to the display framework of information display platform, the decode procedure of while accelerating video stream.
Described control processing module, need handle two processes simultaneously: after the first, from the decoding video stream module, getting access to the decoding video stream data, judge its form earlier, call corresponding converting algorithm then, be converted into the information display platform and show that the form preparation that needs shows; Second, the host node machine is monitored the control operation instruction about the video flowing viewing area, as monitor video flowing and stride the screen demonstration, amplify and show, dwindle demonstration, the control operation instruction of stacked demonstration etc., the host node chance is converted into this control operation instruction the idsplay order of information display platform inside, this process is the instruction preliminary treatment, then pretreated instruction is sent to the multicast address of the control command of all child node machines, all child node machines are received from network and are carried out corresponding control operation after the preliminary treatment after the instruction (as amplifying, dwindle, stride screen etc.), the back of finishing dealing with sends the completed instruction of preparation to the host node machine.After the host node machine is received the completed instruction of preparation of all child node machines transmissions, send synchronous idsplay order again to the child node machine.
Described display module, obtain the video flowing demonstration data that the control processing module transforms by the child node machine, video flowing is shown that data export to respectively in the video card buffering area of every estrade node machine, but do not refresh the video card buffering area immediately, but wait behind the idsplay order of receiving the host node machine just by sharing the mode of video memory content, show to a plurality of display units that are connected with the child node machine synchronously. alwaysBecause video flowing is the continuous animation that the picture by a frame one frame constitutes, data after so decoding is come out, it also is a frame one frame, therefore, video stream data is not show immediately after the unit deposits the buffering of video card in the frame, just shows synchronously behind the idsplay order of receiving the host node machine, like this, can guarantee the synchronously consistent of a plurality of display units, resolve the stationary problem that video flowing shows.
In the present embodiment, if what the host node machine listened to is to stride screen control operation instruction, then the host node machine is by comparing the size of video flowing viewing area and the size of all display units, find related child node machine, the video flowing viewing area is shielded the child node machine that instruction sends to association by the size of the display unit of child node machine connection by striding, after associated child node machine is received and is striden screen control operation instruction, parse the size that needs demonstration, feedback response instructs to the host node machine then, after the host node machine is received the feedback response instruction of relevant child node machine, send idsplay order, the related synchronous display video stream picture of child node machine.
In the present embodiment, if what the host node machine listened to is to amplify to show the control operation instruction, then the host node machine records the video flowing viewing area original size that needs amplification earlier, record amplifies the size of rear video stream viewing area then, the passing ratio computational algorithm is calculated the video flowing viewing area size and original video stream viewing area magnitude proportion value after the amplification, by computer network this ratio value is sent to all child node machines, each child node machine receives that the parsing of instruction back obtains ratio value, the video display area of own display part is carried out the amplification of equal proportion, transmitter ready instructs to the host node machine then, after the host node machine is received the ready instruction of all child node machines, send synchronous idsplay order again, all child node machines show synchronously.
In the present embodiment, if what the host node machine listened to is to dwindle to show the control operation instruction, the video flowing viewing area original size that need dwindle of host node machine elder generation record then, record dwindles the size of rear video stream viewing area then, video flowing viewing area size and original video stream viewing area magnitude proportion value after the passing ratio computational algorithm is calculated and dwindled, by computer network this ratio value is sent to all child node machines, each child node machine receives that the parsing of instruction back obtains ratio value, the video display area of own display part is carried out dwindling of equal proportion, transmitter ready instructs to the host node machine then, after the host node machine is received the ready instruction of all child node machines, send synchronous idsplay order again, all child node machines show synchronously.
In the present embodiment, if what the host node machine listened to is stacked demonstration control operation instruction, then each video flowing viewing area shows in the information display platform, platform all can generate ID number next correspondence of an integer automatically, when a plurality of viewing areas are superimposed demonstration, the machine-readable ID that needs the video flowing of top set viewing area that gets of host node, by computer network all the child node machines that are sent to that read; Each child node machine is received the ID of the video flowing viewing area that needs top set that the parsing of instruction back obtains reading, find corresponding video flowing viewing area by ID, and reduce this video flowing viewing area play up the degree of depth make it reach the top shows, and then transmitter ready instructs to the host node machine, the host node machine receives that the ready instruction back of all child node machines sends synchronous idsplay order, and all child node machines show synchronously.
In the present embodiment, above-mentioned IP video flowing multicast address is 225.0.0.101, and port is 8101, and the coded format of video flowing is for H.264; One in host node machine, two in child node machine, wherein the IP of host node machine is assumed to 10.1.1.1, the IP of two estrade node machines is respectively 10.1.1.253 and 10.1.1.254, every estrade node machine all connects four display units, the multicast address that the host node machine sends to the control command of child node machine is 225.0.0.60, and port is 5505.
Those skilled in the art can use the computer program flow process to realize according to the part or all of step of above-mentioned example.Above-described embodiment is preferred implementation of the present invention; but embodiments of the present invention are not restricted to the described embodiments; other any do not deviate from change, the modification done under spiritual essence of the present invention and the principle, substitutes, combination, simplify; all should be the substitute mode of equivalence, be included within protection scope of the present invention.