JP6209835B2 - Information processing system, server device, and program - Google Patents

Description

  The present invention relates to an information processing system, a server device, an information processing method, and a program.

  We know the technology to generate multimedia contents such as video data by shooting the contents of explanation using a video camera during a presentation or meeting, and synthesizing the data used for the presentation material and the shot video. It has been. By referring to the multimedia content, a person who could not participate in the presentation or conference can grasp the contents of the presentation.

  Patent Document 1 is a known invention related to the present invention. Patent Document 1 discloses an invention of an apparatus that automatically generates multimedia contents including video and audio in a presentation or the like.

  However, in the prior art, in order to synthesize the data used for the presentation material and the captured video, an editing operation by the user and a special device are required. Further, data recorded by a special device prepared in advance, such as data recorded by a presentation observer, could not be synthesized.

  The present invention has been made in view of the above, and is an information processing system and server device that can more easily synthesize data used for explanation in a presentation or the like and data recorded during the explanation as moving image data. It is an object to provide an information processing method and program.

In order to solve the above-described problems and achieve the object, an information processing system of the present invention is an information processing system including a server device and a plurality of client devices, and one client among the plurality of client devices. An apparatus includes a data request unit that requests display data from the server device, a display control unit that controls display of the display data, and an update information acquisition unit that acquires update information including a time when the display of the display data is updated And a recording unit that records the voice during display of the display data and acquires the voice data, and a transmission unit that transmits the update information and the voice data to a folder in which the display data is stored , the server apparatus, the storage unit having a folder which display data is stored in response to a request of the one client device, the client of the one A data processing unit that transmits the display data to location, said update information by one client device and said audio data is stored in the folder, the plurality of the data folder by another client device of the client device when stored in, on the basis of the update information, and a generating unit that generates moving image data obtained by synthesizing the above and the display data and the voice data data.

  According to the present invention, there is an effect that the data used for the explanation in the presentation or the like and the data recorded during the explanation can be more easily combined as moving image data.

FIG. 1 is a diagram illustrating an example of functional blocks of the information processing system according to the first embodiment. FIG. 2 is a diagram illustrating an example of a hardware connection relationship of the information processing system according to the first embodiment. FIG. 3 is a diagram illustrating an example of update information of the information processing system according to the first embodiment. FIG. 4 is a diagram illustrating an example of functional blocks of the control unit according to the first embodiment. FIG. 5 is a flowchart for explaining an example of the information processing method according to the first embodiment. FIG. 6 is a diagram for describing generation of moving image data in the information processing system according to the first embodiment. FIG. 7 is a diagram illustrating an example of functional blocks of the information processing system according to the second embodiment. FIG. 8 is a diagram illustrating an example of a hardware connection relationship of the information processing system according to the second embodiment. FIG. 9 is a diagram illustrating an example of data (file) added from the client device (listener) according to the second embodiment. FIG. 10 is a diagram illustrating an example of a data format of text data added from the client device (listener) according to the second embodiment. FIG. 11 is a diagram for describing generation of moving image data in the information processing system according to the second embodiment. FIG. 12 is a diagram for explaining an example of a hardware configuration of the server device and the client device according to the first and second embodiments.

(First embodiment)
Hereinafter, embodiments of an information processing system, a server device, an information processing method, and a program will be described in detail with reference to the accompanying drawings. FIG. 1 is a diagram illustrating an example of functional blocks of the information processing system 100 according to the first embodiment. The information processing system 100 according to the present embodiment includes a server device 10, a client device 20, a monitor 30, and a projector 40.

  FIG. 2 is a diagram illustrating an example of a hardware connection relationship of the information processing system 100 according to the first embodiment. In the information processing system 100 according to the present embodiment, the server device 10, the client device 20, the monitor 30, and the projector 40 are connected to each other via a network 60. The client device 20 is, for example, a smart device or a PC (Personal Computer). The monitor 30 and the projector 40 are output devices for displaying (projecting) data of the client device 20. The monitor 30 is a large display, for example. Hereinafter, in the description of the present embodiment, display of display data includes display by projecting the display data on the projector 40 as a projection image.

  Note that the communication method of the network 60 may be a wired method or a wireless method. The network 60 may be realized by combining a wired method and a wireless method. Note that the information processing system 100 may include a plurality of client devices 20, monitors 30, and projectors 40, respectively. For example, a plurality of client devices 20 may be provided, and a plurality of users may communicate with the server device 10 at the same time. Moreover, you may comprise the server apparatus 10 by multiple units | sets for reasons, such as load distribution.

  Returning to FIG. 1, the server device 10 includes a data processing unit 11, a generation unit 12, and a storage unit 13. The client device 20 includes a control unit 21, a recording unit 22, and a transmission unit 23. The control unit 21 receives an instruction to start displaying (projecting) display data to be displayed (projected) on the monitor 30 or the projector 40 in accordance with the operation of the presenter (user of the client device 20). Next, the control unit 21 requests display data designated by the presenter from the server device 10. The data processing unit 11 of the server device 10 acquires the requested display data from the storage unit 13 and transmits it to the client device 20. The control unit 21 of the client device 20 displays (projects) the display data received from the server device 10 on the monitor 30 or the projector 40 in response to an instruction to start display (projection) of the display data. In addition, the control unit 21 instructs the recording unit 22 to start voice recording. The recording unit 22 starts recording sound and records the sound being displayed.

  The control unit 21 receives a display data display (projection) update instruction by an operation such as updating the display page by the presenter. The control unit 21 updates the display (projection) content of the display data and acquires update information including the time when the display data display is updated. FIG. 3 is a diagram illustrating an example of update information of the information processing system 100 according to the first embodiment. In the example of FIG. 3, the update information has an ID, a page number, and an update time. The ID is information for uniquely identifying data included in the update information. The page number is a page number of display data. The update time is the time when the display data display is updated to display the corresponding page number. For example, the data of ID = 2 indicates that the time when the display data display is updated on the second page is 12:00:00.

  Returning to FIG. 1, the control unit 21 receives an instruction to end display (projection) of display data in accordance with the operation of the presenter. The control unit 21 ends the display (projection) of the display data. In addition, the control unit 21 transmits update information to the transmission unit 23. Further, the control unit 21 instructs the recording unit 22 to end the recording of the voice. The recording unit 22 ends the audio recording and transmits the audio data to the transmission unit 23. The transmission unit 23 transmits the audio data and the update information to the server device 10. Note that the protocol used by the transmission unit 23 for transmission may be arbitrary. For example, HTTP (Hyper Text Transfer Protocol) or FTP (File Transfer Protocol) may be used.

  The data processing unit 11 of the server device 10 stores the audio data, update information, and display data received from the client device 20 in the same location as the storage area of the storage unit 13 in which the display data is stored. The storage area is, for example, a file system folder of the server device 10. In addition, the data processing unit 11 transmits the audio data, the update information, and the display data received from the client device 20 to the generation unit 12. The generation unit 12 generates moving image data obtained by combining display data and audio data based on the update information. Details of the moving image data generation method will be described later. The generation unit 12 transmits the moving image data to the data processing unit 11. The data processing unit 11 stores the moving image data received from the generation unit 12 in the same location as the storage area of the storage unit 13 in which display data is stored. The data stored in the same storage area is distinguished by the data extension and data name.

  FIG. 4 is a diagram illustrating an example of functional blocks of the control unit 21 according to the first embodiment. The control unit 21 according to the present embodiment includes an operation reception unit 51, a data request unit 52, a display control unit 53, and an update information acquisition unit 54. The operation reception unit 51 receives an operation for controlling display of display data from a presenter (user of the client device 20). The data request unit 52 requests display data from the server device 10. The display control unit 53 controls the start, update, and end of display of display data. The update information acquisition unit 54 acquires update information including the time when the display of the display data is updated.

  FIG. 5 is a flowchart for explaining an example of the information processing method according to the first embodiment. When receiving a display (projection) start request from the operation receiving unit 51, the data request unit 52 of the client device 20 requests display data from the server device 10 (step S1). The data processing unit 11 of the server device 10 extracts the display data requested from the data requesting unit 52 from the storage unit 13 (step S2). The data processing unit 11 transmits display data to the client device 20 (step S3). The display control unit 53 displays the display data by projecting the display data received from the server device 10 onto the projector 40 (step S4). The recording unit 22 starts recording audio (step S5).

  When receiving a display (projection) update request from the operation reception unit 51, the display control unit 53 updates the image (display data) projected by the projector 40 (step S6). When the display data display is updated, the update information acquisition unit 54 records the update information including the time when the display data display is updated (step S7).

  When receiving the display (projection) end request from the operation receiving unit 51, the display control unit 53 ends the display (projection) of the image (display data) projected on the projector 40 (step S8). The recording unit 22 ends the sound recording and acquires the sound data (step S9). The transmission part 23 transmits audio | voice data and update information to the server apparatus 10 (step S10).

  The data processing unit 11 of the server device 10 stores the audio data uploaded from the client device 20 in the storage unit 13 (step S11). The generation unit 12 generates moving image data obtained by combining display data and audio data based on the update information (step S12).

  FIG. 6 is a diagram for describing generation of moving image data in the information processing system 100 according to the present embodiment. The generation unit 12 uses the update time of the update information as a relative time by setting the display (projection) start time to 00:00:00. The generation unit 12 generates moving image data obtained by synthesizing the audio data and the display data by switching the display data page based on the update information on the basis of the reproduction time of the audio data.

  Returning to FIG. 5, the data processing unit 11 stores the generated moving image data in the same location as the storage area where the display data of the storage unit 13 is stored (step S <b> 13).

  According to the information processing system 100 of the present embodiment, there is an effect that the data used for the explanation in the presentation and the audio data recorded during the explanation can be more easily synthesized as moving image data.

(Second Embodiment)
Next, a second embodiment will be described. FIG. 7 is a diagram illustrating an example of functional blocks of the information processing system 100 according to the second embodiment. In the information processing system 100 of the second embodiment, a case will be described in which data is uploaded to the server device 10 not only from the client device 20a of the presenter but also from the client device 20b of the listener. The information processing system 100 according to the present embodiment includes a server device 10, a client device 20a, a client device 20b, a monitor 30, and a projector 40. The client device 20a is used by the presenter. The client device 20b is used by a listener.

  FIG. 8 is a diagram illustrating an example of a hardware connection relationship of the information processing system 100 according to the second embodiment. In the information processing system 100 according to the present embodiment, the server device 10, the client device 20 a, the client device 20 b, the monitor 30, and the projector 40 are connected to each other via a network 60. The description of the hardware connection relationship of the present embodiment is the same as the description of the first embodiment, and will be omitted.

  Returning to FIG. 7, the description of the configuration of the client device 20a, the client device 20b, the monitor 30, and the projector 40 is the same as that of the first embodiment, and thus the description thereof is omitted. Hereinafter, the server apparatus 10 will be described. The generating unit 12 of the server device 10 according to the first embodiment generates moving image data when receiving audio data and update information from the client device 20a. That is, in the information processing system 100 according to the first embodiment, the generation unit 12 is triggered when the operation reception unit 51 of the client device 20a receives an operation indicating the end of display (projection) from the presenter. The moving image data was generated based on the update information. After the presenter's presentation using the client device 20a is completed, the server device 10 of the present embodiment further transfers data (image data, moving image data, and text data) from the client device 20b (or the client device 20a) to the server device 10. Etc.) is added as a trigger when moving image data is generated.

  Next, an example of data added to the server device 10 after the presentation of the presenter is completed will be described. FIG. 9 is a diagram illustrating an example of data (file) added from the client device (listener) 20b according to the second embodiment. image1. jpg and image2. jpg is, for example, image data taken by the client device 20b, such as information added on the whiteboard on which the display data is projected by the bystander of the presentation. Note that the data format of the image data is not limited to jpg and may be any format. Also, movie. The mpg is, for example, moving image data in which a presentation bystander has taken a picture of the presentation. Note that the format of the moving image data is not limited to mpg, and may be any format.

  In addition, when the production | generation part 12 synthesize | combines several data and produces | generates moving image data, the creation date (creation time) of data is referred. Therefore, the client devices 20a and 20b may have a function of adjusting the time of the client devices 20a and 20b using an NTP (Network Time Protocol) server or the like.

  FIG. 10 is a diagram illustrating an example of a data format of text data added from the client device (listener) 20b according to the second embodiment. The text data is, for example, data in which a bystander of a presentation records a memo being presented. The text data of the present embodiment has a data format including text and correspondence information that associates the text with a page of display data. The correspondence information is, for example, a page number of display data.

  FIG. 11 is a diagram for describing generation of moving image data in the information processing system 100 according to the second embodiment. In the moving image data generated in the example of FIG. 11, the data illustrated in FIGS. 9 and 10 is further added to the moving image data generated by the information processing system according to the first embodiment. That is, the generation unit 12 generates texts (texts 1 to 3) included in the text data, image1. jpg, image2. jpg and movie. Movie data is generated with mpg added.

  When the image data is further added to the storage area in which the display data is stored, the generation unit 12 is already stored in the storage area in which the display data is stored, for example, based on the creation date and time of the image data. The moving image data is generated by combining the acquired data and the added image data.

  Further, when the moving image data is further added to the storage area in which the display data is stored, the generation unit 12 stores the display data based on, for example, the creation date and time of the moving image data and the length of the reproduction time. Moving image data is generated by combining the data already stored in the storage area and the moving image data. In other words, the generation unit 12 combines the added moving image data so that the added moving image data is reproduced from the date and time when the added moving image data is created.

  In addition, when the generation unit 12 further adds, for example, text data including correspondence information that associates the text with the page of the display data to the storage area in which the display data is stored, Based on the correspondence information, moving image data is generated by synthesizing the data already stored in the storage area where the display data is stored and the added text data.

  In addition, when storing a plurality of moving image data in the same storage area, the generation unit 12 makes a distinction by adding a prefix to the name of the moving image data. The prefix is, for example, the creation date and number of moving image data.

  In addition, the generation unit 12 uses the data already stored in the storage area in which the display data is stored, the data used for data synthesis and the data synthesis by the data name, the data extension, etc. It may be distinguished from data that is not. For example, the generation unit 12 may not use the synthesized moving image data already stored in the storage area where the display data is stored for the synthesis of the moving image data.

  In addition, when the data used for data synthesis includes a plurality of data having audio data, the generation unit 12 may determine a data format that preferentially uses the audio data. Further, the data for validating the audio data may be appropriately changed by the setting of the server device 10.

  According to the information processing system 100 of the present embodiment, after the presentation of the presenter using the client device 20a is completed, data is further added to the server device 10 from the client device 20b (or the client device 20a). Sometimes, it is possible to generate moving image data by combining the data.

  FIG. 12 is a diagram for describing an example of a hardware configuration of the server device 10 and the client device 20 according to the first and second embodiments.

  The server device 10 and the client device 20 according to the first and second embodiments include a control device 71, a main storage device 72, an auxiliary storage device 73, a display device 74, an input device 75, and a communication device 76. The control device 71, the main storage device 72, the auxiliary storage device 73, the display device 74, the input device 75, and the communication device 76 are connected to each other via a bus 77. Hereinafter, a case where the server apparatus 10 is a computer having the same configuration as a PC and the client apparatus 20 is a smart device will be described. The server device 10 and the client device 20 are not limited to PCs and smart devices, and may be any computer that can execute a program.

  The control device 71 executes the program read from the auxiliary storage device 73 to the main storage device 72. The main storage device 72 is a memory such as a ROM (Read Only Memory) or a RAM (Random Access Memory). For example, in the case of the server device 10, the auxiliary storage device 73 is a hard disk or the like. In the case of the client device 20, it is a memory card or the like. The display device 74 is a screen that displays the statuses of the server device 10 and the client device 20. For example, in the case of the server device 10, the display device 74 is a liquid crystal display or the like. In the case of the client device 20, a touch panel or the like is used. The input device 75 is an interface for operating the server device 10 and the client device 20. For example, in the case of the server device 10, the input device 75 is a keyboard, a mouse, or the like. In the case of the client device 20, a touch panel, a button, or the like is used. The communication device 76 is an interface for connecting to a network.

  The programs to be executed on the server device 10 and the client device 20 according to the first and second embodiments are installed in an installable format or an executable format file, such as a CD-ROM, a memory card, a CD-R, and a DVD (Digital The program may be recorded on a computer-readable recording medium such as Versatile Disk) and provided as a computer program product. In addition, the programs executed by the server device 10 and the client device 20 of the first and second embodiments are stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also good. Further, the program executed by the server device 10 and the client device 20 of the first and second embodiments may be provided or distributed via a network such as the Internet without downloading. The programs of the server device 10 and the client device 20 according to the first and second embodiments may be provided by being incorporated in advance in a ROM or the like.

  The program executed by the server device 10 according to the first and second embodiments is a functional block (data processing unit 11 and generation unit 12) that can be realized as a program among the functional blocks of the server device 10 described above. The module configuration includes

  The program executed by the client device 20 of the first and second embodiments is a functional block (control unit 21 (operation receiving unit) that can be realized as a program among the functional blocks of the client device 20 described above. 51, a data request unit 52, a display control unit 53, an update information acquisition unit 54), and a transmission unit 23).

  As the actual hardware, the control device 71 reads the program from the storage medium and executes the module, whereby the modules are loaded onto the main storage device 72. That is, each module is generated on the main storage device 72. Note that some or all of the functional blocks of the server device 10 and the client device 20 may be realized by hardware such as an IC (Integrated Circuit) without being realized by a program.

  According to the information processing system 100 of the first and second embodiments, there is an effect that the data used for the description in the presentation and the data recorded during the description can be more easily combined as the moving image data. Play.

DESCRIPTION OF SYMBOLS 10 Server apparatus 20 Client apparatus 30 Monitor 40 Projector 60 Network 11 Data processing part 12 Generation part 13 Storage part 21 Control part 22 Recording part 23 Transmission part 51 Operation reception part 52 Data request part 53 Display control part 54 Update information acquisition part 71 Control Device 72 Main storage device 73 Auxiliary storage device 74 Display device 75 Input device 76 Communication device 77 Bus 100 Information processing system

JP 2005-252574 A

Claims (10)

An information processing system comprising a server device and a plurality of client devices,
One client device of the plurality of client devices is:
A data requesting unit that requests display data from the server device;
A display control unit for controlling display of the display data;
An update information acquisition unit for acquiring update information including a time when the display of the display data is updated;
A sound recording unit for recording the sound displaying the display data and obtaining the sound data;
A transmission unit that transmits the update information and the audio data to a folder in which the display data is stored ;
With
The server device
A storage unit having the folder in which the display data is stored ;
Wherein in response to a request of one client device, a data processing unit that transmits the display data to the client device of the one,
When the update information and the audio data are stored in the folder by the one client device, and data is stored in the folder by another client device among the plurality of client devices , based on the update information, A generating unit that generates moving image data obtained by combining the display data, the audio data, and the data ;
An information processing system comprising: The generator is
When the data stored in the folder in which the display data is stored by the other client device is image data, the display data is based on the update information and the creation date and time of the image data. The information processing system according to claim 1, wherein moving image data obtained by synthesizing the audio data and image data is generated. The generator is
When the data stored in the folder in which the display data is stored by the other client device is moving image data, based on the creation date and time of the moving image data, the length of the reproduction time, and the update information the information processing system according to claim 1 for generating a moving image data obtained by synthesizing the said display data the audio data and video data. The generator is
The data to which the display data by said other client device is stored in the folder that is stored in the text and, in the case of text data included the corresponding information for associating the page of the display data and the text The information processing system according to claim 1, wherein moving image data is generated by combining the display data , the audio data, and text data based on the correspondence information and the update information . The display control unit
The information processing system according to any one of claims 1 to 4, wherein the display data is displayed as a projection image projected from a projector.   The generator is
  When other data is added to the folder in which the display data is stored, the other data that has been added, data that has already been stored in the folder in which the display data is stored, and Generate video data that combines
  The information processing system according to any one of claims 1 to 5.   The generation unit identifies whether the data is used for synthesis by at least one of the name of the data and the extension of the data.
  The information processing system according to any one of claims 1 to 6. An information processing system comprising a server device and a plurality of programs executed by a plurality of client devices ,
One program among the plurality of programs,
A data requesting unit that requests display data from the server device;
A display control unit for controlling display of the display data;
An update information acquisition unit for acquiring update information including a time when the display of the display data is updated;
A sound recording unit for recording the sound displaying the display data and obtaining the sound data;
A transmission unit that transmits the update information and the audio data to a folder in which the display data is stored ;
With
The server device
A storage unit having the folder in which the display data is stored ;
In response to a request of the one program, and a data processing unit that transmits the display data to said one program,
When the update information and the audio data are stored in the folder by the one program, and the data is stored in the folder by another program among the plurality of programs , the display data is based on the update information. Generating unit that generates moving image data obtained by combining the audio data and the data ;
An information processing system comprising: A server device connected to a plurality of client devices,
The server device
A storage unit having a folder in which display data is stored ;
A data processing unit that transmits the display data to the one client device in response to a request from one of the plurality of client devices;
Update information including a time at which the display of the display data is updated by the one client device and audio data in which a sound displaying the display data is recorded are stored in the folder, and the plurality of client devices when among the data by another client device stored in the folder, and on the basis of the update information generation unit that generates moving image data obtained by synthesizing the above and the display data and the voice data data,
A server device comprising: A computer including a storage unit having a folder in which display data is stored and connected to a plurality of client devices.
A data processing unit that transmits the display data to the one client device in response to a request from one of the plurality of client devices;
Update information including a time at which the display of the display data is updated by the one client device and audio data in which a sound displaying the display data is recorded are stored in the folder, and the plurality of client devices when among the data by another client device stored in the folder, and on the basis of the update information generation unit that generates moving image data obtained by synthesizing the above and the display data and the voice data data,
Program to function as.

Images