JP6973567B2 - Information processing equipment and programs - Google Patents

Description

The present invention relates to an information processing apparatus and a program.

For example, time-series information such as a movie to be viewed by a user is divided into a plurality of parts, and each of the divided parts is obtained from a feature word related to the part obtained from the sound included in the part and an image included in the part. There is a technique for creating a summary by associating a feature image related to the part with the feature image (Patent Document 1).

Japanese Unexamined Patent Publication No. 2008-148121

Since the importance of the feature words in each part is different between each part, when the user browses the time series information according to the importance of the feature words, it is necessary to show the user the importance of the feature words in each part. .. Therefore, when creating a summary including a plurality of feature images, it is possible to make the sizes of the plurality of feature images different according to the importance of the feature words, which improves the convenience of the user.

One of an object of the present invention is to provide an information processing device capable of allowing a user to grasp the importance of a feature word of each part in which time-series information is divided.

The information processing apparatus according to the present invention is divided into a classification means for classifying time-series information including voice information and image information and changing with time into a plurality of parts, and an operation instruction receiving means for receiving an operation instruction by a user. was displayed in severity size corresponding to of parts, and a display control unit for controlling so that displays a summary image including a feature image indicating the characteristic of the segmented part, wherein the display control unit , The display of the feature word associated with the feature image indicating the feature of the divided part is restricted according to the size of the feature image, and the operation instruction receiving means limits the display of the feature word. When the operation of instructing the feature image is received, the display is controlled to display the summary image in which the feature word whose display is restricted is displayed.

The information processing apparatus according to claim 2 of the present invention acquires, in the information processing apparatus according to claim 1, the characteristic words indicating the characteristics of the divided parts based on the voice information included in the parts. The feature word acquisition means further includes the feature word acquisition means, and the feature word acquisition means acquires the feature word according to the appearance frequency in the voice information corresponding to the divided part.

The information processing apparatus according to the present invention generates the summary image including the plurality of feature images, each of which is displayed in a size corresponding to the importance.

The information processing apparatus according to claim 3 of the present invention is the information processing apparatus according to claim 1. In the information processing apparatus according to claim 1, the feature image is displayed larger as the importance is higher, and is displayed smaller as the importance is lower.

In the information processing apparatus according to claim 4, the importance is determined from the number of appearances of the characteristic word in the voice information in the information processing apparatus according to claim 1.

The information processing apparatus according to claim 5 of the present invention is the information processing apparatus according to claim 1, wherein the importance is determined from the volume of the characteristic word in the voice information.

The information processing device according to claim 6 of the present invention is the information processing device according to claim 1, wherein the importance is whether or not there is a silent time immediately before the time when the feature word appears in the voice information. Determined by.

In the information processing apparatus according to the present invention, the summary image includes the feature image associated with the feature word.

In the information processing apparatus according to the present invention, the summary image includes the feature image associated with the feature word in an aspect corresponding to the size of the feature image.

In the information processing apparatus according to the present invention, the summary image generation means limits the display of the feature word associated with the feature image according to the size of the feature image.

The information processing apparatus according to claim 7 of the present invention is the information processing apparatus according to claim 1, wherein the summary image generation means is smaller than or equal to a predetermined threshold value. The feature word associated with the feature image is not displayed.

The information processing apparatus according to claim 8 of the present invention is the information processing apparatus according to claim 1, wherein the summary image generation means is smaller than or equal to a predetermined threshold value. A part of the feature word associated with the feature image is displayed.

The information processing apparatus according to the present invention further includes an operation instruction receiving means for receiving an operation instruction by a user, and the operation instruction receiving means performs an operation of instructing the feature image in which the display of the feature word is restricted. Upon receipt, the summary image generation means generates the summary image displaying the feature word whose display is restricted.

The program according to the present invention is a classification means that divides time-series information including audio information and image information and changes with time into a plurality of parts, and the image including a feature image showing the characteristics of the divided parts. A feature image acquisition means acquired from information, a feature word acquisition means for acquiring a feature word indicating a feature of the divided part based on the audio information included in the part, and an importance of the feature word of the divided part. It is a program for operating a computer as a summary image generation means for generating a summary image including a plurality of the feature images displayed in a mode corresponding to the above.

According to the present invention, it is possible for the user to grasp the importance of the characteristic words of each part in which the time series information is divided.

According to claim 2, the feature word can be determined according to the frequency of appearance in each part.

According to the present invention, the user can be made to grasp the importance of the feature word of each part by the size of the feature image.

According to claim 3 of the present invention, it is possible to make the user understand that the larger the feature image, the higher the importance of the feature word, and the smaller the feature image, the lower the importance of the feature word.

According to claim 4, the importance of the feature word can be determined from the number of appearances of the feature word in the voice information.

According to claim 5, the importance of the feature word can be determined from the volume of the feature word in the voice information.

According to claim 6, the importance of the feature word can be determined from whether or not there is a silent time immediately before the time when the feature word appears in the voice information.

According to the present invention, it is easy for the user to grasp the information of each part.

According to the present invention, it is possible to make the user grasp the importance of the feature word of each part from the display mode of the feature word.

According to the present invention, it is possible to reduce the amount of information about the less important part of the feature word.

According to the present invention, it is possible to provide information only when the user requests a less important part of the feature word.

It is a figure which shows an example of the hardware composition of the information processing system which concerns on this embodiment. It is a functional block diagram which shows an example of the main function realized by the server which concerns on this embodiment. It is a figure which shows an example of the summary image which concerns on this embodiment. It is a flow diagram which shows an example of the summary image generation processing executed by the server which concerns on this embodiment. It is a flow diagram which shows an example of the feature information acquisition process which a server which concerns on this embodiment executes. It is a flow diagram which shows an example of the display mode setting process executed by the server which concerns on this embodiment. It is a figure which shows an example of the summary image which concerns on this embodiment. It is a flow diagram which shows an example of the display mode setting process executed by the server which concerns on this embodiment. It is a figure which shows an example of the summary image which concerns on this embodiment.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing an example of a hardware configuration of the information processing system 1 according to the present embodiment. As shown in FIG. 1, the information processing system 1 according to the present embodiment includes a server 10 and a terminal device 20 connected via a network. In FIG. 1, the information processing system 1 includes only one terminal device 20, but may include a plurality of other terminal devices 20.

The server 10 is an information processing device such as a server computer, and includes a control unit 11, a storage unit 12, and a communication unit 13.

The control unit 11 is, for example, a CPU or the like, and executes various information processing according to a program stored in the storage unit 12.

The storage unit 12 includes, for example, a memory element such as RAM or EOM, a hard disk, or the like. The storage unit 12 holds a program executed by the control unit 11 and various data. The storage unit 12 also operates as a work memory of the control unit 11.

The communication unit 13 is a network interface such as a LAN card, and transmits / receives information to / from the server 10 via a communication means such as a LAN or a wireless communication network. The control unit 11, the storage unit 12, and the communication unit 13 are each connected via a bus.

The terminal device 20 is an information processing device such as a personal computer, and includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, and an operation unit 25. Each of the above parts 21 to 25 is connected via a bus. The control unit 21, the storage unit 22, and the communication unit 23 may have the same configuration as the control unit 11, the storage unit 12, and the communication unit 13, respectively.

The display unit 24 is, for example, a liquid crystal display, a CRT display, an organic EL display, or the like, and displays information according to an instruction from the control unit 21.

The operation unit 25 is, for example, a keyboard, a mouse, a button, a touch panel, or the like, and receives a user's instruction operation and outputs the content of the instruction operation to the control unit 21.

Next, the functions realized by the information processing system 1 according to the present embodiment will be described. FIG. 2 is a functional block diagram showing an example of the main functions realized by the server 10 according to the present embodiment. As shown in FIG. 2, functionally, the server 10 has a time-series information acquisition unit 50, a part division unit 51, a feature word acquisition unit 52, a feature image acquisition unit 53, a feature information association unit 54, and an importance calculation unit. It includes 55, a display mode setting unit 56, and a summary image generation unit 57. These functions are realized by the control unit 11 executing the program stored in the storage unit 12.
This program includes, for example, a magnetic disk (HDD, FD (Flexible Disk), etc.), an optical recording medium (optical disc (CD (Compact Disk), DVD (Digital Versatile Disk), etc.)), an optical magnetic recording medium, a semiconductor memory ( It is supplied to the server 10 via a computer-readable recording medium such as a flash ROM) or via a communication means such as the Internet.

The time-series information acquisition unit 50 acquires time-series information. Here, the time-series information is information that changes with time, and in the present embodiment, it is information including audio information and image information including a plurality of frame images. The specific time-series information may be lecture information recording a lecture or distribution record information recording a video distributed on television or the Internet. The time-series information may be stored in the storage unit 12 of the server 10 or may be provided by the terminal device 20.

The part division unit 51 divides the time series information into a plurality of parts. The part division unit 51 divides the audio information and the image information included in the time-series information into a plurality of parts. The part division section 51 calculates, for example, the difference between the color histograms of two consecutive frame images, the pixel difference, the conversion coefficient difference such as the discrete cosine transform, and the like, and when the calculated difference becomes equal to or more than a predetermined threshold value. The two frame images are used as part delimiters.

The feature word acquisition unit 52 acquires feature words indicating the characteristics of the part in each part classified by the part division unit 51. The feature word acquisition unit 52 according to the present embodiment acquires feature words according to voice information. First, the feature word acquisition unit 52 performs voice recognition on the voice information of each part and converts it into character information. Then, the feature word acquisition unit 52 acquires the feature word from the converted character information. For example, the feature word acquisition unit 52 extracts the word most frequently appearing from the converted character information as a feature word.

The feature image acquisition unit 53 acquires a feature image showing the characteristics of the part in each part divided by the part division unit 51. The feature image acquisition unit 53 acquires a frame image corresponding to the feature word acquired by the feature word acquisition unit 52 as a feature image. Specifically, the feature image acquisition unit 53 acquires the appearance position of the feature word in the voice information, and acquires the frame image corresponding to the appearance position as the feature image. The feature image acquisition unit 53 may acquire a feature image based on the image information. For example, the feature image acquisition unit 53 may acquire a frame image that first appears in a part as a feature image, or acquires a frame image satisfying a predetermined criterion from a plurality of frame images included in the part as a feature image. May be good.

The feature information association unit 54 stores the association information in which the feature word acquired by the feature word acquisition unit 52 and the feature image acquired by the feature image acquisition unit 53 are associated with each other in the association information storage unit.
As for the association information, it is assumed that the feature word and the feature image are associated with each part. Information related to feature words and feature images may be further associated with the association information for each part. For example, the appearance position where the feature word appears in the time-series information (for example, the reproduction time), the appearance position where the feature image appears in the time-series information, and the like may be associated.

The importance calculation unit 55 calculates the importance of each part classified by the part division unit 51. The importance calculation unit 55 calculates the importance of each part based on the feature words acquired by the feature word acquisition unit 52. For example, the importance calculation unit 55 calculates the importance based on the volume of the time when the feature word appears in the voice information. Specifically, the importance calculation unit 55 calculates the importance as higher as the volume of the time when the feature word appears, and lowers the importance as the volume of the time when the feature word appears is lower. This is because it is considered that the louder the volume, the more the content that one wants to insist. Further, the importance calculation unit 55 may calculate the importance depending on whether or not there is a silent time immediately before the time when the feature word appears in the voice information. Specifically, the importance calculation unit 55 calculates the importance high when there is a silent time immediately before the time when the feature word appears. This is because, for example, when the time-series information is a record of a lecture, it is judged that the information is silent in order to attract the attention of the audience, and it is considered that the content to be claimed after the silent time is included. .. Further, the importance calculation unit 55 may calculate the importance according to the number of appearances of the feature word in each part. This is because it is considered that the characteristic word of the part is more important as the number of appearances of the characteristic word in the part increases. The importance calculation unit 55 may calculate the importance based on the feature image. For example, the importance calculation unit 55 may calculate the importance from the color histogram of the feature image, the image distribution, and the like. Further, the importance calculation unit 55 may calculate the importance of each part by combining two or more of the above-mentioned importance calculation methods. For example, the importance calculation unit 55 may calculate the importance based on the feature word and the feature image.

The display mode setting unit 56 sets the display mode of each feature image when the summary image generation unit 57 generates a summary image representing a summary of time-series information using a plurality of feature images. Then, the summary image generation unit 57 generates a summary image according to the display mode set by the display mode setting unit 56.

The display mode setting unit 56 sets the display mode of each feature image based on the importance of each part calculated by the importance calculation unit 55. Specifically, the display mode setting unit 56 makes the sizes of the plurality of feature images different according to the importance. That is, the display mode setting unit 56 sets the feature image of the high-importance part to be displayed large and the feature image of the low-importance part to be displayed small.

FIG. 3 is a diagram showing an example of a summary image 100 according to the present embodiment. The summary image 100 shown in FIG. 3 includes a plurality of frames 110, and a feature image is displayed in each frame 110. The plurality of frames 110 have different sizes, for example, the frame 110a is larger than the frame 110b. The plurality of feature images are displayed in different sizes according to the size of each frame 110. The size of these frames and the size of the feature image are set according to the importance as described above. The display mode setting unit 56 may set the size of the feature image or may set the size of each frame 110 of the summary image 100. When the display mode setting unit 56 sets the size of each frame 110, the summary image generation unit 57 may convert each feature image into a size corresponding to the corresponding frame 110 and display it.

The summary image 100 as shown in FIG. 3 is transmitted to the terminal device 20 via the network and displayed on the display unit 24 of the terminal device 20. The user of the terminal device 20 can see the summary image 100 displayed on the display unit 24 of the terminal device 20. Then, when the user selects one of the feature images, the time-series information is reproduced from the appearance position of the feature image so that the user can view it. In this way, the user can determine the importance from the size of the feature image divided into frames, and can select the reproduction position according to the importance.

Further, the display mode setting unit 56 may set the display position of each of the plurality of feature images in the summary image 100. For example, the display mode setting unit 56 may set the display position of each feature image so that the feature images are arranged in chronological order. Further, the display mode setting unit 56 may set the display position of each feature image according to the size of the feature image. For example, the display mode setting unit 56 may set the display position of each feature image so that the feature images are arranged in descending order of size, or display each feature image so that the largest feature image is located at the center of the summary image 100. You may set the position.

Further, in the summary image 100 shown in FIG. 3, a character image in which a feature word associated with the feature image is indicated by characters may be superimposed and displayed on each feature image. At this time, if the size of the feature image is less than or equal to a predetermined threshold value, all the feature word characters may not be displayed. For example, if the feature image is small with respect to the number of characters of the feature word, it may not be possible to display all the characters of the feature word. Therefore, the display mode setting unit 56 adjusts the character image according to the size of each feature image. For example, the display mode setting unit 56 reduces the size of the character image so that all the characters of the feature word are displayed according to the size of the feature image. Further, the display mode setting unit 56 may limit the display of the character image when all the characters of the feature word cannot be displayed with respect to the size of the feature image. In this case, when the user who sees the summary image 100 mouses over the feature image in which the display of the character image is restricted, the character image may be displayed. These specific processes will be described later.

Here, an example of the summary image generation process executed by the server 10 according to the present embodiment will be described with reference to the flow chart shown in FIG.

First, the time-series information acquisition unit 50 acquires the time-series information (S101). Here, the time-series information includes audio information and image information including a plurality of frame images.

The part division unit 51 divides the time series information acquired by the time series information acquisition unit 50 into a plurality of parts (S102). Here, the part division unit 51 divides the time-series information into K parts, and assigns numbers 1 to K to each of the divided parts in chronological order.

Then, the initial value of n = 1 is set in the variable n (S103), and the feature information acquisition process is executed (S104). Here, the variable n is a counter variable that takes an integer value of 1 or more.

An example of the feature information acquisition process executed by the server according to the present embodiment will be described with reference to the flow chart of FIG. Here, the feature information acquired by the feature information acquisition process is information indicating the features of each part, and in the present embodiment, the feature words and the feature images are acquired.

First, the feature word acquisition unit 52 acquires the voice information of the nth part (S201).

Next, the feature word acquisition unit 52 converts the voice information of the nth part into character information by voice recognition (S202).

Then, the feature information acquisition unit extracts the feature word indicating the feature of the nth part from the character information obtained in the process S202 (S203).

Next, the feature image acquisition unit 53 acquires the appearance position of the feature word obtained in the process S203 in the voice information, and acquires the frame image corresponding to the appearance position as the feature image showing the feature of the nth part ( S204).

Then, the feature information association unit 54 associates the feature word acquired in the process S203 with the feature image acquired in the process S204 (S205), and returns. Here, the feature information association unit 54 stores the association information in which the number for identifying the part, the feature word, and the feature image are associated with each other in the storage unit.

When the feature information extraction process in the process S104 is completed, it is determined whether or not n = K is satisfied (S105). That is, it is determined whether the feature information extraction process has been performed in all K parts.

If it is determined that n = K does not hold as a result of the determination of the process S105 (S105: N), 1 is added to the variable n (S106), and the processes after the process S104 are repeatedly executed.

If it is determined that n = K is satisfied as a result of the determination in the process S105 (S105: Y), the importance calculation unit 55 calculates the importance of each of the K parts (S107). Here, the importance calculated by the importance calculation unit 55 is added to the association information and is associated and stored.

Then, the display mode setting process is executed (S108). An example of the display mode setting process executed by the server according to the present embodiment will be described with reference to the flow chart of FIG.

As shown in FIG. 6, first, the display mode setting unit 56 determines the size of the frame 110 for displaying the feature image of each part based on the importance of each part calculated by the importance calculation unit 55 in the process S107. Set (S301). Here, the display mode setting unit 56 sets the size of the K frames 110 corresponding to the K parts, respectively. For example, the display mode setting unit 56 sets the frame 110 corresponding to the high-importance part to be large and the frame 110 corresponding to the low-importance part to be small. Here, the information set by the display mode setting unit 56 is added to and associated with the association information of each part.

Next, the initial value of m = 1 is set in the variable m (S302). Here, the variable m is a counter variable that takes an integer value of 1 or more.

Then, the display mode setting unit 56 calculates the number of characters of the feature word of the m part (S303). Further, the display mode setting unit 56 calculates the number of characters that can be arranged when the characters are arranged in the frame 110 corresponding to the m part (S304). Here, the number of characters that can be arranged in the frame 110 is predetermined according to the size of the frame 110 and the character size to be used.

Then, it is determined whether the number of characters that can be arranged is equal to or greater than the number of characters of the feature word (S305).
That is, it is determined whether all the characters of the feature word can be arranged in the frame 110 set in the process S301.

If the number of characters that can be arranged is equal to or greater than the number of characters of the feature word as a result of the determination of the process S305 (S305: Y), the display mode setting unit 56 associates the feature word character data indicating the character of the feature word with the feature image (S305: Y). S306). Here, the display mode setting unit 56 adds feature word character data to the association information corresponding to the m part, associates it, and stores it. The feature word character data may include information such as a character font and an arrangement position. The display mode setting unit 56 may newly generate and store a feature image associated with the feature word character data.

Then, it is determined whether or not m = K holds (S307). That is, it is determined whether the feature word character data is associated with all K parts.

If it is determined that m = K does not hold as a result of the determination of the process S307 (S307: N), 1 is added to the variable m (S308), and the processes after the process S303 are repeatedly executed.

If it is determined that m = K is satisfied as a result of the determination of the process S307 (S307: Y), the process returns.

Further, as a result of the determination of the process S305, when the number of characters that can be arranged is smaller than the number of characters of the feature word (S305: N), the display mode setting unit 56 indicates the feature word character data indicating the character of the feature word to be arranged in the frame 110. Is adjusted (S309). For example, the display mode setting unit 56 changes the character size of the feature word character data to a size that can be arranged in the frame 110. Then, the processes after the process S307 are executed. The display mode setting unit 56 may associate a part of the feature word with the feature image as the feature word character data. Further, the display mode setting unit 56 may be set to display the character of the characteristic word indicated by the characteristic word character data as a telop.

When the display mode setting process is completed, the summary image generation unit 57 generates the summary image 100 according to the display mode set in the display mode setting process (S109), and the summary image generation process ends. Here, the summary image generation unit 57 may generate the summary image 100 according to various associated information for each part of the association information.

FIG. 7 is a diagram showing an example of a summary image 100 according to the present embodiment. FIG. 7 shows an example of the summary image 100 generated by the summary image generation unit 57 in the process S109. In the summary image 100 shown in FIG. 7, the feature word character image 200 corresponding to the feature word character data is superimposed on the feature image of each frame 110. The character size of the feature word character image 200b superimposed on the feature image of the small frame 110b is smaller than that of the feature word character image 200a superimposed on the feature image of the large frame 110a. By displaying all the characters of the feature word on the feature image of the small frame 110b in this way, it is easy for the user to grasp the information of each part.

Next, another example of the display mode setting process executed by the server according to the present embodiment will be described with reference to the flow chart of FIG. Here, the processing when the feature word character image is not superimposed on the feature image will be described.

First, the display mode setting unit 56 sets the size of the frame 110 for displaying the feature image of each part based on the importance of each part calculated by the importance calculation unit 55 in the process S107 (S401).

Next, the display mode setting unit 56 selects a part on which the feature word character image is not superimposed (S402). Here, the display mode setting unit 56 selects a part in which the number of characters that can be arranged is smaller than the number of characteristic word characters. The display mode setting unit 56 may select all the parts.

Then, the display mode setting unit 56 generates alternative data to be superimposed instead of the feature word character image for the part on which the feature word character image is not superimposed (S403). Here, the alternative data is for informing the user who sees the summary image 100 that the characteristic word character image is not superimposed but the character information exists. As the alternative data, for example, an image icon or character data such as "..." is used.

Then, the display mode setting unit 56 generates display character data (S404). The display character data is displayed when the user gives an operation instruction (for example, a mouse over operation) to select a feature image on which the feature word character image is not superimposed. The display character data may indicate the characters of the feature word, or may indicate the character information obtained by converting the voice information included in the part by voice recognition.

The display mode setting unit 56 associates the alternative data generated in the process S403 with the display character data with the feature image (S404), and returns. Here, the display mode setting unit 56 adds alternative data and display character data to the association information corresponding to each part and stores them in association with each other.

FIG. 9 is a diagram showing an example of a summary image 100 according to the present embodiment. FIG. 9 shows an example of the summary image 100 generated by the summary image generation unit 57 according to the display mode set by the display mode setting process shown in FIG. In the summary image 100 shown in FIG. 9, the substitute data image 300 corresponding to the substitute data is superimposed on the feature image of the small frame 110b. Here, when the user selects the alternative data image 300 by a mouse over operation or the like, the operation instruction is transmitted from the terminal device 20 to the server 10. When the server 10 receives the operation instruction, the summary image generation unit 57 generates the summary image 100 on which the display character image 400 corresponding to the display character data is superimposed. Then, the generated summary image is transmitted to the terminal device 20. Then, the summary image 100 on which the display character image 400 is superimposed is displayed on the display unit 24 of the terminal device 20. The display character image 400 may be configured so that the characters indicated by the display character data are displayed as telops.

Further, when the server 10 receives an operation instruction for selecting an alternative data image 300 by a mouse over operation or the like by the user, the summary image generation unit 57 generates a display character image 400 corresponding to the display character data and sends the terminal device 20 to the terminal device 20. It may be sent.

The present invention is not limited to the above embodiment.

For example, the feature word may be changed when the number of characters that can be arranged in the process S305 is less than the number of characters of the feature word. Here, the feature information acquisition process may be executed, and the feature word acquisition unit 52 may acquire the feature words arranged in the frame of the size set by the display mode setting unit 56.

Further, in the above embodiment, the example in which the server 10 and the terminal device 20 are separate bodies is shown, but the server 10 and the terminal device 20 may be an integrated device.

1 Information processing system, 10 servers, 11,21 control units, 12,22 storage units, 13,23 communication units, 20 terminal devices, 24 display units, 25 operation units, 50 time series information acquisition units, 51 part division units, 52 Feature word acquisition unit, 53 Feature image acquisition unit, 54 Feature information association unit, 55 Importance calculation unit, 56 Display mode setting unit, 57 Summary image generation unit, 100 Summary image, 110, 110a, 110b frames, 200, 200a , 200b Feature word character image, 300 alternative data image, 400 display character image.

Claims (9)

A classification means that divides time-series information that changes with time, including audio information and image information, into multiple parts, and
Operation instruction receiving means for receiving operation instructions by users and
The displayed by segmented importance magnitude corresponding to of parts, and a display control unit for controlling so that displays a summary image including a feature image indicating the characteristic of the segmented part,
The display control means limits the display of the feature word indicating the feature of the divided part associated with the feature image according to the size of the feature image, and the operation instruction receiving means is the feature. When an operation for instructing the feature image with the word display restricted is accepted, the summary image displaying the feature word with the display restriction is controlled to be displayed.
An information processing device characterized by this. Further including a feature word acquisition means for acquiring the feature word indicating the feature of the divided part based on the voice information included in the part.
The feature word acquisition means acquires the feature word according to the frequency of appearance in the voice information corresponding to the divided part.
The information processing apparatus according to claim 1. The feature image is
The higher the importance, the larger the display, and the lower the importance, the smaller the display.
The information processing apparatus according to claim 1. The importance is determined from the number of appearances of the characteristic word in the voice information.
The information processing apparatus according to claim 1. The importance is determined from the volume of the feature word in the voice information.
The information processing apparatus according to claim 1. The importance is determined by whether or not there is a silent time immediately before the time when the feature word appears in the voice information.
The information processing apparatus according to claim 1. The display control means is
When the size of the feature image is less than or equal to a predetermined threshold value, the feature word associated with the feature image is not displayed.
The information processing apparatus according to claim 1. The display control means is
When the size of the feature image is less than or equal to a predetermined threshold value, a part of the feature words associated with the feature image is displayed.
The information processing apparatus according to claim 1. A classification means that divides time-series information that changes with time, including audio information and image information, into multiple parts.
A feature image acquisition means for acquiring a feature image showing the features of the divided part from the image information included in the part.
A feature word acquisition means for acquiring a feature word indicating the characteristics of the divided part based on the voice information included in the part.
Operation instruction receiving means for receiving operation instructions by the user,
The feature is a plurality of the feature images, each of which is displayed in a size corresponding to the importance of the feature word of the divided part, and the feature word having an aspect according to the size of the feature image is associated with the feature. A summary image including an image is generated, the display of the feature word associated with the feature image is restricted according to the size of the feature image, and the operation instruction receiving means is restricted from displaying the feature word. A summary image generation means for generating the summary image displaying the feature word whose display is restricted when the operation for instructing the feature image is received.
A program to make your computer work as.

Images