JP7622390B2 - Information processing device, end roll generating method, and program - Google Patents

Description

The present invention relates to an information processing device, an end credits generation method, and a program, and more particularly to generating end credits for video content such as games and movies.

Traditionally, RPGs (role-playing games) have had end credits added to the end of the story, and these are played when the player clears the game. The end credits include the names of the production staff along with the ending theme song and in-game scenes, allowing the player to look back on the game's story and enjoy the afterglow. However, end credits are generally standardized, and the same ones are provided to every user.

Regarding the generation of end credits for video content, for example, Patent Document 1 proposes adding commercial video content to the front and end credits of a content stream in a system that distributes content generated by individual users.

JP 2006-338080 A

However, to enjoy the afterglow of video content, it is desirable for the end credits to reproduce scenes that moved or left a strong impression on the user. And this will be different for each user.

The present invention has been made in consideration of the above problems, and aims to provide an information processing device etc. that can customize the end credits of video content such as games and movies.

A first invention for solving the above-mentioned problems is an information processing device comprising: a video playback means for playing video content; a capture means for saving a captured image of the video content; and an end credits generation means for generating an end credits for the video content using the captured image saved by the capture means, and further comprising an emotion estimation means for estimating an emotion of a user watching the video content and separately scoring two or more emotions other than normal (unemotional), wherein the emotion estimation means instructs the capture means to capture a screen at a time when any one of the scores of the emotions other than normal (unemotional) reaches or exceeds a predetermined value, and does not issue a capture instruction when the score of the emotion other than normal (unemotional) does not reach the predetermined value, and the capture means records the captured image in association with information on the emotion at that time .

According to the information processing device of the first invention, a captured image of a screen of video content such as a game, a movie, a video, etc. is recorded and stored, and the saved captured image is used to generate an end credits for the video content. This allows the end credits for games, movies, etc. to be customized, and different end credits can be played for each user.
In addition, scenes that are memorable or moving to the user can be captured and used in the end credits. Also, captured images can be recorded according to changes in the user's emotions without the user having to perform any operations.

In the first invention, it is preferable that a photographing means is provided for photographing a facial image of the user, and the emotion estimation means estimates the emotion of the user based on the facial image photographed by the photographing means. This makes it possible to estimate the emotion from the user's facial expression.

The end roll generating means may insert a captured image acquired when a particular emotion was felt into the end roll .
A second invention is an information processing device comprising a video playback means for playing video content, a capture means for saving a captured image of the video content, and a roll generating means for generating a roll of the video content using the captured image saved by the capture means, the roll generating means randomly selecting the acquired captured image and inserting it into the roll, thereby making it possible to automatically generate a roll of the video content using the captured image.

It is also preferable to further include a selection means for selecting whether or not to generate an end roll using the end roll generation means. This allows the user to select whether or not to customize the end roll.

A third invention is an information processing device comprising a video playback means for playing video content, a capture means for saving a captured image of the video content, an end credits generation means for generating an end credits for the video content using the captured image saved by the capture means, a photobook generation means for generating a photobook using the captured image , and a photographing means for photographing and storing a user, the photobook generation means arranging an image of the user photographed by the photographing means alongside the captured image, thereby making it possible to generate a photobook that includes a collection of memorable or moving scenes for the user, and further arranging an image of the user in the scenes of the captured image alongside the captured image, thereby providing a memorable photobook.

It is also preferable to further provide a photo movie generating means for generating a photo movie that combines music with the captured images. This makes it possible to generate an original photo movie that combines music, such as background music or a theme song for video content, with captured images.

A fourth invention is an end roll generating method including the steps of: playing video content by a computer; estimating the emotions of a user watching the video content and separately scoring each of two or more emotions other than normal (unemotional); not issuing a capture instruction when the score of an emotion other than normal (unemotional) does not reach a predetermined value, and issuing a capture instruction to capture the screen at that time when any one of the scores of the emotions other than normal (unemotional) reaches or exceeds a predetermined value; saving the captured image of the video content in association with information on the emotion at that time ; and generating an end roll for the video content using the saved captured image.
A fifth invention is an end roll generating method including the steps of: a computer playing video content; saving a capture image of the video content; and generating an end roll for the video content using the saved capture image, wherein in the step of generating the end roll for the video content, the acquired capture image is randomly selected and inserted into the end roll.
A sixth invention is an end roll generating method characterized by including the steps of: a computer playing video content; saving a capture image of the video content; photographing and storing a user; generating an end roll for the video content using the saved capture image; and arranging an image of the user photographed in the step of photographing and storing the user alongside the capture image to generate a photo book.

According to any one of the third to sixth aspects of the present invention, a captured image of the screen of the video content being played is stored, and the stored captured image is used to generate an end credits for the video content. This allows the end credits for games, movies, etc. to be customized, and different end credits can be played for each user.

A seventh invention is a program for causing a computer to function as video playback means for playing video content, capture means for saving a captured image of the video content, and end credits generation means for generating an end credits for the video content using the captured image saved by the capture means, and further causes the computer to function as emotion estimation means for estimating emotions of a user watching the video content and separately scoring two or more emotions other than normal (unemotional), wherein the emotion estimation means instructs the capture means to capture a screen at the time when any one of the scores of emotions other than normal (unemotional) becomes equal to or greater than a predetermined value, and does not issue a capture instruction when the score of an emotion other than normal (unemotional) does not reach the predetermined value, and the capture means records the captured image in association with information on the emotion at that time .
An eighth invention is a program for causing a computer to function as a video playback means for playing video content, a capture means for saving a captured image of the video content, and an end roll generation means for generating an end roll of the video content using the captured image saved by the capture means, wherein the end roll generation means is a program for randomly selecting an acquired captured image and inserting it into the end roll.
The ninth invention is a program for causing a computer to function as a video playback means for playing video content, a capture means for saving captured images of the video content, and an end credits generation means for generating an end credits for the video content using the captured images saved by the capture means, and further causing the computer to function as a photobook generation means for generating a photobook using the captured images, and a photographing means for photographing and storing a user, the photobook generation means arranging an image of the user photographed by the photographing means alongside the captured images.

According to the seventh, eighth and ninth inventions, it is possible to cause a computer to function as the information processing device of the first , second and third inventions, respectively .

The present invention provides an information processing device that can customize the end credits of games, movies, etc.

FIG. 1 shows an external configuration of an information processing device. FIG. 1 shows a hardware configuration of an information processing device 1. FIG. 2 shows a functional configuration of the information processing device 1. A diagram explaining emotion estimation results and capture actions FIG. 1 is a diagram for explaining association between a captured image 122 and emotions. FIG. 2 is a diagram showing an example of a folder structure in the storage unit 12. Example of how to generate end credits Example of how to generate end credits Example of how to generate end credits 1 is a flowchart showing a flow of processing executed by the information processing device 1. Diagram showing the operation of the player and the operation flow of each part FIG. 11 is a diagram showing a functional configuration of an information processing apparatus 1A according to a second embodiment; Diagram showing the operation flow of the player and each part A flowchart showing a flow of processing executed by the information processing device 1A. FIG. 13 is a diagram showing a functional configuration of an information processing apparatus 1B according to a third embodiment; Flowchart showing the flow of photo book generation processing FIG. 13 is a diagram showing a functional configuration of an information processing device 1C according to a fourth embodiment; Flowchart showing the flow of photo movie generation processing

The following describes in detail a preferred embodiment of the present invention with reference to the drawings.

[First embodiment]
FIG. 1 is a diagram showing the external configuration of an information processing device 1 according to a first embodiment of the present invention, and FIG. 2 is a diagram showing the hardware configuration of the information processing device 1. The information processing device 1 is, for example, a device capable of reproducing video content such as a PC, a game device, a DVD/BD player, or a smartphone. In the example of FIG. 1, the information processing device 1 is configured by a PC equipped with a main body unit 10, a display unit 14, a camera 17, an input unit 15, and the like. As shown in FIG. 2, the main body unit 10 includes a control unit 11, a storage unit 12, a communication unit 13, and an image processing unit 16. In addition, the information processing device 1 includes a peripheral device I/F unit 18 for connecting the information processing device 1 to peripheral devices. The control unit 11, the storage unit 12, the communication unit 13, the image processing unit 16, the display unit 14, the input unit 15, the camera 17, and the peripheral device I/F unit 18 are connected by a bus 19 or the like.

The control unit 11 is composed of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc. The CPU loads programs stored in the storage unit 12, ROM, recording medium, etc. into a work memory area on the RAM and executes them, and drives and controls each unit connected via the bus 19. The ROM permanently stores programs such as the computer's boot program and BIOS, as well as data, etc. The RAM temporarily stores loaded programs and data, and also has a work area used by the control unit 11 to perform various processes. The control unit 11 functions as each means of the information processing device 1 by reading and executing the above programs.

The memory unit 12 is a storage device such as a hard disk drive, solid state drive, or flash memory, and stores the programs executed by the control unit 11 during the processing described below, data necessary for program execution, the OS, etc. These programs and data are read out as necessary by the control unit 11 and transferred to the RAM, and are then read out and executed by the CPU.

Video data 121 is stored in the memory unit 12. The video data 121 is game data (including game programs and game video data) and data on video content such as movies and videos. The video data 121 may be data recorded on media such as DVDs and BDs, or may be data downloaded via the communication unit 13.

The memory unit 12 also stores a capture image 122. The capture image 122 is screen recording data of the video data 121, and is an image that records the screen while the game is being played (while the video content is being played), and is acquired in the process described below. Details of these data will be described later.

The communication unit 13 has a communication control device, a communication port, etc., and is a communication interface that mediates communication between the information processing device 1 and a network. The network includes networks such as a LAN (Local Area Network), a WAN (Wide Area Network), and the Internet, as well as short-range wireless communication such as Bluetooth (registered trademark). The connection may be either wired or wireless (Wi-Fi).

The image processing unit 16 is a GPU (Graphics Processing Unit) or the like, and is a computing device that mainly executes processes related to image depiction and video playback, such as computer graphics. Note that instead of the image processing unit 16, the CPU of the control unit 11 may execute processes related to image depiction and video content playback.

The display unit 14 is composed of a display such as a liquid crystal panel and a logic circuit (such as a video adapter) for executing display processing in cooperation with the display, and displays on the display the display data input under the control of the control unit 11 and the video data generated by the image processing unit 16. The display unit 14 may be a touch panel display in which an input device such as a touch panel is integrally provided on the display screen.

The input unit 15 includes, for example, a touch panel, a keyboard, a pointing device such as a mouse, an input device such as a numeric keypad, a game controller, etc., and inputs input data to the control unit 11.

The camera 17 is a video camera that uses an imaging element such as a CCD image sensor or a CMOS image sensor, and obtains a user image by capturing an image of the user. The user image is input to the control unit 11 and used to estimate the user's emotions.

The peripheral device I/F (interface) unit 18 is a port for connecting peripheral devices. The peripheral device I/F unit 18 is composed of a USB, a video signal input/output interface, etc. The connection with the peripheral devices may be wired or wireless.
The bus 19 is a path that mediates the transmission of control signals, data signals, and the like between the devices.

FIG. 3 is a diagram showing the functional configuration of the information processing device 1. As shown in FIG. 3, the information processing device 1 includes the above-mentioned memory unit 12, display unit 14, image processing unit 16, and camera 17, as well as an emotion estimation unit 21, a capture unit 22, and an end roll generation unit 23. The emotion estimation unit 21, the capture unit 22, and the end roll generation unit 23 are each realized by the control unit 11 of the information processing device 1 executing processing. Programs for realizing these functions are stored in the memory unit 12 and are read and executed by the control unit 11. The above programs may be part of a game program or video content, or may be recorded on a medium together with the game program or video content and are read and executed by the control unit 11.

The emotion estimation unit 21 estimates and scores the emotion of a user (player) who is playing a game or watching video content. Specifically, the emotion estimation unit 21 acquires an image of the user taken by the camera 17 and estimates the user's emotion by a method such as analyzing changes in facial expressions. Emotion estimation can be performed using known methods such as the emotion recognition AI "Affdex" (https://affectiva.jp/) or an algorithm called FVAEs (Factorized Variational Autoencoders) (https://neurosciencenews.com/neuroscience-terms/fvaes/). The emotion estimation unit 21 inputs an instruction to the capture unit 22 to record the capture image 122 according to the emotion score value.

Figure 4 is a diagram showing an example of emotion scores. The emotion estimation unit 21 analyzes the facial expression of the user and, as shown in Figure 4, quantifies (scores) various emotions such as "normal (no emotion)", "fun", "sad", "surprise", and "anger". Then, when the score of an emotion other than "normal (no emotion)" is equal to or greater than a predetermined value, it instructs the user to capture the screen at that time. For example, as shown in Figure 4(a), when the score of "normal (no emotion)" is large and the scores of other emotions do not reach a predetermined value, a capture instruction is not issued. As shown in Figure 4(b), when the scores of emotions other than "normal (no emotion)" are equal to or greater than a predetermined value, a capture instruction is input. In Figure 4(b), the score of the emotion "fun" is "90%", so a capture instruction is input to the capture unit 22. The emotion estimation unit 21 inputs a capture instruction to the capture unit 22 not only when the emotion score of "fun" is large, but also when the emotion scores of other emotions such as "sad", "surprise", and "anger" are equal to or greater than a predetermined value. Alternatively, the focus may be on a specific emotion, and a capture instruction may be input to the capture unit 22 only when the score of the specific emotion is equal to or greater than a predetermined value. Although the emotions estimated by the emotion estimation unit 21 are exemplified as "normal (no emotion)", "joy", "sadness", "surprise", and "anger", various other emotions (such as "frustration" and "impatience") may also be estimated.

The capture unit 22 records one or more frames (one to multiple screens) of the video content (video data 121) displayed on the display unit 14 as a still image or video. In the first embodiment, when the emotion estimation unit 21 determines that an emotion score other than "normal (no emotion)" is equal to or greater than a predetermined value, a capture instruction is input to the capture unit 22. When the capture unit 22 receives the capture instruction, it records (screen record) the frame data displayed on the display of the display unit 14 at that time. The capture unit 22 stores the screen-recorded image (captured image 122) in the memory unit 12.

The capture unit 22 may store the captured image 122 in association with information on the emotion at that time. FIG. 5 illustrates an example of association between emotions and the captured image 122. For example, the captured image 122a is recorded in association with the emotion "fun", the captured image 122b is recorded in association with the emotion "sad", the captured image 122c is recorded in association with the emotion "surprise", and the captured image 122d is recorded in association with the emotion "anger".

Figure 6 is a diagram showing an example of the structure of a folder for saving captured images 122 in the storage unit 12. As shown in Figure 6, a folder (chapter folder) is generated for each "chapter" of the game, and a folder is further generated for each type of emotion within the chapter folder. For example, in the second chapter of the game, a captured image 122a recorded when the user's score for the emotion "fun" is equal to or greater than a predetermined value is stored in the "fun" folder in the second chapter folder. Saving in such a folder structure identifies in which chapter of the game story the captured image 122 was saved and with what emotion it was saved. Also, instead of creating folders, the file names of each captured image 122 may indicate the "chapter" and the "type of emotion." For example, if the captured image 122 was recorded in the second chapter with a fun emotion, a character string such as "02_tanoshii" may be added to the file name and saved. Furthermore, the capture time may be recorded in the file name.

The rolls generator 23 generates the rolls for the video content using the captured images 122 stored by the capture unit 22. For example, as shown in FIG. 7, the rolls generator 23 randomly selects a captured image 122 from the saved images and generates the rolls by inserting it into a predetermined area of a standardized roll (such as a staff roll) that has been prepared in advance.

Also, for example, as shown in FIG. 8, the end roll generating unit 23 may select only the capture images 122 recorded when a specific emotion was expressed, and insert them into a standard end roll. Also, as shown in FIG. 9, the capture images 122 saved in story order (the order in which the capture images 122 were obtained) may be inserted into a standard end roll.

It is preferable to allow the user to select whether or not to customize the end roll (generation of the end roll by the end roll generation unit 23) before the story of the video content begins. For example, on the start screen of the game, it is possible to select whether or not to customize the end roll, and if a selection is made not to customize, a normal (standard) end roll prepared in advance will be displayed, whereas if a selection is made to customize, an original end roll will be generated by executing the operations of the emotion estimation unit 21, capture unit 22, and end roll generation unit 23 of this embodiment.

Next, the flow of processing executed by the information processing device 1 will be described with reference to a flowchart. FIG. 10 is a flowchart showing the flow of processing executed by the information processing device 1, and FIG. 11 is a diagram showing the flow of the player's operations and the operation of each part. Note that the following description will be given for the case where the video content is a game, but similar processing can be applied to video content such as movies, not limited to games.

As shown in FIG. 10, when the game is started, the control unit 11 of the information processing device 1 displays the start screen of the game (step S101). The start screen is provided with a selection field (check box, selection button, etc.) for selecting whether or not to customize the end roll, a start button, etc. If it is selected not to customize the end roll on the start screen and the start button is operated (step S102; No), the control unit 11 performs normal game processing and normal end roll playback (steps S103 to S105). That is, the control unit 11 performs game processing according to the game program (step S103). In the game processing, events are generated according to the player's operation, and the game story progresses while playing game video content. When the game is cleared (step S104; Yes), a normal end roll is played (step S105). A normal end roll is a standard video content that is included in advance in the game data and is prepared, and text information of the production staff, etc., game scenes, ending videos, etc. are displayed together with music (ending theme song, etc.). Once the credits have finished, the start screen will be displayed and processing will end.

On the other hand, when customizing the end credits is selected on the start screen and the start button is operated (step S102; Yes), the control unit 11 acquires a capture image 122 while executing the game processing, and generates and plays an original end credits using the acquired capture image 122 (steps S106 to S114). That is, the control unit 11 performs the game processing according to the game program as described above (step S106). During the execution of the game processing, the control unit 11 takes an image of the player with the camera 17 and acquires a facial image at a predetermined time interval (step S107). The control unit 11 (emotion estimation unit 21) estimates the player's emotion based on the facial image acquired in step S107 (step S108). When the score of an emotion other than "normal (no emotion)" (such as fun, sadness, surprise, anger, etc.) is estimated to be equal to or greater than a certain value (step S109; Yes), the control unit 11 (capture unit 22) captures the display screen at that timing (step S110). The control unit 11 saves the captured image 122 in a specified folder in the storage unit 12 (step S111). For example, the control unit 11 saves the captured image 122 in a folder for the corresponding emotion in the corresponding chapter folder. The control unit 11 repeats the process of steps S106 to S111 until the game is cleared (step S112; No → step S106).

Figure 11 shows the operation procedure of the control unit 11 while the game is in progress. In Figure 11, time progresses from left to right on the diagram. When the game is started by the player's operation, the control unit 11 progresses the game until it ends, repeatedly executing game calculations according to the player's input operations. In addition, while the game is in progress, the control unit 11 acquires facial images of the player from the camera 17 at predetermined time intervals and executes emotion estimation calculations on the acquired facial images. If the emotion score obtained by the emotion estimation calculation is equal to or greater than a predetermined value, it performs a capture process of the game screen.

Returning to the explanation of FIG.
In step S112, when the game is cleared (step S112; Yes), the control unit 11 (end roll generating unit 23) generates an end roll (step S113). In the end roll generating process in step S113, the control unit 11 generates an end roll using the saved capture images 122. For example, as shown in Fig. 7, the capture images 122 may be inserted randomly into a normal end roll (standard video content prepared in advance and included in the game data), as shown in Fig. 8, the capture images 122 to be inserted may be limited to those showing specific emotions, or as shown in Fig. 9, the capture images 122 may be inserted in the order of the story.

When the generation of the end credits is complete, the control unit 11 plays the generated end credits (step S114). When playback of the generated end credits has finished, the start screen is displayed and the game ends.

As described above, according to the information processing device 1 of the first embodiment of the present invention, a capture image 122 of the game screen is recorded in response to a change in the user's (player's) emotions while playing a game, and when the game ends, the recorded capture image 122 is used to generate an end roll. This makes it possible to play scenes that excited the user (player) or memorable scenes in the end roll. Since emotions differ for each user (player) while playing the game, a variety of end rolls can be generated and played. In addition, the capture image 122 can be obtained without any operation by the user (player).

Second Embodiment
Next, an information processing device 1A according to a second embodiment of the present invention will be described with reference to Figures 12 to 14. The hardware configuration of the information processing device 1A according to the second embodiment is similar to that of the first embodiment, but the second embodiment differs from the first embodiment in terms of its functional configuration.

Fig. 12 is a block diagram showing the functional configuration of an information processing device 1A according to the second embodiment. As shown in Fig. 12, the information processing device 1A includes a storage unit 12, a display unit 14, an image processing unit 16, an input unit 15, a capture unit 22, and an end roll generating unit 23. The difference from the first embodiment is that a capture instruction to the capture unit 22 is input from the input unit 15.

That is, as shown in FIG. 13, when the user (player) inputs a capture command via the input unit 15 while the game is in progress, the capture unit 22 records the display screen during game execution and saves it as a captured image 122. Unlike the first embodiment, emotion estimation and the like is not performed, and the user (player) can capture a desired scene at a desired timing. The end roll generation unit 23 generates the end roll in the same manner as in the first embodiment.

Next, the flow of processing executed in the information processing device 1A of the second embodiment will be described with reference to the flowcharts in Figures 13 and 14.

As shown in FIG. 14, when the game is started, the control unit 11 of the information processing device 1 displays the start screen of the game (step S201). As in the first embodiment, the start screen is provided with a selection field (check box, selection button, etc.) for selecting whether or not to customize the end credits, a start button, etc. If it is selected on the start screen that the end credits are not to be customized and the start button is operated (step S202; No), the control unit 11 performs normal game processing and normal end credits playback (steps S203 to S205). The processing in steps S203 to S205 is the same as steps S103 to S105 in FIG. 10.

On the other hand, when customizing the end credits is selected on the start screen and the start button is operated (step S202; Yes), the control unit 11 acquires a capture image 122 while executing the game processing, and generates and plays an original end credits using the acquired capture image 122 (steps S206 to S212). That is, the control unit 11 performs the game processing according to the game program as described above (step S206). During the execution of the game processing, when a capture instruction operation is input from the player via the input unit 15 (step S207; Yes), the control unit 11 (capture unit 22) captures the display screen at that timing (step S208). The control unit 11 saves the capture image 122 in a specified folder in the storage unit 12 (step S209). For example, the capture image 122 is saved in the corresponding chapter folder. The control unit 11 repeatedly executes the processing of steps S206 to S209 until the game is cleared (step S210; No → step S206).

When the game is cleared in step S210 (step S210; Yes), the control unit 11 (end roll generation unit 23) generates an end roll (step S211). In the end roll generation process in step S211, the control unit 11 generates an end roll using the saved capture images 122. For example, as shown in FIG. 7, the control unit 11 may randomly insert the capture images 122 into a normal end roll (standard video content that is included in advance in the game data), or as shown in FIG. 9, the control unit 11 may insert the capture images 122 in the order of the story.

When the generation of the end credits is complete, the control unit 11 plays the generated end credits (step S212). When playback of the generated end credits has finished, the start screen is displayed and the game ends.

As described above, according to the information processing device 1A of the second embodiment of the present invention, the user (player) can issue a screen capture instruction while the game is being played (while video is being played), record the capture image 122, and generate an original end credits using the recorded capture image 122. The user (player) can capture a favorite scene by their own operation, and can look back on it again in the end credits.

In the first embodiment, the user's (player's) emotions are used as a trigger, and in the second embodiment, the user's (player's) operation is used as a trigger to input a capture instruction, but the present invention is not limited to this. For example, a capture instruction may be input based on the user's gestures (body movements). In this case, the camera 17 captures the user's whole body or upper body, and the control unit 11 analyzes the movements of the user's arms, head, etc., and when the movements are recognized as predetermined movements, the control unit 11 issues a capture instruction. In addition, a biometric information measuring device such as a pulse measuring device, a heart rate sensor, or a thermometer may be connected to the information processing device 1 to measure the biometric information of the user while watching video content, and when a predetermined change occurs in the measured value, the control unit 11 issues a capture instruction. In addition, a voice input device (microphone, speech recognition processing unit, etc.) may be provided, and a capture instruction may be input using the user's voice as a trigger.

[Third embodiment]
Next, an information processing device 1B according to a third embodiment of the present invention will be described with reference to Figures 15 and 16. The hardware configuration of the information processing device 1B according to the third embodiment is similar to that of the first embodiment, but the third embodiment adds a photo book generation function to the information processing device 1 according to the first embodiment.

Fig. 15 is a block diagram showing the functional configuration of an information processing device 1B according to the third embodiment. As shown in Fig. 15, like the information processing device 1 (Fig. 3) according to the first embodiment, the information processing device 1B includes a memory unit 12, a display unit 14, an image processing unit 16, a camera 17, an emotion estimation unit 21, a capture unit 22, and an end roll generation unit 23, as well as a photo book generation unit 25 and a user image acquisition unit 26.

The photo book generating unit 25 generates a photo book using the capture images 122 stored in the storage unit 12. Unlike an end credits, the photo book is a digital photo book that does not include information about the production staff, etc. For example, the photo book is generated by arranging the capture images 122 randomly, arranging them according to the game story, or arranging the capture images 122 recorded when the user was feeling a particular emotion.

The user image acquisition unit 26 acquires an image of the user (user image 123) captured by the camera 17 and stores it in the storage unit 12. For example, an image of the user is acquired from the camera 17 at the time when the user's emotion score reaches or exceeds a predetermined value and the capture unit 22 records a capture image 122 of the screen, and the image is stored in the storage unit 12 as the user image 123.

The photo book generating unit 25 may arrange the user image 123 at that time alongside the captured image 122. For example, a photo book can be generated in which the game screen (captured image 122) and the user's facial expression (user image 123) at the time when the score for the emotion "fun" reaches or exceeds a predetermined value are arranged side by side.

Fig. 16 is a flowchart showing the flow of the photobook generation process executed by the information processing device 1B of the third embodiment. When a menu is displayed by the user's instruction (step S301) and the photobook generation menu is selected (step S302; Yes), the control unit 11 (photobook generation unit 25) acquires the capture images 122 and the user images 123 from the storage unit 12 and generates a photobook (step S303). The control unit 11 may automatically randomly select and arrange the capture images 122 and the user images 123 at that time to generate a photobook, or may arrange them according to the story of the game, or may accept an editing operation by the user, and the user may select and lay out the desired capture images 122 and user images 123. When the photobook is generated, the control unit 11 displays the generated photobook on the display unit 14 (step S304).

As described above, the information processing device 1B of the third embodiment can generate a photo book using the captured images 122 in addition to the end credits.

In the above description, the information processing device 1B is configured by adding a photobook generation unit 25 and a user image acquisition unit 26 to the functional configuration of the information processing device 1 of the first embodiment, but the present invention is not limited to this, and the photobook generation unit 25, camera 17, and user image acquisition unit 26 may be added to the functional configuration of the information processing device 1A of the second embodiment. In other words, the information processing device 1B acquires a capture image 122 according to a capture instruction from the user, and also photographs and stores a user image 123, and when the photobook generation menu is selected by the user, generates a photobook using the capture image 122 and the user image 123.

[Fourth embodiment]
Next, an information processing device 1C according to a fourth embodiment of the present invention will be described with reference to Figures 17 and 18. The hardware configuration of the information processing device 1C according to the fourth embodiment is the same as that of the first embodiment, but the fourth embodiment adds a photo movie generation function to the information processing device 1 according to the first embodiment.

Fig. 17 is a block diagram showing the functional configuration of an information processing device 1C of the fourth embodiment. As shown in Fig. 17, the information processing device 1C has a configuration in which a photo movie generating unit 27 is added to the functional configuration of the information processing device 1 (Fig. 3) of the first embodiment.

The photo movie generating unit 27 generates a photo movie using the captured images 122 and music data 124 stored in the storage unit 12. Unlike end credits, a photo movie is a movie (video content) that does not include information about the production staff, etc. For example, it is generated by sequentially displaying the captured images 122 in sync with music such as the game's background music, and adding various effects such as enlarging, reducing, rotating, moving, and changing the color tone of the images.

Figure 18 is a flowchart showing the flow of the photo movie generation process executed by the information processing device 1C of the fourth embodiment. When a menu is displayed by the user's instruction (step S401) and the photo movie generation menu is selected (step S402; Yes), the control unit 11 (photo movie generation unit 27) selects music from the storage unit 12 (step S403) and generates a photo movie using the selected music and capture images 122 (step S404). The photo movie may be generated by the control unit 11 automatically selecting music or selecting capture images 122 and arranging them randomly or according to the story of the game, or the photo movie may be generated by accepting editing operations by the user, selecting the desired music and capture images 122, and applying the desired effect processing. When the photo movie is generated, the control unit 11 displays the generated photo movie on the display unit 14 (step S405).

As described above, in the information processing device 1C of the fourth embodiment, in addition to the end credits, it is also possible to generate a photo movie by combining the captured images 122 with music.

In the above description, the information processing device 1C is configured by adding a photo movie generation unit 27 to the functional configuration of the information processing device 1 of the first embodiment, but the present invention is not limited to this, and the photo movie generation unit 27 may be added to the functional configuration of the information processing device 1B of the second embodiment or the information processing device 1C of the third embodiment.

The above describes preferred embodiments of the present invention with reference to the attached drawings, but the present invention is not limited to these examples. It is clear that a person skilled in the art can come up with various modified or revised examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally fall within the technical scope of the present invention.

1. Information processing device 10... Main body 11... Control unit 12... Memory unit 13... Communication unit 14... Display unit 15... Input unit 16... Image processing unit 17... Camera 18... Peripheral device I/F unit 19... Bus 21... Emotion estimation unit 22... Capture unit 23... End roll generation unit 25... Photo book generation unit 26... User image acquisition unit 27... Photo movie generation unit

Claims (13)

A video playback means for playing back video content;
A capture means for storing a captured image of the video content;
an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means;
Equipped with
The apparatus further includes an emotion estimation means for estimating an emotion of a user viewing the video content, and separately scoring two or more emotions other than normal (neutral),
the emotion estimation means instructs the capture means to capture the screen at a timing when any one of the scores of emotions other than normal (neutral) becomes equal to or greater than a predetermined value, and does not instruct the capture means when the score of the emotion other than normal (neutral) does not reach the predetermined value;
The information processing device is characterized in that the capture means records the captured image in association with information on the emotion at that time . A photographing means for photographing a face image of the user is provided,
The information processing apparatus according to claim 1 , wherein the emotion estimation means estimates the emotion of the user based on a face image captured by the imaging means. 3. The information processing apparatus according to claim 1 , wherein the end roll generating means inserts a captured image obtained when the user expressed a specific emotion into the end roll. A video playback means for playing back video content;
A capture means for storing a captured image of the video content;
an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means;
Equipped with
The information processing device is characterized in that the end roll generating means randomly selects the acquired capture images and inserts them into the end roll . 5. The information processing apparatus according to claim 1 , further comprising a selection unit for selecting whether or not to generate an end roll by said end roll generating unit. A video playback means for playing back video content;
A capture means for storing a captured image of the video content;
an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means;
Equipped with
A photo book generating unit generates a photo book using the captured images,
A photographing means is provided for photographing a user and storing the photographed image,
The information processing apparatus is characterized in that the photo book generating means arranges an image of the user taken by the photographing means alongside the capture image . 7. The information processing apparatus according to claim 1 , further comprising a photo movie generating unit for generating a photo movie by combining the captured images with a piece of music. The computer
playing video content;
A step of estimating an emotion of a user watching the video content, and separately scoring two or more emotions other than normal (neutral);
a step of not issuing a capture instruction when the score of an emotion other than normal (neutral) has not reached a predetermined value, and issuing a capture instruction to capture the screen at a timing when any one of the scores of the emotions other than normal (neutral) has reached or exceeded a predetermined value;
A step of storing a captured image of the video content in association with information on the emotion at that time ;
generating an end credit for the video content using the stored captured image;
13. A method for generating end rolls, comprising: The computer
playing video content;
storing a captured image of the video content;
generating an end credit for the video content using the stored captured image;
Including,
The end roll generating method, wherein in the step of generating an end roll for the video content, the acquired captured images are randomly selected and inserted into the end roll . The computer
playing video content;
storing a captured image of the video content;
Photographing and storing a user;
generating an end credit for the video content using the stored captured image;
a step of arranging the image of the user taken in the step of photographing and storing the user alongside the captured image to generate a photo book;
13. A method for generating end rolls, comprising: Computer,
A video playback means for playing back video content;
A capture means for saving a captured image of the video content;
an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means;
A program for causing the device to function as a
The computer,
further functioning as emotion estimation means for estimating an emotion of a user viewing the video content and separately scoring two or more emotions other than normal (neutral);
the emotion estimation means instructs the capture means to capture the screen at a timing when any one of the scores of emotions other than normal (neutral) becomes equal to or greater than a predetermined value, and does not instruct the capture means when the score of the emotion other than normal (neutral) does not reach the predetermined value;
The capture means is a program that records the captured image in association with information about the emotion at that time. Computer,
A video playback means for playing back video content;
A capture means for saving a captured image of the video content;
an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means;
A program for causing the device to function as a
The end roll generating means is a program that randomly selects the acquired captured images and inserts them into the end roll . Computer,
A video playback means for playing back video content;
A capture means for saving a captured image of the video content;
an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means;
A program for causing the device to function as a
The computer,
a photobook generating means for generating a photobook using the captured images;
An imaging means for imaging and storing an image of a user;
As a
The photo book generating means is a program for arranging the image of the user taken by the photographing means alongside the capture image.

Images