JP7648938B2 - Information processing device, information processing system, and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, and an information processing program.

Online services such as websites (web pages, web services), online games, and application software (hereafter referred to as "apps") that are delivered to information processing devices such as mobile terminals via computer networks have become widespread.

One type of online service is a video posting site where users can post videos they have taken themselves and other users can watch those videos. Users can also post performance videos, such as singing videos, on video posting sites. There are also online services that allow users to compete against each other in performance videos made by different users.

Various proposals have been made regarding image capture technology. For example, Patent Document 1 discloses a display control device equipped with a setting means for setting the type of auxiliary display related to the composition to be displayed on the display unit. The setting means separately sets a first auxiliary display in still image mode and a second auxiliary display in video mode.

Patent Document 2 also discloses a safe area warning device that sets a predetermined angle of view range as a safe area when the angle of view range for capturing a subject to be photographed is limited to the entire angle of view range of a captured image captured by an imaging means, and that is equipped with a warning means that issues a warning to that effect if it is determined that the AF frame is in danger of moving outside the safe area.

JP 2016-123033 A JP 2010-152135 A

However, because the posted video displayed on the terminal device receiving the posted video cannot be recognized by the user who posted it, the user who posts, i.e., sends an image, may not be able to post the video that he or she wants as an image to be viewed by other users. The technologies in Patent Documents 1 and 2 cannot solve this problem.

The present invention aims to provide an information processing device, an information processing system, and an information processing program that enable an image displayed on a receiving terminal device to be recognized on a sending terminal device.

The information processing device of the present invention is an information processing device capable of communicating with a receiving terminal device, and includes a display control unit that displays at least a portion of a captured image on a display, and a communication unit that transmits at least a portion of the captured image to the receiving terminal device, and the display control unit causes the display area of the captured image on the receiving terminal device to be displayed on the display together with the captured image.

According to the present invention, the image displayed on the receiving terminal device can be recognized on the sending terminal device.

1 is a schematic diagram of a karaoke system according to an embodiment of the present invention; FIG. 2 is an explanatory diagram of an electrical configuration of the server. FIG. 2 is an explanatory diagram of the electrical configuration of the mobile terminal. FIG. 11 is an explanatory diagram of a screen display of a mobile terminal when shooting a singing video. FIG. 11 is an explanatory diagram of the screen display of a mobile terminal that shoots a singing video when the display area of the mobile terminal to be viewed is changed. FIG. 2 is an explanatory diagram of a screen display on a mobile terminal for viewing. FIG. 2 is an explanatory diagram of a screen display on a mobile terminal for viewing. This is an explanatory diagram of the screen display in the case of a singing competition, which is displayed on a mobile device used for viewing. FIG. 13 is an explanatory diagram of division of battle songs. This is an explanatory diagram of the screen display in the case of a singing competition, which is displayed on the mobile device used for viewing. FIG. 2 is a functional block diagram of a mobile terminal that transmits a singing video. 13 is a flow diagram of a singing competition process in a mobile terminal that transmits a singing video. FIG. FIG. 2 is a functional block diagram of a server. A flow diagram of singing competition processing in the server.

In this embodiment, a performer records their own performance as a video using a mobile device and transmits it to a server device, thereby uploading it to a video posting site. The video uploaded to the video posting site (posted video) can be viewed via a mobile device. In this embodiment, the performance is referred to as singing, the performer is referred to as a singing user, and the video uploaded to the video posting site is referred to as a singing video. Furthermore, a user who views a singing video uploaded to the video posting site is referred to as a viewing user. In this example, the video is transmitted from the singing user to the viewing user via the server device, but the video may also be transmitted from the singing user to the viewing user without passing through the server device.

The karaoke system 1 shown in FIG. 1 is an example of an embodiment of an information processing system. The karaoke system 1 includes mobile terminals 3A1, 3A2, and 3B, which are connected via a communication line 2 and can communicate with each other, and a server 4, which is an example of a server device. In the following description, when there is no distinction between the mobile terminals 3A1 and 3A2, they are collectively referred to as mobile terminals 3A, and when there is no distinction between the mobile terminals 3A and 3B, they are collectively referred to as mobile terminals 3.

Communication line 2 forms a computer network and is, for example, a wide area communication line provided by an electric power company.

The mobile terminal 3 is an example of a terminal device used by a user to utilize online services, and is, for example, an information processing terminal such as a smartphone, a tablet terminal, or a notebook computer. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone jack 3e for connecting earphones (not shown). Note that photographing here refers to a state in which the camera 3d is operating and the subject is displayed on the touch panel display 3a regardless of whether recording is occurring. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing object such as a finger, a stylus, or a pen.

The server 4 is an information processing device that provides online services to the mobile terminal 3 via the communication line 2. In the example of FIG. 1, the singing user transmits his/her singing video (singing video data) from the mobile terminal 3A to the server 4, where the singing video is uploaded to a video posting site and distributed to the viewing user. The viewing user accesses the video posting site using the mobile terminal 3B, acquires the singing video, and views it. In this way, the mobile terminal 3A is a transmitting terminal device used by the singing user to transmit the singing video, and the mobile terminal 3B is a receiving terminal device used by the viewing user to receive the singing video. However, the singing user can view the singing video that he/she uploaded by accessing the video posting site using the mobile terminal 3A. In addition, the user of the mobile terminal 3B can also become a singing user and upload a singing video to the video posting site.

An example of the electrical configuration of the server 4 will be described with reference to Fig. 2. The server 4 includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the entire server 4, a ROM (Read Only Memory) in which various programs and various data are stored in advance, and a
The computer 10 is equipped with a RAM (Random Access Memory) 22, a RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and a HDD (Hard Disk Drive) 26 as a storage means for storing various programs and various data.

The HDD 26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to a video posting site, and song data indicating songs that the singing user can sing. Note that the storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory such as a flash memory.

The server 4 further includes an operation input unit 28, which is composed of a keyboard, a mouse, etc. and accepts input of various operations, a monitor 30, such as a liquid crystal display device, which displays various images, and an external interface 32, which is connected to other information processing devices, such as a mobile terminal 3, via the communication line 2 and transmits and receives various data to and from the other information processing devices.

The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation status of the operation input unit 28, display images on the monitor 30, and send and receive various data to and from other information processing devices, etc. via the external interface 32.

The electrical configuration of the mobile terminal 3 will be described with reference to FIG. 3. The mobile terminal 3 includes a touch panel display (hereinafter referred to as the "screen") 3a, a speaker 3b, a microphone 3c, a camera 3d, an earphone jack 3e, as well as a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and operation buttons 48.

The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the entire mobile terminal 3.

The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images and programs used in the processing of the main control unit 40. The programs stored in the auxiliary storage unit 44 are, for example, an OS (operating system) for implementing the basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing e-mail, web browsing, and various other functions. In addition, the auxiliary storage unit 44 pre-stores an application for shooting and posting singing videos and viewing video posting sites (hereinafter referred to as a "video posting and viewing application"). The auxiliary storage unit 44 is an information processing program that executes a display control step of displaying at least a part of the captured image (singing video) on the display and a communication step of transmitting at least a part of the captured image to the receiving terminal device (mobile terminal 3B), and the display control step stores an information processing program that displays the display area of the captured image on the receiving terminal device together with the captured image on the display.

The communication unit 46 is, for example, a NIC (Network Interface Controller) and has a function of connecting to the communication line 2. Note that the communication unit 46 may have a function of connecting to a wireless LAN (Local Area Network) instead of or together with the NIC, a function of connecting to a wireless WAN (Wide Area Network), a function of enabling short-range wireless communication such as Bluetooth (registered trademark), and infrared communication, etc.

The operation buttons 48 are provided on the side of the mobile terminal 3 and include a power button for starting and stopping the mobile terminal 3 and a button for adjusting the volume of the sound output by the speaker 3b.

The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, operation buttons 48, screen 3a, speaker 3b, microphone 3c, camera 3d, and earphone jack 3e are electrically connected to each other via a system bus 49. This allows the main control unit 40 to access the main memory unit 42 and auxiliary memory unit 44, display images on the screen 3a, grasp the operation state of the screen 3a and operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b or an earphone connected to the earphone jack 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

When a singing user shoots a singing video, the singing user launches a video posting and viewing app on the mobile terminal 3A. When the video posting and viewing app is launched, the mobile terminal 3A accesses the server 4 that stores multiple pieces of music data. The singing user then arbitrarily selects a piece of music to sing from the video posting and viewing app, and downloads the music data from the server 4 to the mobile terminal 3A. The singing user then plays the music at a timing of their choice using the video posting and viewing app, and sings it. When the video posting and viewing app starts playing the music, it also starts shooting a video using the camera 3d. That is, the singing video is an image (hereinafter referred to as a "shot image") captured by the mobile terminal 3A while the music is being played from the mobile terminal 3A.

Note that song data is associated with lyrics data, and when song data is downloaded from the server 4 to the mobile terminal 3A, the associated lyrics data is also downloaded to the mobile terminal 3A. Note that in the following explanation, song data is considered to include lyrics data.

Figure 4 is an example of a display (hereinafter referred to as "screen display") on the screen 3a of the mobile terminal 3A when shooting a singing video.

As shown in FIG. 4, the image on the screen 3a of the mobile terminal 3A has a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 that shows the lyrics of the song being sung by the user, a pitch image 54 that shows the pitch of the song, and a progress bar 56 that shows the progress of the song playback.

The lyric image 52 and the pitch image 54 are updated as the playback of the music progresses. In the present embodiment, as an example, the lyric image 52 and the pitch image 54 are updated every few phrases and displayed in the lyrics display area 50A. Note that the timing of updating the lyric image 52 and the pitch image 54 may be the same or different.

The lyrics image 52 displays the lyrics, for example, in multiple rows (two rows in the example of FIG. 4), and the color of the lyrics in the upper row changes from the left end to the right end as the song progresses so that the singing user can visually grasp the lyrics that should currently be sung. When the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and are displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the song progresses.

As an example, the pitch image 54 is displayed in a stepped pattern on the left and right sides of the screen 3a as multiple pitch bars 54A corresponding to the pitch of the note. Then, in order to allow the singing user to visually grasp the pitch and pitch of the note that he or she is currently about to sing, the color of the pitch bars 54A changes from the left end to the right end as the song progresses, and the pointer 54B moves from the left end to the right end. When the color of the pitch bar 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

As an example, the length of the progress bar 56 from the left end to the right end indicates the time length of the entire song. When playback of the song begins, a pointer 56A indicating the playback position of the song moves from the left end to the right end, and the point where the pointer 56A reaches the right end corresponds to the end of playback of the song. Note that the progress bar 56 that the pointer 56A has passed through is displayed thicker than the position before the progress, but this display mode is not limited to this.

Playback of a song is started, for example, by tapping a play button (not shown) displayed on screen 3a. When playback starts, camera 3d (see Figures 1 and 3) is activated, i.e., turned on, and shooting begins. A captured image such as a singing video is displayed as a video image in captured image display area 50B. This allows the singing user to adjust the position, direction, attitude, etc. of at least one of himself/herself and mobile terminal 3A while looking at captured image display area 50B, or by looking at it at any time, to create the desired captured image. As a result, the captured image desired by the singing user is acquired on mobile terminal 3A.

In the captured image display area 50B, the area (hereinafter referred to as the "display area") RD of the singing video displayed on the screen 3a of the mobile terminal 3B (see FIG. 1) used by the viewing user for viewing is visible. The display area RD displayed in the captured image display area 50B at the start of shooting may be preset to an initial value (default) in the video posting and viewing app, or may be set at any time by the server 4. In this example, in the case of a singing competition in which multiple singing users compete in singing, the display area RD at the start of shooting of the singing video is set by the server 4, but in the case of non-competitive singing that is not a singing competition, the display area RD at the start of shooting of the singing video is preset to an initial value in the video posting and viewing app.

The singing video, except for the display area RD, is displayed on the screen 3a of the mobile terminal 3A as a part (hereinafter referred to as the "non-display area") RN that is not displayed on the screen 3a of the mobile terminal 3B (see FIG. 1) with a different image quality from that of the display area RD, thereby making the display area RD visible. Examples of image quality include hue, brightness, saturation, contrast, gradation, and transparency. In this example, the display area RD is displayed in a state in which the transparency of the singing video is maintained, and the non-display area RN is displayed as a semi-transparent image with a lower transparency than the display area RD (an image masked to the extent that the singing video in the background is visible), so that the display area RD is displayed visibly. Note that FIG. 4 shows an example in which the non-display area RN is on both sides of the captured image display area 50B. That is, FIG. 4 shows an example in which the vertical length (length in the vertical direction in FIG. 4) L1 of the display area RD is the same as the vertical length of the singing video, and the horizontal length (length in the horizontal direction in FIG. 4) L2 is shorter than the horizontal length of the singing video.

The display method of the display area RD is not limited to this example. For example, the display area RD may be displayed visibly by displaying a line segment indicating the boundary between the display area RD and the non-display area RN in the captured image display area 50B, or by displaying the four vertices of a rectangular display area as dots.

In this way, the display area RD on the mobile terminal 3B used by the viewing user is displayed on the mobile terminal 3A used by the singing user, and the singing user can recognize the display area RD, so that the singing user can capture a subject image that corresponds to the display area RD. For example, the singing user adjusts the position, direction, posture, etc. of at least one of himself or herself and the mobile terminal 3A to capture a desired part and area of his or her body so that it fits within the display area RD. As a result, the singing video that the singing user desires is reliably and easily obtained on the mobile terminal 3A.

The display area RD is displayed superimposed on the singing video in the captured image display area 50B. This allows the singing user to intuitively grasp the image seen by the viewing user when looking at the screen 3a.

The mobile terminal 3A is preferably configured to be able to change the display area RD while maintaining the aspect ratio based on the display area RD. This allows the image of the singing video displayed on the mobile terminal 3B used by the viewing user to be adjusted on the mobile terminal 3A used by the singing user. The aspect ratio based on the display area RD is the aspect ratio calculated from the vertical length L1 and the horizontal length L2, and is calculated as L2/L1. It may also be calculated as L1/L2.

For example, when a singing user taps on the captured image display area 50B, as shown in FIG. 5, a line segment LD showing the outline of the display area RD is displayed superimposed on the singing video. In this example, there are non-display areas RN on both sides, and the vertical length L1 is the same as the vertical length of the singing video, so the vertical line portion LDv of the line segment LD is displayed extending in the vertical direction from the top to the bottom of the captured image display area 50B, and the horizontal line portion LDs is displayed coinciding with the top and bottom edges of the captured image display area 50B. Then, by sliding (e.g. swiping) a pointer such as a finger touching the screen 3a in the captured image display area 50B from one of the four vertices of the display area RD toward the center GC, the display area RD can be changed to, for example, the area shown by the two-dot chain line, and the aspect ratio of the area shown by the two-dot chain line is the same as the aspect ratio based on the display area RD. In addition, FIG. 5 shows an example in which the vertical line portion LDv and the horizontal line portion LDs are displaced simultaneously so as to maintain the aspect ratio, with the center GC of the captured image display area 50B as the center of change of the display area RD.

The aspect ratio to be maintained is not limited to the aspect ratio based on the display area RD, and may be, for example, an aspect ratio based on the singing video. In addition, when the display area RD is changed without maintaining the aspect ratio based on the display area RD, it is preferable to displace the vertical line portion LDv and the horizontal line portion LDs independently. In this case, each of the two vertical line portions LDv may be displaced independently, and similarly, each of the two horizontal line portions LDs may be displaced independently.

The display area RD may be displaced while maintaining the shape and area of the display area RD by sliding the entire line segment LD within the captured image display area 50B. In addition, the movement ranges of the line segment LD, vertical line portion LDv, and horizontal line portion LDs, and the movement range of the sliding movement of the display area RD may be set to be limited. For example, the line segment LD, vertical line portion LDv, and horizontal line portion LDs are set not to be positioned in the central area including the center GC of the captured image display area 50B, so that a non-display area RN is not formed in the central area.

Changes to the display area RD, such as changing the display area RD while maintaining the aspect ratio based on the display area RD, or sliding the display area RD while maintaining the shape and size of the display area RD, can be made even while recording the singing video.

The mobile terminal 3A may also be provided with a function, such as automatically detecting the position of the singing user's eyes in the singing video, and sliding the display area RD based on the detection signal, via a video posting and viewing app.

When the display area RD is changed (for example, when the display area RD is changed while maintaining the aspect ratio based on the display area RD, or when the display area RD is slid while maintaining the shape and size of the display area RD), it is preferable that the changed display area RD is notified to the mobile terminal 3B, and this is also done in this example.

The recording of the singing video starts a predetermined time (e.g., 10 seconds) after the singing user selects a song and taps the recording start button (not shown) displayed on the screen 3a. The start and end of the video recording may coincide with the start and end of the song, but the video recording may start a predetermined time before the start of the song (e.g., 5 seconds before), or end a predetermined time after the end of the song (e.g., 5 seconds after). The image to be recorded may be the singing video displayed in the entire captured image display area 50B, or at least a part of the singing video, such as only the display area RD of the singing video. In this example, the singing video displayed in the entire captured image display area 50B is recorded, and even if the singing video is recorded in this way, only the image for the display area RD is displayed on the screen 3a of the viewing user's mobile terminal 3B.

The singing user connects earphones to the earphone jack 3e, listens to the played music using the earphones, and sings along with the music. The mobile terminal 3A captures an image of the singing user with the camera 3d, and records the singing of the singing user with the microphone 3c. In other words, the microphone 3c does not capture the sound of the played music. The mobile terminal 3A then records the singing user's singing voice captured by the microphone 3c, and uses this as singing data.

The singing data may be data that has been obtained by extracting the frequency band of the human voice through a filtering process. This filtering process removes noise caused by the singing user's surrounding environment from the singing data, making the recorded singing voice of the singing user clearer.

The video posting and viewing app then combines the music data and singing data with the recording data to generate singing video data that can be sent to server 4. As an example, the singing user can select one of the following two types of timing for sending the singing video data to server 4, i.e., the timing for uploading the data to the video posting site.

One is live streaming, in which the singing user uploads singing video data to a video sharing site in real time while singing. In live streaming, viewing users watch the singing user sing in real time. The other is non-live streaming, in which the singing user uploads singing video data to a video sharing site at a timing of their choice after they have finished singing the song.

When performing live streaming, the singing user sets up the live streaming before recording so that the singing video data is uploaded to the video sharing site when recording starts. Note that in the case of live streaming, the singing video data may be uploaded to the video sharing site without being stored in the mobile terminal 3A.

When live streaming is performed, the singing user can set either a first live streaming setting that allows viewing users to view the singing video during live streaming, or a second live streaming setting that allows viewing users to view the singing video even after the live streaming. That is, with the first live streaming setting, the singing video data is deleted from the server 4 when the live streaming ends, and the viewing user cannot view the live-streamed singing video after the live streaming ends. On the other hand, with the second live streaming setting, the server 4 continues to store the singing video data even after the live streaming ends, so the viewing user can view the singing video as a non-live stream even after the live streaming ends.

When non-live streaming is performed, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user operates the video posting and viewing app to upload the singing video to the video posting site at any time.

The following describes a case where a viewing user watches a singing video using mobile terminal 3B.

When a viewing user wishes to view a singing video, the viewing user launches a video posting and viewing application on the mobile terminal 3B. When the video posting and viewing application is launched, the mobile terminal 3B accesses a server 4 that stores multiple singing video data, i.e., a video posting site. The viewing user then selects the singing video they wish to view via the video posting and viewing application and displays it on the screen 3a. Note that one example of the method by which the server 4 distributes the singing video to the mobile terminal 3B is streaming distribution.

Figure 6 shows an example of the screen display of mobile terminal 3B when watching a singing video, showing the screen display when live streaming is taking place.

Screen 3a displays a singing video and also has a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video as shown in FIG. 6, or may be displayed in a separate area from the video display area (not shown) where the singing video is displayed.

The singing user display area 50C displays the username of the singing user who posted the singing video, whether it is a live broadcast or not, and the name of the song being sung.

The lyrics of the singing video are displayed in the lyrics display area 50D. As an example, the lyrics displayed are multiple phrases at a time, and the color of the lyrics changes from the left end to the right end as the music progresses. As an example, the lyrics display area 50D may display lyrics in multiple rows. In this case, when the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and is displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the music progresses.

In the comment input display area 50E, a comment input field is displayed, and comments from viewing users who are watching the singing video are displayed together with their user names. As an example, each time a comment is input from a viewing user, that comment is added and displayed at the top of the comment input display area 50E, and comments that were previously displayed are moved down. If there are more comments than can be displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area, and comments that were not previously displayed on the screen 3a can be displayed by the viewing user operating the scroll bar.

In addition, operation icons 58A to 58D are displayed on screen 3a to allow the viewing user to perform various operations.

Operation icon 58A is an icon that is tapped by the viewing user when the viewing user empathizes with the singing video that the viewing user is viewing, and the total number of taps on operation icon 58A for that singing video is displayed above operation icon 58A.

Operation icon 58B is an icon that is tapped when a viewing user challenges a singing user who is live streaming a singing video displayed on screen 3a to a battle (hereinafter referred to as a "singing battle"). In a singing battle, multiple singing videos (first singing video, second singing video) by different singing users are simultaneously displayed on screen 3a of the viewing user's mobile terminal 3B, and the singing videos take turns singing the same song. In other words, a viewing user who taps operation icon 58B becomes a singing user who will engage in a singing battle, and the mobile terminal 3B that they are using functions as mobile terminal 3A after tapping operation icon 58B.

Operation icon 58C is an icon that is tapped by the viewing user to configure various settings for the video posting and viewing app.

Operation icon 58D is an icon that is tapped by the viewing user when a decorative image is to be superimposed on the singing video displayed on screen 3a. Note that the decorative images in this embodiment have a price determined according to their type, and can be purchased by the viewing user for a fee. Then, by tapping operation icon 58D, the viewing user superimposes a decorative image on the singing video that he or she is viewing. The singing user of the singing video on which the decorative image is superimposed receives money according to the superimposed decorative image from the operator of the video posting site. In other words, the superimposition (display instruction) of a decorative image on a singing video by the viewing user corresponds to a so-called tipping to the singing user.

The singing video is an image that is contained within the display area RD on the mobile terminal 3A. Because the singing user captures the image on the mobile terminal 3A while being aware of the display area RD, the viewing user can be sure to view the singing video that the singing user desires. For example, if the singing user is recording and most of the left half of his/her face is outside the display area RD, most of the left half of the singing user's face will not be displayed on the screen 3a in the singing video before displacement, as shown in FIG. 6. However, if the mobile terminal 3A is displaced so that the singing user's face is closer to the center of the display area RD, the singing video will be displayed as an image in which the singing user's face is closer to the center of the screen 3a than in the aspect shown in FIG. 6, as shown in FIG. 7.

The singing competition function will now be described. The video posting and viewing app according to this embodiment has a singing competition function that allows multiple users, who are performers, to compete against each other to see who can show the best performance video of themselves. The singing competition function according to this embodiment is a type of karaoke battle, and is a singing competition function that simultaneously displays multiple singing videos (first singing video 60A, second singing video 60B) by different singing users on the screen 3a of the viewing user's mobile terminal 3B, as exemplified in FIG. 8. The singing competition function is executed by the server 4.

Figure 8 is an example of the screen display of the viewing user's mobile terminal 3B in a singing battle. Note that the "VS" display shown in Figure 8 means "versus" and is displayed when the singing battle begins and is stopped a predetermined time after the singing battle begins (e.g., 3 seconds). The screen display of the singing user's mobile terminal 3A after the singing battle begins may be, for example, the same as that shown in Figure 8, or may be a screen display in which the other singing users who will be singing in the singing battle are displayed in reduced size (see Figure 10) compared to the screen display of the singing video as shown in Figure 4.

For a singing competition to take place, a singing user (hereinafter referred to as the "first singing user") makes a request (hereinafter referred to as a "competition request") to another singing user (hereinafter referred to as the "second singing user") to simultaneously distribute a singing video. If the second singing user accepts the competition request, the singing competition begins, and if the second singing user does not accept, the singing competition does not begin.

More specifically, the first singing user launches a video posting and viewing app on his/her mobile terminal 3A1 and sends a battle request to a second singing user who is live streaming a singing video using the video posting and viewing app. The battle request is sent by the first singing user tapping the operation icon 58B. The first singing user selects the song to be sung in the battle. Information indicating the selected song (hereinafter referred to as the "battle song") (title and singer name) is sent to the second singing user together with the battle request.

The match request sent from the mobile terminal 3A1 is sent to the mobile terminal 3A2 of the second singing user via the server 4. An image corresponding to the received match request is displayed on the screen 3a of the mobile terminal 3A2, and if the second singing user accepts the match request, he or she taps, for example, a predetermined image displayed on the screen 3a.

When the second singing user accepts the battle request from the first singing user, the server 4 starts the singing battle by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. For example, the server 4 starts the singing battle by generating and distributing a composite image consisting of the first singing video 60A and the second singing video 60B. This allows the viewing user to watch the singing battle (real-time battle) between the first singing user and the second singing user in real time. In the following description, the first singing video 60A and the second singing video 60B distributed in the singing battle are collectively referred to as the singing battle video. The number of singing users who perform the singing battle may be three or more, and the number, arrangement, and size of the singing videos that make up the composite image may be set based on the number of singing users who perform the singing battle.

In this way, the singing competition function accepts a singing video competition request from a first singing user to a second singing user, and if the second singing user accepts the competition request, delivers the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the singing competition function enables singing users to compete with each other by their own singing videos, and enables a viewing user to simultaneously watch multiple competing singing videos.

It is also possible that the second singing user accepts the battle request but does not accept the battle song. For such a case, the battle singing function may have a function to transmit information indicating the change in the battle song and the battle song selected by the second singing user from the second singing user's mobile terminal 3A2 to the first singing user's mobile terminal 3A1, and to request the first singing user's approval.

When a singing match is started, the server 4 may change the display area RD of each of the first singing video 60A and the second singing video 60B on the mobile terminal 3B in order to generate a composite image, and this is also done in this example. When the server 4 changes the display area RD, it notifies the mobile terminal 3A on which the singing video that is the subject of the change was shot of the changed display area RD. The display area RD notified by the server 4 is displayed as a new display area RD in the shot image display area 50B (see FIG. 4) of the mobile terminal 3A that has received the notification. After this, the display area RD on each mobile terminal 3A may be further changed, in which case each mobile terminal 3A can change the display area RD to an area narrower than the display area RD notified by the server 4, and can also displace (slide) the display area RD while maintaining the shape and area of the display area RD.

In the competitive singing function according to this embodiment, a first singing user and a second singing user take turns singing the same song (hereinafter referred to as "alternate singing").

Alternating singing may take the form of, for example, a first singing user finishing singing a song in its entirety, and then a second singing user singing the same song in its entirety; however, the singing battle function according to this embodiment virtually divides a song into multiple regions on the time axis as shown in FIG. 9, and sets the order of singing users who will sing for each divided region 68 (hereinafter referred to as "alternating performance setting"). As a result, the first singing user and the second singing user will sing the same song in turn according to the alternating performance setting, so that the viewing user can clearly recognize the difference in singing ability between the first singing user and the second singing user, and can enjoy the singing battle even more. In the following description, the order of singing users who will sing will be referred to as the alternating singing order.

As an example, the singing competition function highlights the portion of the lyrics that the singing user is singing, allowing the singing user to recognize the divided area 68 that he or she is singing. The highlighting is achieved by changing the color or thickness of the lyrics, etc.

In the example of FIG. 9, divided areas 68 are set so that the first singing user and the second singing user sing alternately, and divided areas 68 are also set so that the first singing user and the second singing user sing together. The divided areas 68 are set in advance based on, for example, phrases, choruses, or measures of a song, and the time length of each divided area 68 does not necessarily have to be the same.

The alternating singing order is determined when a singing battle is decided. For example, it is set so that the first singing user who requested the battle sings first, and the second singing user sings afterwards. Note that the divided area 68 in which the first singing user and the second singing user sing together may be set in advance for each song.

The screen display and audio output during alternating singing will be described. Figure 8 shows the display screen of the viewing user's mobile terminal 3B during competitive singing, where the first singing video 60A and the second singing video 60B are displayed with the same shape and size. For the singing video in which singing is currently being performed, a display that allows the viewing user to recognize it (for example, the display of "NOW PLAYING" in Figure 8) is displayed.

Here, a singing video or its audio when singing is not currently being performed is not of interest to a viewing user and may distract a viewing user who is watching singing that is currently being performed.

The singing competition function according to this embodiment distributes singing videos to mobile terminal 3B so that the sound of the singing video in which singing is being performed is output, and the sound of the singing video in which singing is not being performed is not output. Furthermore, server 4 distributes singing videos to mobile terminal 3B so that singing videos in which singing is being performed are displayed larger on screen 3a of mobile terminal 3B than singing videos in which singing is not being performed. This allows the viewing user to watch the singing competition videos without being distracted by singing videos in which singing is not being performed.

Figure 10 is an example of the screen display of the mobile terminal 3B in a singing battle. In the example of Figure 10, the first singing video 60A is being sung and the second singing video 60B is not being sung, so the first singing video 60A is enlarged (full screen display) while the second singing video 60B is reduced (window display). The size and position on the screen 3a when the singing video is reduced may be predetermined, or the viewing user may be able to change the size and position of the singing video to any size on the mobile terminal 3B. For example, the mobile terminal 3B may be configured to display vertical line portion LDv and horizontal line portion LDs that match the outline of one of the objects to be reduced, as in the screen 3a of the mobile terminal 3A shown in Figure 5, and the shape, size, and arrangement of the reduced display may be changed by displacing each of these.

The singing battle function according to this embodiment distributes singing videos to the mobile terminal 3B so that the first singing video 60A and the second singing video 60B are output as audio or the first singing video 60A and the second singing video 60B are displayed on the screen based on the alternating singing order described above.

That is, in the divided area 68 where the first singing user sings, the sound of the first singing video 60A is output and the first singing video 60A is displayed enlarged, while the sound of the second singing video 60B is not output and the second singing video 60B is displayed reduced. Also, in the divided area 68 where the second singing user sings, the sound of the second singing video 60B is output and the second singing video 60B is displayed enlarged, while the sound of the first singing video 60A is not output and the first singing video 60A is displayed reduced. Also, in the divided area 68 where the first singing user and the second singing user sing together, the first singing video 60A and the second singing video 60B are displayed on the screen with the same shape and size as shown in FIG. 8, and the sound of both is output.

The voting function will now be described. The video posting and viewing application has a voting function that accepts input of evaluations (hereinafter referred to as "votes") for each singing video in a singing competition from the viewing user's mobile terminal 3B.

As shown in Figures 8 and 10, a vote is entered when a viewer taps an operation icon 58A provided for each singing video. That is, if a viewing user sympathizes with a singing video, the viewing user taps the operation icon 58A as an indication of their intention to give a positive evaluation of the singing video. Then, an image 66 showing the evaluation result for each singing video that has been accepted (hereinafter referred to as a "voting result image") is delivered so as to be displayed on the screen 3a of the mobile device 3B together with the singing video.

In this way, the voting function according to this embodiment allows the viewing user to rate the competitive singing videos by tapping the operation icon 58A, for example, so that when a singing competition takes place, the viewing user can easily determine the quality of the singing. Note that the viewing user can also rate one singing video and the other singing video.

The voting function accepts input of points as votes, and derives the total points input during the distribution of the singing videos (hereinafter referred to as "total evaluation points") as the evaluation result. The total evaluation points is the sum of the points input by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation points input by the time the singing competition ends. In other words, the singing user with the singing video with the relatively higher total evaluation point is determined to be the winner. In this way, according to the voting function of this embodiment, multiple viewing users can vote cooperatively for the singing user (singing video) they support, and therefore the singing user they support can be determined to be the winner, allowing the viewing users to empathize more with the singing user.

In the voting function according to this embodiment, one point is entered each time the operation icon 58A is tapped. The numbers ("21" and "185") in the voting result image 66 shown in Figures 8 and 10 are the total evaluation points for each singing user (singing video), and the bar image that extends to the left and right of the screen 3a and has different hatching (colors) on the left and right indicates the relative total evaluation points for each singing video.

In addition, an upper limit is set for the number of times each viewing user can tap operation icon 58A (hereinafter referred to as "tap upper limit"), and the tap upper limit in this embodiment is one time. Then, when the tap upper limit is reached, operation icon 58D is displayed on screen 3a in place of operation icon 58A, as shown in FIG. 10.

By tapping the operation icon 58D, the viewing user can superimpose a decorative image (hereinafter referred to as a "throwing effect image") on the singing video corresponding to the tapped operation icon 58D. In this way, the voting function has a throwing effect function that receives a request from the mobile terminal 3B to superimpose a throwing effect image on the singing video and superimposes the received throwing effect image on the singing video. In the following description, the viewing user's instruction (selection) to display the throwing effect image via the mobile terminal 3B is referred to as a throwing input, as described above.

In other words, since a viewing user decorates a singing video that he or she sympathizes with by superimposing a coin tip effect image on the singing video, the coin tip effect function can liven up the viewers and the singing video itself during distribution of the singing video. Note that the coin tip effect function is a function executed by the server 4 in response to a display instruction from a viewing user via the video posting and viewing app.

Furthermore, an image (icon image 64) showing a viewing user who has given a relatively higher rating (vote) to the singing video than other viewing users, i.e., a viewing user who has input a large number of points (hereinafter referred to as a "highly rated user"), may be displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to make the other viewing users aware of the singing user that they are supporting. Also, the viewing user can make the singing user aware that they are supporting him/her.

As shown in FIG. 11, the mobile terminal 3A is composed of an input unit 71, a terminal output unit 73, a first display control unit 75, a first communication unit 77, etc. The input unit 71 inputs various commands such as instructions to start shooting or recording a singing video, instructions to select a song, a battle request, approval of a battle request or battle song, instructions to change the display area RD, shooting a singing video, and singing voice.

The terminal output unit 73 plays songs, displays singing videos and the display area RD, etc.

The first display control unit 75 causes at least a portion of the singing video (the singing video in this example) to be displayed on the device output unit 73. The first display control unit 75 causes the device output unit 73 to display the display area RD together with the singing video. The first display control unit 75 preferably causes the device output unit 73 to display the display area RD superimposed on the singing video, and this is also done in this example. The first display control unit 75 preferably changes the display area RD while maintaining the aspect ratio based on the display area RD.

The first communication unit 77 transmits at least a part of the singing video (the singing video in this example) to the mobile terminal 3B via the server 4. When the display area RD is changed, it is preferable to notify the mobile terminal 3B of the changed display area RD, and this is also done in this example.

The input unit 71 includes the touch panel display (screen) 3a, microphone 3c, camera 3d, and operation buttons 48 shown in FIG. 3. The terminal output unit 73 includes the touch panel display (screen) 3a, speaker 3b, and earphone jack 3e. The first display control unit 75 includes the main control unit 40, main memory unit 42, and auxiliary memory unit 44. The first communication unit 77 includes the communication unit 46.

The singing battle process in the mobile terminal 3A will be described with reference to FIG. 12. The singing battle begins when a request for a battle is made at the input unit 71 in the mobile terminal 3A1 and this request for a battle is accepted by the server 4, and when the request for a battle is accepted at the input unit 71 in the mobile terminal 3A2 and this acceptance is judged as positive by the server (S11).

When the server 4 determines that the match request has been accepted, the server 4 generates a composite image 60 (see Figures 8 and 10), and the mobile terminal 3A1 receives a notification of the display area RD (see Figures 4 and 5) of the first singing video 60A in the composite image 60, and the mobile terminal 3A2 receives a notification of the display area RD of the second singing video 60B from the server 4 (S13).

After acquiring the notification of the display area RD from the server 4, the mobile terminal 3A displays the display area RD of the acquired notification on the screen 3a of the terminal output unit 73 by the first display control unit 75 (S14). The mobile terminal 3A determines whether an instruction to change the display area RD has been acquired by input to the input unit 71, for example, by moving the line segment LD (see FIG. 5) (S15). If it is determined in step S15 that an instruction to change the display area RD has been acquired, the first display control unit 75 generates an image of the display area RD after the change based on the acquired instruction and displays it on the screen 3a of the terminal output unit 73 (S17). In addition, the first communication unit 77 notifies the mobile terminal 3B of the viewing user of the changed display area RD (S18). Note that in this example, the mobile terminal 3B of the viewing user is notified via the server 4, but the mobile terminal 3B may be configured to be notified without the server 4.

When the mobile terminal 3A determines in step S15 that it has not received an instruction to change the display area RD, it distributes the battle singing video to the mobile terminal 3B via the server 4 (S19). Note that, for example, in step S15, it may determine that there is no instruction to change if no instruction to change the display area RD is input to the input unit 71 within a predetermined time from step S14, or it may determine that there is no instruction to change if an instruction to start playing and recording the battle song is input to the input unit 71 regardless of the time elapsed from step S14. In this example, when an instruction to start playing and recording the battle song is input to the input unit 71, the battle singing video is distributed to the mobile terminal 3B via the server 4. In step S19, the mobile terminal 3A combines the battle singing video with the music data and singing data of the battle song to generate battle singing video data, and distributes the singing video by distributing this singing video data.

The process of changing the display area RD can be performed either before or after the start of distribution of the singing video (S19), or can be performed both, as long as the notification of the display area RD is received from the server 4. In this example, the process of changing the display area RD, i.e., step S15 and steps S17 and S18 when it is determined in step S15 that there is an instruction to change, is also performed after step S19, and is shown as steps S21, S23, and S24 in FIG. 12. Every time the display area RD is changed, in this example, the first communication unit 77 notifies the mobile terminal 3B of the changed display area RD via the server 4. Note that if an instruction to change the display area RD is not input to the input unit 71 in step S21, it is determined that there is no instruction, and the playback of the battle song continues.

Step S21 is repeated while playback of the battle song has not finished (S25). After playback of the battle song has finished (S25), the mobile terminal 3A ends distribution of the battle singing video (S27).

When distributing a non-competitive singing video, the mobile terminal 3A performs a process of changing the display area RD (S15, S17, S18) after starting to shoot the singing video. The display area RD can also be changed (S21, S23, S24) after starting to record or distribute the singing video.

As shown in FIG. 13, the server 4 includes a match request receiving unit 80, a match acceptance determination unit 81, a match setting unit 82, a video evaluation unit 83, a coin tip effect superimposition unit 84, a second display control unit 87, and a second communication unit 88. The processes executed by each function of the server 4 are realized by an information processing program stored in the HDD 26.

The match request receiving unit 80, match acceptance determination unit 81, match setting unit 82, video evaluation unit 83, coin tip effect superimposition unit 84, and second display control unit 87 are configured to include the CPU 20, ROM 22, RAM 24, and HDD 26 shown in FIG. 2. The second communication unit 88 is configured to include the external interface 32.

The match request receiving unit 80 receives a match request from a first singing user to a second singing user. The match acceptance determination unit 81 determines whether the second singing user has accepted the match request from the first singing user.

The battle setting unit 82 performs various settings such as setting the battle song and the singing order for the battle singing. The battle setting unit 82 divides the song into multiple divided areas 68 (see FIG. 9) on the time axis, i.e., in chronological order, and sets the order of the singing users who will sing for each divided area 68 (alternate singing order).

The video evaluation unit 83 receives input of an evaluation (score) for each singing video distributed to the mobile terminal 3B, and superimposition of a tip effect image (not shown) on the singing video (tipping input) from the mobile terminal 3B. The video evaluation unit 83 then derives the total evaluation score input during distribution of the singing video, and determines the outcome of the singing competition.

When a tip input is received, the tip effect superimposition unit 84 superimposes a tip effect image (not shown) corresponding to the received tip input onto the singing video.

The second display control unit 87, the second communication unit 88, etc. constitute a video distribution module (not shown) that distributes the singing video to the mobile terminal 3B. When the match consent determination unit 81 makes a positive determination that the second singing user has consented to the match request from the first singing user, the second display control unit 87 generates a composite image 60 (see Figures 8 and 10) based on the first singing video 60A from the mobile terminal 3A1 and the second singing video 60B from the mobile terminal 3A2. When generating the composite image 60, the second display control unit 87 sets (including changes) the display areas RD of the first singing video 60A and the second singing video 60B.

The second communication unit 88 transmits the composite image 60 to the mobile terminal 3B. As a result, the composite image 60 is displayed on the mobile terminal 3B. The second communication unit 88 also notifies the mobile terminal 3A1 of the display area RD of the first singing video 60A displayed in the composite image 60, and notifies the mobile terminal 3A2 of the display area RD of the second singing image 60B displayed in the composite image 60.

The mobile terminal 3A1 acquires notification of the display area RD from the second communication unit 88 via the first communication unit 77, and causes the notified display area RD to be displayed on the screen 3a together with the first singing video via the first display control unit 75. Similarly, the mobile terminal 3A2 acquires notification of the display area RD from the second communication unit 88 via the first communication unit 77, and causes the notified display area RD to be displayed on the screen 3a together with the second singing video via the first display control unit 75.

The singing competition process in the server 4 will be described with reference to FIG. 14. An information processing program for executing the singing competition process according to this embodiment is pre-stored in a specified area of the HDD 26. The HDD 26 of the server 4 performing the singing competition process stores an information processing program for executing a display control step of displaying at least a part of the captured image (singing video) on the display, and a communication step of transmitting at least a part of the captured image to the receiving terminal device (mobile terminal 3B), and the display control step stores an information processing program for displaying the display area of the captured image in the receiving terminal device together with the captured image on the display.

First, in step S31, the match request receiving unit 80 determines whether or not a match request has been made by the first singing user to the second singing user, and if the determination is positive, i.e., if a match request from the first singing user has been received, the process proceeds to step S33. On the other hand, if the determination is negative, the process enters a waiting state until a match request is received.

In step S33, the match acceptance determination unit 81 determines whether the second singing user has accepted the match request, and if the judgment is affirmative, the process proceeds to step S37, and if the judgment is negative, the process returns to step S31.

In step S37, the second display control unit 87 sets the display area RD of each of the first singing video 60A and the second singing video 60B. The display area RD is set, for example, based on the number of mobile terminals 3A that will perform the singing battle. After step S37, the second display control unit 87 generates a composite image 60 using the first singing video 60A and the second singing video 60B that correspond to the display area RD (S38). When the second display control unit 87 has set the display area RD of each of the first singing video 60A and the second singing video 60B, it notifies the mobile terminal 3A1 of the display area RD set for the first singing video 60A and notifies the mobile terminal 3A2 of the display area RD set for the second singing video 60B (S39). The notification in step S39 corresponds to the notification in step S13 in FIG. 12. As a result, the display area RD is displayed on the mobile terminal 3A1 and the mobile terminal 3A2 along with the first singing video and the second singing video. After the notification of step S39, the battle setting unit 82 performs various settings for the singing battle (S40).

In step S42, the second communication unit 88 of the server 4 judges whether or not it has received a notification of a change in the display area RD from the mobile terminal 3A1 or the mobile terminal 3A2 (simply written as "notification of the display area" in FIG. 14). If the second communication unit 88 has received a notification of a change in the display area RD, a positive judgment is made in step S42, and the second display control unit 87 regenerates the composite image 60 based on the first singing video and the second singing video corresponding to the display area RD that is changed based on the received notification (S43). If the second communication unit 88 has not received a notification, a negative judgment is made in step S42, and the second communication unit 88 starts distributing the battle singing video (S45). The battle singing video to be distributed includes the composite image 60 generated (including regeneration) by the second display control unit 87. As a result, at least a part of the first singing video and at least a part of the second singing video are displayed on the screen 3a of the mobile terminal 3B as a composite image 60. Note that step S42 may occur before step S40.

If the server 4 receives (S48) the notification of step S24 (FIG. 12) via the second communication unit 88 after the start of distribution of the battle singing videos in step S45, it regenerates (S49) and distributes the composite image 60 based on the first singing video and the second singing video corresponding to the obtained display area RD, and if not, it continues to distribute the composite image 60 being distributed and progresses the song. Step S48 is repeated while playback of the battle song has not ended (S51).

In this example, in step S38, the server 4 generates the composite image 60, and in step S49, the server 4 regenerates the composite image 60. However, at least one of the generation and regeneration of the composite image 60 may be performed by the mobile terminal 3B used by the viewing user. When the generation and regeneration of the composite image 60 are performed by the mobile terminal 3B, the mobile terminal 3B may be provided with a third display control unit (not shown) configured similarly to the second display control unit 87 of the server 4. When the generation of the composite image 60 is performed by the mobile terminal 3B, the server 4 notifies the mobile terminal 3B of the display area RD set in step S37, for example in step S45, together with the transmission of the first singing video and the second singing video, and the mobile terminal 3B generates the composite image 60 corresponding to the notified display area RD. When the composite image 60 is regenerated by the mobile terminal 3B, the server 4 that has received the notification in step S24 of FIG. 12 may send the notification to the mobile terminal 3B together with the singing video acquired from the mobile terminal 3A. When the composite video 60 is regenerated by the mobile terminal 3B, the notification in step S24 of FIG. 12 may be sent directly from the mobile terminal 3A to the mobile terminal 3B without going through the server 4.

In step S51, the video distribution module (not shown) determines whether the song in the singing competition has ended, and if the determination is positive, the second communication unit 88 ends the distribution of the singing competition video (S53). On the other hand, if the determination is negative in step S51, the second communication unit 88 continues distributing the singing competition video until the song has ended.

In the case of non-competitive singing, the server 4 may obtain the singing video data distributed from the mobile terminal 3A and store it in a specified area of the HDD 26 (see FIG. 2). In the case of non-competitive singing, the singing video data may be sent to the mobile terminal 3B without going through the server 4.

The outcome of a singing competition is not limited to being determined by the votes of viewing users. For example, the singing competition function may have an automatic scoring function, and the outcome may be determined by the results of the judgment made by this automatic scoring function.

In the above embodiment, the performance is singing and the video uploaded to the video sharing site is a singing video, but the present invention is not limited to this. For example, the performance may be something other than singing, such as dancing and the video uploaded to the video sharing site is a dance video.

<Additional Notes>
The information processing device of the present invention is an information processing device capable of communicating with a receiving terminal device, and is equipped with a display control unit that displays at least a part of the captured image on a display, and a communication unit that transmits at least a part of the captured image to the receiving terminal device, and the display control unit causes the display area of the captured image on the receiving terminal device to be displayed on the display together with the captured image.
This allows the image displayed on the receiving terminal to be recognized by the sending terminal.

It is preferable that the display control unit causes the display to display an area display image indicating the display area superimposed on the captured image.
This allows the image to be displayed on the receiving terminal device to be intuitively understood on the transmitting terminal device.

It is further preferable that the display control unit changes the display area while maintaining the aspect ratio based on the display area, and the communication unit notifies the receiving terminal device of the changed display area.
This allows the image displayed on the receiving terminal device to be adjusted on the transmitting terminal device.

The information processing system of the present invention is an information processing system capable of communication between a transmitting terminal device and a receiving terminal device, and is equipped with a display control unit that displays at least a portion of a captured image on a display of the transmitting terminal device, and a communication unit that transmits at least a portion of the captured image to the receiving terminal device, and the display control unit displays the display area of the captured image on the receiving terminal device together with the captured image on the display.
This allows the image displayed on the receiving terminal to be recognized by the sending terminal.

The information processing system further includes a server device that communicates with a plurality of transmitting terminal devices including a first transmitting terminal device and a second transmitting terminal device and a receiving terminal device, and the server device transmits to the receiving terminal device a composite image generated based on a first captured image from the first transmitting terminal device and a second captured image from the second transmitting terminal device, notifies the first transmitting terminal device of a first display area to be displayed in the composite image of the first captured image, and notifies the second transmitting terminal of a second display area to be displayed in the composite image of the second captured image, and it is preferable that the first transmitting terminal device displays the first display area together with the first captured image on the display of the first transmitting terminal device, and the second transmitting terminal device displays the second display area together with the second captured image on the display of the second transmitting terminal device.
As a result, even if there are a plurality of transmitting terminal devices, the image displayed on the receiving terminal device can be recognized at the transmitting terminal device.

The information processing program of the present invention is an information processing program that causes a computer of an information processing device capable of communicating with a receiving terminal device to execute a display control step of displaying at least a portion of the captured image on a display, and a communication step of transmitting at least a portion of the captured image to the receiving terminal device, and the display control step causes the display area of the captured image on the receiving terminal device to be displayed on the display together with the captured image.
The information processing method of the present invention is an information processing method for communicating with a receiving terminal device, and includes a display control step of displaying at least a part of the captured image on a display, and a communication step of transmitting at least a part of the captured image to the receiving terminal device, and the display control step causes the display area of the captured image on the receiving terminal device to be displayed on the display together with the captured image.
By using each of these information processing programs and information processing methods, an image displayed on a receiving terminal device is recognized on a transmitting terminal device.

REFERENCE SIGNS LIST 1 Karaoke system 3A, 3B Portable terminal 3a Screen 4 Server 50B Captured image display area 60 Composite image 60A First singing video 60B Second singing video 75 First display control unit 77 First communication unit 87 Second display control unit 88 Second communication unit RD Display area

Claims (6)

A first terminal device and a server,
The first terminal device is
Transmitting at least a portion of a first captured image of the user to the server;
Displaying a display area of the first captured image to be displayed on the second terminal device on a display of the first terminal device;
The server,
transmitting to the second terminal device a composite image generated based on at least a portion of the first captured image and at least a portion of captured images transmitted from one or more other terminal devices to the server;
when changing a display area in the composite image in which the first captured image is displayed from a display area displayed on the display of the first terminal device, notifying the first terminal device of the changed display area;
system. The first terminal device transmits at least a portion of the first captured image of the user to the server;
The first terminal device displays a display area of the first captured image to be displayed on the second terminal device on a display of the first terminal device;
the server transmits to the second terminal device a composite image generated based on at least a portion of the first captured image and at least a portion of captured images transmitted to the server from one or more other terminal devices;
when changing a display area in which the first captured image is displayed in the composite image from a display area displayed on the display of the first terminal device, the server notifies the first terminal device of the changed display area;
method. causing the server to receive at least a portion of the first captured image of the user transmitted from the first terminal device;
causing the server to transmit to a second terminal device a composite image generated based on at least a portion of the first captured image and at least a portion of captured images transmitted from one or more other terminal devices;
causing a server to display, on a display of the first terminal device, a display area of the first captured image to be displayed on the second terminal device;
a server notifies the first terminal device of a display area after the change when a display area in which the first photographed image is displayed in the compound image is changed from a display area displayed on the display of the first terminal device;
program. causing the terminal device to transmit at least a portion of the first captured image of the user to the server;
a terminal device that displays on a display a display area of the first captured image to be displayed on a second terminal device to which a composite image generated based on at least a part of the first captured image and at least a part of captured images transmitted from one or more other terminal devices to the server is transmitted;
when a display area in which the first photographed image is displayed in the compound image is changed from a display area displayed on the display, the terminal device is caused to receive a notification of the changed display area from the server;
program. receiving at least a portion of a first captured image of a user transmitted from a first terminal device;
Transmitting a composite image to a second terminal device, the composite image being generated based on at least a portion of the first captured image and at least a portion of captured images transmitted from one or more other terminal devices to a server ;
Displaying a display area of the first captured image to be displayed on the second terminal device on a display of the first terminal device;
when changing a display area in the composite image in which the first captured image is displayed from a display area displayed on the display of the first terminal device, notifying the first terminal device of the changed display area;
Information processing device. Transmitting at least a portion of the first captured image of the user to a server;
displaying, on a display, a display area of the first captured image displayed on a second terminal device to which a composite image generated based on at least a part of the first captured image and at least a part of a captured image transmitted from one or more other terminal devices to the server is transmitted;
receiving, from the server, a notification of a display area after the change, in which the first captured image is displayed in the compound image, from the display area displayed on the display;
Terminal device.

Images