JP7629609B2 - Information processing system, information processing method, and computer program - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act On August 31, 2020, the information processing system was made public on the official website https://reality.wrightflyer.net/.

Application of Article 30, Paragraph 2 of the Patent Act On August 31, 2020, an information processing system was released on the iOS download site https://itunes.apple.com/us/app/reality/id1404176564?l=ja&ls=1&mt=8.

Application of Article 30, Paragraph 2 of the Patent Act On August 31, 2020, an information processing system was released on the Android download site https://play.google.com/store/apps/details?id=net.wrightflyer.le.reality.

The present invention relates to an information processing system, an information processing method, and a computer program.

There is known an information processing system that generates animation of a character object based on the movement of an actor and distributes a video including the animation of the character object (see, for example, Patent Document 1).

JP 2015-184689 A

How to increase distributors' willingness to distribute and/or viewers' willingness to watch is an important issue in this technical field.

Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. One of the more specific objects of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can increase distributors' motivation to distribute and/or viewers' motivation to watch.

The information processing system of the present disclosure is an information processing system for distributing video, and includes one or more computer processors, and the one or more computer processors include a reception unit that receives a selection of a first object from a first information processing terminal, a transmission unit that transmits a predetermined notification to a second information processing terminal associated with the first object in accordance with the selection received by the reception unit, a reception unit that receives a response to the predetermined notification from the second information processing terminal, a first determination unit that determines the state of a first user associated with the first information processing terminal, and a determination unit that determines a second screen to be displayed on the second information processing terminal based on the result of the first determination unit.

The first determination unit can determine whether the state of a first user associated with the first information processing terminal is a first state in which the user is appearing in a video, a second state in which the user is watching a video on the main screen, or a third state in which the user is neither appearing in a video nor watching a video on the main screen.

When the first determination unit determines that the state of the first user is the first state, the determination unit can set the second screen to be displayed on the second information processing terminal as a screen for viewing a video in which the first user is appearing.

When the first determination unit determines that the state of the first user is the second state, the determination unit can set the second screen to be displayed on the second information processing terminal as a screen for viewing the video being viewed by the first user.

When the first determination unit determines that the state of the first user is the third state, the determination unit can set the second screen to be displayed on the second information processing terminal as a message exchange screen with the first user.

The one or more computer processors further include a display processing unit for displaying the first object, and the display processing unit can display the first object within an online notification indicating that a second user associated with the second information processing terminal has become online.

The one or more computer processors further include a display processing unit for displaying the first object, and the display processing unit can display the first object within a list screen of one or more second users who have a specific relationship with the first user.

The first determination unit can determine the state of the first user at the time the reception unit receives the selection.

The first determination unit can determine the state of the first user at the time the receiving unit receives the response.

The one or more computer processors may further include a second determination unit that determines the state of one or more second users that have a specific relationship with the first user.

The second determination unit can determine whether the state of the second user is a fourth state in which the user is appearing in a video, a fifth state in which the user is watching a video, or a sixth state in which the user is neither appearing in a video nor watching a video.

The sixth state can further include a seventh state in which the user is online but not appearing in or watching a video, and an eighth state in which the user is offline.

The display processing unit can display the first object in association with only the second user who is determined by the second determination unit to be in the fifth state.

When the state of the second user related to the second information processing terminal is the sixth state, the second determination unit further determines whether the state of the second user is the seventh state or the eighth state, and the transmission unit can vary the type of the specified notification depending on whether the state of the second user is the seventh state or the eighth state.

The display processing unit can display on the list screen an image and/or name showing the profile of one or more second users who have a specific relationship with the first user, together with the status of the second users in an identifiable manner.

The specified notification may display the number of times the first object has been selected by operating the first information processing terminal in a manner that allows the user to confirm the number of times.

The information processing method disclosed herein is an information processing method in an information processing system that distributes video, characterized in that one or more computer processors provided in the information processing system execute a reception step of receiving a selection of a first object from a first information processing terminal, a transmission step of transmitting a predetermined notification to a second information processing terminal associated with the first object in accordance with the selection received in the reception step, a reception step of receiving a response to the predetermined notification from the second information processing terminal, a first determination step of determining the state of a first user associated with the first information processing terminal, and a determination step of determining a second screen to be displayed on the second information processing terminal based on the result of the first determination step.

The information processing method disclosed herein is an information processing method in a first information processing terminal constituting an information processing system for distributing video, the information processing system comprising a first information processing terminal, a second information processing terminal, and a server device, and is characterized in that it causes one or more computer processors in the first information processing terminal to execute a display processing step of displaying a first object on a screen, a reception step of receiving a selection of the first object displayed in the display processing step, a first determination step of determining the state of a first user associated with the first information processing terminal, and a transmission step of transmitting the selection received in the reception step and the result determined in the first determination step to the server device.

The computer program of the present disclosure is a computer program for a first information processing terminal constituting an information processing system for distributing video, the information processing system comprising a first information processing terminal, a second information processing terminal, and a server device, and is characterized in that one or more computer processors of the first information processing terminal realize a display processing function for displaying a first object on a screen, a reception function for receiving a selection of the first object displayed by the display processing function, a first judgment function for judging the state of a first user related to the first information processing terminal, and a transmission function for transmitting the selection received by the reception function and the result determined by the first judgment function to the server device.

The information processing method disclosed herein is an information processing method in a second information processing terminal constituting an information processing system for distributing video, the information processing system comprising a first information processing terminal, a second information processing terminal, and a server device, and causes one or more computer processors in the second information processing terminal to execute a receiving step of receiving a predetermined notification transmitted from the server device in response to a selection of a first object in the first information processing terminal, a transmitting step of transmitting a response to the predetermined notification received in the receiving step to the server device, and a display processing step of displaying a second screen based on information regarding the second screen received from the server device, the second screen being determined based on the state of a first user associated with the first information processing terminal.

The computer program of the present disclosure is a computer program for a second information processing terminal constituting an information processing system for distributing video, the information processing system comprising a first information processing terminal, a second information processing terminal, and a server device, and causes one or more computer processors of the second information processing terminal to realize a receiving function for receiving a predetermined notification transmitted from the server device in response to a selection of a first object on the first information processing terminal, a transmitting function for transmitting a response to the predetermined notification received by the receiving function to the server device, and a display processing function for displaying a second screen based on information regarding the second screen received from the server device, the second screen being determined based on the state of a first user associated with the first information processing terminal.

According to the invention disclosed herein, it is possible to provide technical improvements that solve or alleviate at least some of the problems of the conventional technology described above. Specifically, it is possible to provide an information processing system, an information processing method, and a computer program that can increase distributors' motivation to distribute and/or viewers' motivation to watch.

1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. FIG. 2 is a configuration diagram showing an example of a hardware configuration of an information processing device according to the present disclosure. FIG. 2 is a configuration diagram showing an example of a functional configuration of an information processing device according to the present disclosure. 11 is a conceptual diagram showing a display image of an online notification displayed on the first information processing terminal. FIG. FIG. 13 is a conceptual diagram showing an image of a situation in which an online notification is sent. 13 is a conceptual diagram showing a display image of a call notification displayed on the second information processing terminal. FIG. FIG. 13 is a conceptual diagram showing an image of a situation in which a call notification is sent. 11 is a table showing a relationship between a first user's state and a second screen. FIG. 11 is a configuration diagram showing another example of the functional configuration of the information processing device according to the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. 11 is a table showing the relationship between the status of a second user and the on/offline status. FIG. 13 is a conceptual diagram showing an image of a profile image of a second user in which the status of the second user is displayed in a identifiable manner. FIG. 13 is a conceptual diagram showing an image of a profile image of a second user in which the status of the second user is displayed in a identifiable manner. FIG. 13 is a conceptual diagram showing an image of a profile image of a second user in which the status of the second user is displayed in a identifiable manner. FIG. 13 is a conceptual diagram showing an image of a profile image of a second user in which the status of the second user is displayed in a identifiable manner. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a configuration diagram showing another example of the functional configuration of the information processing device according to the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 1 is a flow diagram showing an example of the flow of an information processing method according to the present disclosure. FIG. 2 is a circuit configuration diagram showing an example of a circuit configuration for implementing a computer program according to the present disclosure. 1A is a block diagram showing an example of a functional configuration of a first information processing terminal according to the present disclosure, and FIG. 1B is a block diagram showing an example of a circuit configuration for realizing the functions of a program for a first information processing terminal according to the present disclosure. 10 is a flow diagram showing an example of the flow of an information processing method in a first information processing terminal in the present disclosure. 1A is a block diagram showing an example of a functional configuration of a second information processing terminal according to the present disclosure, and FIG. 1B is a block diagram showing an example of a circuit configuration for realizing the functions of a program for a second information processing terminal according to the present disclosure. 11 is a flow diagram showing an example of the flow of an information processing method in a second information processing terminal in the present disclosure.

First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.

The information processing system in the present disclosure is an information processing system that distributes videos and includes one or more computer processors. The distributed videos are described as including animation of a character object generated based on the movements of the broadcasting user, but are not limited to this and may be videos that do not feature a character object generated based on the movements of the broadcasting user. For example, the videos may feature the broadcasting user himself or may be videos in which the broadcasting user's voice and a specified image are played, such as a karaoke video or a game commentary video. Furthermore, as described below, the videos may be displayed by superimposing a character object on a game screen and/or a captured image of real space.

<System Configuration>
As shown as an example in FIG. 1, the information processing system 1000 of the present disclosure may include one or more viewing user terminals 1100, and an information processing device (support computer) 1300 located in a video distribution studio, etc., connected to these viewing user terminals 1100 via a network 1200.

The information processing device 1300 may be connected to a server device 1400 (not shown) via the Internet, and some or all of the processing that should be performed by the information processing device 1300 may be performed by the server device 1400. The server device 1400 may be the information processing device 2400 shown in FIG. 2.

In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.

In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

The information processing system 1000 of the present invention can also be linked to another information processing system 2000, shown as an example in FIG. 2. The information processing system 2000 shown in FIG. 2 can include a broadcast user terminal 2100, one or more viewing user terminals 2200, and an information processing device (server device) 2400 connected to the broadcast user terminal 2100 and the viewing user terminal 2200 via a network 2300.

In the above example, the broadcast user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, broadcasting by such an information processing system 2000 is referred to as mobile broadcasting.

In mobile distribution, the facial movements of the broadcast user are captured by a camera installed in the broadcast user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.

The videos generated by the above information processing system 1000 and information processing system 2000 can be distributed to viewing users from a single video distribution platform, as an example.

In addition, in any broadcast, the process of generating animation by reflecting motion on a character and the process of displaying gifts (described below) may be shared among the broadcasting user terminal, the viewing user terminal, an information processing device, and other devices.

Specifically, facial motion data and voice data of the broadcasting user are transmitted from the broadcasting user terminal to a terminal or device that generates animation of the character object. Body motion may also be transmitted in addition to facial motion.

In the following explanation, the process of generating animation is assumed to be performed on both the broadcasting user terminal and the viewing user terminal, but this is not limited to the above.

In the following description, the information processing system of the present disclosure will be described as having the system configuration (mobile distribution) shown in FIG. 2, but it may also have the system configuration shown in FIG. 1.

Note that there is no particular distinction between broadcast users and viewing users in mobile distribution; viewing users can broadcast via mobile at any time, and broadcast users can become viewing users when viewing videos of other broadcast users.

In the following description, the information processing system of the present disclosure will be described as having the system configuration (mobile distribution) shown in FIG. 2 and the system configuration shown in FIG. 3. The information processing system 3000 of the present disclosure shown in FIG. 3 can include a first information processing terminal 100, one or more second information processing terminals 200, and an information processing device (server device) 400 connected to the first information processing terminal 100 and the one or more second information processing terminals 200 via a network 300.

As described above, the video distributed by the information processing system of the present disclosure may be a game screen played by the broadcasting user and/or a captured image in real space. In this case, a character object generated based on the broadcasting user's movements or an actual image of the broadcasting user may be displayed together with the game screen. Furthermore, if the broadcasting user is included in the captured image in real space, a character object generated based on the broadcasting user's movements may be displayed superimposed on the actual image of the broadcasting user (Augmented Reality (AR)). Furthermore, an animation of a gift object or the like may be displayed superimposed on the captured image in real space.

In the present disclosure, the distribution user terminal and the viewing user terminal, and the first information processing terminal and the second information processing terminal can be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head mounted display (HMD), a wearable computer such as a glasses-type wearable terminal (AR glasses, etc.), and an information processing device capable of playing videos other than these devices. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that they can send and receive various data.

<Hardware Configuration>
4, a hardware configuration of the information processing device 1300 included in the information processing system 3000 will be described. The information processing device 1300 includes a processor 401, a memory 402, a storage 403, an input/output interface (input/output I/F) 404, and a communication interface (communication I/F) 405. The components are connected to each other via a bus B.

The information processing device 400 can realize the functions and methods described in this embodiment through cooperation between the processor 401, memory 402, storage 403, input/output I/F 404, and communication I/F 405.

The processor 401 executes functions and/or methods realized by codes or instructions included in a program stored in the storage 403. The processor 401 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). In addition, these circuits may be realized by one or more integrated circuits, and multiple processes shown in each embodiment may be realized by one integrated circuit. In addition, an LSI may be called a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.

The memory 402 temporarily stores the programs loaded from the storage 403 and provides a working area for the processor 401. The memory 402 also temporarily stores various data generated while the processor 401 is executing the programs. The memory 402 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), etc.

Storage 403 stores programs. Storage 403 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), flash memory, etc.

The communication I/F 405 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I/F 405 communicates with other information processing devices via the network 300. The communication I/F 405 transmits various data to other information processing devices according to instructions from the processor 401. The communication I/F 405 also receives various data transmitted from other information processing devices and transmits it to the processor 401.

The input/output I/F 404 includes an input device that inputs various operations to the information processing device 400, and an output device that outputs the results of processing by the information processing device 400. The input/output I/F 404 may be an integrated input device and output device, or may be separate input device and output device.

The input device is realized by any of all types of devices, or a combination of devices, that can receive input from a user and transmit information related to the input to the processor 401. Examples of input devices include hardware keys such as a touch panel, a touch display, and a keyboard, pointing devices such as a mouse, a camera (operation input via images), and a microphone (operation input via voice).

The input device may include a sensor unit. The sensor unit is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit may be a publicly known one. An example of the sensor unit includes a ToF sensor that measures and detects the time of flight (Time of Flight) until light irradiated toward the user is reflected by the user's face and returns, a camera that photographs the user's face, and an image processing unit that processes the data photographed by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and the near-infrared camera may be, for example, True Depth of the "iPhoneX (registered trademark)", or "LIDER" of the "iPad Pro (registered trademark)", or other ToF sensors installed in smartphones. Specifically, this camera uses a dot projector to project tens of thousands of invisible dots onto the user's face, etc. Then, it detects and analyzes the reflected light from the dot pattern to form a depth map of the face, and captures an infrared image of the face, etc., thereby capturing accurate facial data. The sensor unit's processing unit generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.

The sensor unit may also have a function of tracking not only the user's face but also their hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing objects in the real space in which the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized objects on a spatial map. Hereinafter, when face motion detection data and body motion detection data are described without making a distinction between them, they will simply be referred to as "tracking data". Note that the image processing unit of the sensor unit may be provided in a control unit that can be provided in the information processing system of the present invention.

The operation unit as an input device can be one that corresponds to the type of user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may have various known sensors built in, such as an acceleration sensor and an inertial measurement unit (IMU) such as a gyroscope. Another example of the operation unit may be a tracking device that identifies the user's hand movement, eye movement, head movement, line of sight, and the like. In this aspect, for example, the user's instructions can be determined based on the user's hand movement, and various operations can be performed, such as starting or ending the distribution of a video, rating a message or a video, and requesting the display of a specific object (for example, a gift, which will be described later). Note that if the sensor unit also has an input interface function such as a hand truck function, the operation unit can be omitted.

The output device outputs the results of processing performed by the processor 401. Examples of the output device include a touch panel, a speaker, etc.

In addition, the first information processing terminal 100, the second information processing terminal 200, and the information processing device 400 in this disclosure can also be configured with the same hardware configuration as in FIG. 4, except where otherwise noted.

<Functional configuration>
The one or more computer processors (information processing device 400 in this example) include a reception unit 410, a transmission unit 420, a reception unit 430, a first determination unit 440, and a decision unit 450, as shown in FIG.

The reception unit 410 receives a selection of a first object from the first information processing terminal 100.

Depending on the state of the first user related to the first information processing terminal 100, it is determined whether the first information processing terminal 100 is the broadcasting user terminal 2100 shown in FIG. 2, the viewing user terminal 2200, or a user terminal that is neither (a terminal that is neither broadcasting nor viewing). This point will be described later.

As an example, the first object may be displayed in an online notification 10 indicating that a second user related to the second information processing terminal 200 has gone online, as shown in FIG. 6. In the example shown in FIG. 6, the online notification 10 displays text 11 stating "AAA (user name) is now online," a profile image 12 of the second user, and a first object 13.

As shown in the image of FIG. 7, the online notification 10 is sent to the first information processing terminal 100 of the first user when the second user of the second information processing terminal 200 starts a specific application (when the second user goes online).

As an example, the second user may be a user who has a mutual follow relationship with the first user.

The transmitting unit 420 transmits a predetermined notification to the second information processing terminal 200 associated with the first object 13 in accordance with the selection accepted by the accepting unit 410.

As an example, the specified notification may be a call notification 20 indicating that a first user related to the first information processing terminal 100 is calling a second user, as shown in FIG. 8. In the example shown in FIG. 8, the call notification 20 displays the text 21 saying "BBB (user name) is calling you," a profile image 22 of the second user, and a second object 23.

The call notification 20 is sent to the second information processing terminal 200 of the second user when the first user selects the first object 13, as shown in the image in FIG. 9.

The receiving unit 430 receives a response to the specified notification from the second information processing terminal 200.

The second user responds to the predetermined notification by tapping on the displayed call notification 20. Alternatively, the second user may respond by tapping on the second object 23 displayed on the call notification 20.

The first determination unit 440 determines the state of the first user related to the first information processing terminal 100.

The status of the first user can be broadly categorized into whether the first user is currently streaming a video, watching a video, or in other states. Details will be provided later.

Then, the determination unit 450 determines the second screen to be displayed on the second information processing terminal 200 based on the result of the first determination unit 440.

As an example, when the first determination unit 440 determines that the first user's state is that a video is being streamed, the determination unit 450 causes the second information processing terminal 200 to display, as the second screen, a viewing screen for the video being streamed by the first user.

Alternatively, when the first determination unit 440 determines that the state of the first user is watching a video, the determination unit 450 causes the second information processing terminal 200 to display, as the second screen, a viewing screen of the video being watched by the first user.

Alternatively, when the first determination unit 440 determines that the first user is neither streaming nor watching a video, the determination unit 450 causes the second information processing terminal 200 to display a chat screen with the first user as the second screen.

Figure 10 shows a table of the contents of the second screen when broadly categorized into whether the first user is streaming a video, watching a video, or something else.

In this way, the specified notification sent by selecting the first object is a notification for the first user to tell the second user "come over," and specifically, it can be sent for the purpose of getting the second user to come and watch a video that the first user is streaming, or for the purpose of getting the second user to come and watch a video that another user is streaming, or for the purpose of chatting.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Specifically, with the above configuration, it is possible to attract second users as viewers of the video, thereby increasing the number of viewers of the video that you are distributing or the video that another user is distributing. This leads to increased motivation for distributors to distribute.

In addition, the second user can be invited to a recommended video by the first user (directed to the viewing screen), which increases the second user's motivation to watch.

In addition, the first user will be able to casually talk to the second user, which will lead to more active communication.

As described above, the first determination unit 440 can determine whether the state of the first user related to the first information processing terminal 100 is the first state, the second state, or the third state. These states are described in more detail below.

The first state refers to a state in which the first user is appearing in a video. Appearing in a video refers to a state in which the first user or the first user's character object is appearing in a video being distributed, and includes a state in which the first user is the distributor of the video, or a state in which the first user is participating as a guest user in a video being distributed by another distributor.

The second state refers to a state in which the first user is currently viewing a video on the main screen. Viewing a video on the main screen includes a state in which the first user is a viewing user who is viewing a video being distributed by another distribution user. Note that the second state does not include a state in which a video is currently being viewed on a sub-screen. A detailed explanation of the main screen and sub-screen will be given in the explanation of "Small Audio Window Distribution" below.

The third state is a state in which the first user is neither appearing in a video nor watching a video on the main screen. This is a state that is neither the first state nor the second state.

When the first determination unit 440 determines that the state of the first user is the first state, the determination unit 450 can set the second screen to be displayed on the second information processing terminal 200 as a screen for watching a video in which the first user is appearing.

This allows the first user in the first state to invite the second user to watch the video that he or she is streaming.

When the first determination unit 440 determines that the state of the first user is the second state, the determination unit 450 can set the second screen to be displayed on the second information processing terminal 200 as a screen for viewing the video that the first user is watching.

As a result, the first user, who is in the second state, can invite the second user to come and watch the video that he or she is watching. Then, by watching videos of the streaming user (favorite user) that the first user supports together, the first user can stimulate communication with the second user. Furthermore, the first user can support the favored user by increasing the number of viewers and the number of giftings. This support further increases the streaming user's motivation to stream videos.

When the first determination unit 440 determines that the state of the first user is the third state, the determination unit 450 can set the second screen to be displayed on the second information processing terminal 200 as a message exchange screen with the first user.

This allows the third user, who is in the third state, to invite the second user to start a chat with him or her.

In this way, the first user can casually talk to the second user, leading to more active communication.

Here, the first determination unit 440 can determine the state of the first user at the time when the reception unit 410 receives the selection.

With this configuration, regardless of the timing at which the receiving unit 430 receives a response to a specific notification from the second information processing terminal 200, the second screen is determined according to the state of the first user at the time the acceptance unit 410 accepts the selection.

Alternatively, the first determination unit 440 can determine the state of the first user at the time the receiving unit 430 receives the response.

With this configuration, regardless of the timing at which the accepting unit 410 accepts a selection from the first information processing terminal 100, the second screen is determined according to the state of the first user at the time when the receiving unit 430 receives a response to a specified notification from the second information processing terminal 200.

When the first determination unit 440 determines the state of the first user at the time when the reception unit 410 receives the selection, if the distribution of the video to be displayed on the second screen has ended, the determination unit 450 may display, as the second screen, a screen indicating that the distribution has ended, or a profile screen of the distribution user, or may re-determine the second screen depending on the result of the determination of the state of the first user at the time when the reception unit 430 receives the response.

The one or more computer processors in this disclosure may further include a display processing unit 460, as shown in FIG. 11.

The display processing unit 460 is for displaying the first object, and displays the first object in an online notification 10 indicating that a second user related to the second information processing terminal 200 has become online. An image of the online notification 10 is as shown in FIG. 6.

In addition, it is also possible to set whether or not to receive online notifications 10 on the first information processing terminal 100.

In this case, one or more processors in the present disclosure may further include a second determination unit 465 and a second transmission unit 470.

The second determination unit 465 determines whether the first information processing terminal 100 can receive the online notification 10. Whether the online notification 10 can be received can be set for each of the one or more second information processing terminals 200.

The second transmission unit 470 transmits an online notification 10 to the first information processing terminal 100 if the result of the second determination unit 465 is positive.

It is also possible to set whether or not to send online notification 10 on the second information processing terminal 200.

In this case, one or more processors in the present disclosure may further include a determination unit 475.

At this time, the second determination unit 465 determines whether the second information processing terminal 200 can send the online notification 10. Whether the online notification 10 can be sent can be set for each of the one or more first information processing terminals 100.

The identification unit 475 identifies a specific first information processing terminal 100 to which the online notification 10 is to be sent when the result by the second determination unit 465 is positive.

The second transmission unit 470 transmits the online notification 10 to the specific first information processing terminal 100 identified by the identification unit 475.

A specific first information processing terminal 100 is, in other words, a first information processing terminal 100 that is capable of sending an online notification 10 to a second information processing terminal 200 and is further capable of receiving an online notification 10 from the second information processing terminal 200.

In addition, the specified notification may display the number of times the first object 13 has been selected by operating the first information processing terminal 100 in a manner that allows the user to confirm the number of times.

As shown in FIG. 8, a second object 23 is displayed in a predetermined notification (call notification 20). This second object 23 can be displayed a number of times according to the number of times the first object 13 is selected by the first user on the first information processing terminal 100.

With this configuration, the number of second objects 23 displayed can be used to gauge the degree of solicitation from the first user.

Note that there is an upper limit to the number of second objects 23 that can be displayed, and even if a first object 13 is selected beyond this limit, no more will be displayed.

The above describes an example in which a first object 13 is displayed in the online notification 10 shown in FIG. 6, but the first object 13 may also be displayed by the display processing unit 460 in a list screen of one or more second users who have a specific relationship with the first user.

Figure 12 shows a list screen 30 of users with mutual follow relationships, which is displayed by selecting the Follow tab as a list screen of one or more second users who have a specific relationship with the first user. Mutual follow refers to a relationship in which each user is a follower of the other user.

This list screen 30 displays the profile images and names of users with whom you have a mutual follow relationship.

As shown in FIG. 12, a first object 31 is displayed for each second user on the list screen 30. A chat object 32 may also be displayed together with the first object 31. By selecting this chat object, it is possible to transition to an individual chat screen with the second user.

In addition, when a first user selects a first object 31 on the list screen and a second user selects a call notification 20 sent to the second user, the second screen displayed to the second user can be an individual chat screen with the first user.

The individual chat screens for the first user and the second user can be the same, but it is assumed that the first user will input the first comment calling out to the other party on the chat screen transitioned to by selecting chat object 32, and the second user will input the first comment calling out to the other party on the chat screen transitioned to by selecting call notification 20.

In addition, one or more computer processors of the present disclosure may further include a third determination unit 485, as shown in FIG. 11.

The third determination unit 485 determines the status of one or more second users who have a specific relationship with the first user.

Specifically, the third determination unit 485 determines whether the state of the second user is a fourth state in which the user is appearing in a video, a fifth state in which the user is watching a video, or a sixth state in which the user is neither appearing in a video nor watching a video.

The sixth state can further include a seventh state in which the user is online but not appearing in or watching a video, and an eighth state in which the user is offline.

Figure 13 is a table summarizing the relationship between these states and the on/offline state.

Then, the display processing unit 160 can display on the list screen 30 an image and/or name showing the profile of one or more second users who have a specific relationship with the first user, together with the status of the second users in an identifiable manner.

Figure 14 is an image diagram for explaining an image showing the profile of the second user U4 shown in Figure 12. For the second user U4 in the fourth state, the image 33 showing the profile is provided with the word "LIVE" 34a and an audio object 35 indicating that audio is being played. In addition, the frame 36 surrounding the image showing the profile can also be decorated to distinguish it from other states.

Figure 15 is an image diagram for explaining an image showing the profile of second user U5 shown in Figure 12. For second user U5 in the fifth state, the image 33 showing the profile is provided with the word "VIEW" 34b and an audio object 35 indicating that audio is being played. As with the example of the fourth state above, the frame 36 surrounding the image showing the profile can be decorated to distinguish it from the other states.

Figure 16 is an image diagram for explaining an image showing the profile of the second user U6 shown in Figure 12. For the second user U6 who is in both the sixth and seventh states, an online object 37a indicating that the user is online is added to the image 33 showing the profile. Note that no particular decoration is added to the frame 36 surrounding the image showing the profile.

Figure 17 is an image diagram for explaining an image showing the profile of the second user U7 shown in Figure 12. For the second user U7 who is in both the sixth and eighth state, an object 37b showing the time elapsed since going offline is added to the image 33 showing the profile. Note that no particular decoration is added to the frame 36 surrounding the image showing the profile.

The display processing unit 460 can also display the first object 31 in association with only the second user who is determined by the third determination unit 485 to be in the fifth state.

Alternatively, the display processing unit 460 can associate the first object 31 with a second user who is determined by the third determination unit 485 to be in the fourth state, and not display the first object 31.

Figure 18 shows the fourth state, where the second user U4 is not displayed in the mutual follow activity column, but a thumbnail image of the distribution channel is displayed in the distribution column.

In this way, when it comes to a second user who is currently streaming, it is preferable to prioritize watching the video being streamed rather than calling the second user.

In addition, when the state of the second user related to the second information processing terminal 200 is the sixth state, the third determination unit 485 can further determine whether the state of the second user is the seventh state or the eighth state, and at this time, the transmission unit 420 changes the type of the specified notification depending on whether the state of the second user is the seventh state or the eighth state.

Specifically, when the second user is in the seventh state, a dedicated application is running on the second information processing terminal 200, and therefore the predetermined notification is displayed on the screen as a notification within the dedicated application. Note that this example is not limited to the seventh state, and can also be applied to the fifth state.

On the other hand, when the second user is in the eighth state, since the dedicated application is not running on the second information processing terminal 200, the specified notification is displayed on the screen as a push notification by the function of the second information processing terminal 200.

It is also possible to set whether or not to receive a specific notification on the second information processing terminal 200. Such whether or not to receive a notification can be set for each of the one or more first information processing terminals 100.

At this time, the second determination unit 465 determines whether the second information processing terminal 200 can receive a specified notification.

If the result of the second determination unit 465 is positive, the transmission unit 420 transmits a predetermined notification to the second information processing terminal 200.

Here, we will explain, with reference to the drawings, the various functions that can be executed on a user terminal that has launched an application realized by the information processing system of this disclosure, and the transitions of the screens that are displayed.

First, we will explain the flow for starting video distribution.

The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit (not shown).

The distribution start request receiving unit receives a request to start distribution of a first video including animation of a character object from the distribution user terminal of the distribution user.

Here, the first video refers to a video that includes animation of a character object. Note that in this specification, a character object may also be called an "avatar."

The request to start distribution can be transmitted from a user terminal (later becoming the distribution user terminal 2100) to the information processing device 2400 by selecting a distribution button located on an avatar setting screen or the like displayed on the user terminal that has launched a dedicated application (video distribution/viewing application) for accessing the video distribution platform.

Figure 19 shows an example of an avatar setting screen 40. The avatar setting screen 40 can display a character object CO, a distribution button 41, a change of clothes button 42, a gacha button 43, etc.

When the user selects the Change Clothes button 42, a screen appears that allows the user to select various avatar parts for the character object, such as the eyes, nose, mouth, hair, accessories, clothes, and background.

When the user selects the gacha button 43, a lottery screen for obtaining the avatar parts appears.

When the user selects the distribution button 41, a distribution start request is sent to the information processing device 2400.

The distribution setting unit sets the distribution settings for the first video based on the specifications from the distribution user terminal 2100 in response to a request to start distribution of the first video accepted by the distribution start request accepting unit.

As an example, when the broadcast button 41 is selected, the screen displayed on the broadcast user terminal 2100 transitions from the avatar setting screen 40 shown in FIG. 19 to the broadcast setting screen 44 shown in FIG. 20.

The distribution settings may include at least one of the following: a setting regarding the title of the first video, a setting regarding whether other users can appear in the first video, a setting regarding the number of people who can appear in the first video, and a setting regarding a password.

These distribution settings can be set in the title setting field 45, collaboration permission setting field 46, number of participants setting field 47, and password setting field 48 in FIG. 20.

The title of the first video can be freely determined by the broadcasting user within the range of the maximum number of characters allowed. If there is no input from the broadcasting user, a pre-set title including the name of the broadcasting user or character object, such as "This is XXX's broadcast ♪", may be automatically determined.

The distributing user can freely decide whether or not other users can appear in the first video. If it is allowed, other users can make an appearance request to the distributing user, and if it is not allowed, other users cannot make an appearance request to the distributing user. In this specification, the state in which other users appear in the distributing user's video is sometimes referred to as "collaboration." More details on collaboration will be provided later.

The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distributor user within the range of the maximum number of people allowed.

The password can be set arbitrarily only if other users are allowed to appear in the first video described above, and the distributor user can freely decide the number of digits. When other users apply to appear in the first video, they will be required to enter this password.

The distribution start unit distributes information about the first video to the viewing user terminal 2200 of the viewing user based on the conditions set by the distribution setting unit.

The instruction to start such distribution is sent by selecting the distribution start button 49 shown in FIG. 20.

As an example, the distribution starting unit distributes (avatar distributes) information about a video (first video) including animation of the distribution user's character object to the viewing user terminal 2200 of the viewing user.

The information about the first video includes, for example, motion information indicating the movement of the character object, audio information of the broadcasting user, and gift object information indicating gifts sent by other viewing users. The gift object information includes at least gift object identification information that specifies the type of gift object, and position information that indicates the position where the gift object is displayed.

Then, the distribution start unit can live-stream the video via the video distribution platform described above.

Figure 21 shows the avatar distribution screen 50 displayed on the distribution user terminal 2100.

In addition to displaying the character object CO, the avatar distribution screen 50 can also display a comment input button 51 for the distribution user to input a comment, an audio switch button 52 for switching the audio ON/OFF, a start play button 53 for playing a game executed by a computer, which will be described later, an external service linkage button 54 for watching videos provided by an external service, and a gacha button 43 for obtaining avatar parts.

In addition, the top of the avatar distribution screen 50 can display a cumulative viewer count 55, a cumulative like count 56, a collaborator count 57, a share button for external SNS 58, a guest details button 59, an invite button 60, and a settings button 61. An end button 62 for ending the distribution is also displayed.

A detailed description of these displays and buttons will be omitted, but by selecting the settings button 61, it is possible to change the distribution settings set on the distribution settings screen 44.

Note that FIG. 21 shows an example in which distribution has been started with the distribution setting screen 44 allowing other users to appear in the first video and the number of people who can appear in the first video being three, so character object CO is displayed shifted to the bottom left. Up to three character objects of other users can appear in the empty space.

The above is an explanation of the screen transitions that occur when delivering an avatar according to the invention disclosed herein.

Next, we will explain the flow for starting to watch a video.

As shown in FIG. 22, one or more processors in the present disclosure may further include a viewing acceptance unit 490 and a distribution unit 495.

The viewing reception unit 490 receives requests from users to view videos.

In response to a viewing request, the distribution unit 495 distributes video and audio information as video information to the user's information processing terminal.

Figure 23 shows the top screen 63 that is displayed on the user terminal when the video distribution and viewing application is launched.

As shown in FIG. 23, a user can select a distribution channel (distribution slot, distribution program, distribution video) from thumbnail images of one or more recommended distribution channels 65 displayed as a list in the recommendation tab 64 on the top screen 63, and watch a video being played on that one distribution channel.

Alternatively, a user can view a video being played on a specific distribution channel by accessing a fixed link for that specific distribution channel. Such a fixed link can be obtained through notifications from a distribution user that the user is following, or through notifications of shares sent by other users.

In this way, the user who watches the video becomes a viewing user, and the terminal on which the video is watched becomes a viewing user terminal 2200.

As shown in FIG. 23, the top screen 63 may also display a display area 66 for notifications such as campaigns and events. This notification display area 66 can be switched to display other notifications by sliding the display area.

Then, from the top screen 63, a follow tab 67 for transitioning to the above-mentioned Figures 12 and 18, a game tab 68 for displaying game categories, a collaboration waiting tab 69 for displaying distribution channels waiting for collaboration, and a beginner tab 70 for displaying beginner distribution channels are displayed. By selecting these (by switching between tabs), the top screen 63 transitions to each of the different screens.

The service name display 71 and search button 72 in the upper frame of the top screen 63 may remain fixed and displayed on the screen to which the user transitions.

Similarly, the home button 73, message button 74, delivery preparation button 75, notification button 76, and profile button 77 in the bottom frame of the top screen 63 may also be fixed and remain displayed on the transition destination screen.

On the top screen 63 shown in FIG. 23, a user who selects a displayed thumbnail image can become a viewing user who watches the video, and a user who selects the distribution preparation button 75 can become a distribution user who distributes an avatar video.

As an example, when the distribution preparation button 75 is selected on the top screen 63 shown in FIG. 23, the screen transitions to the avatar setting screen 40 shown in FIG. 19. Then, when the distribution button 41 is selected on the avatar setting screen 40, the screen transitions to the distribution setting screen 44 shown in FIG. 20. Then, when the start distribution button 49 is selected on the distribution setting screen 44, the screen transitions to the avatar distribution screen 50 shown in FIG. 21.

In addition, when a thumbnail image is selected on the top screen 63 shown in FIG. 23, the screen transitions to a video viewing screen.

Figure 24 shows an example of a viewing screen 78 of an avatar video displayed on the viewing user terminal 2200.

A viewing user can post a comment by entering text in the comment posting field 79 and pressing the send button 80.

In addition, by pressing the gift button 81, the viewing user can display a list of gifts (Figure 25) and send a display request for the specified gift by selecting it.

At this time, one or more processors in the present disclosure may include a determination unit (not shown). The determination unit determines whether or not a gift display request has been made from the viewing user terminal 2200.

The display request may include gift object information. The gift object information includes at least gift object identification information that identifies the type of gift object, and location information that indicates the location where the gift object is to be displayed.

In addition, as shown in FIG. 25, gifts can be displayed by category (free (paid) gifts, accessories, cheering goods, appeals, variety, etc.).

Here, paid gifts are gifts that can be purchased by consuming My Coins purchased by the viewing user, and free gifts are gifts that can be obtained by the viewing user with or without consuming My Points that were obtained for free.

In addition, viewing users can post ratings that show their approval by pressing the like button 82.

In addition, if the broadcasting user has set the option to allow other users to appear in the video in their broadcast settings, they can send a request to appear in the video by selecting the collaboration request button 83.

In addition, on the screen of a video distributed by a distributor user who is not yet being followed by the viewing user, a follow button 84 is displayed so that the viewing user can follow the distributor user. This follow button functions as an unfollow button on the screen of a video distributed by a distributor user who is already being followed by the viewing user.

Note that this "following" may occur from viewing user to viewing user, from broadcasting user to viewing user, or from broadcasting user to broadcasting user. However, following is managed as a one-way association only, and associations in the reverse direction are managed separately as followers.

The viewing screen 78 also displays a support ranking display button 85, a share button 86, and an invite button 87.

The support ranking displays a ranking of viewing users who are supporting a broadcasting user, and the ranking can be calculated based on the amount of the gift (points/coins), etc.

In addition, when sharing a video, the viewing user can press the share button 86 to check a list of SNS (social networking services) on which the video can be shared, and can send a fixed link to a specified location on a specified SNS by selecting it.

The invite button 87, like the first object in this disclosure, is for inviting the second user to the video being watched, and by selecting it, a list screen for inviting mutual follows can be displayed.

Figure 26 shows an example of a list screen 89 for invoking mutual following. The list screen 89 may display a first object along with images and/or names representing the profiles of one or more second users having a particular relationship with the first user. Selection of the first object causes a call notification to be sent to the second user.

You can also request a collaboration broadcast from the broadcasting user by pressing the collaboration request button 83. A collaboration broadcast means having the viewing user's character object appear in the broadcasting user's broadcast video.

The upper part of the viewing screen 78 can display a broadcasting user icon 89, a broadcasting user name (character object name) 90, a cumulative number of viewers display 91, and a cumulative number of likes display 92.

Also, when the End Viewing button 88 is selected, a screen for ending viewing appears, allowing the user to send a request to end viewing.

The screen for ending such viewing will be explained in detail below. The state in which such a screen is displayed is called "audio small window delivery", and is for viewing in a mode in which only the audio is played without displaying the video image.

Selection of the above-mentioned end viewing button 88 is accepted by the viewing acceptance unit 490 as a request to end viewing of the video.

At this time, the distribution unit 495 ends the distribution of information related to the video in response to the request to end viewing, but does not end the distribution of information related to the audio.

When information about video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information about audio only is distributed, the video is not displayed on the user terminal, but a sub-screen indicating that a video is being viewed is displayed.

Figure 27 shows an image of the screen on which the above-mentioned sub-screen 90 is displayed.

When this sub-screen 90 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, the display returns to the recommendation tab, and if you move from the follow tab to the viewing frame, the display transitions to the follow tab.

When this sub-screen 90 is displayed, operations can be performed on the main screen, and transitions to other screens are possible. Therefore, when the first user has the sub-screen 90 displayed, it is not included in the second state described above, and is determined to be in the third state.

The sub-screen 90 displays a profile picture, name, title, and an audio icon that visually indicates that audio is being played.

Then, viewing can be completely ended by selecting the end icon 91 displayed on the sub-screen 90.

When the video display is to be terminated, the server device may transmit information but not display it on the terminal, or the server device may stop transmitting information altogether.

With this configuration, you can search for other broadcasts or chat with other users while listening to only the audio.

Next, we will explain "collaborations," where other users appear in a streaming user's videos.

As described above, the viewing user can send a request to participate in the above video by pressing the collaboration request button 83 shown in FIG. 24 and going through the collaboration distribution participation request confirmation screen that is displayed.

In response to the participation request received by the reception unit, the avatar display unit (not shown) displays in the video a character object that is generated based on the movement of the viewing user who made the participation request.

Figure 28 shows, as an example, a screen in which a second avatar A2, which is a character object of a guest user, is participating in a video in which a first avatar A1, which is a character object of a host user, is displayed. Note that in Figure 28, the display of objects other than the avatars is omitted.

Furthermore, as shown in FIG. 29, a third avatar A3, which is a character object generated based on the movement of another viewing user, may also participate in the video. Note that in FIG. 29, the third avatar A3 is placed behind the first avatar A1 and the second avatar A2, but the three may also be placed in a horizontal line. Also, the placement position of the avatar may be specified by the distribution user.

The above configuration can provide a technical improvement that solves or alleviates at least some of the problems with the conventional technology described above. Specifically, it can provide an information processing system that can increase distributors' motivation to distribute and/or increase viewers' motivation to watch.

Next, we will explain the information processing method in an embodiment of the present disclosure.

The information processing method according to the embodiment of the present disclosure is an information processing method in an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 includes a first information processing terminal 100, a second information processing terminal 200, and an information processing device 400 (server device 400).

As shown as an example in FIG. 30, the information processing method of the present disclosure causes one or more computer processors included in the information processing system to execute a reception step S11, a transmission step S17, a reception step S18, first determination steps S12 and S14, and decision steps S13, S15, and S16.

The reception step S11 receives a selection of a first object from the first information processing terminal. Such reception step S11 can be executed by the reception unit 410 described above.

The sending step S17 sends a predetermined notification to the second information processing terminal associated with the first object in accordance with the selection accepted in the accepting step S11. Such sending step S17 can be executed by the sending unit 420 described above.

The receiving step S18 receives a response to the predetermined notification from the second information processing terminal. Such receiving step S18 can be executed by the receiving unit 430 described above.

The first determination steps S12 and S14 determine the state of the first user associated with the first information processing terminal. Such first determination steps S12 and S14 can be executed by the first determination unit 440 described above.

The decision steps S13, S15, and S16 decide the second screen to be displayed on the second information processing terminal based on the result of the first judgment step. Such decision step S15 can be executed by the decision unit 450 described above.

Note that, although FIG. 30 shows an example in which the first judgment steps S12 and S14 and the decision steps S13, S15, and S16 are performed before the transmission step S17, they may also be performed after the reception step S18.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the computer program in an embodiment of the present disclosure.

The computer program in the embodiment of the present disclosure is a computer program executed in an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 includes a first information processing terminal 100, a second information processing terminal 200, and an information processing device 400 (server device 400).

The computer program disclosed herein is characterized in that it causes one or more processors included in an information processing system to realize a reception function, a transmission function, a reception function, a first determination function, and a decision function.

The reception function receives a selection of a first object from the first information processing terminal.

The sending function sends a predetermined notification to a second information processing terminal associated with the first object in response to the selection accepted by the accepting function.

The receiving function receives a response to a specified notification from the second information processing terminal.

The first determination function determines the state of a first user associated with a first information processing terminal.

The decision function decides the second screen to be displayed on the second information processing terminal based on the result of the first judgment function.

The above functions can be realized by the reception circuit 1410, transmission circuit 1420, reception circuit 1430, first judgment circuit 1440, and decision circuit 1450 shown in FIG. 31. The reception circuit 1410, transmission circuit 1420, reception circuit 1430, first judgment circuit 1440, and decision circuit 1450 are realized by the reception unit 410, transmission unit 420, reception unit 430, first judgment unit 440, and decision unit 450 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the first information processing terminal in an embodiment of the present disclosure.

The first information processing terminal 100 in the embodiment of the present disclosure constitutes an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 may further include a second information processing terminal 200 and an information processing device 400 (server device 400).

The first information processing terminal 100 includes a display processing unit 101, a reception unit 102, a first determination unit 103, and a transmission unit 104, as shown in FIG. 32(a).

The display processing unit 101 displays the first object on the screen.

The reception unit 102 receives the selection of the first object displayed by the display processing unit 101.

The first determination unit 103 determines the state of the first user associated with the first information processing terminal.

The transmission unit 104 transmits the selection accepted by the acceptance unit 102 and the result of the judgment made by the first judgment unit 103 to the server device.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the computer program for the broadcast user terminal in an embodiment of the present disclosure.

The computer program in this disclosure is a computer program executed on a first information processing terminal 100 constituting an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 may further include a second information processing terminal 200 and a server device 400 (server device 400).

The computer program then causes one or more computer processors included in the first information processing terminal 100 to realize a display processing function, a reception function, a first determination function, and a transmission function.

The display processing function displays the first object on the screen.

The reception function accepts the selection of the first object displayed by the display processing function.

The first determination function determines the state of a first user associated with a first information processing terminal.

The transmission function transmits the selection accepted by the reception function and the result determined by the first determination function to the server device.

The above functions can be realized by the display processing circuit 1101, the reception circuit 1102, the first determination circuit 1103, and the transmission circuit 1104 shown in FIG. 32(b). The display processing circuit 1101, the reception circuit 1102, the first determination circuit 1103, and the transmission circuit 1104 are realized by the display processing unit 101, the reception unit 102, the first determination unit 103, and the transmission unit 104 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the information processing method in the first information processing terminal in an embodiment of the present disclosure.

The information processing method in the present disclosure is an information processing method in a first information processing terminal 100 constituting an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system may further include a second information processing terminal 200 and a server device 400 (server device 400).

As shown as an example in FIG. 33, the information processing method of the present disclosure causes one or more computer processors included in a first information processing terminal 100 to execute a display processing step S21, a reception step S22, first determination steps S23 and S25, and transmission steps S24, S26, and S27.

The display processing step S21 displays the first object on the screen. The display processing step S21 can be executed by the display processing unit 101 described above.

The reception step S22 receives the selection of the first object displayed in the display processing step S21. The reception step S22 can be executed by the reception unit 102 described above.

The first determination steps S23 and S25 determine the state of the first user associated with the first information processing terminal. Such first determination steps S23 and S25 can be executed by the first determination unit 103 described above.

In the transmission steps S24, S26, and S27, the selection accepted in the reception step S22 and the result judged in the first judgment step are transmitted to the server device. Such transmission steps S24, S26, and S27 can be executed by the transmission unit 104 described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the second information processing terminal in an embodiment of the present disclosure.

The second information processing terminal 200 in the present disclosure constitutes an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 may further include a first information processing terminal 100 and an information processing device 400 (server device 400).

The second information processing terminal 200 includes a receiving unit 201, a transmitting unit 202, and a display processing unit 203, as shown in FIG. 34(a).

The receiving unit 201 receives a predetermined notification sent from the server device in response to the selection of a first object on the first information processing terminal 100.

The transmitting unit 202 transmits a response to the specified notification received by the receiving unit 201 to the server device.

The display processing unit 203 displays the second screen based on the information about the second screen received from the server device.

The second screen is determined based on the state of the first user of the first information processing terminal 100.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the computer program for the second information processing terminal in an embodiment of the present disclosure.

The computer program in this disclosure is a computer program executed on a second information processing terminal 200 constituting an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 may further include a first information processing terminal 100 and an information processing device 400 (server device 400).

The computer program then causes one or more computer processors provided in the second information processing terminal 200 to realize a receiving function, a transmitting function, and a display processing function.

The receiving function receives a predetermined notification sent from the server device in response to the selection of a first object on the first information processing terminal 100.

The sending function sends a response to the specified notification received by the receiving function to the server device.

The display processing function displays the second screen based on information about the second screen received from the server device.

The second screen is determined based on the state of the first user of the first information processing terminal.

The above functions can be realized by the receiving circuit 1201, the transmitting circuit 1202, and the display processing circuit 1203 shown in FIG. 34(b). The receiving circuit 1201, the transmitting circuit 1202, and the display processing circuit 1203 are realized by the receiving unit 201, the transmitting unit 202, and the display processing unit 203 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the information processing method in the second information processing terminal 200 in an embodiment of the present disclosure.

The information processing method in the present disclosure is an information processing method in a second information processing terminal 200 constituting an information processing system 3000 that distributes videos, as shown in FIG. 3. The information processing system 3000 may further include a first information processing terminal 100 and an information processing device 400 (server device 400).

As shown in FIG. 35, the information processing method disclosed herein causes one or more computer processors included in the second information processing terminal to perform a receiving step S31, a transmitting step S32, and a display processing step S33.

The receiving step S31 receives a predetermined notification sent from the server device in response to the selection of a first object on the first information processing terminal.

The sending step S32 sends a response to the specified notification received in the receiving step to the server device.

The display processing step S33 displays the second screen based on the information about the second screen received from the server device.

The second screen is determined based on the state of the first user of the first information processing terminal.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-mentioned embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in a memory unit of the information processing device, and reading and executing the program by the CPU of the information processing device.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

The method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, etc.), semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium also includes a setting program that configures the software means (including not only execution programs but also tables and data structures) that the calculator executes. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, configures the software means using the setting program, and executes the above-mentioned processing by controlling the operation of this software means. Note that the recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes a storage medium such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as a main storage device, an auxiliary storage device, or a cache memory, for example.

The term "gift" used in this application has the same concept as the term "token." Therefore, it is possible to understand the technology described in this application by replacing the term "gift" with the term "token."

In addition, all items sent and received in the information processing system of this disclosure, such as the above-mentioned "gifts" and "comments," are electronic "data."

The Summary section above is provided to introduce in a simplified form selected concepts that are described below in the Detailed Description section. All trademarks used herein are the property of their respective owners. The statements in this Summary section are not intended to identify key features or essential features of the claimed inventions, nor are they intended to limit the scope of the claimed inventions. The above and other objects, features, and advantages of the claimed inventions will become more apparent from the Detailed Description section, which is presented with reference to the accompanying drawings.

The communication lines for implementing the above-mentioned network may include, but are not limited to, a cellular network, a wireless network (e.g., Bluetooth, WiFi (such as IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, RF connection), a landline network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and/or an Ethernet network.

The memory mentioned above may include, but is not limited to, computer readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid state drive (SSD), magnetic tape, optical media). As will be readily understood, the term "computer readable recording medium" may include media for data storage such as memory and storage, as well as transmission media such as modulated data signals or transitory signals.

This specification is described in terms of representative embodiments that are not intended to be limiting in any manner. As used in this application, the singular forms "a," "the," "said," "above," "the," "the," "this," and "it" can include the plural, unless the plural is clearly not indicated. Also, the term "comprises" can mean "comprises" or "has." Furthermore, the terms "coupled," "coupled," "connected," "connected," and "connected" encompass mechanical, electrical, magnetic, and optical methods of coupling, connecting, or joining objects together, as well as other methods, and do not exclude the presence of intermediate elements between objects so coupled, coupled, connected, connected, or joined.

The various systems, methods, and devices described herein should not be construed as being limited in any manner. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to specific aspects, specific features, or combinations of such specific aspects with specific features, nor do the products and methods described herein require that one or more specific advantages be present or problems be solved. Moreover, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.

Although the operations of some of the various methods disclosed herein have been described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations, unless a particular order is required by specific text below. For example, operations described in a sequence may in some cases be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings do not show various ways in which the various items and methods described herein may be used with other items and methods. In addition, this specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "deliver." These terms are high-level descriptions of various actual operations that may be performed. The actual operations that correspond to these terms may vary depending on the particular implementation and may be readily recognized by one of ordinary skill in the art having the benefit of the disclosure herein.

Any theory of operation, scientific principles, or other theoretical descriptions presented herein relating to the devices or methods of the present disclosure are provided for purposes of better understanding and are not intended to limit the scope of the technology. The devices and methods of the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.

Any of the various methods disclosed herein may be implemented and executed on a computer using computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media, such as one or more optical media disks, volatile memory components, or non-volatile memory components). Here, the volatile memory components may include, for example, DRAM or SRAM. Also, the non-volatile memory components may include, for example, hard drives and solid-state drives (SSDs). Furthermore, the computer may include any computer available on the market, including, for example, smartphones and other mobile devices having hardware to perform computations.

Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated and used during the implementation of the various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may be, for example, part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may be executed, for example, on a single local computer (e.g., as an agent executing on any suitable computer available on the market) or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.

For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.

Moreover, any of the various such software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or accessed in a remote manner by any suitable communication means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF, microwave, and infrared communication), electronic communication, or other such communication means.
[Additional Notes]
The inventions described in the claims of the original application immediately prior to division are set forth below.
[1]
An information processing system for distributing video, comprising one or more computer processors,
the one or more computer processors:
a reception unit that receives a selection of a first object from the first information processing terminal;
a transmission unit that transmits a predetermined notification to a second information processing terminal associated with the first object in response to the selection received by the reception unit;
a receiving unit that receives a response to the predetermined notification from the second information processing terminal;
a first determination unit that determines a state of a first user associated with the first information processing terminal;
a determination unit that determines a second screen to be displayed on the second information processing terminal based on a result of the first determination unit.
[2]
The first determination unit determines whether a state of a first user related to the first information processing terminal is
The first state, which is appearing in the video,
A second state in which a video is being watched on the main screen;
2. The information processing system according to claim 1, further comprising a step of determining whether the user is in a third state, ie, neither appearing in a video nor viewing a video on the main screen.
[3]
When the first determination unit determines that the state of the first user is the first state,
The information processing system according to claim 2, characterized in that the determination unit sets the second screen to be displayed on the second information processing terminal as a screen for watching a video in which the first user is appearing.
[4]
When the first determination unit determines that the state of the first user is the second state,
The information processing system according to claim 2 or 3, characterized in that the determination unit sets the second screen to be displayed on the second information processing terminal as a screen for viewing the video that the first user is currently watching.
[5]
When the first determination unit determines that the state of the first user is the third state,
5. The information processing system according to claim 2, wherein the determination unit determines that the second screen to be displayed on the second information processing terminal is a message exchange screen with the first user.
[6]
The one or more computer processors further include:
a display processing unit for displaying the first object,
An information processing system according to any one of claims 1 to 5, characterized in that the display processing unit displays the first object within an online notification indicating that a second user related to the second information processing terminal has become online.
[7]
The one or more computer processors further include:
a display processing unit for displaying the first object,
An information processing system according to any one of claims 1 to 5, characterized in that the display processing unit displays the first object within a list screen of one or more second users who have a specific relationship with the first user.
[8]
The information processing system according to claim 1 , wherein the first determination unit determines a state of the first user at a time when the reception unit receives the selection.
[9]
The information processing system according to claim 1 , wherein the first determination unit determines a state of the first user at a timing when the receiving unit receives the response.
[10]
The one or more computer processors further include:
8. The information processing system according to claim 7, further comprising a second determination unit that determines a state of one or more second users having a specific relationship with the first user.
[11]
The second determination unit determines whether the state of the second user is
The fourth state, which is featured in the video,
The fifth state is when you are watching a video.
11. The information processing system according to claim 10, further comprising a sixth state, which is determined to be either a state in which the user is neither appearing in a video nor a state in which the user is neither viewing a video.
[12]
The sixth state further comprises:
A seventh state where you are online but not appearing in or watching a video;
an eighth state of being offline;
12. The information processing system according to claim 11, further comprising:
[13]
The information processing system according to claim 11 or 12, characterized in that the display processing unit displays the first object in association with only a second user who is determined to be in the fifth state by the second determination unit.
[14]
the second determination unit, when the state of the second user related to the second information processing terminal is the sixth state, further determines whether the state of the second user is the seventh state or the eighth state;
13. The information processing system according to claim 12, wherein the transmission unit changes the type of the predetermined notification depending on whether the second user's status is the seventh status or the eighth status.
[15]
The display processing unit is
An information processing system as described in any one of claims 10 to 14, characterized in that the list screen displays the status of one or more second users having a specific relationship with the first user in an identifiable manner along with an image and/or name indicating the profile of the second users.
[16]
An information processing system according to any one of claims 1 to 15, characterized in that the specified notification displays the number of times the first object has been selected by operation of the first information processing terminal in a manner that allows the number of times the first object has been selected to be confirmed.
[17]
An information processing method in an information processing system that distributes moving images, comprising:
The one or more computer processors of the information processing system include
a receiving step of receiving a selection of a first object from the first information processing terminal;
a sending step of sending a predetermined notification to a second information processing terminal associated with the first object in response to the selection accepted in the accepting step;
a receiving step of receiving a response to the predetermined notification from the second information processing terminal;
a first determination step of determining a state of a first user associated with the first information processing terminal;
and a determination step of determining a second screen to be displayed on the second information processing terminal based on a result of the first determination step.
[18]
An information processing method in a first information processing terminal constituting an information processing system for distributing moving images, comprising:
the information processing system includes the first information processing terminal, the second information processing terminal, and a server device;
The one or more computer processors of the first information processing terminal
a display processing step of displaying the first object on a screen;
a receiving step of receiving a selection of the first object displayed in the display processing step;
a first determination step of determining a state of a first user associated with the first information processing terminal;
a transmitting step of transmitting the selection accepted in the accepting step and the result determined in the first determining step to the server device.
[19]
A computer program for a first information processing terminal constituting an information processing system for distributing video, comprising:
the information processing system includes the first information processing terminal, the second information processing terminal, and a server device;
The one or more computer processors of the first information processing terminal
a display processing function for displaying the first object on a screen;
a reception function for receiving a selection of the first object displayed by the display processing function;
a first determination function for determining a state of a first user associated with the first information processing terminal;
a transmission function of transmitting to the server device the selection accepted by the acceptance function and the result determined by the first determination function.
[20]
An information processing method in a second information processing terminal constituting an information processing system for distributing moving images, comprising:
the information processing system includes a first information processing terminal, the second information processing terminal, and a server device;
The one or more computer processors of the second information processing terminal
a receiving step of receiving a predetermined notification transmitted from the server device in response to a selection of a first object in the first information processing terminal;
a sending step of sending a response to the predetermined notification received in the receiving step to the server device;
a display processing step of displaying the second screen based on information regarding the second screen received from the server device;
The information processing method, wherein the second screen is determined based on a state of a first user associated with the first information processing terminal.
[21]
A computer program for a second information processing terminal constituting an information processing system for distributing video, comprising:
the information processing system includes a first information processing terminal, the second information processing terminal, and a server device;
The one or more computer processors of the second information processing terminal
a receiving function for receiving a predetermined notification transmitted from the server device in response to selection of a first object in the first information processing terminal;
a transmission function for transmitting a response to the predetermined notification received by the reception function to the server device;
a display processing function of displaying the second screen based on information regarding the second screen received from the server device;
A computer program in which the second screen is determined based on a state of a first user associated with the first information processing terminal.

REFERENCE SIGNS LIST 1000 Information processing system 2000 Information processing system 3000 Information processing system 100 First information processing terminal 200 Second information processing terminal 300 Network 400 Information processing device 410 Accepting unit 420 Transmitting unit 430 Receiving unit 440 First determining unit 450 Determining unit 460 Display processing unit 465 Second determining unit 470 Second transmitting unit 475 Identifying unit 485 Third determining unit

Claims (12)

An information processing system including one or more computer processors,
the one or more computer processors;
a determining function for determining a status of one or more second users associated with the first user;
a display processing function for displaying information of the second user in a different display mode on a display unit of a first user terminal of the first user based on the state of the second user determined by the determination function;
The display processing function at least changes the display mode depending on whether the second user is currently appearing in a video or not ,
An information processing system in which the video can be viewed by users other than the first user and/or users associated with the second user . The information processing system according to claim 1, characterized in that the display processing function changes the display mode at least when the second user is in a state of appearing in the video, when the second user is in a state of watching the video, and when the second user is in a state of neither appearing in nor watching the video. The display processing function further includes:
The information processing system described in claim 1, characterized in that when the second user's status is that of appearing in the video, an image for viewing the video, which is a thumbnail image of the video, is displayed on the display unit of the first user terminal. The information processing system according to claim 1, characterized in that the information of the second user includes an image showing the profile of the second user. The information processing system according to claim 1, characterized in that the display processing function, when the second user is not currently appearing in the video, causes the display unit of the first user terminal to display, in addition to the information about the second user, a first object for sending a predetermined notification to the second user terminal of the second user. The information processing system according to claim 1, characterized in that the display processing function does not display a first object for sending a predetermined notification to the second user terminal of the second user on the display unit of the first user terminal when the second user is currently appearing in the video. The one or more computer processors further include:
a reception function for receiving a selection of the first object from the first user terminal;
The information processing system according to claim 5 , further realizing a transmission function of transmitting a predetermined notification to a second user terminal associated with the first object in response to the selection received by the reception function. The one or more computer processors further include:
The information processing system according to claim 7 , further comprising a receiving function for receiving a response to the predetermined notification from the second user terminal. The determination function, when the state of the second user related to the second user terminal is not a state of appearing in the video, further determines whether the state of the second user is a state of not appearing in the video or not watching the video but is online, or a state of offline;
8. The information processing system according to claim 7, wherein the sending function changes the type of the predetermined notification depending on whether the second user is in the online state or the offline state. An information processing method in an information processing system, comprising:
The one or more computer processors of the information processing system include
determining a status of one or more second users associated with the first user;
a display processing step of displaying information of the second user in a different display mode on a display unit of a first user terminal of the first user based on the state of the second user determined in the determination step;
In the display processing step, the display mode is made different at least between a state in which the second user is appearing in a video and a state in which the second user is not appearing in a video ;
An information processing method in which the video is viewable by users other than the first user and/or users associated with the second user . An information processing method in a first user terminal constituting an information processing system, comprising:
One or more computer processors included in the first user terminal,
executing a display processing step of displaying information of the second user in a different display mode on a display unit of a first user terminal of the first user based on a state of one or more second users associated with the first user;
In the display processing step, the display mode is made different at least between a state in which the second user is appearing in a video and a state in which the second user is not appearing in a video ;
An information processing method in which the video is viewable by users other than the first user and/or users associated with the second user . A computer program for a first user terminal constituting an information processing system,
One or more computer processors included in the first user terminal,
A display processing function is realized that changes the display mode of information of the second user on a display unit of a first user terminal of the first user based on a state of one or more second users associated with the first user;
The display processing function at least changes the display mode depending on whether the second user is currently appearing in a video or not ,
A computer program in which the video is viewable by users other than the first user and/or users associated with the second user .

Images