JP7776340B2 - Information processing device, distribution control method, computer program, and storage medium - Google Patents

Description

The present invention relates to an information processing device, a distribution control method, a computer program, and a storage medium.

Content distribution services are known that distribute video footage or audio captured by terminal devices such as smartphones to viewers via a network. As network performance and capacity have improved and terminal devices have become more sophisticated, it has become easier in recent years for content distributors to distribute content live without using large-scale distribution facilities.

Patent Document 1 discloses an example of a video distribution server that mediates live video distribution between user terminals. In addition to the function of distributing video from the distributor's terminal to the viewer's terminal, the video distribution server in Patent Document 1 also provides a two-way interaction function that allows text comments entered on one terminal to be displayed on the other terminal.

Japanese Patent Application Laid-Open No. 2019-22219

When live streaming content, streamers must be mindful of the impact on the surrounding environment (e.g., noise and loss of privacy) and the impact of the surrounding environment (e.g., noise interference). For example, streamers living in apartment buildings will find it difficult to freely stream content without the consent and cooperation of their housemates.

The present invention aims to provide more content distributors with the opportunity to freely distribute content by utilizing vehicles such as passenger cars, which have excellent soundproofing and privacy features, as a content distribution environment.

According to the present invention,
An information processing device mounted on a vehicle,
a content acquisition means for acquiring live-streamed content including at least one of video and audio of a content distributor who is a passenger;
a transmitting means for transmitting the content acquired by the content acquiring means to a network for distribution to one or more participant terminal devices;
receiving means for receiving feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
a control means for controlling presentation of the feedback received by the receiving means to the content distributor;
Equipped with
the feedback received by the receiving means includes a first feedback that can be read aloud;
the control means causes the voice output means to output a voice reading out the first feedback when the vehicle is moving;
An information processing device is provided.

This invention makes it possible to provide more distributors with the opportunity to freely distribute content using vehicles.

1 is a schematic diagram showing an example of the configuration of a content distribution system according to an embodiment. FIG. 1 is a block diagram showing an example of the physical configuration of a vehicle and an in-vehicle system according to an embodiment. FIG. 1 is a block diagram showing an example of a functional configuration of an in-vehicle system according to an embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of a distribution server according to an embodiment. FIG. 10 is an explanatory diagram showing an example of the configuration of a content viewing screen that can be displayed to participants. FIG. 10 is an explanatory diagram showing an example of the configuration of a content distribution screen that can be displayed to a distributor while the distributor is not moving. FIG. 10 is an explanatory diagram showing an example of the configuration of a content distribution screen that can be displayed to a distributor while on the move. FIG. 1 is a sequence diagram showing an example of a schematic processing flow in a content distribution system according to an embodiment. 10 is a flowchart showing a first embodiment of the flow of a content distribution process that can be executed by an in-vehicle system. 10 is a flowchart showing an example of the flow of a feedback presentation process while not moving. 10 is a flowchart showing an example of the flow of a feedback presentation process during movement. 10 is a flowchart showing a second embodiment of the flow of a content distribution process that can be executed by an in-vehicle system.

The following embodiments are described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the claimed invention, and not all combinations of features described in the embodiments are necessarily essential to the invention. Two or more of the features described in the embodiments may be combined in any desired manner. Furthermore, identical or similar components are designated by the same reference numerals, and redundant descriptions will be omitted.

<1. System Overview>
First, an overview of a system to which the present invention can be applied will be described using Figures 1 and 2. Figure 1 is a schematic diagram showing an example of the configuration of a content distribution system 1 according to an embodiment. The content distribution system 1 is a platform that enables live content distribution from content distributors who are vehicle occupants to participants who watch, browse, or listen to the content. Referring to Figure 1, the content distribution system 1 includes a distribution server 3, one or more participant terminals 5, and an in-vehicle system 10.

The distribution server 3, each participant terminal 5, and the in-vehicle system 10 are interconnected via a network 2. The network 2 may be any combination of a wireless network and a wired network. The wireless network may be configured according to any type of wireless communication protocol, such as a cellular communication network (e.g., 5G NR (New Radio) or LTE (Long Term Evolution)) or a wireless LAN (Local Area Network).

The distribution server 3 is a server device that manages the distribution of content from the in-vehicle system 10 to each participant terminal 5. The distribution server 3 may be implemented, for example, as an application server, web server, or cloud server using a high-performance general-purpose computer. The distribution server 3 includes, for example, a communication interface for communicating with other devices via the network 2, memory and storage devices for storing one or more computer programs, and a processor that manages content distribution by executing computer programs. The functions of the distribution server 3 will be described in detail below.

The participant terminal 5 is a terminal device used by participants in content distribution. The participant terminal 5 may be any type of terminal device, such as a smartphone, a PC (Personal Computer), or a PDA (Personal Digital Assistant). The participant terminal 5 may be portable or stationary. The participant terminal 5 typically includes an input device for accepting user input, a communication interface for communicating with other devices via the network 2, a display for displaying images and information, and a speaker for outputting audio. As will be explained further below, the participant terminal 5 receives content distributed from the in-vehicle system 10 via the network 2, displays the video of the received content on the display, and outputs audio from the speaker. The participant terminal 5 also accepts feedback (FB) from participants to the content distributor via the input device and returns the received feedback to the network 2. Several types of feedback that can be returned from the participant terminal 5 will be explained in detail later.

In this embodiment, vehicle V provides a content distribution environment to a content distributor. The content distributor is an occupant of vehicle V, such as the driver. In-vehicle system 10 is a subsystem (or information processing device) for content distribution that is installed in vehicle V.

Figure 2 is a block diagram showing an example of the physical configuration of vehicle V and in-vehicle system 10. Here, as an example, vehicle V is assumed to be a four-wheeled sedan-type passenger car. Referring to Figure 2, in-vehicle system 10 includes a processing circuit 11 having one or more processors 12 and one or more memories 13. Processing circuit 11 is connected to an input device 14, a microphone 15, a display 16, a communication interface (I/F) 17, and a storage device 18 via interfaces (not shown). Processing circuit 11 is also connected to one or more control units 20 via a connection I/F 19.

The processor 12 may be, for example, a CPU, and controls the overall functions of the in-vehicle system 10. The memory 13 may include volatile and non-volatile storage media, such as RAM, ROM, and flash memory, and stores computer programs executed by the processor 12 and related data. The input device 14 may include, for example, one or more of a touch panel, button, switch, and keypad, and detects user operations and outputs operation signals to the processing circuit 11. The microphone 15 detects sound inside the vehicle V and outputs input audio signals to the processing circuit 11. The display 16 displays images and information output from the processing circuit 11 on a screen. The communication I/F 17 is an interface for communication between the in-vehicle system 10 and other devices via the network 2. The storage device 18 is a device with a large storage capacity, such as a hard disk drive. The connection I/F 19 is an interface that mediates the connection between the processing circuit 11 and the control unit 20. Note that the in-vehicle system 10 may include additional components other than those shown in FIG. 2, such as a positioning module (e.g., a GPS module). Also, some of the components shown may be omitted from the configuration of the in-vehicle system 10.

The in-vehicle system 10 may be fixedly installed in the vehicle V. Alternatively, the in-vehicle system 10 may be configured by attaching a detachable device to the vehicle V. For example, the in-vehicle system 10 may be configured by connecting a terminal device such as a smartphone or navigation device to the connection I/F 19.

Vehicle V further includes one or more control units 20, a drive source 21, a braking device 22, a power steering device 23, an inertia sensor 25, a wheel speed sensor 26, an accelerator pedal sensor 27, a brake pedal sensor 28, a camera 30, a speaker 32, a meter panel 33, and an exterior microphone 35.

The control unit 20 controls the driving and other functions of the vehicle V. The drive source 21 includes, for example, an internal combustion engine and an automatic transmission. The control unit 20 can control the speed of the vehicle V by changing the output of the drive source 21. The brake device 22 includes, for example, a disc brake. The control unit 20 can operate the brake device 22 to stop or decelerate the vehicle V. The power steering 23 is a mechanism that steers the front wheels in response to the driver's operation of the steering wheel (steering operation). The control unit 20 can control the steering of the vehicle V through the power steering 23 and can calculate the steering amount based on the sensor output from the steering angle sensor of the power steering 23.

The inertial sensor 25 includes, for example, an acceleration sensor and a yaw rate sensor. The control unit 20 can calculate the attitude of the vehicle V based on the sensor signal from the inertial sensor 25. The wheel speed sensor 26 detects the rotational speed of the tires of the vehicle V. The control unit 20 can calculate the speed of the vehicle V based on the sensor signal from the wheel speed sensor 26. The accelerator pedal sensor 27 detects the driver's depression of the accelerator pedal. The control unit 20 controls the output of the drive source 21 based on the sensor signal from the accelerator pedal sensor 27. The brake pedal sensor 28 detects the driver's depression of the brake pedal. The control unit 20 controls the operation of the brake device 22 based on the sensor signal from the brake pedal sensor 28.

Vehicle V may also include additional sensors other than the group of sensors illustrated in FIG. 2. For example, vehicle V may include sensors for detecting abnormalities occurring in vehicle V (e.g., unit malfunction, sudden acceleration, sudden stopping, or collision). Control unit 20 may use these sensors to continuously monitor the state of vehicle V (e.g., driving state and presence or absence of abnormalities) and output status information representing the state of vehicle V to processing circuit 11.

The camera 30 is a device capable of capturing video with a field of view that primarily includes the occupants of the vehicle V. Video data of the video captured by the camera 30 can be output to the processing circuit 11 via the connection I/F 19. While FIG. 2 shows only one camera 30 as a capturing device, the vehicle V may have multiple cameras facing different fields of view. The camera 30 may also be an omnidirectional camera with a 360-degree field of view. The speaker 32 is a device capable of outputting sound (e.g., a warning sound or sound effect) or voice. The meter panel 33 has a screen that can display the speed of the vehicle V and other information calculated by the control unit 20. While driving the vehicle V, the driver primarily focuses their attention on the display on the meter panel 33, as well as the traffic conditions around the vehicle V. The exterior microphone 35 is a device attached to the outside of the vehicle body of the vehicle V and capable of capturing noise generated while the vehicle V is traveling. Noise here may include, for example, one or more of tire friction noise, exhaust noise, operating noise of the drive source 21, and environmental noise from the outside vehicle environment. Audio data of noise acquired by the exterior microphone 35 can be output to the processing circuit 11 via the connection I/F 19.

<2. Functional configuration of the in-vehicle system>
Fig. 3 is a block diagram showing an example of the functional configuration of the in-vehicle system 10. Referring to Fig. 3, the in-vehicle system 10 includes a content acquisition unit 110, a content transmission unit 120, a feedback reception unit 130, a setting unit 140, a distribution control unit 150, a status monitoring unit 160, and a log storage unit 170.

The content acquisition unit 110 is a content acquisition means that acquires target content that is distributed live from the vehicle V. In this embodiment, the content to be distributed includes at least one of video and audio from the content distributor. The content acquisition unit 110 acquires, for example, video data of video captured by the camera 30 and audio data of audio acquired by the microphone 15. The content acquisition unit 110 compresses and encodes the acquired video data and audio data using the respective codecs and outputs the encoded video data and audio data to the content transmission unit 120 as content data. In one embodiment, the content acquisition unit 110 may also acquire audio data of noise sound (hereinafter referred to as noise sound data) acquired by the exterior microphone 35. In this case, the content acquisition unit 110 compresses and encodes the noise sound data and outputs the encoded noise sound data to the content transmission unit 120 as additional content data.

The content sending unit 120 is a sending means that sends content data to the network 2 for distribution to the participant terminals 5. The content sending unit 120 generates a series of communication packets by shaping and multiplexing the content data input from the content acquisition unit 110 in a format suitable for communication, and sequentially sends the generated communication packets to the network 2. Typically, content data is sent in the form of live streaming. Distribution setting information such as the streaming destination address, port number, and encryption method is notified from the distribution server 3.

The feedback receiving unit 130 is a receiving means for receiving feedback from one or more participants to the content distributor, the feedback being related to the distributed content. In this embodiment, the feedback receiving unit 130 can receive two types of feedback.

The first type of feedback is a comment from a participant. Typically, the comment includes text entered by the participant into the participant terminal 5. The comment can be displayed on the screen and can be read aloud. When the feedback receiving unit 130 receives a comment as feedback, it outputs comment information indicating the name of the comment sender and the text of the comment to the distribution control unit 150.

The second type of feedback is a participant's expression of willingness to pay compensation for the distribution of content. For example, when a participant feels that the distributed content is meaningful or wishes to financially support the distributor's activities, they decide to pay compensation for the distribution of content and express their intention by performing a specified operation on the participant terminal 5. The compensation may be paid using any known method, and detailed explanations will be omitted here. The compensation does not necessarily have monetary value like currency (for example, the compensation may simply be a number indicating a positive evaluation, the accumulated value of which serves as an indicator of the distributor's reputation). In the following explanation, the participant's expression of willingness to pay compensation will be referred to as a "tip" for convenience. When a tip is received as feedback, the feedback receiving unit 130 outputs tip information indicating the name of the tip sender and the amount of the tip to the distribution control unit 150.

The setting unit 140 accepts settings (hereinafter referred to as user settings) that can be specified by the distributor regarding content distribution via the input device 14, and outputs the accepted settings to the distribution control unit 150. For example, the user settings that can be specified by the distributor may include one or more of the following setting items:
Name of the broadcast session Start and end times of the broadcast session Camera selection (if multiple cameras are available in vehicle V)
・Speaker volume ・Enable/disable noise distribution ・Whether to read out comments when not moving ・Whether to notify tips when not moving

The distribution control unit 150 is a control means that controls the distribution of content from the in-vehicle system 10. For example, the distribution control unit 150 transmits a session registration request to the distribution server 3, including the name, start time, and end time of the distribution session specified by the distributor. Furthermore, upon receiving distribution setting information for streaming distribution from the distribution server 3, the distribution control unit 150 sets the streaming operation of the content transmission unit 120 in accordance with the distribution setting information. Furthermore, the distribution control unit 150 activates input/output devices (e.g., a camera, microphone, and speaker) of the vehicle V in accordance with the user settings accepted by the setting unit 140. As a result, content data including at least one of video and audio from the content distributor is sent from the content transmission unit 120 to the network 2 while the distribution session is ongoing.

In one embodiment, the distribution control unit 150 may determine whether noise sound should be transmitted from the content transmission unit 120 in accordance with user settings. In this embodiment, if the distributor enables the transmission of noise sound, the distribution control unit 150 determines that noise sound should be transmitted, and the noise sound is transmitted along with the content. On the other hand, if the distributor disables the transmission of noise sound, the distribution control unit 150 determines that noise sound should not be transmitted, and the content is transmitted without noise sound.

The distribution control unit 150 also displays the same video as the content video sent to the network 2 on the screen of the display 16, which is a display means. When the vehicle V is not moving, the distributor can check what video is being distributed to participants by looking at this screen.

Furthermore, the distribution control unit 150 controls the presentation of feedback received by the feedback receiving unit 130 to the content distributor based on the state of the vehicle V indicated by the status information input from the control unit 20. For example, if the status information indicates that the driver is not driving the vehicle V (i.e., the vehicle V is not moving), the distribution control unit 150 displays a comment (first feedback) on the screen. The comments may be displayed, for example, in chronological order in the order in which they were received. On the other hand, if the status information indicates that the driver is driving the vehicle V (i.e., the vehicle V is moving), the distribution control unit 150 outputs a voice reading out the comment from the speaker 32, which is an audio output means. This allows the distributor, who is the driver or other occupant, to understand the message of the comment while the vehicle V is moving without looking at the screen. In this case, the distribution control unit 150 does not display the comment on the screen. This prevents the risk of the driver being distracted by the display of the comment and losing attention. If the status information indicates that the vehicle V is not moving, the distribution control unit 150 may not cause the speaker 32 to output audio reading out the comment. Alternatively, the distribution control unit 150 may determine whether or not to read out the comment when the vehicle V is not moving, in accordance with the user settings received by the setting unit 140.

Furthermore, for example, if the status information indicates that the vehicle V is not moving, the distribution control unit 150 displays an object representing a tip (second feedback) on the screen. On the other hand, if the status information indicates that the vehicle V is moving, the distribution control unit 150 causes the meter panel 33 or a light-emitting device (e.g., an LED) provided near the meter panel 33 to emit light indicating the receipt of a tip, or causes the speaker 32 to output a sound effect indicating the receipt of a tip. This allows the distributor, who is the driver or other passenger, to understand that the tip has been received while the vehicle V is moving without looking at the screen. In this case, the distribution control unit 150 does not display an object representing a tip on the screen. This can prevent the risk of the driver being distracted by the notification of the receipt of a tip and losing attention. If the status information indicates that the vehicle V is not moving, the distribution control unit 150 may not output light or sound effects indicating the receipt of a tip. Alternatively, the distribution control unit 150 may determine whether or not to notify the user of receipt of a tip with light or sound effects (in addition to the screen display) when the vehicle V is not moving, in accordance with the user settings received by the setting unit 140.

The status monitoring unit 160 is a status monitoring means that monitors the status of the vehicle V while content is being distributed by the content transmission unit 120, based on status information input from the control unit 20. In this embodiment, the status monitoring unit 160 chronologically stores the status of the vehicle V indicated by the status information in log data 172 of the log storage unit 170. If an abnormality is detected in the vehicle V, the log data 172 stores information related to the abnormality in association with the time the abnormality was detected. The log storage unit 170 may correspond to a specified storage area of the storage device 18.

As an example, the information related to the anomaly stored in log data 172 may include at least one of the content distribution status and feedback presentation status when the anomaly was detected. The content distribution status may indicate, for example, the name of the distribution session and the type of content data being distributed. The feedback presentation status may indicate, for example, when each piece of feedback was received and via which device it was presented to the distributor. Log data 172 recording such information can be read out to an external device afterwards and used for purposes such as analyzing the relationship between content distribution activities and anomalies or providing advice to the distributor.

<3. Functional configuration of distribution server>
4 is a block diagram showing an example of the functional configuration of the distribution server 3. Referring to FIG. 4, the distribution server 3 includes a distribution management DB 210, a distribution control unit 220, and a feedback control unit 230.

The distribution management DB 210 is a database that stores data for managing content distribution. In this embodiment, the distribution management DB 210 includes a distributor table 211, a participant table 212, and a session table 213.

The distributor table 211 is a table that stores data related to one or more distributors who distribute content using the content distribution system 1. The distributor table 211 has, for example, one or more of the following data items:
・Distributor ID
・Name ・Authentication information ・Distribution configuration information ・Registered user list ・Earned chip information

The "broadcaster ID" is an identifier that uniquely identifies each broadcaster. The "name" represents the name (e.g., first name or nickname) of each broadcaster used for screen display. The "authentication information" is information used together with the broadcaster ID for login authentication when each broadcaster logs in to the system. For example, the "authentication information" may include one or more of a password, data for biometric authentication (such as fingerprint data or iris data), and an address for two-step authentication. The "broadcast configuration information" is information related to the system configuration of the in-vehicle system 10 used by each broadcaster for content distribution. For example, the "broadcast configuration information" may include the communication address of the in-vehicle system 10, the type of content data that can be distributed, and supported protocols. The "registered user list" is a list of identifiers of participants registered as users interested in content distribution from each broadcaster. The "earned tip information" is information related to the tips earned by each broadcaster. For example, the "earned tip information" may include the total amount of tips earned and detailed data.

The participant table 212 is a table that stores data related to one or more participants registered in the content distribution system 1. The participant table 212 has, for example, one or more of the following data items:
・Participant ID
・Name ・Authentication information ・Registered broadcaster list ・Payment tip information

"Participant ID" is an identifier for uniquely identifying each participant. "Name" represents the name of each participant (e.g., first name or nickname) used for screen display. "Authentication information" is information used together with the participant ID for login authentication when each participant logs in to the system. For example, "Authentication information" may include one or more of a password, data for biometric authentication, and an address for two-step authentication. "Registered broadcaster list" is a list of identifiers of broadcasters that each participant has registered as being of interest to. "Payment tip information" is information related to tips paid by each participant. For example, "Payment tip information" may include the total amount of tips paid and detail data.

The session table 213 is a table that stores data related to content distribution sessions that are performed under the management of the content distribution system 1. The session table 213 has, for example, one or more of the following data items:
・Session ID
・Distributor ・Session name ・Start time ・End time ・Participant list ・Session setting information

The "session ID" is an identifier that uniquely identifies each distribution session. The "distributor" identifies the distributor who distributes content in each distribution session by the "distributor ID" in the distributor table. The "session name," "start time," and "end time" represent the name, start time, and end time specified by the distributor for each distribution session. The "participant list" is a list of identifiers of one or more participants who wish to receive content for each distribution session and whose wishes have been approved. The "session setting information" is the setting information that should be set for streaming distribution of content data for each distribution session. The "session setting information" may include distribution setting information that should be set in the in-vehicle system 10 (e.g., destination address, port number, encryption method, etc.) and reception setting information that should be set in the participant terminal 5 (e.g., URL to be accessed, etc.).

The distribution control unit 220 is a control means for controlling live content distribution in the content distribution system 1. The distribution control unit 220, for example, accepts a session registration request from a distributor and registers session-related information included in the accepted request, such as the session name, start time, and end time, in the session table 213 of the distribution management DB 210. The distribution control unit 220 also determines the necessary setting information for each distribution session, registers it in the session table 213, and transmits the distribution setting information to the communication address of the distributor.

In addition, the distribution control unit 220 provides the participant terminal 5 with a list of sessions that are scheduled to be distributed or are in progress in response to a session list request received from the participant terminal 5. When the distribution control unit 220 receives a participation request from a participant terminal 5 requesting content distribution for a specific distribution session, it transmits the reception setting information required to receive the content data of that distribution session to the participant terminal 5. When the distribution control unit 220 receives a participation request from a participant terminal 5, it may inquire of the distributor whether to allow the participant to participate, and transmit the reception setting information to the participant terminal 5 of that participant only if the distributor allows the participant to participate.

The distributor's in-vehicle system 10 is properly configured in accordance with the distribution setting information, and when the start time of the distribution session arrives, streaming of content data from the in-vehicle system 10 begins. As one example, the content data may be transmitted from the in-vehicle system 10 to a streaming server (not shown) and then streamed from the streaming server to each participant terminal 5. The streaming server may be implemented in the same physical device as the distribution server 3, or may be implemented in a device physically separate from the distribution server 3. As another example, the content data may be streamed directly from the in-vehicle system 10 to each participant terminal 5 without going through the streaming server.

The distribution control unit 220 displays a content viewing screen, described below, on the display of each participant terminal 5. The video of the content is played in a predetermined display area on this content viewing screen, and the audio of the content is played from the speaker of each participant terminal 5. The distribution control unit 220 also displays a content distribution screen, described below, on the display 16 of the distributor's in-vehicle system 10. The video distributed to each participant terminal 5 can also be played in a predetermined display area on this content distribution screen.

The feedback control unit 230 is a control means for controlling feedback from each participant to the distributor during content distribution. While each distribution session is in progress, the feedback control unit 230 waits to receive feedback from the participant terminals 5 participating in that distribution session. As described above, in this embodiment, feedback that can be received from the participant terminals 5 can include comments, which are a first type of feedback, and tips, which are a second type of feedback.

When a comment is received from a participant terminal 5, the feedback control unit 230 transfers comment information (i.e., feedback) indicating the name of the participant who sent the comment and the text of the comment to the distributor's in-vehicle system 10. As a result, the comment can be displayed on the content distribution screen of the in-vehicle system 10, and the comment can be read aloud by the in-vehicle system 10. The feedback control unit 230 also transfers the comment information to other participant terminals 5 participating in the same distribution session. As a result, comments posted by other participants can be displayed on the content viewing screen of each participant terminal 5.

When the feedback control unit 230 receives an indication of intent to pay, i.e., a tip, from a participant terminal 5, it transmits tip information (i.e., feedback) indicating the name of the participant who sent the tip and the amount of the tip to the broadcaster's in-vehicle system 10. As a result, it becomes possible for the in-vehicle system 10 to notify the reception of tips in various ways. The feedback control unit 230 may also forward the tip information to other participant terminals 5 participating in the same broadcast session. Furthermore, the broadcast control unit 220 updates the earned tip information in the broadcaster table 211 and the paid tip information in the participant table 212 in the broadcast management DB 210 in response to receiving tips.

<4. Example of User Interface (UI)>
This section describes some example configurations of a graphical user interface (GUI) that may be displayed to participants and broadcasters during a broadcast session.

<4-1. Content viewing screen>
5 shows an example of the configuration of a content viewing screen 310 that can be displayed on the display of the participant terminal 5. Referring to FIG. 5, the content viewing screen 310 includes a title bar 311, a session information area 312, a video playback area 321, a comment display area 322, and a UI area 323.

The title bar 311 displays an arbitrary title. The session information area 312 is an area where information related to the ongoing session is displayed. In the example of Figure 5, the session information area 312 displays the name of the participant who is the logged-in user, the name of the ongoing session, and the number of participants currently participating in the session. The video playback area 321 is an area where the video of the content to be distributed is played. In the example of Figure 5, the upper half of the video playback area 321 displays video from a camera pointed toward the front of the distributor's vehicle V, and the lower half displays video from a camera pointed toward the distributor in vehicle V, displayed side by side.

The comment display area 322 is an area in which comments made by one or more participants taking part in the ongoing distribution session are displayed in sequence. In addition to comments from participants, the comment display area 322 may also display tips sent from participants to the broadcaster. In the example of FIG. 5 , the comment display area 322 further includes a comment input field 331 and a send button 332. When a participant enters the text of a comment in the comment input field 331 and operates (e.g., touches or clicks) the send button 332, the entered comment is sent from the participant terminal 5 to the distribution server 3.

The UI area 323 is an area where objects that accept user operations other than sending comments are placed. In the example of FIG. 5, the UI area 323 includes a tip input button 333 and a send button 334, in addition to buttons for calling the main menu and exiting the distribution session. When a participant determines the number of tips via the tip input button 333 and operates the send button 334, the determined number of tips is sent from the participant terminal 5 to the distribution server 3.

<4-2. Content distribution screen>
6 shows an example of the configuration of a content distribution screen 350a that may be displayed on the display 16 of the in-vehicle system 10 when the vehicle V is not moving. Referring to FIG. 6, the content distribution screen 350a includes a title bar 351, a session information area 352, a video playback area 361, a feedback display area 362, and a UI area 363.

The title bar 351 displays an arbitrary title. The session information area 312 is an area where information related to the ongoing session is displayed. In the example of Figure 6, the session information area 352 displays the name of the ongoing session, the number of participants currently participating in the session, and the total amount of tips earned by the broadcaster in the session. The video playback area 361 is an area where the video of the content being broadcast is played.

The feedback display area 362 is an area in which feedback received from one or more participants participating in the ongoing broadcast session is visually presented. In the example of FIG. 6, the feedback display area 362 displays three feedback items 371, 372, and 373 in chronological order according to the order in which the feedback was received. Feedback item 371 includes the name "User C" and the text of the comment received from this participant. Feedback item 372 includes the name "User B" and the text of the comment received from this participant. Feedback item 373 includes the name "User C" and a number of tip icons corresponding to the number of tips received from this participant. As new feedback is received, these feedback items 371, 372, and 373 may, for example, scroll upward and disappear one by one, and new feedback items may be added below.

The UI area 363 is an area where objects that accept operations by the broadcaster are placed. In the example of FIG. 6, the UI area 363 includes a camera switching button 381 and a noise switching button 382, in addition to buttons for calling the main menu and ending the broadcast session. The camera switching button 381 is a button for switching the camera to be used as the source for video broadcast when multiple cameras are available on the vehicle V. The noise switching button 382 is a button for setting whether to enable or disable the transmission of noise.

Figure 7 shows an example of the configuration of a content distribution screen 350b that may be displayed on the display 16 of the in-vehicle system 10 while the vehicle V is moving. Similar to the content distribution screen 350a, the content distribution screen 350b includes a title bar 351, a session information area 352, a video playback area 361, a feedback display area 362, and a UI area 363.

In the example of FIG. 7, feedback received from participants is not visually presented in the feedback display area 362. When the vehicle V is moving, instead of displaying feedback items in the feedback display area 362 as described using FIG. 6, the distribution control unit 150 causes the speaker 32 to output audio reading out the comments received from the participants. The distribution control unit 150 also causes the light-emitting device to output light indicating receipt of tips from participants, or causes the speaker 32 to output sound effects indicating receipt of tips. As in the example of FIG. 7, the distribution control unit 150 may also display a message 365 in the feedback display area 362 to notify the distributor that comments will be output audio because the distributor is driving.

<5. Processing flow>
In this section, the flow of processing that can be executed in the content distribution system 1 according to this embodiment will be described with reference to the sequence diagram of FIG. 8 and the flowcharts of FIGS.

<5-1. Overall flow>
8 shows an example of a schematic processing flow of live content distribution involving the distribution server 3, participant terminals 5, and in-vehicle system 10. Here, only one participant terminal 5 is shown, but in reality, more participant terminals 5 may participate in the content distribution. Note that, prior to the start of the illustrated processing, it is assumed that information related to the content distributor has been properly registered in the distributor table 211 of the distribution management DB 210, and information related to the participant has been properly registered in the participant table 212 of the distribution management DB 210.

First, in S11, the distributor who has determined the content distribution schedule sends a session registration request, for example from the in-vehicle system 10 to the distribution server 3. In accordance with the session registration request received from the in-vehicle system 10, the distribution server 3 registers information related to the scheduled session in the session table 213 of the distribution management DB 210. In response to the session registration request, the distribution server 3 also sends distribution setting information to the in-vehicle system 10 in S12. The in-vehicle system 10 configures content distribution in accordance with the distribution setting information received from the distribution server 3. When the start time specified in the session registration request arrives, in S13 the in-vehicle system 10 starts a streaming session for content distribution.

Meanwhile, in S15, the participant sends a session list request from the participant terminal 5 to the distribution server 3. In response to the session list request, in S16, the distribution server 3 sends a list of sessions that the participant can view to the participant terminal 5. The participant terminal 5 displays the session list received from the distribution server 3 on its screen and accepts the selection of the session the participant wishes to view. In S21, the participant terminal 5 sends a participation request to the distribution server 3, requesting content distribution for the session selected by the participant. Upon receiving the participation request from the participant terminal 5, the distribution server 3 updates the participant list in the session table 213 of the distribution management DB 210. In addition, in S22, the distribution server 3 sends participant information to the in-vehicle system 10 (at this time, the distributor may decide to allow or deny participation, as necessary). In response to the participation request, in S23, the distribution server 3 sends reception setting information to the participant terminal 5. The participant terminal 5 configures itself to receive content data according to the reception setting information received from the distribution server 3.

Once the streaming session is initiated by the in-vehicle system 10 and the necessary reception settings are made by the participant terminal 5, in S30, content including at least one of the video and audio of the content provider is streamed from the in-vehicle system 10 to the participant terminal 5. The content streaming can continue until the end time of the session arrives or the provider chooses to end the session midway. Of course, participants can also leave the session while it is in progress.

While the session is in progress, in S31 the participant terminal 5 accepts comments input by participants. In S32, the participant terminal 5 transmits the accepted comments to the distribution server 3 as feedback for the broadcaster. In S33, the distribution server 3 forwards the feedback received from the participant terminal 5 to the in-vehicle system 10. In S34, the in-vehicle system 10 presents the comments included in the feedback received from the distribution server 3 to the broadcaster. A more detailed flow of the feedback presentation process performed here will be described later.

Also, while the session is in progress, in S35 the participant terminal 5 accepts tip input by the participant. In S36, the participant terminal 5 transmits the specified number of tips to the distribution server 3 as feedback to the broadcaster. In S37, the distribution server 3 forwards the feedback received from the participant terminal 5 to the in-vehicle system 10. In S38, the in-vehicle system 10 presents a tip receipt notification to the broadcaster based on the feedback received from the distribution server 3. A more detailed flow of the feedback presentation process performed here will be explained later. Also, in S39, the distribution server 3 updates the tip information stored in the distribution management DB 210.

At S41, the distributor performs an operation to end the distribution session on the content distribution screen. In response to detecting the end operation, the in-vehicle system 10 stops the streaming session at S42 and reports the end of the session to the distribution server 3. At S43, the distribution server 3 notifies the participant terminal 5 of the end of the session.

<5-2. Content distribution process (first embodiment)>
Fig. 9 shows a first example of the flow of a content distribution process that can be executed by the in-vehicle system 10. The content distribution process shown in Fig. 9 can be realized, for example, by the processor 12 of the in-vehicle system 10 executing a computer program stored in the memory 13.

First, in S101, the content acquisition unit 110 acquires video from a camera specified by the broadcaster. Then, in S103, the content acquisition unit 110 acquires the broadcaster's audio from a microphone. Next, in S105, the content transmission unit 120 transmits a communication packet of content data, which may include the video and audio acquired by the content acquisition unit 110, to the network 2 for content distribution to the participant terminal 5.

While streaming of content data from the content sending unit 120 continues, the feedback receiving unit 130 waits for feedback from the participants in S107. If any feedback is received, processing proceeds to S109. If no feedback is received, processing proceeds to S130.

When feedback is received by the feedback receiving unit 130, in S109, the process branches depending on whether the vehicle V is moving or not. For example, if the status information from the control unit 20 indicates that the vehicle V is not moving, the process proceeds to S110. In S110, the distribution control unit 150 executes feedback presentation processing for when the vehicle is not moving. On the other hand, if the status information from the control unit 20 indicates that the vehicle V is moving, the process proceeds to S120. In S120, the distribution control unit 150 executes feedback presentation processing for when the vehicle is moving.

Next, in S130, the distribution control unit 150 determines whether the distribution session should be ended. For example, the distribution control unit 150 may determine that the distribution session should be ended when the end time of the session arrives or when the distributor performs an on-screen end operation. If the distribution session is not to be ended, the process returns to S101, and the above-described acquisition and distribution of content data, and reception and presentation of feedback are repeated. If it is determined that the distribution session should be ended, the content distribution process of FIG. 9 ends.

<5-3. Feedback presentation process>
(1) Processing When Not Moving FIG. 10A shows an example of the flow of the feedback presentation processing that can be executed in S110 of FIG. 9 when the vehicle V is not moving.

First, in S111, the distribution control unit 150 determines whether the type of feedback received by the feedback receiving unit 130 is a comment or a tip. If the type of feedback is a comment, processing proceeds to S113. On the other hand, if the type of feedback is a tip, processing proceeds to S115.

At S113, the distribution control unit 150 displays the received comment on the content distribution screen together with the name of the comment sender. At this time, the distribution control unit 150 may or may not output audio reading the comment from the speaker, according to user settings previously specified by the distributor. Meanwhile, at S115, the distribution control unit 150 displays an object (see the example in Figure 6) notifying the user of the receipt of a tip on the content distribution screen together with the name of the tip sender. At this time, the distribution control unit 150 may or may not output light or sound effects to notify the user of the receipt of a tip, according to user settings previously specified by the distributor. Then, the feedback presentation process in Figure 10A ends.

(2) Processing During Movement FIG. 10B shows an example of the flow of the feedback presentation processing that can be executed in S120 of FIG. 9 when the vehicle V is moving.

First, in S121, the distribution control unit 150 determines whether the type of feedback received by the feedback receiving unit 130 is a comment or a tip. If the type of feedback is a comment, processing proceeds to S123. On the other hand, if the type of feedback is a tip, processing proceeds to S125.

At S123, the distribution control unit 150 causes the speaker to output a sound reading out the received comment. Meanwhile, at S125, the distribution control unit 150 causes the light-emitting device to emit light to notify the broadcaster that the tip has been received, or causes the speaker to output a sound effect to notify the broadcaster that the tip has been received. Then, the feedback presentation process of FIG. 10B ends.

<5-4. Content distribution process (second embodiment)>
Fig. 11 shows a second example of the flow of a content distribution process that can be executed by the in-vehicle system 10. The content distribution process shown in Fig. 11 can be realized, for example, by the processor 12 of the in-vehicle system 10 executing a computer program stored in the memory 13.

First, in S101, the content acquisition unit 110 acquires video from the camera specified by the distributor. Then, in S102, the content acquisition unit 110 acquires noise from the exterior microphone 35. Then, in S103, the content acquisition unit 110 acquires the voice of the distributor from the microphone 15.

Next, in S104, the distribution control unit 150 determines whether or not to distribute noise sound according to user settings specified in advance by the distributor. If the distribution control unit 150 determines not to distribute noise sound, in S105 the content sending unit 120 sends a communication packet of content data that may include video and audio acquired by the content acquisition unit 110 to network 2. On the other hand, if the distribution control unit 150 determines to distribute noise sound, in S106 the content sending unit 120 sends a communication packet of content data that may include video acquired by the content acquisition unit 110, the distributor's audio, and noise sound to network 2.

The subsequent processing steps S107 to S130 are the same as those in the first embodiment described using Figure 9, so their description will be omitted here.

6. Summary of the embodiment
The above-described embodiments disclose at least the following information processing device, distribution control method, computer program, and storage medium.

1. The information processing device (10) mounted on the vehicle (V) of the above embodiment includes:
a content acquisition means (110) for acquiring content including at least one of video and audio of a content distributor who is a passenger;
a transmitting means (120) for transmitting the content acquired by the content acquiring means to a network (2) for distribution to one or more participant terminal devices (5);
receiving means (130) for receiving feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
a control means (150) for controlling the presentation of the feedback received by the receiving means to the content distributor;
Equipped with
the feedback received by the receiving means includes a first feedback that can be read aloud;
When the vehicle is moving (S120), the control means causes the voice output means (32) to output a voice reading out the first feedback (S123).
According to this embodiment, a content distributor can use a vehicle, such as a passenger car, with excellent soundproofing and privacy features as a content distribution environment. Furthermore, feedback sent from participants to the content distributor is presented to the content distributor, enabling two-way communication between the content distributor and participants and realizing live distribution of highly attractive content. Furthermore, the presentation method of feedback from participants is switched depending on whether the vehicle is moving or not, and the content distributor can understand the content of the feedback through audio while the vehicle is moving. This reduces the risk of the vehicle driver's attention being distracted. Therefore, it is possible to provide more distributors with opportunities to freely distribute content while maintaining safety.

2. In the above embodiment,
When the vehicle is not moving (S110), the control means does not cause the voice output means to output the voice that reads out the first feedback.
According to this embodiment, in a vehicle that is not moving and is simply being used as an environment for content distribution, it is possible to avoid a situation in which content distribution is hindered by unnecessary voice reading.

3. In the above embodiment,
The control means
When the vehicle is not moving, display the first feedback on a display means (S113);
When the vehicle is moving, the first feedback is not displayed on the display means.
According to this embodiment, when the vehicle is not moving, the content distributor can check what kind of feedback the participants are giving to the content by looking at the screen, and when the vehicle is moving, the driver can be prevented from trying to look at the screen.

4. In the above embodiment,
the feedback received by the receiving means includes second feedback related to a fee for the distribution of the content;
When the vehicle is moving, the control means causes the light emitting device to output light representing the second feedback, or causes the audio output means to output a sound effect representing the second feedback (S125).
According to this embodiment, participants can provide compensation for content distribution to content distributors, which encourages content distributors to distribute more substantial content. Furthermore, while the vehicle is moving, the content distributor can know that they have received compensation for content distribution through light or sound effects, which more effectively reduces the risk of the vehicle driver's attention being distracted.

5. In the above embodiment,
When the vehicle is not moving (S110), the control means does not output the light or the sound effect representing the second feedback.
According to this embodiment, in a vehicle that is not moving and is simply being used as an environment for content distribution, it is possible to avoid a situation in which content distribution is hindered by the output of unnecessary light or sound effects.

6. In the above embodiment,
The control means
When the vehicle is not moving, display the second feedback on a display means (S115);
When the vehicle is moving, the second feedback is not displayed on the display means.
According to this embodiment, when the vehicle is not moving, the content distributor can check when and how much compensation has been provided by the participants by looking at the screen, and when the vehicle is moving, the driver can be prevented from looking at the screen.

7. In the above embodiment,
The information processing device includes:
a noise acquisition means (35) for acquiring noise generated when the vehicle is running;
Furthermore,
The transmitting means transmits the noise sound acquired by the noise acquiring means to the network together with the content.
According to this embodiment, by providing participants with realistic sounds that are generated while driving as part of the content, it is possible to further increase the appeal of the content to be distributed.

8. In the above embodiment,
The control means determines whether the noise sound should be transmitted together with the content in accordance with a setting designated by the content distributor (S104);
When the control means determines that the noise sound should be transmitted together with the content, the transmission means transmits the noise sound together with the content to the network.
According to this embodiment, it is possible for a content provider to enable or disable the distribution of noise sounds in accordance with the characteristics of the content intended by the content provider. For example, from the same vehicle, it is possible to distribute content that gives a sense of realism while driving at one timing, and to block out noise sounds at another timing to emphasize the voice of the content provider.

9. In the above embodiment,
The information processing device includes:
a status monitoring means (160) for monitoring the status of the vehicle while the content is being distributed by the transmission means, and for storing information relating to an abnormality in a storage device (170) when an abnormality is detected in the vehicle;
Further provided are:
According to this embodiment, when an abnormality is detected in a vehicle, the information stored in the storage device can be read out and used for purposes such as investigating the cause of the abnormality or providing advice to the distributor.

10. In the above embodiment,
The information related to the abnormality includes at least one of the distribution status of the content and the presentation status of the feedback when the abnormality was detected.
According to this embodiment, it is possible to perform a retrospective analysis of how the content distribution activities of the content distributor or the feedback provided to the content distributor affected the vehicle abnormality.

11. The distribution control method for controlling content distribution from a vehicle (V) according to the above embodiment includes:
In the vehicle, content including at least one of video and audio of a content distributor who is an occupant is acquired (S101, S103);
transmitting the acquired content from the vehicle to a network for distribution to terminal devices of one or more participants (S105);
receiving (S107) feedback from the one or more participants to the content distributor at the vehicle, the feedback relating to the distributed content;
Presenting the received feedback to the content distributor (S110, S120);
Including,
the feedback includes a first feedback that can be read aloud;
When the vehicle is moving (S120), presenting the first feedback to the content distributor includes outputting a voice in the vehicle that reads out the first feedback (S123).
According to this embodiment, it becomes possible to use a vehicle with excellent soundproofing and privacy performance as an environment for content distribution, thereby providing more content distributors with the opportunity to freely distribute content while maintaining safety.

12. The computer program of the above embodiment
When executed by a processor (12) of an information processing device (10) that controls content distribution from a vehicle (V), the information processing device
acquiring content including at least one of video and audio of a content distributor who is an occupant of the vehicle;
transmitting the retrieved content from the vehicle to a network for distribution to terminal devices of one or more participants;
receiving, at the vehicle, feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
presenting the received feedback to the content distributor; and
Let them do this,
the feedback includes a first feedback that can be read aloud;
When the vehicle is moving, presenting the first feedback to the content distributor includes outputting a voice in the vehicle that reads the first feedback aloud.
According to this embodiment, it becomes possible to use a vehicle with excellent soundproofing and privacy performance as an environment for content distribution, thereby providing more content distributors with the opportunity to freely distribute content while maintaining safety.

13. The storage medium of the above embodiment is
A computer-readable storage medium (13) storing a computer program,
The computer program, when executed by a processor (12) of an information processing device (10) that controls content distribution from a vehicle (V), causes the information processing device to:
acquiring content including at least one of video and audio of a content distributor who is an occupant of the vehicle;
transmitting the retrieved content from the vehicle to a network for distribution to terminal devices of one or more participants;
receiving, at the vehicle, feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
presenting the received feedback to the content distributor; and
Let them do this,
the feedback includes a first feedback that can be read aloud;
When the vehicle is moving, presenting the first feedback to the content distributor includes outputting a voice in the vehicle that reads the first feedback aloud.
According to this embodiment, it becomes possible to use a vehicle with excellent soundproofing and privacy performance as an environment for content distribution, thereby providing more content distributors with the opportunity to freely distribute content while maintaining safety.

The above describes an embodiment of the invention, but the invention is not limited to the above embodiment, and various modifications and variations are possible within the scope of the invention.

V: Vehicle; 1: Content distribution system; 2: Network; 3: Distribution server; 5: Participant terminal; 10: In-vehicle system (information processing device); 110: Content acquisition unit; 120: Content transmission unit; 130: Feedback reception unit; 140: Setting unit; 150: Distribution control unit; 160: Status monitoring unit; 170: Log storage unit; 172: Log data

Claims (13)

An information processing device mounted on a vehicle,
a content acquisition means for acquiring live-streamed content including at least one of video and audio of a content distributor who is a passenger;
a transmitting means for transmitting the content acquired by the content acquiring means to a network for distribution to terminal devices of one or more participants;
receiving means for receiving feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
a control means for controlling presentation of the feedback received by the receiving means to the content distributor;
Equipped with
the feedback received by the receiving means includes a first feedback that can be read aloud;
the control means causes the voice output means to output a voice reading out the first feedback when the vehicle is moving;
Information processing device. The information processing device according to claim 1, wherein the control means does not cause the audio output means to output the audio reading out the first feedback when the vehicle is not moving. The control means
When the vehicle is not moving, displaying the first feedback on a display means;
When the vehicle is moving, the first feedback is not displayed on the display means.
3. The information processing device according to claim 1 or 2. the feedback received by the receiving means includes second feedback related to a fee for the distribution of the content;
the control means causes a light emitting device to output light representing the second feedback, or causes the sound output means to output a sound effect representing the second feedback, when the vehicle is moving;
The information processing device according to any one of claims 1 to 3. The information processing device of claim 4, wherein the control means does not output the light or sound effect representing the second feedback when the vehicle is not moving. The control means
When the vehicle is not moving, displaying the second feedback on a display means;
When the vehicle is moving, the second feedback is not displayed on the display means.
6. The information processing device according to claim 4 or 5. The information processing device includes:
a noise acquisition means for acquiring noise generated when the vehicle is running;
Furthermore,
the transmitting means transmits the noise sound acquired by the noise acquiring means to the network together with the content;
The information processing device according to any one of claims 1 to 6. the control means determines whether the noise sound should be transmitted together with the content in accordance with a setting specified by the content distributor;
the transmitting means transmits the noise sound together with the content to the network when the control means determines that the noise sound should be transmitted together with the content;
The information processing device according to claim 7 . The information processing device includes:
a status monitoring means for monitoring the status of the vehicle while the content is being distributed by the transmission means, and for storing information relating to an abnormality in a storage device when an abnormality is detected in the vehicle;
The information processing device according to any one of claims 1 to 8, further comprising: The information processing device of claim 9, wherein the information related to the abnormality includes at least one of the distribution status of the content and the presentation status of the feedback when the abnormality was detected. 1. A distribution control method for controlling content distribution from a vehicle, comprising:
In the vehicle, acquiring live-streamed content including at least one of video and audio of a content distributor who is an occupant of the vehicle;
transmitting the retrieved content from the vehicle to a network for distribution to terminal devices of one or more participants;
receiving, at the vehicle, feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
presenting the received feedback to the content distributor; and
Including,
the feedback includes a first feedback that can be read aloud;
and when the vehicle is moving, presenting the first feedback to the content distributor includes outputting, in the vehicle, a voice reading out the first feedback.
Delivery control method. When executed by a processor of an information processing device that controls content distribution from a vehicle, the information processing device:
In the vehicle, acquiring live-streamed content including at least one of video and audio of a content distributor who is an occupant of the vehicle;
transmitting the retrieved content from the vehicle to a network for distribution to terminal devices of one or more participants;
receiving, at the vehicle, feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
presenting the received feedback to the content distributor; and
Let them do this,
the feedback includes a first feedback that can be read aloud;
and when the vehicle is moving, presenting the first feedback to the content distributor includes outputting, in the vehicle, a voice reading out the first feedback.
Computer program. A computer-readable storage medium storing a computer program,
The computer program, when executed by a processor of an information processing device that controls content distribution from a vehicle, causes the information processing device to:
In the vehicle, acquiring live-streamed content including at least one of video and audio of a content distributor who is an occupant of the vehicle;
transmitting the retrieved content from the vehicle to a network for distribution to terminal devices of one or more participants;
receiving, at the vehicle, feedback from the one or more participants to the content distributor, the feedback relating to the distributed content;
presenting the received feedback to the content distributor; and
Let them do this,
the feedback includes a first feedback that can be read aloud;
and when the vehicle is moving, presenting the first feedback to the content distributor includes outputting, in the vehicle, a voice reading out the first feedback.
storage medium.