JP7700259B2 - Output Control Device - Google Patents

Description

The present invention relates to an output control device.

AR glasses are known as devices that realize Augmented Reality (AR), which superimposes information such as images onto the real world. AR glasses are also called see-through HMDs (Head Mounted Displays). Patent Document 1 discloses a technology for controlling the display mode of information displayed by a see-through HMD so that a user wearing the see-through HMD does not stare too closely at the information displayed on the see-through HMD.

JP 2014-106445 A

When the AR glasses display an image represented by a piece of content and also emit a sound represented by that content, the user of the AR glasses can recognize the content through the image and sound. In such a case, if the user of the AR glasses becomes too focused on the content because of the sound represented by the content, the user of the AR glasses will be deprived of awareness of the real world.

The object of the present invention is to provide an output control device that can prevent a user from concentrating too much on content.

An output control device according to one embodiment of the present invention includes an acquisition unit that acquires content indicating an image and sound, an estimation unit that estimates a level of concentration of a user on the content based on the content and user information regarding a user wearing a transparent display device, a display control unit that causes the image indicated by the content to be displayed on the transparent display device, and a volume control unit that controls the volume of the sound indicated by the content based on the level of concentration.

One aspect of the present invention can prevent a user from concentrating too much on content.

FIG. 2 is a diagram for explaining a mobile device 1 and AR glasses 2. FIG. 1 is a diagram showing an example of a portable device 1. 11 is a diagram showing an example of a relationship between a concentration level C and a volume of a content sound. FIG. 13 is a diagram showing another example of the relationship between the concentration level C and the volume of the content sound. FIG. FIG. 11 is a diagram showing yet another example of the relationship between the concentration level C and the volume of the content sound. FIG. 11 is a diagram showing yet another example of the relationship between the concentration level C and the volume of the content sound. FIG. 11 is a diagram showing yet another example of the relationship between the concentration level C and the volume of the content sound. FIG. 2 is a diagram showing an example of AR glasses 2. 1 is a diagram for explaining an example of the operation of the mobile device 1. FIG. A diagram showing an example of AR glasses 2 having an acceleration sensor 2g. 1 is a diagram showing an example of a portable device 1 having an acceleration sensor 18. FIG. A diagram showing an example of AR glasses 2 having a camera 2h.

A: First embodiment A1: Mobile device 1 and AR glasses 2
1 is a diagram for explaining a mobile device 1 and AR glasses 2. The mobile device 1 is, for example, a smartphone. The mobile device 1 is not limited to a smartphone, and may be, for example, a tablet or notebook personal computer. The mobile device 1 is also referred to as a terminal device.

The portable device 1 acquires content A indicating a content image and a content sound. The portable device 1 acquires content A from a content distribution device 3 such as a server via a communication line NW. The portable device 1 may acquire content A not from the content distribution device 3 but from a device different from the content distribution device 3 (e.g., a portable memory).

Content A is information indicating a content image and a content sound, for example, digital information indicating a content image and a content sound. Content A includes image information indicating the content image and sound information indicating the content sound. Content A may include meta information regarding content A. The meta information indicates, for example, the title of content A, the format of the content image, and the content shown in the content image. The format of the content image is, for example, a video or a still image. The format of the content image is not limited to a video or a still image, and may be, for example, a three-dimensional model or a two-dimensional image.

The mobile device 1 is connected to the AR glass 2 via a wired connection. The mobile device 1 may be connected to the AR glass 2 wirelessly. The mobile device 1 controls the AR glass 2 based on the content A.

The AR glasses 2 are glasses-type display devices. The AR glasses 2 are an example of a transmissive HMD that transmits light and displays an image. The AR glasses 2 are also an example of a transmissive display device. The transmissive display device is not limited to the AR glasses 2, and may be, for example, a goggle-shaped transmissive HMD that has similar functions to those of the AR glasses 2.

The AR glasses 2 include temples 91 and 92, a bridge 93, a body 94 and 95, and lenses 2aL and 2aR.

The body 94 is provided with a display panel for the left eye and an optical member for the left eye. The display panel is, for example, a liquid crystal panel or an organic EL (Electro Luminescence) panel. The display panel for the left eye displays a content image indicated by the image information of content A, for example, based on control from the portable device 1. The optical member for the left eye is an optical member that guides light emitted from the display panel for the left eye to the lens 2aL.

The body 95 is provided with a display panel for the right eye and an optical member for the right eye. The display panel for the right eye displays a content image indicated by the image information of content A, for example, based on control from the portable device 1. The optical member for the right eye is an optical member that guides light emitted from the display panel for the right eye to the lens 2aR.

Each of lenses 2aL and 2aR has a half mirror. The half mirror of lens 2aL transmits light representing the real world, thereby guiding the light representing the real world to user B's left eye B1L. The half mirror of lens 2aL also reflects light guided by the optical member for the left eye to user B's left eye B1L. The half mirror of lens 2aR transmits light representing the real world, thereby guiding the light representing the real world to user B's right eye B1R. The half mirror of lens 2aR also reflects light guided by the optical member for the right eye to user B's right eye B1R.

The display unit 2a, which will be described later in FIG. 8 and other figures, includes a lens 2aL, a display panel for the left eye, an optical member for the left eye, a lens 2aR, a display panel for the right eye, and an optical member for the right eye. The display unit 2a is a transmissive display unit that transmits light.

Light representing the real world passes through the display unit 2a. The display unit 2a displays a content image indicated by the image information of content A based on control from the mobile device 1. When user B wears the AR glasses 2, the display unit 2a is positioned in front of user B's left eye B1L and right eye B1R. User B wearing the AR glasses 2 can view the real world represented by the light that has passed through the display unit 2a and the content image displayed on the display unit 2a. For example, user B can view a content image superimposed on the real world.

The AR glasses 2 include a sound output unit 2b in addition to the display unit 2a. As shown in FIG. 1, the sound output unit 2b is located on each of the torsos 94 and 95. The sound output unit 2b may not be located on each of the torsos 94 and 95, but may be located on, for example, one of the torsos 94 and 95, at least one of the temples 91 and 92, or the bridge 93. At least one of the temples 91 and 92 means, for example, "temple 91", "temple 92", or "temples 91 and 92". The sound output unit 2b is, for example, a speaker. The sound output unit 2b may be separate from the AR glasses 2 without being included in the AR glasses 2. The sound output unit 2b separate from the AR glasses 2 is not limited to a speaker, and may be, for example, an earphone or a headphone. The sound output unit 2b separate from the AR glasses 2 is, for example, connected wirelessly to the mobile device 1 or the AR glasses 2. The sound emitting unit 2b, which is separate from the AR glasses 2, may be connected by wire to the mobile device 1 or the AR glasses 2. The sound emitting unit 2b is controlled by the mobile device 1 directly or via the AR glasses 2. The sound emitting unit 2b outputs content sound indicated by sound information of content A based on the control from the mobile device 1.

User B wearing the AR glasses 2 can hear the content sound while viewing the real world and the content image. Therefore, user B wearing the AR glasses 2 can recognize content A through the content image and content sound while perceiving the real world.

A2: Portable device 1
2 is a diagram showing an example of the portable device 1. The portable device 1 includes an input device 11, an output device 12, communication devices 13 and 14, a storage device 15, a processing device 16, and a bus 17. The input device 11, the output device 12, the communication devices 13 and 14, the storage device 15, and the processing device 16 are connected to each other by the bus 17 for communicating information. The bus 17 may be configured using a single bus, or may be configured using different buses between the devices.

The input device 11 includes a touch panel. The input device 11 may include a plurality of operation keys in addition to the touch panel. The input device 11 may include a plurality of operation keys without including a touch panel. The input device 11 accepts operations performed by user B.

The output device 12 includes a display. The touch panel of the input device 11 is layered on top of the display of the output device 12. The output device 12 displays various information.

The communication device 13 communicates with the content distribution device 3 via the communication line NW. The communication device 13 may also communicate with the content distribution device 3 without via the communication line NW. The communication device 13 receives content A from the content distribution device 3.

The communication device 14 communicates with the AR glasses 2 via a wired connection. The communication device 14 may also communicate with the AR glasses 2 wirelessly.

The storage device 15 is a recording medium that can be read by the processing device 16. The storage device 15 includes, for example, a non-volatile memory and a volatile memory. The non-volatile memory is, for example, a ROM (Read Only Memory), an EPROM (Erasable Programmable Read Only Memory), and an EEPROM (Electrically Erasable Programmable Read Only Memory). The volatile memory is, for example, a RAM (Random Access Memory). The storage device 15 stores the program PG1 and user information Ba.

User information Ba is information about user B. User information Ba includes preference information Bc. Preference information Bc is information indicating user B's preferences. Preference information Bc is generated, for example, based on a history of content viewed by user B using portable device 1. Preference information Bc may also be generated based on a history of content viewed by user B using AR glasses 2. Preference information Bc may be generated by processing device 16, or may be generated by a server (not shown) that communicates with portable device 1. The method of generating preference information Bc is a publicly known technology, so a detailed explanation will be omitted.

The processing device 16 includes one or more central processing units (CPUs). The one or more CPUs are an example of one or more processors. Each of the processor and the CPU is an example of a computer.

The processing device 16 is an example of an output control device. The processing device 16 reads the program PG1 from the storage device 15. The processing device 16 executes the program PG1 to function as an acquisition unit 161, an estimation unit 162, a volume control unit 163, and a display control unit 164. The acquisition unit 161 may be configured by a circuit such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), and an FPGA (Field Programmable Gate Array). At least one of the estimation unit 162, the volume control unit 163, and the display control unit 164 may be configured by a circuit such as a DSP, an ASIC, a PLD, and an FPGA. At least one of the estimation unit 162, the volume control unit 163, and the display control unit 164 means, for example, "estimation unit 162," "volume control unit 163," "display control unit 164," "estimation unit 162 and volume control unit 163," "estimation unit 162 and display control unit 164," "volume control unit 163 and display control unit 164," or "estimation unit 162, volume control unit 163, and display control unit 164."

The acquisition unit 161 acquires content A from the content distribution device 3 via the communication device 13. The acquisition unit 161 may acquire content A not from the content distribution device 3 but from a personal information processing device such as a personal computer, or a portable recording medium such as a Universal Serial Bus (USB) memory.

The estimation unit 162 estimates the concentration level C of user B on content A based on content A and user information Ba. The estimation unit 162 indicates the concentration level C of user B on content A by a numerical value. The numerical value indicating the concentration level C increases as the concentration level C increases. The numerical value indicating the concentration level C decreases as the concentration level C decreases.

The estimation unit 162 estimates the concentration level C based on, for example, the format of the content image and the preference information Bc.

The estimation unit 162 first identifies image information indicating a content image from content A. Next, the estimation unit 162 identifies the format of the content image by analyzing the image information indicating the content image. If content A includes meta information indicating the format of the content image, the estimation unit 162 may identify the format of the content image based on the meta information.

In a situation where the preference information Bc indicates that user B prefers videos over still images, if the content image format is a video, the estimation unit 162 estimates the concentration level C to be a concentration level H1 that is greater than the first level Lv1.

In a situation where the preference information Bc indicates that user B prefers videos over still images, if the format of the content image is a still image, the estimation unit 162 estimates the concentration level C to be a concentration level L1 that is smaller than the first level Lv1.

In this way, the estimation unit 162 sets the concentration level C (concentration level H1) estimated when content A matches the preferences of user B to a concentration level greater than the concentration level C (concentration level L1) estimated when content A does not match the preferences of user B. In addition, the estimation unit 162 changes the concentration level C depending on the format of the content image.

The preference information Bc is not limited to information indicating that user B prefers videos over still images. For example, the preference information Bc may be information indicating that user B prefers three-dimensional models over two-dimensional images.

In a situation where the preference information Bc indicates that user B prefers three-dimensional models to two-dimensional images, if the format of the content image is a three-dimensional model, the estimation unit 162 estimates a concentration level H2, which is greater than the first level Lv1, as the concentration level C. The concentration level H2 may be the same value as the concentration level H1 or may be a different value.

In a situation where the preference information Bc indicates that user B prefers three-dimensional models to two-dimensional images, if the format of the content image is a two-dimensional image, the estimation unit 162 estimates a concentration level L2 that is smaller than the first level Lv1 as the concentration level C. The concentration level L2 may be the same value as the concentration level L1 or may be a different value.

The preference information Bc may be information indicating a preference that user B prefers images containing only text (e.g., images containing only email text).

In a situation where the preference information Bc indicates that user B prefers images containing only text, if the format of the content image is a format containing only text, the estimation unit 162 estimates a concentration level H3, which is greater than the first level Lv1, as the concentration level C. The concentration level H3 may be the same value as at least one of the concentration levels H1 and H2, or may be a value different from both the concentration levels H1 and H2. At least one of the concentration levels H1 and H2 means, for example, "concentration level H1", "concentration level H2", or "concentration level H1 and concentration level H2".

In a situation where the preference information Bc indicates that user B prefers images containing only text, and the format of the content image is a format including text and figures, the estimation unit 162 estimates a concentration level L3, which is lower than the first level Lv1, as the concentration level C. The concentration level L3 may be the same value as at least one of the concentration levels L1 and L2, or may be a value different from both the concentration levels L1 and L2. At least one of the concentration levels L1 and L2 means, for example, "concentration level L1", "concentration level L2", or "concentration level L1 and concentration level L2".

The estimation unit 162 may estimate the degree of concentration based on the content shown in the content image and the preference information Bc.

The estimation unit 162 first identifies image information indicating a content image from content A. Next, the estimation unit 162 identifies the content shown in the content image by analyzing the image information indicating the content image. If content A includes meta information indicating the content shown in the content image, the estimation unit 162 may identify the content shown in the content image based on the meta information.

For example, in a situation where the preference information Bc indicates that user B has a preference for animals, when the content image shows an animal, the estimation unit 162 estimates a concentration level H4, which is greater than the first level Lv1, as the concentration level C. The concentration level H4 may be the same value as at least one of the concentration levels H1, H2, and H3, or may be a value different from any of the concentration levels H1, H2, and H3. At least one of the concentration levels H1, H2, and H3 means, for example, "concentration level H1", "concentration level H2", "concentration level H3", "concentration level H1 and concentration level H2", "concentration level H1 and concentration level H3", "concentration level H2 and concentration level H3", or "concentration level H1, concentration level H2, and concentration level H3".

In a situation where the preference information Bc indicates that user B has a preference for animals, but the content image does not show an animal, the estimation unit 162 estimates a concentration level L4, which is lower than the first level Lv1, as the concentration level C. The concentration level L4 may be the same value as at least one of the concentration levels L1, L2, and L3, or may be a value different from any of the concentration levels L1, L2, and L3. At least one of the concentration levels L1, L2, and L3 means, for example, "concentration level L1", "concentration level L2", "concentration level L3", "concentration level L1 and concentration level L2", "concentration level L1 and concentration level L3", "concentration level L2 and concentration level L3", or "concentration level L1, concentration level L2, and concentration level L3".

In this way, the estimation unit 162 changes the concentration level C depending on the content shown in the content image (for example, whether or not the content image shows an animal).

The content shown in the content image used to estimate the concentration level C is not limited to content related to animals.

For example, in a situation where the preference information Bc indicates that user B has a preference for mazes, if the content image shows a maze, which is an example of a complex object, the estimation unit 162 estimates a concentration level H5, which is greater than the first level Lv1, as the concentration level C. The concentration level H5 may be the same value as at least one of the concentration levels H1, H2, H3, and H4, or may be a value different from any of the concentration levels H1, H2, H3, and H4. At least one of concentration levels H1, H2, H3 and H4 means, for example, "concentration level H1", "concentration level H2", "concentration level H3", "concentration level H4", "concentration level H1 and concentration level H2", "concentration level H1 and concentration level H3", "concentration level H1 and concentration level H4", "concentration level H2 and concentration level H3", "concentration level H2 and concentration level H4", "concentration level H3 and concentration level H4", "concentration level H1, concentration level H2 and concentration level H3", "concentration level H1, concentration level H2 and concentration level H4", "concentration level H1, concentration level H2 and concentration level H4", "concentration level H1, concentration level H3 and concentration level H4", or "concentration level H1, concentration level H2, concentration level H3 and concentration level H4".

In a situation where the preference information Bc indicates that user B has a preference for mazes, but the content image does not show a maze, the estimation unit 162 estimates a concentration level L5, which is lower than the first level Lv1, as the concentration level C. The concentration level L5 may be the same value as at least one of the concentration levels L1, L2, L3, and L4, or may be a value different from any of the concentration levels L1, L2, L3, and L4. At least one of concentration degree L1, concentration degree L2, concentration degree L3, and concentration degree L4 means, for example, "concentration degree L1", "concentration degree L2", "concentration degree L3", "concentration degree L4", "concentration degree L1 and concentration degree L2", "concentration degree L1 and concentration degree L3", "concentration degree L1 and concentration degree L4", "concentration degree L2 and concentration degree L3", "concentration degree L2 and concentration degree L4", "concentration degree L3 and concentration degree L4", "concentration degree L1, concentration degree L2, and concentration degree L3", "concentration degree L1, concentration degree L2, and concentration degree L4", "concentration degree L1, concentration degree L3 and concentration degree L4", "concentration degree L2, concentration degree L3 and concentration degree L4", or "concentration degree L1, concentration degree L2, concentration degree L3, and concentration degree L4".

In a situation where the preference information Bc includes preference information that user B prefers character strings, if the content image shows a predetermined number (e.g., 300) or more of characters, the estimation unit 162 estimates concentration level H6 as concentration level C. Concentration level H6 may be the same value as at least one of concentration levels H1, H2, H3, H4, and H5, or may be a value different from concentration levels H1, H2, H3, H4, and H5. The predetermined number is not limited to 300, and may be more or less than 300. At least one of concentration level H1, concentration level H2, concentration level H3, concentration level H4, and concentration level H5 is, for example, "concentration level H1", "concentration level H2", "concentration level H3", "concentration level H4" , "Concentration degree H5", "Concentration degree H1 and concentration degree H2", "Concentration degree H1 and concentration degree H3", "Concentration degree H1 and concentration degree H4", "Concentration degree H1 and concentration degree H5", "Concentration degree H2 and concentration degree Moderate H3'', ``Concentration level H2 and concentration level H4'', ``Concentration level H2 and concentration level H5'', ``Concentration level H3 and concentration level H4'', ``Concentration level H3 and concentration level H5'', ``Concentration level H4 and concentration level H5", "Concentration H1, Concentration H2 and Concentration H3", "Concentration H1, Concentration H2 and Concentration H4", "Concentration H1, Concentration H2 and Concentration H5", "Concentration H1, Concentration H 3 and concentration level H4'', ``concentration level H1, concentration level H3 and concentration level H5'', ``concentration level H1, concentration level H4 and concentration level H5'', ``concentration level H2, concentration level H3 and concentration level H4'', ``concentration level H2, concentration level H3 and concentration level H5'', ``concentration level H2, concentration level H4 and concentration level H5'', ``concentration level H3, concentration level H4 and concentration level H5'', ``concentration level H1, concentration level H2, concentration level H3 and and concentration level H4'', ``concentration level H1, concentration level H2, concentration level H3 and concentration level H5'', ``concentration level H1, concentration level H2, concentration level H4 and concentration level H5'', ``concentration level H1, concentration level H3, concentration level H4 and concentration level H5'', ``concentration level H2, concentration level H3, concentration level H4 and concentration level H5'', or ``concentration level H1, concentration level H2, concentration level H3, concentration level H4 and concentration level H5''.

In a situation where the preference information Bc includes preference information that user B prefers character strings, if the content image does not show a predetermined number (e.g., 300) or more of characters, the estimation unit 162 estimates the concentration level L6 as the concentration level C. The concentration level L6 may be the same value as at least one of the concentration levels L1, L2, L3, L4, and L5, or may be a value different from any of the concentration levels L1, L2, L3, L4, and L5. At least one of the concentration levels L1, L2, L3, L4, and L5 is, for example, "concentration level L1", "concentration level L2", "concentration level L3", "concentration level L4", "concentration level L5", "concentration level L1 and concentration level L2", "concentration level L1 and concentration level L3", "concentration level L1 and concentration level L4", "concentration level L1 and concentration level L5", "concentration level L2 and concentration level L3", "concentration level L2 and concentration level L4", "concentration level L2 and concentration level L5", "concentration level L3 and concentration L4", "concentration level L3 and concentration L5", "concentration level L4 and concentration L5", "concentration level L1, concentration level L2, and concentration level L3", "concentration level L1, concentration level L2, and concentration level L4", "concentration level L1, concentration level L2, and concentration level L5 ... "concentration L1, concentration L3 and concentration L5", "concentration L1, concentration L4 and concentration L5", "concentration L2, concentration L3 and concentration L4", "concentration L2, concentration L3 and concentration L5", "concentration L2, concentration L3 and concentration L4", "concentration L2, concentration L3 and concentration L5", "concentration L2, concentration L4 and concentration L5", "concentration L3, concentration L4 and concentration L5", "concentration L1, concentration L2, concentration L3 and concentration L4", "concentration L1, concentration L2, concentration L3 and concentration L5", "concentration L1, concentration L2, concentration L4 and concentration L5", "concentration L1, concentration L3, concentration L4 and concentration L5", "concentration L1, concentration L3, concentration L4 and concentration L5", "concentration L2, concentration L3, concentration L4 and concentration L5", or "concentration L1, concentration L2, concentration L3, concentration L4 and concentration L5".

Concentration level H1, concentration level H2, concentration level H3, concentration level H4, concentration level H5, concentration level H6, concentration level L1, concentration level L2, concentration level L3, concentration level L4, concentration level L5, and concentration level L6 may each be a fixed value or a value that can be changed by user B, etc.

The volume control unit 163 causes the content sound indicated by the sound information contained in content A to be emitted from the sound emitting unit 2b of the AR glasses 2.

The volume control unit 163 controls the volume of the content sound based on the concentration level C estimated by the estimation unit 162. For example, as shown in Fig. 3, when the concentration level C is equal to or higher than the first level Lv1, the volume control unit 163 sets the volume of the content sound to a volume lower than the volume of the content sound when the concentration level C is lower than the first level Lv1.

The volume control unit 163 may decrease the volume of the content sound in response to an increase in the concentration level C. For example, as shown in FIG. 4 or FIG. 5, the volume control unit 163 may decrease the volume of the content sound in response to an increase in the concentration level C, and increase the volume of the content sound in response to a decrease in the concentration level C. In the example shown in FIG. 4, the relationship between the concentration level C and the volume of the content sound is a linear relationship. In the example shown in FIG. 5, the relationship between the concentration level C and the volume of the content sound is a non-linear relationship.

In the example shown in Figure 4 and the example shown in Figure 5, when the concentration level C is equal to or higher than the first level Lv1, the volume control unit 163 sets the volume of the content sound to a volume lower than the volume of the content sound when the concentration level C is less than the first level Lv1.

In an example in which the volume of the content sound when the concentration level C is equal to or higher than the first level Lv1 is set to a volume lower than the volume of the content sound when the concentration level C is less than the first level Lv1, the relationship between the concentration level C and the volume of the content sound is not limited to the relationship shown in Figure 3, Figure 4, or Figure 5. For example, the relationship between the concentration level C and the volume of the content sound may be the relationship shown in Figure 6.

The method of controlling the volume of the content sound based on the concentration level C is not limited to the above-mentioned method and can be modified as appropriate. For example, the relationship between the concentration level C and the volume of the content sound may be the relationship shown in Figure 7.

By controlling the volume of the content sound based on the concentration level C, it becomes possible to control the volume of the content sound so that user B does not become too concentrated on content A. This makes it possible to prevent user B from neglecting his/her awareness of the real world.

The volume control unit 163 generates a sound signal indicating the content sound based on the sound information of content A contained in content A. The volume control unit 163 determines the amplification rate of the sound signal based on the concentration level C. An increase in the amplification rate of the sound signal causes an increase in the volume of the content sound. A decrease in the amplification rate of the sound signal causes a decrease in the volume of the content sound.

For example, when the concentration level C is less than the first level Lv1, the volume control unit 163 determines a first amplification rate as the amplification rate of the sound signal. When the concentration level C is equal to or greater than the first level Lv1, the volume control unit 163 determines a second amplification rate smaller than the first amplification rate as the amplification rate of the sound signal. The volume control unit 163 may decrease the amplification rate of the sound signal in response to an increase in the concentration level C. The volume control unit 163 may decrease the amplification rate of the sound signal in response to an increase in the concentration level C, and increase the amplification rate of the sound signal in response to a decrease in the concentration level C. The volume control unit 163 generates the content sound signal A1 by amplifying the sound signal at the amplification rate determined based on the concentration level C. The volume control unit 163 controls the volume of the content sound by providing the content sound signal A1 to the AR glasses 2 via the communication device 14.

The display control unit 164 causes the content image to be displayed on the display unit 2a of the AR glasses 2 based on the image information of content A contained in content A. The display control unit 164 controls the display mode of the content image based on the concentration level C.

For example, the display control unit 164 increases the size of the content image in response to an increase in the concentration level C. The display control unit 164 may increase the size of the content image in response to an increase in the concentration level C, and decrease the size of the content image in response to a decrease in the concentration level C. The size of the content image based on the concentration level C is an example of a display mode of the content image based on the concentration level C. When the size of the content image increases in response to an increase in the concentration level C, the visibility of the content image improves. Therefore, the time required by user B to view the content image can be shortened in response to an increase in the concentration level C. This makes it possible to prevent user B from concentrating too much on the content image (content A).

The display control unit 164 may increase the resolution of the content image in response to an increase in the concentration level C. The display control unit 164 may increase the resolution of the content image in response to an increase in the concentration level C, and decrease the resolution of the content image in response to a decrease in the concentration level C. The resolution of the content image based on the concentration level C is an example of a display mode of the content image based on the concentration level C. When the resolution of the content image increases in response to an increase in the concentration level C, the image quality of the content image improves. As the resolution of the content image increases, that is, as the image quality of the content image improves, the visibility of the content image improves. Therefore, the time required by user B to view the content image can be shortened in response to an increase in the concentration level C. This makes it possible to prevent user B from concentrating too much on the content image (content A).

The display control unit 164 may move the display position of the content image closer to the edge of the display unit 2a as the concentration level C increases. The display control unit 164 may move the display position of the content image closer to the edge of the display unit 2a as the concentration level C increases, and move the display position of the content image closer to the center of the display unit 2a as the concentration level C decreases. The display position of the content image based on the concentration level C is an example of a display mode of the content image based on the concentration level C. The closer the display position of the content image is to the edge of the display unit 2a, the easier it is to see the real world. Therefore, the visibility of the real world improves as the concentration level C increases. This prevents user B from concentrating too much on the content image (content A) and neglecting recognition of the real world.

The display control unit 164 may increase the transmittance of the content image in response to an increase in the concentration level C. The display control unit 164 may increase the transmittance of the content image in response to an increase in the concentration level C, and decrease the transmittance of the content image in response to a decrease in the concentration level C. The transmittance of the content image based on the concentration level C is an example of a display mode of the content image based on the concentration level C. When the transmittance of the content image increases in response to an increase in the concentration level C, the real world becomes easier to see. Therefore, the visibility of the real world improves in response to an increase in the concentration level C. This can prevent user B from concentrating too much on the content image (content A) and neglecting his/her recognition of the real world.

The display control unit 164 may decrease the display time of the content image in response to an increase in the concentration level C. The display control unit 164 may decrease the display time of the content image in response to an increase in the concentration level C, and increase the display time of the content image in response to a decrease in the concentration level C. The display time of the content image in response to the concentration level C is an example of a display mode of the content image based on the concentration level C. In this case, it is possible to prevent user B from becoming immersed in the content image (content A).

The display control unit 164 may hide the content image when the concentration level C is equal to or higher than the second level Lv2. Hiding the content image means setting the display time of the content image to "0". The second level Lv2 may be the same as or different from the first level Lv1. In this case, too, it is possible to prevent user B from becoming immersed in the content image (content A).

The display control unit 164 generates a content image signal A2 by performing image processing based on the concentration level C on the image information of content A contained in content A. The content image signal A2 indicates a content image in a display mode based on the concentration level C.

Image processing based on concentration level C is, for example, a first image processing that increases the size of the content image as the concentration level C increases and decreases the size of the content image as the concentration level C decreases.

The image processing based on the concentration level C may be a second image processing that increases the resolution of the content image in response to an increase in the concentration level C and decreases the resolution of the content image in response to a decrease in the concentration level C.

The image processing based on the concentration level C may be a third image processing that moves the display position of the content image closer to the edge of the display unit 2a as the concentration level C increases, and moves the display position of the content image closer to the center of the display unit 2a as the concentration level C decreases.

The image processing based on the concentration level C may be a fourth image processing that increases the transparency of the content image in response to an increase in the concentration level C and decreases the transparency of the content image in response to a decrease in the concentration level C.

The image processing based on the concentration level C may be a fifth image processing which reduces the display time of the content image in response to an increase in the concentration level C and increases the display time of the content image in response to a decrease in the concentration level C.

The image processing based on the concentration degree C may include at least two of the first image processing to the fifth image processing. At least two of the first image processing to the fifth image processing may be, for example, "first image processing and second image processing", "first image processing and third image processing", "first image processing and fourth image processing", "first image processing and fifth image processing", "second image processing and third image processing", "second image processing and fourth image processing", "second image processing and fifth image processing", "third image processing and fourth image processing", "third image processing and fifth image processing", "fourth image processing and fifth image processing", "first image processing, second image processing and third image processing", "first image processing, second image processing and fourth image processing", "first image processing, second image processing and fifth image processing", "first image processing, third image processing and fourth image processing", "first image processing, third image processing and fifth image processing", This means "first image processing, fourth image processing, and fifth image processing", "second image processing, third image processing, and fourth image processing", "second image processing, third image processing, and fifth image processing", "second image processing, fourth image processing, and fifth image processing", "third image processing, fourth image processing, and fifth image processing", "first image processing, second image processing, third image processing, and fifth image processing", "first image processing, second image processing, fourth image processing, and fifth image processing", "first image processing, third image processing, fourth image processing, and fifth image processing", or "first image processing, second image processing, third image processing, fourth image processing, and fifth image processing".

The display control unit 164 generates a content image signal A2 by performing image processing on the image information of the content A based on the concentration level C, and provides the content image signal A2 to the AR glasses 2 via the communication device 14. The display control unit 164 controls the display mode of the content image by providing the content image signal A2 to the AR glasses 2.

A3: AR Glasses 2
8 is a diagram showing an example of the AR glasses 2. The AR glasses 2 include a display unit 2a and a sound output unit 2b, as well as a communication device 2c, a storage device 2d, a processing device 2e, and a bus 2f. The display unit 2a, the sound output unit 2b, the communication device 2c, the storage device 2d, and the processing device 2e are connected to each other by a bus 2f for communicating information. The bus 2f may be configured using a single bus, or may be configured using different buses between elements such as devices.

The communication device 2c communicates with the mobile device 1 via a wired connection. The communication device 2c may also communicate with the mobile device 1 wirelessly.

The storage device 2d is a recording medium that can be read by the processing device 2e. The storage device 2d includes, for example, a non-volatile memory and a volatile memory. The storage device 2d stores the program PG2.

The processing device 2e includes one or more CPUs. The processing device 2e reads the program PG2 from the storage device 2d. The processing device 2e functions as an operation control unit 2e1 by executing the program PG2. The operation control unit 2e1 may be configured by circuits such as a DSP, an ASIC, a PLD, and an FPGA.

The operation control unit 2e1 controls the operation of the AR glasses 2. For example, the operation control unit 2e1 provides the content sound signal A1 received by the communication device 2c from the portable device 1 to the sound emission unit 2b. The sound emission unit 2b emits the content sound indicated by the content sound signal A1. The operation control unit 2e1 provides the content image signal A2 received by the communication device 2c from the portable device 1 to the display unit 2a. The display unit 2a displays the content image indicated by the content image signal A2.

A4: Description of Operation FIG. 9 is a diagram for explaining an example of the operation of the portable device 1. As shown in FIG.

In step S101, the acquisition unit 161 acquires content A from the content distribution device 3 via the communication device 13.

Next, in step S102, the estimation unit 162 estimates the concentration level C based on the content A and the user information Ba. For example, the estimation unit 162 estimates the concentration level C based on the content A and the preference information Bc. The estimation unit 162 sets the concentration level C estimated when the content A matches the preference of the user B to a concentration level greater than the concentration level C estimated when the content A does not match the preference of the user B.

Next, in step S103, the volume control unit 163 controls the volume of the content sound based on the concentration level C, and the display control unit 164 controls the display mode of the content image based on the concentration level C.

In step S103, the volume control unit 163 generates a sound signal indicating the content sound based on the sound information included in the content A. Next, when the concentration level C is less than the first level Lv1, the volume control unit 163 determines a first amplification rate as the amplification rate of the sound signal. When the concentration level C is equal to or greater than the first level Lv1, the volume control unit 163 determines a second amplification rate lower than the first amplification rate as the amplification rate of the sound signal. The volume control unit 163 generates the content sound signal A1 by amplifying the sound signal at an amplification rate based on the concentration level C. The volume control unit 163 provides the content sound signal A1 to the AR glasses 2 via the communication device 14. The operation control unit 2e1 of the AR glasses 2 provides the content sound signal A1 provided from the volume control unit 163 of the portable device 1 to the sound emission unit 2b. The sound emission unit 2b emits the content sound indicated by the content sound signal A1.

In addition, in step S103, the display control unit 164 performs image processing based on the concentration level C on the image information of content A to generate a content image signal A2 indicating a content image in a display mode based on the concentration level C. The display control unit 164 provides the content image signal A2 to the AR glasses 2. The operation control unit 2e1 of the AR glasses 2 provides the content image signal A2 provided from the display control unit 164 of the portable device 1 to the display unit 2a. The display unit 2a displays the content image indicated by the content image signal A2.

A5: Summary of the First Embodiment According to the first embodiment, the volume control unit 163 controls the volume of the content sound based on the concentration level C estimated by the estimation unit 162. Therefore, compared to a configuration in which volume control based on the concentration level C is not performed, it is possible to control the volume of the content sound to prevent user B from concentrating too much on content A. It is also possible to prevent user B from concentrating too much on content A and neglecting recognition of the real world.

When the concentration level C is equal to or higher than the first level Lv1, the volume control unit 163 sets the volume of the content sound to a volume lower than the volume of the content sound when the concentration level C is lower than the first level Lv1. This makes it more difficult for user B to become immersed in content A compared to a configuration in which the volume is not controlled. In addition, the volume of the content sound can be controlled according to a simple comparison of the magnitude relationship between the first level Lv1 and the concentration level C.

When the volume control unit 163 reduces the volume of the content sound in response to an increase in the concentration level C, it becomes more difficult for user B to become immersed in content A, compared to a configuration in which the volume of the content sound is not reduced in response to an increase in the concentration level C. In addition, the volume of the content sound can be precisely controlled in response to an increase in the concentration level C.

The display control unit 164 controls the display mode of the content image based on the concentration level C. Therefore, both the display mode of the content image and the volume of the content sound are controlled based on the concentration level C. Therefore, it is possible to match the change in the volume of the content sound to the change in the display mode of the content image.

The user information Ba includes preference information Bc indicating the user's preferences. Therefore, the estimation unit 162 can estimate the concentration level C based on the content A and the preference information Bc. In this case, it is possible to estimate the concentration level C based on the preferences of the user B.

B: Modifications The following are modifications of the above-described embodiment. Two or more modifications selected from the following modifications may be combined as appropriate within the scope of not being mutually contradictory.

B1: First Modification In the first embodiment, the user information Ba may include attribute information indicating an attribute of a user. The attribute of the user is, for example, the gender of the user B. The attribute of the user is not limited to the gender of the user B, and may be, for example, the age of the user B.

If the user information Ba includes attribute information, the estimation unit 162 may estimate the concentration level C based on the content A and the attribute information in step S102 of FIG. 9. Below, the first modified example is explained using an example in which the content A has meta information.

For example, in a situation where the meta information of content A indicates that content A is a video introducing women's clothing, and the attribute information indicates a female, the estimation unit 162 estimates the concentration level C to be a concentration level Ha that is greater than the first level Lv1.

In a situation where the meta information of content A indicates that content A is a video introducing women's clothing, and the attribute information indicates male, the estimation unit 162 estimates the concentration level C to be a concentration level La that is smaller than the first level Lv1.

In a situation where the meta information of content A indicates that content A is a video introducing services for people aged 70 or older, and the attribute information indicates an age of 70 or older, the estimation unit 162 estimates a concentration level Hb that is greater than the first level Lv1 as the concentration level C. The concentration level Hb may be the same value as the concentration level Ha or a different value.

In a situation where the meta information of content A indicates that content A is a video introducing a service for people aged 70 or older, and the attribute information indicates an age of less than 70 years old, the estimation unit 162 estimates a concentration level Lb, which is lower than the first level Lv1, as the concentration level C. The concentration level Lb may be the same value as the concentration level La or may be a different value.

According to the first variant example, the estimation unit 162 can estimate the concentration level C using the attributes of user B.

B2: Second Modification In the first embodiment and the first modification, the user information Ba may include motion information related to the motion of user B. The motion of user B is, for example, the walking motion of user B. The motion information related to the motion of user B is, for example, information indicating the walking speed of user B. The walking speed of a person such as user B tends to decrease as the concentration level of the person increases, and to increase as the concentration level of the person decreases.

In the second variant, the AR glasses 2 have an acceleration sensor 2g as shown in Figure 10. The operation control unit 2e1 generates operation information indicating the walking speed of user B based on the output of the acceleration sensor 2g. The operation control unit 2e1 provides the operation information indicating the walking speed of user B to the mobile device 1 via the communication device 2c. The processing device 16 of the mobile device 1 stores the operation information provided from the AR glasses 2 in the storage device 15 as user information Ba.

When the AR glasses 2 do not have the acceleration sensor 2g, but the mobile device 1 has the acceleration sensor 18 as shown in Fig. 11, the processing device 16 generates motion information indicating the walking speed of user B based on the output of the acceleration sensor 18. The processing device 16 stores the motion information indicating the walking speed of user B in the storage device 15 as user information Ba.

The estimation unit 162 may estimate the concentration level C based on one of the preference information Bc and the attribute information, the content A, and the operation information.

For example, the estimation unit 162 first estimates a tentative concentration level based on one of the preference information Bc and the attribute information, and the content A. The method for estimating the tentative concentration level is similar to the method for estimating the concentration level C based on one of the preference information Bc and the attribute information, and the content A. Next, the estimation unit 162 estimates the concentration level C by adjusting the tentative concentration level based on the operation information.

For example, when the walking speed of user B indicated by the operation information is less than the first threshold, the estimation unit 162 uses the value obtained by adding the first adjustment value, which is a positive value, to the provisional concentration level as the concentration level C. Therefore, when the walking speed of user B is less than the first threshold, the concentration level C becomes greater than the provisional concentration level.

When the walking speed of user B indicated by the operation information is equal to or greater than the first threshold, the estimation unit 162 uses the value obtained by subtracting the second adjustment value, which is a value equal to or greater than 0, from the provisional concentration level as the concentration level C. Note that when the walking speed of user B indicated by the operation information is equal to or greater than the first threshold, the estimation unit 162 may estimate the provisional concentration level as the concentration level C. When the walking speed of user B is equal to or greater than the first threshold, the concentration level C is equal to or less than the provisional concentration level.

The method of generating the concentration level C by adjusting the provisional concentration level can be modified as appropriate. For example, the estimation unit 162 first determines a third adjustment value based on the walking speed of user B indicated by the operation information. The third adjustment value decreases as the walking speed of user B increases and increases as the walking speed of user B decreases. The estimation unit 162 then uses the value obtained by adding the third adjustment value to the provisional concentration level as the concentration level C. In this case, the concentration level C decreases as the walking speed of user B increases and increases as the walking speed of user B decreases.

According to the second variant, the accuracy of estimating the concentration level C can be improved compared to a configuration in which the concentration level C is estimated based on either the preference information Bc or the attribute information and the content A without using the walking speed of user B.

B3: Third Modification In the second modification, the movement of user B is not limited to the walking movement of user B. The movement of user B may be, for example, the movement of user B looking at a content image. When the movement of user B is the movement of user B looking at a content image, the movement information regarding the movement of user B is, for example, information indicating the time during which user B looks at the content image. Hereinafter, the time during which user B looks at the content image is also referred to as the "viewing time." The time (viewing time) during which a person such as user B looks at a content image tends to increase as the person's concentration level increases and decrease as the person's concentration level decreases.

In the third variant, as shown in Fig. 12, the AR glasses 2 have a camera 2h that captures an image of the eye B1 of the user B. The camera 2h is located, for example, on the bridge 93 of the AR glasses 2. In the third variant, the following operations are executed following step S103 in Fig. 9.

The operation control unit 2e1 measures the viewing time based on the captured image data generated by the camera 2h. The captured image data shows the eye B1 of the user B.

For example, the operation control unit 2e1 first detects a reference point (e.g., the inner corner of the eye) and a specific point (such as the pupil) of the eye B1 of the user B based on the captured image data. Next, the operation control unit 2e1 estimates the direction of the gaze of the user B based on the positional relationship between the reference point and the specific point. For example, the operation control unit 2e1 estimates the direction of the gaze of the user B by using a table showing the correspondence between the positional relationship between the reference point and the specific point and the direction of the gaze of the user B. Next, the operation control unit 2e1 estimates the position of the content image on the display unit 2a by analyzing the content image signal A2 provided from the mobile device 1. Next, the operation control unit 2e1 measures the time during which the content image is located in the direction of the gaze of the user B as the viewing time.

The operation control unit 2e1 then generates operation information indicating the viewing time. The operation control unit 2e1 provides the operation information indicating the viewing time to the mobile device 1 via the communication device 2c. The processing device 16 of the mobile device 1 stores the operation information provided by the operation control unit 2e1 of the AR glasses 2 in the storage device 15 as user information Ba.

When the looking time indicated by the operation information is less than the second threshold, the estimation unit 162 maintains the value of the concentration level C. When the looking time indicated by the operation information is equal to or greater than the second threshold, the estimation unit 162 changes the value of the concentration level C to a value obtained by adding a fourth adjustment value, which is a positive value, to the current value of the concentration level C. Thus, when the looking time becomes equal to or greater than the second threshold, the concentration level C increases. When the concentration level C is changed, the volume control unit 163 controls the volume of the content sound as described above based on the changed concentration level C. When the concentration level C is changed, the display control unit 164 controls the display mode of the content image as described above based on the changed concentration level C.

The fourth adjustment value may be a fixed value or may be a value that increases as the viewing time increases and decreases as the viewing time decreases. When the fourth adjustment value is a value that increases as the viewing time increases and decreases as the viewing time decreases, for example, the estimation unit 162 determines the fourth adjustment value based on the viewing time.

According to the third variant, the estimation accuracy of the concentration level C can be improved compared to a configuration in which the concentration level C is estimated based on either the preference information Bc or the attribute information and the content A without using the viewing time.

B4: Fourth Modification In the second modification, the action of user B may be the blinking action of user B. When the action of user B is the blinking action of user B, the action information regarding the action of user B is, for example, information indicating the number of blinks of user B per unit time. The unit time is, for example, 10 seconds. The unit time is not limited to 10 seconds, and may be a time shorter than 10 seconds (for example, 5 seconds) or a time longer than 10 seconds (for example, 1 minute). Hereinafter, the number of blinks of user B per unit time is also referred to as the "number of blinks." The number of blinks of a person such as user B tends to decrease as the person's concentration level increases, and to increase as the person's concentration level decreases.

In the fourth variant, as shown in Fig. 12, the AR glasses 2 have a camera 2h that captures an image of the eye B1 of user B. In the fourth variant, the following operations are performed following step S103 in Fig. 9.

The operation control unit 2e1 measures the number of blinks based on the captured image data generated by the camera 2h. The operation control unit 2e1 generates operation information indicating the number of blinks. The operation control unit 2e1 provides the operation information indicating the number of blinks to the mobile device 1 via the communication device 2c. The processing device 16 of the mobile device 1 stores the operation information provided by the operation control unit 2e1 of the AR glasses 2 in the storage device 15 as user information Ba.

If the number of blinks indicated by the operation information is less than the third threshold, the estimation unit 162 changes the value of the concentration level C to a value obtained by adding the fifth adjustment value, which is a positive value, to the current value of the concentration level C. Therefore, if the number of blinks is less than the third threshold, the concentration level C increases. When the concentration level C is changed, the volume control unit 163 controls the volume of the content sound as described above based on the changed concentration level C. When the concentration level C is changed, the display control unit 164 controls the display mode of the content image as described above based on the changed concentration level C. When the number of blinks indicated by the operation information is equal to or greater than the third threshold, the estimation unit 162 maintains the value of the concentration level C.

The fifth adjustment value may be a fixed value, or may be a value that decreases as the number of blinks increases and increases as the number of blinks decreases. When the fifth adjustment value is a value that decreases as the number of blinks increases and increases as the number of blinks decreases, for example, the estimation unit 162 determines the fifth adjustment value based on the number of blinks.

According to the fourth variant, the accuracy of estimating the concentration level C can be improved compared to a configuration in which the concentration level C is estimated based on either the preference information Bc or the attribute information and the content A without using the number of blinks.

B5: Fifth Modification In the first embodiment and the first to fourth modifications, the acquisition unit 161, the estimation unit 162, the volume control unit 163, the display control unit 164, and the user information Ba may be included in the AR glasses 2, rather than being included in the portable device 1. Also, at least one of the acquisition unit 161, the estimation unit 162, the volume control unit 163, and the display control unit 164 may be included in the portable device 1, and the rest may be included in the AR glasses 2. At least one of the acquisition unit 161, the estimation unit 162, the volume control unit 163, and the display control unit 164 means, for example, "the acquisition unit 161", "the estimation unit 162", "the volume control unit 163", "the display control unit 164", "the acquisition unit 161 and the estimation unit 162", "the acquisition unit 161 and the volume control unit 163", "the acquisition unit 161 and the display control unit 164", "the estimation unit 162 and the volume control unit 163", "the estimation unit 162 and the display control unit 164", "the volume control unit 163 and the display control unit 164", "the acquisition unit 161, the estimation unit 162 and the volume control unit 163", "the acquisition unit 161, the estimation unit 162 and the display control unit 164", "the acquisition unit 161, the volume control unit 163 and the display control unit 164", "the estimation unit 162, the volume control unit 163 and the display control unit 164", or "the acquisition unit 161, the estimation unit 162, the volume control unit 163 and the display control unit 164".

According to the fifth variant, for example, the volume of the content sound can be controlled without using the mobile device 1 to prevent user B from concentrating too much on content A.

B6: Sixth Modification In the first embodiment and the first to fifth modifications, the display control unit 164 does not need to control the display mode of the content image based on the concentration degree C.

According to the sixth variant, the load on the display control unit 164 can be reduced compared to a configuration in which the display control unit 164 controls the display mode of the content image based on the concentration level C.

C: Others (1) Each function illustrated in FIG. 2, FIG. 6, FIG. 8, FIG. 9, or FIG. 10 is realized by any combination of hardware and software. The method of realizing each function is not particularly limited. Each function may be realized by using one device that is physically or logically combined, or may be realized by using a device that is configured by connecting two or more devices that are physically or logically separated directly or indirectly (for example, by using wires, wirelessly, etc.). Each function may be realized by combining software with the one device or the multiple devices.

(2) In this specification, the term "apparatus" may be replaced with other terms such as circuit, device or unit.

(3) In each of the first embodiment and the first to sixth variants, the storage device 15 and the storage device 2d may be constituted by at least one of an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. The program may also be transmitted from a network via a telecommunications line.

(4) Each of the first embodiment and the first to sixth modified examples is based on LTE (Long Term Evolution), LTE-A (LTA-Advanced), SUPER 3G, IMT-Advanced, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), 6th generation mobile communication system (6G), xth generation mobile communication system (xG) (x is, for example, an integer or a decimal point), FRA (Future Radio Access), NR (new Radio), New radio access (NX), Future generation radio access (FX), W-CDMA (registered trademark), GSM (registered trademark), CDMA2000, UMB (Ultra Mobile Broadband), IEEE 802.11 (Wi-Fi (registered trademark)), IEEE 802.16 (WiMAX (registered trademark)), IEEE The present invention may be applied to at least one of systems using 802.20, UWB (Ultra-Wide Band), Bluetooth (registered trademark), and other suitable systems, and next-generation systems that are expanded, modified, created, or defined based on these systems. In addition, the present invention may be applied to a combination of multiple systems (e.g., a combination of at least one of LTE and LTE-A with 5G, etc.).

(5) The order of the process procedures, sequences, flow charts, etc. illustrated in the first embodiment and each of the first to sixth variants may be changed as long as there is no inconsistency. For example, the methods described herein present elements of various steps in an exemplary order and are not limited to the particular order presented.

(6) In each of the first embodiment and the first to sixth variants, the input and output information, etc. may be stored in a specific location (e.g., a memory) or may be managed using a management table. The input and output information, etc. may be overwritten, updated, or added to. The output information, etc. may be deleted. The input information, etc. may be transmitted to another device.

(7) In each of the first embodiment and the first to sixth variants, the determination may be made based on a value represented by one bit (either 0 or 1), based on a Boolean value (true or false), or based on a comparison of numerical values (e.g., a comparison with a predetermined value).

(8) The programs exemplified in the first embodiment and each of the first to sixth modified examples should be broadly construed to mean instructions, instruction sets, code, code segments, program code, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, or functions, regardless of whether they are called software, firmware, middleware, microcode, or hardware description language, or by other names. In addition, software, instructions, etc. may be transmitted and received via a transmission medium. For example, if the software is transmitted from a website, server, or other remote source using at least one of wired technology (such as coaxial cable, fiber optic cable, twisted pair, and digital subscriber line (DSL)) and wireless technology (such as infrared, microwave, etc.), at least one of these wired technology and wireless technology is included within the definition of a transmission medium.

(9) The information, etc. described in each of the first embodiment and the first to sixth modified examples may be represented using any of a variety of different technologies. For example, data, information, etc. that may be referred to throughout the above description may be represented as voltage, current, electromagnetic waves, magnetic fields, magnetic particles, optical fields, photons, or any combination thereof. Note that terms described in this specification and terms necessary for understanding this specification may be replaced with terms having the same or similar meanings.

(10) In the first embodiment and each of the first to sixth variants, the terms "system" and "network" are used interchangeably.

(11) In each of the first embodiment and the first to sixth variations, the mobile device 1 may be a mobile station. A mobile station may also be referred to by those skilled in the art as a subscriber station, a mobile unit, a subscriber unit, a wireless unit, a remote unit, a mobile device, a wireless device, a wireless communication device, a remote device, a mobile subscriber station, an access terminal, a mobile terminal, a wireless terminal, a remote terminal, a handset, a user agent, a mobile client, a client, or some other suitable term.

(12) The mobile station may be called a transmitting device, a receiving device, a communication device, or the like. The mobile station may be a device mounted on a moving object, or the moving object itself. The moving object means an object that can move. The moving speed of the moving object is arbitrary. The moving object can be stopped. The moving object includes, but is not limited to, for example, a vehicle, a transport vehicle, an automobile, a motorcycle, a bicycle, a connected car, an excavator, a bulldozer, a wheel loader, a dump truck, a forklift, a train, a bus, a handcar, a rickshaw, a ship and other watercraft, an airplane, a rocket, an artificial satellite, a drone (registered trademark), a multicopter, a quadcopter, a balloon, and objects mounted thereon. The moving object may be a moving object that runs autonomously based on an operation command. The moving object may be a vehicle (e.g., a car, an airplane, etc.), an unmanned moving object (e.g., a drone, an automatic driving vehicle, etc.), or a robot (manned or unmanned). The mobile station also includes a device that does not necessarily move during communication operation. For example, the mobile station may be an Internet of Things (IoT) device such as a sensor.

(13) In each of the first embodiment and the first to sixth modifications, the term "determining" may encompass a wide variety of actions. "Determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, search, inquiry (e.g., searching in a table, database, or other data structure), and regarding ascertaining as "determining". Also, "determining" may include regarding receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, and accessing (e.g., accessing data in memory) as "judging" or "determining". In addition, "decision" may include the deeming of resolving, selecting, choosing, establishing, comparing, etc. as having been "decided." In other words, "decision" may include the deeming of some action as having been "decided." In addition, "decision" may be interpreted as "assuming," "expecting," "considering," etc.

(14) In each of the first embodiment and the first to sixth modifications, the term "connected" or any variation thereof means any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between the elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access". As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using at least one of one or more wires, cables, and printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and light (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

(15) In each of the first embodiment and the first to sixth modified examples, the term "based on" does not mean "based only on," unless otherwise specified. In other words, the term "based on" means both "based only on" and "based at least on."

(16) Any reference to elements using designations such as "first" and "second" as used herein does not generally limit the quantity or order of those elements. These designations may be used herein as a convenient way to distinguish between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must precede the second element in some way.

(17) In each of the first embodiment and the first to sixth modified examples, when the terms "include," "including," and variations thereof are used in this specification or the claims, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this specification or the claims, it is not intended to be an exclusive logical OR.

(18) Throughout this application, where articles have been added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are plural.

(19) It is clear to those skilled in the art that the present invention is not limited to the embodiments described in this specification. The present invention can be implemented in modified and altered forms without departing from the spirit and scope of the present invention as defined by the claims. Therefore, the description in this specification is for illustrative purposes only and does not have any limiting meaning on the present invention. In addition, multiple aspects selected from the aspects exemplified in this specification may be combined.

D: Aspects Obtained from the Above-described Forms or Modifications The following aspects can be obtained from at least one of the above-described forms or modifications.

D1: First Aspect An output control device according to the first aspect includes an acquisition unit, an estimation unit, a display control unit, and a volume control unit. The acquisition unit acquires content indicating an image and a sound. The estimation unit estimates a degree of concentration of the user on the content based on the content and user information on a user wearing a transmissive display device. The display control unit causes the transmissive display device to display the image indicated by the content. The volume control unit controls the volume of the sound indicated by the content based on the degree of concentration.

According to this aspect, the volume of the sound presented by the content is controlled based on the estimated level of concentration of the user. Therefore, compared to a configuration in which volume control based on the level of concentration is not performed, it is possible to control the volume so that the user does not become too focused on the content.

D2: Second aspect In the example of the first aspect (second aspect), when the concentration level is equal to or higher than the first level, the volume control unit sets the volume of the sound to a volume lower than the volume of the sound when the concentration level is less than the first level. According to this aspect, the volume control unit reduces the volume when the estimated concentration level is equal to or higher than the first level. Therefore, compared to a configuration in which the volume is not reduced, it is difficult for the user to become immersed in the content. In addition, the volume can be controlled based on a simple determination result of the magnitude relationship between the first level and the concentration level.

D3: Third aspect In the example of the first aspect (third aspect), the volume control unit reduces the volume of the sound in response to an increase in the concentration level. According to this aspect, the volume control unit reduces the volume in response to an increase in the estimated concentration level. Therefore, compared to a configuration in which the volume is not reduced in response to an increase in the estimated concentration level, it is possible to make it difficult for the user to become immersed in the content. In addition, the volume can be precisely controlled in response to an increase in the concentration level.

D4: Fourth Aspect In any of the first to third aspects (fourth aspect), the display control unit controls the display mode of the image shown by the content based on the concentration level. According to this aspect, both the display mode of the image and the volume can be controlled based on the concentration level. Therefore, the volume can be changed in accordance with the change in the display mode.

D5: Fifth Aspect In any of the examples (fifth aspect) of the first to fourth aspects, the user information includes attribute information indicating the attributes of the user, or preference information indicating the preferences of the user. According to this aspect, the degree of concentration of the user on the content can be estimated based on the user's attributes or the user's preferences. Therefore, it is possible to control the volume based on the user's attributes or the user's preferences to prevent the user from concentrating too much on the content.

D6: Sixth Aspect In any of the examples (sixth aspect) of the first to fifth aspects, the user information includes motion information regarding the motion of the user. According to this aspect, the degree of concentration of the user on the content can be estimated based on the user's motion. Therefore, it is possible to control the volume based on the user's motion to prevent the user from concentrating too much on the content.

1...mobile device, 2...AR glasses, 2a...display unit, 2b...sound emission unit, 2c...communication device, 2d...storage device, 2e...processing device, 2e1...operation control unit, 2f...bus, 2g...acceleration sensor, 2h...camera, 3...content distribution device, 11...input device, 12...output device, 13...communication device, 14...communication device, 15...storage device, 16...processing device, 17...bus, 18...acceleration sensor, 161...acquisition unit, 162...estimation unit, 163...volume control unit, 164...display control unit.

Claims (6)

an acquisition unit that acquires content representing images and sounds;
an estimation unit that estimates a concentration level of the user on the content based on the content and user information related to a user wearing a transmissive display device;
a display control unit that causes the image represented by the content to be displayed on the transmissive display device;
a volume control unit that controls a volume of the sound represented by the content based on a degree of concentration of the user on the content estimated based on the content and the user information;
Including,
The user information includes preference information indicating preferences of the user,
the estimation unit sets a concentration degree estimated when the content matches the user's preference indicated in the preference information to a concentration degree greater than a concentration degree estimated when the content does not match the user's preference indicated in the preference information.
Output control device. When the degree of concentration is equal to or higher than a first level, the volume control unit sets the volume of the sound to a volume lower than the volume of the sound when the degree of concentration is lower than the first level.
The output control device according to claim 1 . The volume control unit reduces the volume of the sound in response to an increase in the degree of concentration.
The output control device according to claim 1 . The display control unit controls a display mode of the image represented by the content based on the concentration degree.
The output control device according to any one of claims 1 to 3. The user information includes attribute information indicating attributes of the user.
The output control device according to any one of claims 1 to 4. The user information includes motion information regarding a motion of the user.
The output control device according to any one of claims 1 to 5.

Images