JP7819538B2 - Image processing device, image processing method, and program - Google Patents

Description

The present invention relates to an image processing device, an image processing method, and a program.

Conventionally, a system has been disclosed in which information indicating the type of scene the video data represents is added to the video data viewed by the user, based on image data output for each frame (for example, Patent Document 1).

Japanese Patent Application Laid-Open No. 2018-42253

However, when processing image data as in Patent Document 1, it is necessary to provide images that meet the user's requirements.

The present invention has been made in consideration of the above, and aims to provide an image processing device, image processing method, and program that can provide images that meet the user's requirements.

The image processing device according to the present invention includes an object information acquisition unit that acquires information about a first object, an object detection unit that detects the first object and a second object related to the first object from image data, and a display mode change unit that changes the display mode of the second object when the first object is detected.

The image processing device of the present invention includes an object information acquisition unit that acquires information about a specific region and information about a first object; a location information processing unit that determines whether a user's location is within the specific region based on the user's location information; an object detection unit that detects the first object related to the specific region and a second object related to the first object from image data; and a display mode change unit that changes the display mode of the second object when it is determined that the user's location is within the specific region and the first object related to the specific region is detected.

The image processing method of the present invention includes the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from image data, and, if the first object is detected, changing the display mode of the second object.

The program of the present invention includes the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from image data, and, when the first object is detected, changing the display mode of the second object.

The present invention provides an image processing device that can provide an image that meets a user's requirements based on image data.

FIG. 1 is a diagram showing an example of an image processing system according to this embodiment. FIG. 2 is a diagram showing an example of an image displayed by the image processing apparatus according to this embodiment. FIG. 3 is a functional block diagram showing an example of an image processing system according to this embodiment. FIG. 4 is a diagram showing an example of a main image in which the main image and the sub-image are superimposed in the first embodiment. FIG. 5 is a diagram showing an example of display mode change information according to this embodiment. FIG. 6 is a flowchart according to this embodiment. FIG. 7 is a diagram showing an example of a main image in which the main image and the sub-image are superimposed in the second embodiment.

Embodiments of an image processing device, image processing method, and program according to the present invention will be described below with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments. Furthermore, the components in these embodiments include those that are easily replaceable by those skilled in the art, or those that are substantially identical.

(First embodiment)
FIG. 1 is a diagram illustrating an example of an image processing system according to the present embodiment. The image processing system 1 according to the first embodiment is a device that provides information to a user U by outputting visual stimuli to the user U. As illustrated in FIG. 1, the image processing system 1 is a so-called wearable device that is worn on the body of the user U. In this embodiment, the image processing system 1 includes an image processing device 100 worn on the eye of the user U. The image processing device 100 worn on the eye of the user U includes an output unit 120 (described below) that outputs visual stimuli (displays images) to the user U. However, the configuration in FIG. 1 is merely an example, and the number of devices and their positions on the user U may be arbitrary. For example, the image processing system 1 is not limited to a wearable device and may be a device carried by the user U, such as a smartphone or tablet terminal.

(Main statue)
2 is a diagram showing an example of an image displayed by the image processing device according to this embodiment. As shown in FIG. 2, the image processing system 1 provides a main image PM to the user U through the output unit 120. This allows the user U wearing the image processing system 1 to view the main image PM. In this embodiment, the main image PM is an image of the scenery that the user U would view if the user U were not wearing the image processing system 1, and can also be said to be an image of an actual object that falls within the user U's field of view. The field of view refers to the range that can be seen without moving the user U's eyes, centered on the user U's line of sight.

In this embodiment, the image processing system 1 provides the user U with the main image PM by, for example, transmitting external light (ambient visible light) from the output unit 120. That is, in this embodiment, the user U can be said to directly view an image of the actual scenery through the output unit 120. However, the image processing system 1 is not limited to allowing the user U to directly view an image of the actual scenery, and may provide the user U with the main image PM through the output unit 120 by displaying an image of the main image PM on the output unit 120. In this case, the user U will view the image of the scenery displayed on the output unit 120 as the main image PM. In this case, the image processing system 1 displays, on the output unit 120, an image captured by the imaging unit 200 (described below) that falls within the user U's field of view as the main image PM.

(Sub image)
2, the image processing system 1 displays the sub-image PS on the output unit 120 so as to be superimposed on the main image PM provided through the output unit 120. As a result, the user U visually recognizes an image in which the sub-image PS is superimposed on the main image PM. The sub-image PS is an image superimposed on the main image PM, and can be said to be an image other than an actual scene that falls within the field of view of the user U. In other words, the image processing system 1 can be said to provide the user U with AR (Augumented Reality) by superimposing the sub-image PS on the main image PM, which is an actual scene.

In this way, the image processing system 1 provides a main image PM and a sub-image PS, but it may also display an image different from the main image PM and the sub-image PS on the output unit 120, and may be any image.

(Image processing system configuration)
3 is a functional block diagram showing an example of an image processing system according to this embodiment. As shown in FIG. 3, the image processing system 1 includes an image processing device 100 and an imaging unit 200. The image processing device 100 includes an input unit 110, an output unit 120, a storage unit 140, a communication unit 130, and a control unit 150.

(imaging unit)
The imaging unit 200 is an imaging device that captures images of the periphery of the image processing system 1 by detecting visible light around the image processing system 1 as environmental information. The imaging unit 200 may be a video camera that captures images at a predetermined frame rate. The imaging unit 200 may be provided in any position and orientation in the image processing system 1. For example, the imaging unit 200 may be provided in the image processing device 100 shown in FIG. 1 , and the imaging direction may be the direction in which the face of the user U is facing. This allows the imaging unit 200 to capture an object in the line of sight of the user U, i.e., an object within the field of view of the user U. The number of imaging units 200 may be any number, and may be one or more.

(Input section)
The input unit 110 is a device that accepts user operations, and may be, for example, a touch panel.

(output section)
The output unit 120 is a display that outputs visual stimuli to the user U by displaying an image, and can also be referred to as a visual stimulus output unit. In this embodiment, the output unit 120 is a so-called HMD (Head Mount Display). As described above, the output unit 120 displays the sub-image PS. Note that the output unit 120 may also be provided with an audio output unit (speaker) that outputs audio, or a tactile stimulus output unit that outputs tactile stimuli to the user U. The tactile stimulus output unit outputs tactile stimuli to the user by physically operating, such as by vibration, but the type of tactile stimulus is not limited to vibration and may be any type.

(Communications Department)
The communication unit 130 is a module that communicates with an external device, etc., and may include, for example, an antenna, etc. In this embodiment, the communication method used by the communication unit 130 is wireless communication, but any communication method may be used.

(Control unit)
The control unit 150 is a computing device, i.e., a central processing unit (CPU). The control unit 150 includes an image data acquisition unit 151, an object information acquisition unit 152, an object detection unit 153, and a display mode change unit 154. The control unit 150 reads and executes a program (software) from the storage unit 140, thereby realizing the image data acquisition unit 151, the object information acquisition unit 152, the object detection unit 153, and the display mode change unit 154 and executing these processes. The control unit 150 may execute these processes using a single CPU, or may be provided with multiple CPUs and execute the processes using the multiple CPUs. Furthermore, at least a portion of the image data acquisition unit 151, the object information acquisition unit 152, the object detection unit 153, and the display mode change unit 154 may be implemented by hardware.

(Image data acquisition unit)
The image data acquisition unit 151 acquires image data through the imaging unit 200. In this embodiment, the image data is an image of the main image PM, which is an environmental image that the user U would visually recognize if the user U were not wearing the image processing system 1, and can also be said to be an image of an actual object within the field of view of the user U. The image data acquisition unit 151 may acquire the image data from the storage unit 140.

Figure 4 is a diagram showing an example of a main image in which a main image and a sub-image are superimposed in the first embodiment. In the example of Figure 4, the image data acquisition unit 151 acquires the main image PM1 viewed by the user U as image data. In the example of Figure 4, the main image PM1 is a scene in which the user U, who is a child, receives an injection from a nurse in the presence of a guardian, and includes a syringe O10 and a human face O20. Below, this embodiment will be described using an injection scene as an example, but this embodiment is not limited to this example.

(Object information acquisition unit)
The object information acquisition unit 152 acquires information about the first object. The information about the first object is information about an object designated as the first object. It can also be said that the object information acquisition unit 152 acquires information indicating the type of the first object (information indicating what kind of object the first object is). In this embodiment, the object information acquisition unit 152 acquires, as the information about the first object, information about an object that causes the user U to feel fear or disgust when gazing at it.

Here, an object refers to a real object that has a certain shape and can be perceived visually. In this embodiment, the first object is, for example, an object that evokes a sense of fear or disgust in the user U, and can also be said to be an object that may intensify the user U's sense of fear or disgust if the user U gazes upon it. In the example of Figure 4, the syringe O10 corresponds to the first object.

(Display mode change information)
In this embodiment, the object information acquisition unit 152 acquires display mode change information D. FIG. 5 is a diagram illustrating an example of the display mode change information according to this embodiment. The display mode change information D includes information on a first object, information on a second object, a predetermined condition, and a changed display mode of the second object. The display mode change information D can be considered data that associates the first object, the second object, the predetermined condition, and the changed display mode of the second object. The second object is an object related to the first object, and can also be considered an object that the user U is likely to view together with the first object. The predetermined condition refers to a condition related to the second object whose display mode is to be changed. In other words, the predetermined condition refers to a condition for selecting a second object whose display mode is to be changed from among multiple types of second objects. The changed display mode of the second object refers to the display mode of the second object that the user U will view, and more specifically, is information indicating a sub-image PS to be superimposed on the second object. The display mode change information D may include, for different first objects, information on the second object, a predetermined condition, and the changed display mode of the second object. That is, multiple types of first objects may be set, and the display mode change information D may be set for each of the first objects.

The object information acquisition unit 152 may acquire the display mode change information D using any method; for example, the user U may input the first object, the second object, predetermined conditions, and the changed display mode of the second object. Furthermore, the object information acquisition unit 152 may determine the second object, predetermined conditions, and the changed display mode of the second object based on the information about the first object input by the user U. Furthermore, setting the display mode change information D by input by the user U is not required, and may be determined by default.

(Object detection unit)
The object detection unit 153 detects a first object and a related second object from the image data based on the display mode change information D. More specifically, the object detection unit 153 detects whether the first object specified in the display mode change information D and the second object associated with the first object in the display mode change information D are included in the image data (the main image PM1 viewed by the user). The object detection unit 153 may detect the first object and the second object using any method. For example, the object detection unit 153 may detect the first object and the second object using an AI (Artificial Intelligence) model. In this case, the AI model is stored in the storage unit 140 and is a model for extracting objects appearing in the image from the image data and identifying their types. The AI model is a trained AI model constructed by learning using multiple datasets as training data, with the image data and information indicating the types of objects appearing in the image as one dataset. 4, a syringe O10 is set as the first object, and a human face O20 is set as the second object. Therefore, the object detection unit 153 detects, from the image data, the syringe O10, which is the first object, and the human face O20, which is the second object corresponding to the syringe O10 in the display mode change information D.

(Display mode change unit)
The display mode modification unit 154 changes the display mode of the second object when a first object is detected. In this embodiment, when a first object and a second object are detected from the same image data, the display mode modification unit 154 changes the display mode of the second object that satisfies a predetermined condition based on the display mode modification information D. Specifically, the display mode modification unit 154 determines whether the second object detected from the image data satisfies the predetermined condition indicated by the display mode modification information D.

When multiple second objects are detected, the display mode modification unit 154 determines for each second object whether it satisfies the predetermined condition indicated in the display mode modification information D, and extracts the second objects that satisfy the predetermined condition. The display mode modification unit 154 then changes the display mode of the second objects by displaying a sub-image PS at a position superimposed on the second objects that satisfy the predetermined condition. More specifically, the display mode modification unit 154 displays the sub-image PS indicated in the display mode modification information D at a position superimposed on the second objects that satisfy the predetermined condition. For second objects that do not satisfy the predetermined condition, the display mode modification unit 154 does not display the sub-image PS at the superimposed position, and the display mode of the second objects is not changed.

In this embodiment, the sub-image PS is an image displayed on the second object to make it difficult for the user U to focus on the first object, which is a specific object included in the main image PM. Any image, such as text or an icon, may be used, or a combination of these, as long as it makes it difficult for the user U to focus on the first object. In the example of FIG. 4, the condition for the second object to change its display mode is that it must not be the face O22 of the user U's guardian. When a syringe O10 and a human face O21 are detected, the display mode change unit 154 superimposes, as a sub-image PS1, an image of a rabbit's face, for example, only on the nurse's face O21, which satisfies the condition. On the other hand, the display mode change unit 154 does not superimpose the sub-image PS1 on the guardian's face O22, which does not satisfy the specified condition. In this case, the user U will view the guardian's face O22 as is.

In the above description, the combination of the first object, the second object, a predetermined condition, and the changed display mode of the second object was set in advance as the display mode change information D. However, this is not limited to this. For example, the sub-image PS, which is the changed display mode of the second object, does not need to be set in advance, and any image may be superimposed on the second object. Furthermore, the changed display mode of the second object is not limited to the sub-image PS superimposed on the second object, but may be an optical processing performed on the second object, such as color adjustment or blurring. In the above description, the second object (here, a human face O20) is detected, and the display mode of only the second object (here, the nurse's face O21) that satisfies a predetermined condition is changed. However, this is not limited to this. For example, a predetermined condition may be imposed when detecting the second object, and the object detection unit 153 may detect the second object that satisfies the predetermined condition. In other words, the object detection unit 153 may detect only the nurse's face O21 without detecting all human faces O20. Furthermore, the predetermined condition is not necessarily required, and the display mode change unit 154 may change the display mode of the second object when the first object is detected.

(Storage part)
The storage unit 140 is a memory that stores various information such as the calculation contents and programs of the control unit 150, and includes at least one of a main storage device such as a RAM (Random Access Memory), a ROM (Read Only Memory), and an external storage device such as an HDD (Hard Disk Drive). The storage unit 140 stores display mode change information D. Note that the display mode change information D and the program for the control unit 150 stored in the storage unit 140 may be stored in a recording medium readable by the image processing system 1. Furthermore, the program for the control unit 150 and the display mode change information D stored in the storage unit 140 are not necessarily stored in advance in the storage unit 140, and the image processing system 1 may obtain these data from an external device via the communication unit 130 when using these data.

(effect)
Here, it is required to provide an image that meets the user's request. In response to this, according to this embodiment, by setting a first object and changing the display mode of a related second object, it is possible to direct the user U's attention to the second object. Therefore, by setting the first object to an object that, for example, evokes fear or disgust in the user U, it becomes difficult for the user U to focus on the first object. This makes it possible to provide an image that meets the user's request.

(flowchart)
6 is a flowchart according to this embodiment. The processing performed by the image processing device 100 will be described below.

The image data acquisition unit 151 acquires image data through the imaging unit 200 (step S10). Next, the object detection unit 153 detects a first object and a second object related to the first object from the image data based on the display mode change information D (step S20). If the first object is detected from the image data (step S30; Yes), and the second object satisfies a predetermined condition (step S40; Yes), the display mode change unit 154 changes the display mode of the second object (step S50). If the second object does not satisfy the predetermined condition (step S40; No), the display mode change unit 154 does not change the display mode of the second object. In this case, the user U views an image of the main image PM in which the sub-image PS is superimposed on the second object that satisfies the predetermined condition, i.e., a main image in which the display mode of the second object that satisfies the predetermined condition has been changed. On the other hand, if the first object is not detected from the image data in step S30 (step S30; No), the display mode of the second object is not changed. At this time, the user U will only be able to see the main image PM.

Second Embodiment
The second embodiment differs from the first embodiment in that the display mode of the second object is changed to make it easier for the user U to recognize the first object. Descriptions of parts of the second embodiment that are common to the first embodiment will be omitted.

(Image data acquisition unit)
7 is a diagram showing an example of a main image in which a main image and a sub-image are superimposed in the second embodiment. In the example of FIG. 7, the image data acquisition unit 151 acquires, as image data, a main image PM2 that a user U is viewing. In the example of FIG. 7, the main image PM2 is a scene in which the user U is searching for a sign for store A in a busy shopping district, and includes a sign O15 for store A and signs O25 for all stores. Hereinafter, this embodiment will be described using a scene of a store sign as an example, but this embodiment is not limited to this example.

(Object information acquisition unit)
In this embodiment, the object information acquisition unit 152 acquires information about an object that the user U needs to recognize as information about the first object. In this embodiment, the first object is, for example, an object that the user U wishes to recognize, and it can also be said that the first object is an object that the user U wants to find from the main image PM2.

(Object detection unit)
In the example of Figure 7, the object detection unit 153 detects from the image data the first object, which is the signboard O15 of store A, and the second object, which is the signboard O25 of all stores, which corresponds to the signboard O15 of store A in the display mode change information D.

(Display mode change unit)
In this embodiment, the sub-image PS is an image displayed on the second object to facilitate recognition of the first object, which is a specific object included in the main image PM. Any image, such as text or an icon, may be used, or a combination of these, as long as it facilitates recognition of the first object by the user U. In the example of FIG. 7 , the condition for changing the display mode of the second object is that it must not be the sign O15 of store A. When the sign O15 of store A and the sign O25 of all stores are detected, the display mode change unit 154 performs processing such as superimposing the sub-image PS2 so as to erase the text information of the sign O26 of store B, which satisfies the condition, or superimposing the sub-image PS3 so as to erase the sign O27 of store C, which satisfies the condition. On the other hand, the sign O15 of store A, which does not satisfy the predetermined condition, is not superimposed with the sub-image PS2 or the sub-image PS3, and the user U views the sign O15 of store A as is.

(effect)
According to this embodiment, by setting a first object and changing the display mode of a related second object, it is possible to draw the attention of the user U to the first object. Therefore, by setting the first object as, for example, an object that the user U wants to find, the user U can easily recognize the first object. This makes it possible to provide an image that meets the user's request.

(Third embodiment)
The third embodiment differs from the first embodiment in that the control unit 150 further includes a location information processing unit and changes the display mode of the second object based on information about a specific area. Explanations of parts of the third embodiment that are common to the first embodiment will be omitted.

(Display mode change information)
In the present embodiment, the display mode change information D is information that further includes information about a specific region. The specific region is a specific geographical area where a user may be present, and refers to, for example, a region where the user U is expected to use the image processing system 1. Here, in the present embodiment, the first object is, for example, an object that is characteristic of the specific region, and the first object can also be said to be an object that the user U is likely to view in the specific region. The display mode change information D may include, for different specific regions, information about the first object, information about the second object, and the changed display mode of the second object. In other words, a plurality of specific regions may be set, and the display mode change information D may be set for each specific region.

(Location information processing section)
In this embodiment, the location information processing unit acquires the user's location information and determines whether the user's location is within a specific area based on the display mode change information D. Here, the user's location information refers to the geographical location where the user U actually exists. The location information processing unit may acquire the user's location information by any method, and may acquire the user's location information via the communication unit 130, for example.

(Object detection unit)
In the present embodiment, the object detection unit 153 detects a first object associated with a specific region and a second object associated with the first object from the image data based on the display mode change information D. More specifically, the object detection unit 153 detects, based on the display mode change information D, whether the first object associated with the specific region and the second object associated with the first object in the display mode change information D are included in the image data (the main image viewed by the user).

(Display mode change unit)
In this embodiment, when the user's location is determined to be within a specific area and a first object and a second object are detected from the same image data, the display mode change unit 154 changes the display mode of the second object that satisfies a specified condition based on the display mode change information D.

In the above explanation, the display mode change information D was such that the first object was associated with a specific region and the second object was associated with the first object, but this is not limited to this. For example, the first object does not have to be associated with a specific region, and the second object may be set in association with a specific region and the first object. In other words, if the user is located within a specific region and a first object is detected from image data, an arbitrary image may be superimposed on the second object associated with the specific region and the first object. In this case, the second object is an object related to the first object and the specific region, and can be said to be an object that the user U is likely to view together with the first object in the specific region.

In the above explanation, the combination of a specific region, a first object, a second object, a predetermined condition, and the changed display mode of the second object was set in advance as display mode change information D, but this is not limited to this. For example, a first object does not have to be set, and when the user's location is within a specific region, an arbitrary image may be superimposed on a second object associated with the specific region. In this case, the second object is an object related to the specific region, and can be said to be an object that user U is likely to view in the specific region.

(effect)
According to this embodiment, by setting a specific region and changing the display mode of the related second object, it is possible to change the display mode of the second object only when the user U is in the specific region, thereby making it possible to provide an image that meets the user's request.

(Effects of the present invention)
The image processing device, image processing method, and program described in each embodiment can be understood, for example, as follows.

The first aspect of the image processing device includes an object information acquisition unit 152 that acquires information about a first object, an object detection unit 153 that detects the first object and a second object related to the first object from the image data, and a display mode change unit 154 that changes the display mode of the second object when the first object is detected. With this configuration, it is possible to detect a specific object from the image data in response to a user request, and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

The image processing device of the second aspect changes the display mode of the second object if the second object satisfies a predetermined condition, and does not change the display mode of the second object if the second object does not satisfy the predetermined condition. This allows the display mode of the second object to be selectively changed, thereby better meeting user needs.

In the third aspect of the image processing device, the object information acquisition unit 152 acquires display mode change information D, which is data associating a first object, a second object, and the changed display mode of the second object, and when a first object is detected, the display mode change unit changes the display mode of the second object based on the display mode change information D. This makes it possible to change the display mode of the corresponding second object for multiple different first objects, thereby better responding to user requests.

The image processing device of the fourth aspect changes the display mode of the second object so as to make it difficult for the user U viewing the image to focus on the first object. As a result, when the user needs to avoid focusing on the first object, changing the display mode so that the second object stands out makes it easier to avoid focusing on the first object, thereby better meeting the user's needs.

The image processing device of the fifth aspect changes the display mode of the second object so that a user U viewing the image can more easily recognize the first object. Specifically, the image processing device of the fifth aspect changes the display mode of the second object to a display mode that deletes text information within the second object. As a result, when a user needs to recognize the first object, changing the display mode so that the second object does not stand out makes it easier to recognize the first object, thereby better meeting user requests.

The sixth aspect of the image processing device includes an object information acquisition unit 152 that acquires information about a specific region and information about a first object; a location information processing unit that determines whether a user's location is within the specific region based on the user's location information; an object detection unit 153 that detects a first object related to the specific region and a second object related to the first object from image data; and a display mode change unit 154 that changes the display mode of the second object when it is determined that the user's location is within the specific region and a first object related to the specific region is detected. With this configuration, it is possible to detect a specific object from image data in response to a request from a user who is in the specific region, and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

The seventh aspect of the image processing device includes an object information acquisition unit 152 that acquires information about a specific region and information about a first object; a location information processing unit that determines whether the user's location is within the specific region based on the user's location information; an object detection unit 153 that detects the first object and a second object related to the specific region and the first object from image data; and a display mode change unit 154 that changes the display mode of the second object when it is determined that the user's location is within the specific region and the first object is detected. With this configuration, it is possible to detect a specific object from image data in response to a request from a user who is in the specific region, and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

The image processing device of the eighth aspect includes a specific area information acquisition unit (object information acquisition unit 152) that acquires information about a specific area, a location information processing unit that determines whether the user's location is within the specific area based on the user's location information, an object detection unit 153 that detects an object (second object) related to the specific area from image data, and a display mode change unit 154 that changes the display mode of the object (second object) when it is determined that the user's location is within the specific area. With this configuration, it is possible to detect a specific object from image data in response to a request from a user who is in the specific area, and to add information to the image data that changes the display mode of the object. This makes it possible to provide an image that meets the user's request.

A ninth aspect of the image processing method includes the steps of acquiring information about a first object, detecting the first object and a second object related to the first object from the image data, and, if the first object is detected, changing the display mode of the second object.

A tenth aspect of the program causes a computer to execute the following steps: acquiring information about a first object; detecting the first object and a second object related to the first object from image data; and, if the first object is detected, changing the display mode of the second object.

Although the embodiments of the present invention have been described above, the embodiments are not limited to the content of these embodiments. Furthermore, the components described above include those that would be easily imagined by a person skilled in the art, those that are substantially identical, and those that are within the scope of what is known as equivalents. Furthermore, the components described above can be combined as appropriate, and the configurations of each embodiment can also be combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the embodiments described above.

1 Image processing system 100 Image processing device 110 Input unit 120 Output unit 130 Communication unit 140 Memory unit 150 Control unit 151 Image data acquisition unit 152 Object information acquisition unit 153 Object detection unit 154 Display mode change unit 200 Imaging unit D Display mode change information O10 Syringe O15, O25, O26, O27 Signboard O20, O21, O22 Face PM, PM1, PM2 Main image PS, PS1, PS2, PS3 Sub-image U User

Claims (6)

an object information acquisition unit that acquires information about a first object;
an object detection unit that detects the first object and a second object related to the first object from image data;
a display mode change unit that changes a display mode of the second object when the first object is detected and the second object is not a face of a predetermined person, and does not change a display mode of the second object when the first object is detected and the second object is a face of a predetermined person ;
An image processing device comprising: the object information acquisition unit acquires display mode change information that is data in which the first object, the second object, and a display mode of the second object after the change are associated with each other;
the display mode change unit changes the display mode of the second object based on the display mode change information when the first object is detected.
The image processing device according to claim 1 . the display mode change unit changes the display mode of the second object to a display mode in which character information in the second object is deleted;
3. The image processing device according to claim 1. an object information acquisition unit that acquires information about a specific region and information about a first object;
a location information processing unit that determines whether the user's location is within the specific area based on the user's location information;
an object detection unit that detects the first object related to the specific area and a second object related to the first object from the image data;
a display mode change unit that changes a display mode of the second object when it is determined that the user's location is within the specific area and the first object and the second object related to the specific area are detected;
An image processing device comprising: obtaining information of a first object;
detecting the first object and a second object related to the first object from image data;
a step of changing a display mode of the second object when the first object is detected and the second object is not a face of a predetermined person, and not changing a display mode of the second object when the first object is detected and the second object is a face of a predetermined person ;
An image processing method comprising: obtaining information of a first object;
detecting the first object and a second object related to the first object from image data;
a step of changing a display mode of the second object when the first object is detected and the second object is not a face of a predetermined person, and not changing a display mode of the second object when the first object is detected and the second object is a face of a predetermined person ;
A program that causes a computer to execute the following.