JP7264675B2 - processor and program - Google Patents

Description

The present invention relates to a processing device and a program.

2. Description of the Related Art In recent years, information processing apparatuses equipped with imaging devices such as cameras have become popular. Examples of such information processing devices include smart phones, mobile phone devices, tablet terminals, and the like. 2. Description of the Related Art An information processing apparatus equipped with an imaging device has a function of analyzing captured image information and automatically detecting and setting camera settings corresponding to a shooting scene (hereinafter also referred to as a "shooting mode setting function"). Proposed. By using the shooting mode setting function, the user of the information processing apparatus (hereinafter also referred to as "user") can take appropriate pictures without setting the camera according to the shooting scene.

The following prior art documents disclose that image processing is performed on image information captured by a camera and a shooting mode suitable for a shooting scene is set.

Japanese Patent Application Laid-Open No. 2018-6828

By the way, there are various kinds of images to be photographed. Therefore, when the information processing apparatus automatically detects and sets camera settings that are determined to be preferable for the shooting scene based on the shot image, depending on the combination of the set shooting conditions and the shooting target, the user's In some cases, the desired image effect was not obtained. For example, when the user attempts to capture the silhouette of a subject in backlight, the brightness of the entire captured image may be adjusted under automatically set shooting conditions.

In one aspect, the present invention provides a technology that makes it easier for a user to understand the processing effect on a captured image obtained under set shooting conditions before capturing the captured image of a subject.

The above technique is exemplified by the following processor configuration. That is, the processing device classifies the situation of photographing the subject into types from the photographed image of the subject photographed by the photographing device, sets the first photographing conditions corresponding to the classified types in the photographing device; A display in which a captured image is displayed with first information indicating a classified type of a situation and second information describing a processing effect obtained from a first imaging condition set corresponding to the classified type. and a control unit for performing:

In one aspect, it is possible to provide a technique that makes it easier for the user to understand the processing effect on the captured image obtained under the set shooting conditions before acquiring the captured image of the subject.

It is a figure which shows an example of the hardware constitutions of the processing apparatus of this embodiment. FIG. 10 is a diagram for explaining display of explanatory information and cancellation of set imaging conditions; FIG. 6 is a diagram showing an example of classification type information held in a classification type table; FIG. 10 is a state transition diagram showing an example of transition of shooting states accompanying a cancel operation; It is a figure explaining the captured image by which the display information which concerns on this embodiment was displayed. FIG. 11 is a state transition diagram showing another example of transition of shooting states accompanying a cancel operation; FIG. 11 is a state transition diagram showing another example of transition of shooting states accompanying a cancel operation; FIG. 11 is a state transition diagram showing another example of transition of shooting states accompanying a cancel operation; 8 is a flowchart illustrating processing related to display information displayed on the viewfinder; FIG. 10 is a flowchart illustrating a process related to pressing a cancel button displayed in the finder; FIG.

Hereinafter, a processing apparatus according to one embodiment will be described with reference to the drawings. The configurations of the following embodiments are examples, and the present processing apparatus is not limited to the configurations of the following embodiments. The processing apparatus of this embodiment will be described below with reference to FIGS. 1 to 10. FIG.

<Embodiment>
FIG. 1 illustrates an example of the hardware configuration of the processing device of this embodiment. The processing device 10 illustrated in FIG. 1 is an information processing device having an imaging device 14 a in the input unit 14 . Examples of such information processing devices include smart phones, mobile phone terminals, tablet terminals, PDAs (Personal Data Assistance), and digital cameras. However, the processing device 10 may be a game machine, a PC (Personal Computer), a notebook PC, or a wearable computer such as a wristwatch type, a wristband type, or a glasses type that can be attached to the user's body, as long as the processing device 10 is equipped with the imaging device 14a. There may be.

The imaging device 14a is, for example, a camera using an image sensor such as a CCD (Charged-Coupled Devices) or a CMOS (Complementary Metal-Oxide-Semiconductor). The imaging device 14a may be a monocular camera, a stereo camera, or an infrared camera. The imaging device 14a is provided integrally with the housing of the processing device 10, for example, and is an application program for capturing a video in a shooting direction or a captured image through an operation input by a user (hereinafter also referred to as a “user”). (hereinafter also referred to as “camera app”). In the processing device 10 in which the camera application is activated, an image in the shooting direction shot through the imaging device 14a is shot at a predetermined frame rate (for example, 30 fps). A captured image captured at a predetermined frame rate is displayed, for example, in a viewfinder that displays the captured image of the subject. In the processing device 10 of FIG. 1, for example, a captured image of an object to be captured is displayed in a display area of a display device such as an LCD (Liquid Crystal Display) 15a that constitutes the output unit 15. FIG.

The processing device 10 of this embodiment includes a component functioning as a mode setting unit 101 . The mode setting unit 101 is, for example, an information processing function provided by the processor 11 executing an application program installed in the processing device 10 . The mode setting unit 101 is provided, for example, when the camera application is activated.

For example, the mode setting unit 101 acquires a captured image captured at a predetermined frame rate through the imaging device 14a in units of frames. Then, the mode setting unit 101 identifies the type of the object included in the captured image based on image processing such as pattern matching while focusing on a person, animals, plants, structures, and the like included in the captured image. The mode setting unit 101 functions as a classifier for classifying a shooting scene (shooting scene) desired by the user based on information about composition such as the type of the specified object and the position and size of the object in the captured image. Function. Such a classifier is realized, for example, by a deep learning algorithm of machine learning using parameters such as objects, arrangement positions, and color schemes in the captured image.

The mode setting unit 101 includes, for example, an algorithm for classifying the shooting scene (shooting scene) as a functional module in the program. Then, the mode setting unit 101 determines the type of the object identified from the captured image, the arrangement position in the captured image, the size, etc., based on the degree of accuracy for each classification type obtained as the output of the function module. classify the shooting scene corresponding to the information indicating the composition of For example, the mode setting unit 101 classifies the shooting scene corresponding to the composition when the output of the functional module is equal to or greater than a threshold value (for example, 0.9). A plurality of categories such as "portrait", "flower", "text", "sunset", "night view", and "cooking" are exemplified as classification types of shooting scenes.

Then, according to the classified shooting scene, the mode setting unit 101 sets the shooting mode when acquiring image information such as “exposure”, “shutter speed”, “color”, and “sharpness” suitable for the shooting scene. Set the conditions (imaging parameters). A captured image reflecting the shooting conditions set according to the classified shooting scene is displayed on the display device of the LCD 15a functioning as a viewfinder. A user who activates the camera application of the processing device 10 visually recognizes the captured image displayed in the viewfinder and performs a shutter operation for photographing. Even a beginner with little knowledge of photography can appropriately set the photography conditions such as "exposure", "shutter speed", "color" and "sharpness" according to the photography scene classified via the mode setting unit 101. It is possible to photograph a photographing object that has an adjusted appearance.

In the processing device 10 according to the present embodiment, in addition to the functions described above, the mode setting unit 101 sets explanatory information for explaining the processing effect on the captured image under the set shooting conditions, and classifies the shooting scenes. It has a function to display in the finder together with the indicated classification name. In the processing device 10, the display device of the LCD 15a that functions as a finder displays a captured image reflecting the set shooting conditions together with explanatory information explaining the processing effect of the shooting conditions and a classification name.

For example, when the categorized shooting scene is "cooking", along with information such as the name "cooking" that indicates the categorized type, explanatory information such as "I will shoot the food so that the contrast is high and the food can be seen vividly." displayed in the finder. Similarly, when the categorized shooting scene is "Night Scenery", information such as "Night Scenery", which indicates the classification type, and descriptive information such as "Lengthen the shutter speed so that the night scenery looks beautiful." is displayed in the finder.

The user can view the captured image reflecting the shooting conditions on the same screen along with the classification name and description information displayed on the viewfinder. effect becomes comprehensible. According to the present embodiment, it is possible to provide an opportunity to determine whether or not to shoot an image reflecting the processing effect of the shooting conditions set through the shooting mode setting function.

Further, in the processing device 10 according to the present embodiment, the mode setting unit 101 erases the explanatory information displayed on the viewfinder after a certain period of time has elapsed, and displays an operation component for canceling the set shooting conditions on the viewfinder. display in the area. Such an operation component is exemplified as a GUI (Graphical User Interface) component represented by a sign (mark) indicating cancellation of setting such as an "x" mark. The processing device 10 receives, for example, an operation input such as a pressing operation via the touch sensor 14b on the GUI component displayed on the display device such as the LCD 15a, which is a finder, or an operation input such as a pressing operation via the pointing device. accept. In the processing device 10, when an operation to press the GUI component is received, for example, the shooting conditions based on the shooting scene classification reflected in the captured image displayed in the finder are canceled, and the state before the shooting scene classification is performed. , the standard shooting conditions are set. The viewfinder displays an image shot under standard shooting conditions.

When the user determines that he/she does not want to take a photograph under the photographing conditions automatically classified by the processing device 10, the user can cancel the photographing condition via the GUI component. After the shooting conditions are canceled by the GUI component, the shooting conditions shift to the standard state before the shooting scene classification is performed. Therefore, for example, the user can acquire the image of the shooting target according to the shooting conditions in the standard state. For example, it is possible to take a photograph of an object in which the photographing effect of backlight is reflected using the photographing conditions of the standard state. According to this embodiment, it is possible to prevent the photographing of a photograph to which a processing effect not intended by the user has been applied.

FIG. 2 is a diagram for explaining display of explanatory information and cancellation of set imaging conditions. FIG. 2 exemplifies transition states of display screens displayed on the LCD 15a functioning as a finder in accordance with the processing according to the present embodiment. Note that the processing device 10 in FIG. 2 is an example of a form that functions as a smart phone. Below, the form of the processing apparatus 10 is demonstrated as a smart phone.

FIG. 2(1) is a diagram showing a display screen when the camera application installed in the processing device 10 is activated. The processing device 10 receives a user operation input such as a tap operation on an operation component (GUI component) for activating a camera application displayed on the start screen or the like, for example. For example, the processing device 10 receives a contact operation by an operation finger or the like superimposed and brought into contact with the display position of the operation component for starting the camera application displayed on the start screen through the touch sensor 14b provided on the surface of the LCD 15a. . The display screen such as the LCD 15a of the processing device 10 displays a captured image captured by the imaging device 14a triggered by the activation of the camera application. The imaging device 14a is provided, for example, on the back side of the LCD 15a. The imaging direction of the imaging device 14a is the back direction of the LCD 15a.

At the time when the camera application is started, the captured images captured at a predetermined frame rate are not classified into captured scenes. For this reason, at the time of FIG. 2(1), the photographed image photographed under the standard photographing conditions is displayed in the display area of the LCD 15a together with the GUI components b1-b4 relating to photographing. The GUI component b1 is, for example, a moving image shooting button, and the GUI component b2 is a shutter button for taking a still image of an object to be shot. Also, the GUI component b3 is an icon that displays the data captured immediately before, and the GUI component b4 is an operation component for ending the camera application and returning to the start screen.

The user holds the housing of the processing device 10, for example, with the image capturing direction of the image capturing device 14a provided on the rear side facing the direction in which the image capturing target exists. The mode setting unit 101 of the processing device 10 starts classifying the captured images captured at a predetermined frame rate through the imaging device 14a into captured scenes. As a result of the classification, as shown in FIGS. 2(2a) and 2(2b), on the display screen of the LCD 15a functioning as a finder of the processing device 10, an image a1 of the person to be photographed photographed at a predetermined frame rate is displayed. is displayed. The captured image a1 captured by the imaging device 14a reflects the shooting conditions corresponding to the shooting scene classified by the mode setting unit 101, for example.

Then, the processing device 10 displays, on the same screen, a classification name a2 indicating the classified shooting scene, and explanation information a3 for explaining the processing effect on the captured image under the shooting conditions set according to the classification. indicate. The display area for displaying such a classification name a2 and description information a3 is defined by, for example, the Y direction being the upward direction of the LCD 15a functioning as a viewfinder, and the X direction being the horizontal direction orthogonal to the upward direction. Specified using dimensional coordinates (X, Y). For example, the processing device 10 designates the display area in which the classification name a2 and the description information a3 are displayed, with the coordinates of the upper left corner of the display being (0, 0) and the coordinates of the lower right corner being (maxX, maxY). can.

In FIG. 2(2a), the classification name a2 is "person", and the explanation information a3 for explaining the processing effect such as "photographing is performed so that the face is brightened and the skin color looks beautiful" is, for example, an imaging The image a1 is superimposed on the image and displayed in a transparent state. The classification name a2 and the description information a3 displayed on the screen together with the captured image a1 are displayed for a certain period of time ((2b) in FIG. 2).

The display period of the classification name a2 and the description information a3 can be obtained experimentally. For example, for a plurality of subjects, the period for determining whether to acquire an image that reflects the processing effect based on the imaging conditions classified through the imaging mode setting function is measured. Then, based on the measurement results, for example, statistical processing such as average value and standard deviation can be performed to determine the display period. It should be noted that the display period may be provided by reflecting attribute information such as age and gender regarding the user of the processing device 10 . It is possible to set the display period in consideration of attribute information such as age and gender of the user.

As shown in FIG. 2(3), the explanatory information a3 on the processing effects of the shooting conditions for the classification name a2 classified through the shooting mode setting function is switched to a non-display state after a certain period of time. Then, the processing device 10 displays an operation component a4 for canceling the set imaging conditions in the display area of the LCD 15a. FIG. 2(4) is an example of a mode in which an operation component a4 for canceling the shooting condition is displayed in parallel near the display area of the classification name a2. FIGS. 2(3) and 2(4) exemplify GUI components represented by signs (marks) such as "x" marks that evoke negative images indicating cancellation of settings. Hereinafter, the operation component a4 is also referred to as "cancel button a4".

The processing device 10 receives an operation input of a pressing operation via the touch sensor 14b, such as a tap operation on the cancel button a4 displayed in the display area of the LCD 15a. When the processing device 10 receives an operation input to the cancel button a4, the processing device 10 cancels the setting of the imaging condition corresponding to the classification name a2. Triggered by the cancellation of the setting, the classification name a2 being displayed in the display area of the LCD 15a is erased from the display screen. Hereinafter, the operation input to the cancel button a4 is also referred to as "cancel operation".

In the processing device 10 for which the setting has been canceled, the shooting condition in the standard state before the shooting scene classification is performed is set. Then, as shown in FIG. 2(5), the captured image a1 of the person to be photographed, which has been photographed under the standard photographing conditions, is continuously displayed on the screen of the LCD 15a. However, as the photographing conditions after cancellation, for example, it is possible to shift to a manual photographing mode, and if there are candidates indicating secondary photographing conditions, the photographing conditions of the secondary candidates are set. may If there is a secondary shooting condition candidate, the classification type to which the candidate belongs and explanation information explaining the effect are displayed on the screen of the finder as the classification name a2 and the explanation information a3.

After canceling the setting, the user starts shooting a new shooting target. The processing device 10, to which the standard shooting conditions have been set, acquires a captured image of a new subject captured at a predetermined frame rate, and starts classifying the captured image into a shooting scene. As a result of the classification, as shown in FIG. 2(6), on the display screen of the LCD 15a functioning as a finder of the processing device 10, an image a5 of the flower to be imaged at a predetermined frame rate is displayed. . The photographing conditions corresponding to the classified photographing scene (“flower”) are reflected in the photographed image a1.

The processing device 10 displays, on the same screen, a classification name a2 indicating the classified shooting scene, and explanatory information a3 for explaining the processing effect on the captured image under the shooting conditions set according to the classification. . In FIG. 2(6), a classification name a2, such as "flower", and explanatory information a3, such as "take a picture so that the color of the flower looks bright and vivid", explaining the processing effect of the photographing condition, are exemplified. be done. In FIG. 2(6) as well, similar to FIG. 2(2a), the classification name a2 and the description information a3 are displayed for a certain period of time by superimposing the captured image a1 on the captured image a1.

Note that the processing device 10 records the shooting scene information (classification name, captured image, etc.) at the time when the operation input (cancel operation) to the cancel button a4 is received as a trigger. Then, the processing device 10 may maintain the canceled state for a predetermined period of time (for example, 5 seconds) after receiving the cancel operation. That is, during a predetermined period from when the cancel operation is performed (hereinafter, this period is also referred to as a "cancellation maintenance period"), the processing device 10 uses the shooting mode setting function for the shooting scene shot through the imaging device 14a. You may control so that classification may be suppressed. In the processing device 10, it is possible to suppress the classification by the shooting mode setting function to the shooting scene in which the cancel operation is detected immediately after the cancellation operation is performed. Annoyance can be avoided.

Further, after the cancellation maintenance period has elapsed, the processing device 10 determines whether the shooting scene has changed since the cancellation operation was accepted, based on the shooting scene information (classification name, captured image, etc.) recorded when the cancellation operation was accepted. can. That is, when the shooting scene after the cancellation maintenance period has elapsed has been changed from the shooting scene for which the cancel operation was received, the processing device 10 classifies the shooting scene after the change by the shooting mode setting function. Then, the processing device 10 displays the classification name and the description information for the changed shooting scene together with the captured image of the shooting target on the same screen. On the other hand, when the shooting scene after the cancellation maintenance period has elapsed has not been changed from the shooting scene at which the cancel operation was accepted, the processing device 10 gives priority to the cancel operation, which is the action intended by the user, and sets the shooting conditions in the standard state. to maintain the settings of As a result, the processing device 10 can provide an opportunity for photographing that reflects the user's intention within the cancellation maintenance period. Since the processing device 10 can reflect the user's intention in the shooting opportunity according to the classification of the shooting scene even after the cancellation maintenance period has elapsed, usability can be improved.

(Device configuration)
Returning to FIG. 1, the processing device 10 has a processor 11, a main storage section 12, an auxiliary storage section 13, an input section 14, an output section 15, and a communication section 16, which are interconnected by a connection bus B1. The main storage unit 12 and the auxiliary storage unit 13 are recording media readable by the processing device 10 .

The processor 11 is a central processing unit that executes a computer program developed in a working area of the main storage unit 12 and controls the processing unit 10 as a whole. The processor provides functions that meet predetermined purposes by controlling peripheral devices through the execution of computer programs. The processor 11 includes a CPU (Central Processing Unit), a D
SP (Digital Signal Processor), GPU (Graphics Processing Unit), etc. are included. Note that the processor 11 is not limited to a single processor, and may have a multiprocessor configuration. Also, a single processor connected with a single socket may have a multi-core configuration.

The main storage unit 12 is a storage medium in which the processor 11 caches programs and data and develops work areas. The main storage unit 12 includes flash memory, RAM (Random Access Memory), and ROM (Read Only Memory). The auxiliary storage unit 13 is a non-volatile storage medium that stores various programs including an OS (Operating System) and various data in a readable and writable manner. The auxiliary storage unit 13 is also called an external storage device. The OS, for example, provides an interface to the resources it manages for installed applications. The application installed in the processing device 10 provides the application function by using an interface to resources provided via the OS. The OS includes a communication interface program for exchanging data with an external device or the like connected via the communication unit 16 . The auxiliary storage unit 13 includes a portable recording medium, flash memory, hard disk drive (HDD), SSD (Solid State Drive), and the like. The portable recording medium is, for example, a disk recording medium such as a USB (Universal Serial Bus) memory, an SD (Secure Digital) memory card, a CD (Compact Disc), or a DVD (Digital Versatile Disc).

The input unit 14 receives operation instructions and the like from the user. The input unit 14 is, for example, an input device such as an imaging device 14a, a touch sensor 14b, an input button, a pointing device, or a microphone. The input unit 14 may include input devices such as a keyboard and a wireless remote controller. Pointing devices include, for example, mice, trackballs, and joysticks.

The output unit 15 outputs data and information processed by the processor 11 and data and information stored in the main storage unit 12 and the auxiliary storage unit 13 . The output unit 15 includes, for example, a display device such as an LCD 15a, an EL (Electroluminescence) panel, an organic EL panel, or the like. The output unit 15 may also include output devices such as a printer and a speaker. The communication unit 16 is, for example, an interface with a network or the like to which the processing device 10 is connected. The network includes a public network such as the Internet, a wired network such as a LAN (Local Area Network), a mobile phone network, and a wireless network such as a wireless LAN.

The processor 11 reads out the OS, various programs, and various data stored in the auxiliary storage unit 13 to the main storage unit 12 and executes them, thereby executing the target program and the processing functions of the mode setting unit 101. offer. The processing device 10 also includes an auxiliary storage unit 13 as a storage destination for data that the processor 11 that executes various programs refers to or manages. The auxiliary storage unit 13 holds a collation pattern DB 201 that stores various image patterns for classifying shooting scenes, and a classification type table 202 that stores information indicating effects for each classified type.

At least part of the processing functions provided by the processor 11 that executes various programs may be provided by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or the like. Also, at least part of the processing functions may be provided by LSIs such as numerical processors, vector processors, image processors, other digital circuits, and analog circuits.

(table configuration)
FIG. 3 is a diagram showing an example of classification type information held in the classification type table 202. As shown in FIG. Information held in the classification type table 202 can be added, changed, or deleted as appropriate. In FIG. 3, the classification type table 202 has fields for setting name, description, setting details, and shooting conditions. It should be noted that FIG. 3 is an example of a mode in which the shooting condition field has respective subfields of exposure, contrast, shutter speed, and sharpness.

The setting name field stores information indicating the type of shooting scene classified by the shooting mode setting function. The information stored in the setting name field is displayed in the display area of the LCD 15a functioning as a finder as "classification name a2", as described with reference to FIG. FIG. 3 exemplifies information indicating the types of categorized shooting scenes such as "portrait", "flower", "text", "sunset", "night view", and "cooking".

The explanation field stores information for explaining the processing effect according to the type of shooting scene. The information stored in the description field is displayed as "description information a3" in the display area of the LCD 15a functioning as a finder, as described with reference to FIG. In FIG. 3, for example, for the setting name "text", the processing effects of the shooting conditions corresponding to the classified shooting scenes, such as "enhance the contrast and outline and shoot so that the characters can be seen clearly", are explained. Information is illustrated.

The setting content field stores information indicating the setting content to be changed with respect to the shooting conditions in the standard state for the setting name. In FIG. 3, "increase exposure of face area", "increase color saturation and increase exposure", "increase contrast and emphasize outline", "brighten dark areas", and "shutter speed Information such as "increase the length" and "increase the contrast" are exemplified.

The shooting condition field stores information indicating shooting conditions for shooting scenes classified under the setting name. The information indicating the shooting conditions is represented by the degree of setting relative to the standard shooting conditions for each parameter such as "exposure", "contrast", "shutter speed", and "sharpness" specified in the subfield. For example, information indicating the degree of relative change is stored for each parameter when the set value under the standard shooting conditions is set to "0" and the maximum variable amount with respect to the set value is set to 100%. A sign indicating the direction of change is added, such as "+" when changing in the increasing direction from the standard state, and "-" when changing in the decreasing direction. However, the relative amount of change may be expressed using multiple levels of indices. For example, a 10-level index may be used, in which an amount of change of 100% is divided by 10%.

The exposure subfield stores information indicating the correction amount from the standard state of the exposure parameter in the shooting scene classified under the setting name. Similarly, the contrast subfield stores information indicating the amount of correction of the contrast parameter from the standard state. The shutter speed subfield stores the setting value (msec) of the shutter speed in the shooting scene classified under the setting name. The sharpness subfield stores information indicating the correction amount from the standard state of the sharpness parameter in the shooting scene classified under the setting name. In addition, in each subfield, when the same set value as the standard shooting condition is used, information indicating that the correction amount does not exist (for example, "-", blank, etc.) is stored.

(Processing flow)
The processing of the processing device 10 according to the present embodiment will be described with reference to FIGS. 4 to 11. FIG. FIGS. 4 to 8 are state transition diagrams showing an example of the transition of the photographing state accompanying a cancel operation. FIG. 4 illustrates the transition of the shooting state over time when the shooting scene has not changed after the cancel operation. Note that the horizontal axis of FIG. 4 represents the elapsed time (t).

In FIG. 4, an area surrounded by a rectangular frame G1 represents a captured image captured by the imaging device 14a. Similarly, the area surrounded by the rectangular frame CL1 represents the types of shooting scenes classified by the shooting mode setting function. In the processing device 10, shooting conditions for shooting scenes to be shot are set according to the classified types. The processing device 10 captures a captured image of an object to be captured at a predetermined frame rate according to the set capturing conditions. The photographed image is displayed on the screen of the LCD 15a functioning as a finder of the processing device 10. FIG.

For example, the processing device 10 receives a user's operation input to an operation component (such as an icon) for starting the camera application displayed on the start screen or the like, and starts the camera application. When the camera application is activated, a captured image Z1 captured under standard shooting conditions is captured. The captured image Z1 does not include the person to be photographed. The user, for example, directs the photographing direction of the imaging device 14a provided on the back side of the processing device 10 to the direction in which the person to be photographed exists, holds the housing, and starts photographing.

The processing device 10 acquires captured images captured at a predetermined frame rate through the imaging device 14a frame by frame, and starts classifying captured scenes including a person to be captured. For example, the processing device 10 identifies the type of an object included in the captured image based on image processing such as pattern matching while focusing on a person, animals, plants, backgrounds, structures, and the like included in the captured image. Then, the processing device 10 classifies the type to which the shooting scene including the person to be shot belongs, based on information about the composition such as the type of the specified object and the arrangement position and size of the object in the captured image. As a result of the classification, the type to which the shooting scene belongs is classified as "person" (time t0). Then, as the shooting conditions for shooting the shooting scene, shooting conditions corresponding to the classified "person" are set (CL1a).

The LCD 15a of the processing device 10 displays a captured image Z2 including a classification name (set name) indicating the type to which the captured scene belongs, and explanatory information for explaining the effects of the imaging conditions corresponding to the classification name. FIG. 5(1) illustrates a diagram for explaining the captured image Z2.

In FIG. 5A, in an area Z2a surrounded by a dashed rectangular frame, a classification name (setting name) indicating the type to which the shooting scene belongs, specified by the mode setting unit 101, is displayed. Also, in a region Z2b surrounded by a dashed rectangular frame, explanation information for explaining the effect obtained by the shooting conditions corresponding to the classification name is displayed. The explanation information displayed in the area Z2b is performed by referring to the information stored in the explanation text field of the classification type table 202, for example. The processing device 10 identifies the record corresponding to the classification name based on the information stored in the set name of the classification type table 202, acquires the information stored in the description field of the record, and displays it in the area Z2a. do it. The classification name displayed in the area Z2a corresponds to the "classification name a2" described in FIG. 2, and the explanation information displayed in the area Z2b corresponds to the "explanation information a3" in FIG.

As shown in FIG. 5A, the classification name displayed in the area Z2a and the description information displayed in the area Z2b are displayed in a state in which the photographed image of the person to be photographed reflecting the photographing conditions is transparent. , are superimposed on the image. The relative display positions of the area Z2a where the classification name is displayed and the area Z2b where the description information is displayed should be displayed close to each other so that the user looking through the viewfinder can easily grasp the displayed information. is preferred. Such designation of the display position can be performed using two-dimensional coordinates (X, Y) in which the vertical direction of the LCD 15a is the Y direction and the horizontal direction is the X direction. It should be noted that the color scheme of the characters composing the classification name and the color scheme of the characters composing the description information can be displayed in different color types.

Returning to FIG. 4, the explanatory information displayed on the viewfinder is switched to a non-display state after a certain period of time t1 has elapsed. Here, the certain period of time t1 can be exemplified as the elapsed time from the determination of the type of classification to which the shooting scene belongs, for example. Such a certain period of time t1 may be held as a predetermined fixed value in seconds (for example, 2 seconds), or may be an experimentally obtained set value.

After a certain period of time t1 has passed, the processing device 10 shifts the explanation information displayed in the finder to a non-display state, and brings it close to the display area where the classification name is displayed, thereby canceling the shooting condition corresponding to the classification name. A GUI component is displayed (captured image Z3). FIG. 5B illustrates a diagram for explaining the captured image Z3.

In FIG. 5(2), in a region Z3a surrounded by a dashed rectangular frame, the classification name (setting name) indicating the type to which the shooting scene belongs, specified by the mode setting unit 101, is continuously displayed. In addition, a GUI part for canceling the shooting condition corresponding to the classification name is displayed in the area Z3b surrounded by the rectangular frame of the dashed line. The GUI part displayed in the area Z3b corresponds to the "cancel button a4" described with reference to FIGS. 2(3) and 2(4). Such a GUI component is composed of, for example, a sign (mark) that evokes a negative image indicating cancellation of setting, such as an "x" mark.

As shown in FIG. 5(2), the relative display positions of the area Z3a where the classification name is displayed and the area Z3b where the GUI component is displayed are such that it is possible to grasp that the GUI component is related to the classification name. It is preferable to display them side by side in the vicinity of the area Z3a as shown in FIG. Note that the color scheme of the signs and the like that constitute the GUI component may be displayed in a different color scheme from the color scheme of the characters that constitute the classification name. Hereinafter, a GUI component for canceling the shooting condition corresponding to the classification name will also be referred to as a "cancel button".

Returning to FIG. 4, the user who has determined that he/she does not want the processing effects of the shooting conditions classified through the shooting mode setting function presses the cancel button displayed near the area Z3a where the classification name is displayed. conduct. The processing device 10 receives, via the touch sensor 14b, a user's contact operation with an operating finger or the like superimposed and in contact with the display position of the cancel button, for example. When the processing device 10 receives an operation input to the cancel button, the processing device 10 cancels the setting of the imaging condition corresponding to the classification name (time t2). In the processing device 10, the photographing condition set by the photographing mode setting function is switched from "portrait setting CL1a" corresponding to the classification name "portrait" to "standard setting CL1b" which is the photographing condition in the standard state.

Further, the processing device 10 deletes the category name and the cancel button being displayed in the finder from the screen when the operation of pressing the cancel button is accepted. In the processing device 10, the captured image Z4 including the person captured under the standard shooting conditions is displayed on the screen of the LCD 15a. Note that the processing device 10 records shooting scene information (category name, captured image, etc.) at the time when the operation input (cancel operation) is received on the cancel button as a trigger.

The processing device 10 maintains the canceled state for a predetermined period of time t3 from when the cancel operation is received (time t2). Such a predetermined period t3 may be held as a predetermined fixed value in units of seconds (eg, 5 seconds), or may be an experimentally obtained set value. During the cancellation maintenance period, which is the period during which the cancellation state is maintained, the imaging conditions in the standard state (standard setting CL1b) are maintained. In the processing device 10, the classification by the shooting mode setting function of the shooting scene shot through the imaging device 14a is suppressed. As a result, it is possible to suppress the classification by the shooting mode setting function to the shooting scene in which the cancel operation is detected immediately after the cancellation operation is performed, so that the user's trouble of repeating the cancel operation for the same shooting scene can be suppressed. can be prevented.

After the cancellation maintenance period has elapsed (time t4), the processing device 10 determines a change in the shooting scene from when the cancel operation was accepted, based on the shooting scene information recorded when the cancel operation was accepted. Then, if the shooting scene after the cancellation maintenance period has elapsed does not change from the shooting scene at the time of receiving the cancel operation, the processing device 10 continues the shooting conditions in the standard state (standard setting CL1b) (S101). ). The LCD 15a that functions as a finder displays a captured image Z5 with standard settings, which does not include display information such as a classification name, description information, and a cancel button. Since the processing device 10 can reflect the user's intention in the shooting opportunity according to the classification type of the shooting scene even after the cancellation maintenance period has elapsed, usability can be improved.

Next, FIG. 6 will be described. FIG. 6 illustrates the transition of the shooting state over time when the cancellation period elapses while the shooting scene has changed during the cancellation maintenance period. Note that the horizontal axes in FIGS. 6 to 8 represent elapsed time (t) as in FIG. In addition, in FIG. 6, the same reference numerals are given to the parts explained in FIG. 4, and the explanation is omitted. Differences from FIG. 4 will be mainly described below.

As shown in FIG. 6, during the cancellation maintenance period (time t2-t4), the shooting scene G1a with the person as the shooting target changes to the shooting scene G1b with the flower as the shooting target (time t5). As the shooting scene changes, the captured image displayed on the finder changes from the captured image Z4 to the captured image Z6. However, even if the shooting scene changes during the cancellation maintenance period, the processing device 10 suppresses the classification by the shooting mode setting function for the shooting scene after the change, and continues the shooting conditions in the standard state (S102). Therefore, the LCD 15a functioning as a finder displays a captured image Z6 of a flower as a photographing object, which does not include display information such as a classification name, description information, and a cancel button.

As in FIG. 4, after the cancellation maintenance period has passed (time t4), the processing device 10 changes the shooting scene from the time when the cancellation operation is accepted based on the shooting scene information recorded when the cancellation operation is accepted. be judged. The processing device 10 determines whether to change the shooting scene G1a in which a person is to be shot to the shooting scene G1b in which a flower is to be shot. Then, the processing device 10 performs classification by the shooting mode setting function on the captured images shot in the changed shooting scene G1b, and sets shooting conditions corresponding to the classification type to which the shooting scene G1b belongs (S103). . The photographing conditions for photographing the photographing scene are shifted from the standard setting CL1b to the photographing conditions for the classification type "flower" as the photographing object, triggered by the time t4 when the cancellation maintenance period has elapsed.

In the viewfinder of the processing device 10, a captured image Z6 of the photographic scene CL1c captured under the photographic conditions of the classification type "flower" is displayed. In the captured image Z6, similarly to the captured image Z2, a classification name (setting name) indicating the type to which the shooting scene belongs, and explanatory information for explaining the effects of the shooting conditions corresponding to the classification name are provided in a predetermined area (area Z2a, Z2b).

In the processing device 10, even when the shooting scene is changed within the cancellation maintenance period, priority is given to the cancellation operation, which is the action intended by the user, and the settings based on the shooting conditions in the standard state can be maintained. Therefore, the processing device 10 can provide photography that reflects the user's intention within the cancellation maintenance period. In addition, the processing device 10 can reflect the user's intention in the shooting opportunity according to the classification of the shooting scene even after the cancellation maintenance period has elapsed.

Next, FIG. 7 will be described. FIG. 7 illustrates the transition of the shooting state over time when the shooting scene changes during the cancellation maintenance period, but the shooting scene after the cancellation period has passed is the same shooting scene as before the cancellation. In addition, in FIG. 7, the same reference numerals are given to the parts explained in FIGS. 4 and 6, and the explanation is omitted. Differences from FIGS. 4 and 6 will be mainly described below.

In FIG. 7 as well, similarly to FIG. 6, during the cancellation maintenance period (time t2-t4), the shooting scene G1a of the person is changed to the flower shooting scene G1b (time t5). Then, as the shooting scene changes, the captured image displayed in the finder changes from the captured image Z4 to the captured image Z6, which does not include display information such as a classification name, description information, and a cancel button, with flowers as the subject of photography. is displayed. This is because, in the processing device 10, even if the shooting scene changes during the cancellation maintenance period, the classification by the shooting mode setting function for the shooting scene after the change is suppressed, and the shooting conditions in the standard state are continued.

Further, as shown in FIG. 7, within the cancellation maintenance period (time t2-t4), the photographing scene G1b in which the photographing object is the flower changes again to the photographing scene G1c in which the photographing object is the person. Then, the cancellation maintenance period elapses (time t4).

After the cancellation maintenance period has elapsed, the processing device 10 determines a change in the shooting scene from when the cancel operation was accepted, based on the shooting scene information recorded when the cancel operation was accepted. If no difference for determining a change is specified between the shooting scene G1c in which a person is the shooting target and the shooting scene G1a at the time when the cancel operation is received, the processing device 10 performs shooting in the standard state. The setting according to the conditions is continued (S107).

The finder of the processing device 10 displays a captured image Z7 of a shooting scene G1c that has been captured under standard shooting conditions. In the processing device 10, the classification by the shooting mode setting function is suppressed, and the shooting conditions in the standard state are continued. Therefore, the captured image Z7 that does not include display information such as a classification name, description information, and a cancel button is displayed.

In the processing device 10, when the shooting scene has changed within the cancellation maintenance period, and when the shooting scene after the cancellation maintenance period has elapsed has not changed from the shooting scene at which the cancellation operation is received, the shooting is performed in the standard state. Settings can be continued according to conditions. As a result, even when a temporary change in the shooting scene occurs, the processing device 10 can provide a photographing opportunity that prioritizes the cancel operation, which is the action intended by the user, based on the shooting scene after the cancellation maintenance period has elapsed. can provide.

Next, FIG. 8 will be described. FIG. 8 illustrates the transition of the shooting state over time when the shooting scene changes after the cancellation period has elapsed. In addition, in FIG. 8, the same reference numerals are assigned to the portions described in FIGS. 4, 6, and 7, and description thereof will be omitted. Differences from FIGS. 4, 6, and 7 will be mainly described below.

In FIG. 8, after the cancellation maintenance period has passed (after time t4), the shooting scene changes from the shooting scene G1a with the person as the shooting target to the shooting scene G1b with the flower as the shooting target (time t6). In the processing device 10, the categorization by the shooting mode setting function for the suppressed shooting scene is canceled at the elapsed time t4 of the cancellation maintaining period. However, at the point in time (time t4) when the cancellation maintenance period has elapsed, the photographic scene to be photographed is the photographic scene G1a in which a person is to be photographed. Therefore, in the processing device 10 after the cancellation maintaining period has elapsed, it is determined that the shooting scene to be shot has not changed since the time when the cancel operation was accepted (time t2). Based on the shooting scene information recorded when the cancel operation is accepted, it is determined whether or not the shooting scene has been changed after the cancellation maintenance period has elapsed.

When the shooting scene after the cancellation maintenance period has passed has not been changed from the shooting scene at the time when the cancel operation is received (time t2), the processing device 10 prioritizes and continues the cancel operation, which is the action intended by the user. . For this reason, the standard setting CL1b, which is the shooting condition in the standard state, is maintained as the shooting condition for shooting the shooting scene G1a to be shot. The standard setting CL1b is continued until it is determined that the shooting scene to be shot is changed from the shooting scene at the time of receiving the cancel operation.

As shown in FIG. 8, in the processing device 10, after the cancellation period has passed, a change from the shooting scene G1a in which the person is shot to the shooting scene G1b in which the flower is shot is determined (
time t6). Triggered by the determination of the change in the shooting scene, the processing device 10 classifies the captured image shot in the shooting scene G1b by the shooting mode setting function, and corresponds to the classification type "flower" to which the shooting scene G1b belongs. The photographing conditions are set (S105).

In the viewfinder of the processing device 10, a captured image Z6 of the photographic scene CL1c captured under the photographic conditions of the classification type "flower" is displayed. In the captured image Z6, a classification name (set name) indicating the type to which the shooting scene belongs, and explanation information for explaining the effects of the shooting conditions corresponding to the classification name are displayed in predetermined areas (areas Z2a and Z2b). .

After the cancellation maintenance period has elapsed, the processing device 10 executes classification of the shooting scene by the shooting mode setting function in response to the determination of the change from the shooting scene for which the cancellation operation is received, and corresponds to the classification type to which the shooting scene belongs. Shooting conditions can be provided. Even after the cancellation maintenance period has elapsed, the processing device 10 can provide an appropriate photographing opportunity according to the classification type of the photographing scene.

The flowcharts illustrated in FIGS. 9-10 will now be described. The flowchart of FIG. 9 shows an example of processing related to display information displayed on the finder. The processor 10 reads various programs and various data stored in the auxiliary storage unit 13 into the main storage unit 12 and executes them, thereby providing the processing functions illustrated in FIGS. be. 9 to 10, for example, a specific GUI part related to shooting displayed together with the captured image in the finder, for example, an operation to press an operation part for exiting the camera application and returning to the start screen. is terminated by

In the flowchart of FIG. 9, the start of processing is exemplified when the camera application is activated. The processing device 10 receives a user operation input such as a tap operation on a GUI component (icon) for starting a camera application displayed on the start screen or the like, for example.

The processing device 10 receives, for example, a touch operation by an operation finger or the like superimposed and brought into contact with the display position of the icon for starting the camera application displayed on the start screen through the touch sensor 14b provided on the surface of the LCD 15a. A captured image captured by the imaging device 14a triggered by activation of the camera application is displayed on a display screen such as the LCD 15a that functions as a finder (S1). The display screen of the LCD 15a displays a plurality of GUI components related to shooting, which have been described with reference to FIG. 2(1). The imaging direction of the imaging device 14a is the opposite surface direction (backward direction) facing the LCD 15a.

For example, the user holds the housing so that the photographing direction of the imaging device 14a provided on the back side of the processing device 10 faces the direction in which the object to be photographed (subject) exists. A captured image of an object to be photographed existing in the photographing direction is photographed via an image sensor such as a CCD or a CMOS that constitutes the imaging device 14a (S2). On the display screen of the LCD 15a functioning as a viewfinder, a captured image of the subject captured at a predetermined frame rate is displayed (S3, "viewfinder state").

The processing device 10 starts classifying the captured image captured by the imaging device 14a into a captured scene including the captured object (S4). Classification of shooting scenes is provided by the mode setting unit 101 . For example, the processing device 10 performs image processing while focusing on a subject such as a person, animals, plants, or structures included in the captured image, and identifies the type of the object included in the captured image. Then, the processing device 10 classifies the type to which the shooting scene including the shooting target belongs based on the information about the composition such as the type of the specified object and the arrangement position and size of the object in the captured image (S5 ).

When the type to which the shooting scene belongs can be classified (S5, "Yes"), the processing device 10 proceeds to the processing of S6. On the other hand, in cases other than the above (S5, "No"), the processing device 10 proceeds to the processing of S10.

In the process of S6, the processing device 10 sets a classification name (setting name) indicating the type of the classified shooting scene, and a classification name for explaining the processing effect on the captured image based on the shooting conditions set according to the classification. Display descriptive information (description) in the finder. As described with reference to FIG. 5(1), for example, on the display screen of the LCD 15a functioning as a finder, a photographed image of a person to be photographed is displayed together with the classification names ``person'' and ``brighten the face and smooth the skin. Explanation information explaining the effect of the processing is displayed, such as "I will shoot so that the colors can be seen clearly." Note that the finder displays a captured image of the subject captured under the shooting conditions corresponding to the classification name “person”, for example, captured after correcting the shooting parameters such as exposure. The classification name and the description information are displayed on the same screen by being superimposed on the captured image of the subject captured under the shooting conditions.

In the process of S7, the processing device 10 activates a timer function for measuring time. The timer function stops after a certain period of time (for example, 2 seconds). By the process of S7, the display period of the explanatory information displayed on the finder is limited to a certain period.

Then, after a certain period of time set in the timer function has passed, the processing device 10 erases the explanatory information displayed on the display screen of the finder, triggered by the timer function being stopped (S8). In addition, when the timer function is stopped, the processing device 10 uses a GUI component (Cancel) for canceling the processing effect on the captured image according to the shooting conditions set according to the classification type of the shooting scene presented by the explanation information. button) is displayed on the display screen of the finder (S9). Such a cancel button is composed of, for example, a sign (mark) that evokes a negative image, such as an "x" mark. As described with reference to FIG. 5(2), the display position of the cancel button is displayed side by side near the display area where the classification name (set name) indicating the type to which the shooting scene belongs is displayed, for example. . After the process of S9, the processing device 10 shifts to the process of S10, and continues to specify the shooting scene including the shooting target.

Next, FIG. 10 will be described. The flowchart of FIG. 10 shows an example of processing related to the pressing operation of the cancel button displayed in the finder. In the following description, as described with reference to FIGS. 4 to 8, it is assumed that the photographic scene to be photographed is changed from the classification name "person" to the classification name "flower".

In the flowchart of FIG. 10, in the process of S11, the processing device 10 determines whether or not there is an operation to press the cancel button displayed together with the captured image classified as "person" as the type to which the shooting scene belongs. For example, when a touch operation (tap operation) to the cancel button displayed on the screen of the viewfinder is detected through the touch sensor 14b provided on the surface of the LCD 15a, the processing device 10 presses the cancel button. Determine that the operation has been performed. On the other hand, if the processing device 10 does not detect the tap operation, it determines that the cancel button has not been pressed.

When the cancel button is pressed (S11, “Yes”), the processing device 10 proceeds to the process of S12. On the other hand, when the cancel button is not pressed (S11, "No"), the processing device 10 proceeds to the process of S21.

The processing device 10 records the shooting scene information at the time when the cancellation operation occurs, triggered by the operation of pressing the cancel button (S12). The shooting scene information includes information such as the classification name and the captured image at the time of receiving the cancel operation. After the process of S12, the display information such as the classification name and the cancel button displayed in the finder are erased from the display screen. Then, the processing device 10 changes the photographing conditions for photographing the object to be photographed to the standard settings, which are the photographing conditions in the standard state (S13). The finder of the processing device 10 displays a captured image captured under standard shooting conditions.

In the process of S<b>14 , the processing device 10 determines whether or not a predetermined period of time has elapsed since the user selected cancellation, ie, accepted the operation of pressing the cancel button. The processing device 10 may, for example, activate a timer function that stops after a predetermined period of time has passed in the same manner as in the process of S7 in FIG. 7, and determine whether the predetermined period of time has elapsed. The processing device 10 proceeds to the processing of S15 when the predetermined period has passed since the reception of the pressing operation of the cancel button (S14, "Yes"). On the other hand, the processing device 10 repeats the process if the predetermined period has not passed since the reception of the pressing operation of the cancel button (S14, "No"). Through the process of S14, the standard shooting conditions are maintained for a predetermined period (cancellation maintenance period) after the cancellation operation occurs, even if the shooting scene changes.

In the process of S15, it is determined whether or not the shooting scene has been changed after the cancellation maintenance period has elapsed since the cancellation operation was received. For example, the processing device 10 determines a change to the shooting scene shot after the cancellation maintenance period, based on the shooting scene information (classification name, captured image, etc.) recorded at the time of accepting the cancel operation.

The processing device 10 classifies, for example, the type to which the shooting scene belongs to, based on the shot image, for the shooting scene after the cancellation maintenance period has elapsed. Then, for example, if the classification name is included in the shooting scene information in which the shooting scene after the cancellation maintenance period has elapsed is recorded, the processing device 10 determines that there is no change in the shooting scene shot after the cancellation maintenance period. . When the processing device 10 determines that there is no change in the shooting scene shot after the cancellation maintenance period (S15, "Yes"), the process proceeds to S21. On the other hand, when the processing device 10 determines that there is a change in the shooting scene shot after the cancellation maintenance period (S15, "No"), the process proceeds to S16.

The processing device 10 sets shooting conditions according to the classified type (classification name “flower”) for the shooting scene shot after the cancellation maintenance period (S16). On the screen of the viewfinder, a photographed image taken under the photographing conditions corresponding to the classification name "flower" is displayed from the standard photographing conditions.

Then, the processing device 10 provides a classification name (setting name) indicating the type of the classified shooting scene, and explanation information ( description) is displayed in the finder (S17). On the display screen of the finder, for example, explanation information for explaining the processing effect such as the category name "flower" and "photograph so that the color of the flower becomes brighter" is displayed.

Since the processing from S18 to S20 is the same as the processing from S7 to S9 shown in the flowchart of FIG. 9, description thereof will be omitted. After the process of S20, the processing device 10 shifts to the process of S21, and continues to specify the shooting scene including the shooting target.

As described above, in the processing device 10 according to the present embodiment, captured images captured at a predetermined frame rate can be obtained in units of frames, and can be classified into types to which shooting scenes including shooting targets belong. After the classification, the LCD 15a functioning as a finder can display the captured image captured under the shooting conditions set according to the type of the shooting scene. Then, the processing device 10 according to the present embodiment provides a classification name (setting name) indicating the type to which the shooting scene belongs, together with the captured image captured under the above-described shooting conditions, and an effect of the shooting conditions corresponding to the classification name. can be displayed on the finder screen. Since the user can view the captured image reflecting the shooting conditions on the same screen along with the classification name and description information displayed on the viewfinder, the user can determine how the shot will be taken before taking the shot. It becomes possible to grasp whether According to the present embodiment, it is possible to provide an opportunity to determine whether or not to shoot an image reflecting the processing effect of the shooting conditions set through the shooting mode setting function. The processing device 10 can acquire an image with processing effects that are acceptable to the user and that look better with regard to the processing effects based on the shooting conditions set via the shooting mode setting function.

Further, in the processing device 10 according to the present embodiment, the explanation information displayed on the screen of the finder is erased after a certain period of time has elapsed, and the finder is provided with an operation component for canceling the shooting conditions that have been set with the erasure as a trigger. can be displayed in the display area of According to this embodiment, the processing device 10 can give the user time to consider selecting a processing effect for the captured image displayed in the viewfinder. In addition, the processing device 10 displays an operation component for canceling the shooting conditions, thereby giving an opportunity to decide whether shooting with other processing effects will look better.

Furthermore, in the processing device 10 according to the present embodiment, when a cancel operation is received, the imaging conditions set via the imaging mode setting function are canceled, and then the imaging conditions in the standard state in which no processing effect occurs are set. can. Then, the processing device 10 can continue the set standard imaging conditions during the cancellation maintenance period. The processing device 10 can prevent photographing with processing effects unintended by the user by setting the photographing conditions of the standard state. In addition, the processing device 10 can prevent the inconvenience of repeating the cancel operation for the same shooting scene within the period by providing the cancellation maintenance period.

(Modification)
The functions provided by the processing device 10 described in the embodiment may be provided by cooperation of multiple computers and external storage devices connected via a network. For example, an external storage device with matching pattern DB 201 and an external storage device with classification type table 202 are connected to a network. A computer that provides the processing function of the mode setting unit 101 is connected to the network.

Each device connected to the network classifies the type to which the shooting scene belongs, based on the captured image captured via the imaging device 14 a provided in the processing device 10 . Each device connected to the network may cause the finder of the processing device 10 to display display information such as a classification name, description information, and a cancel button together with the captured image. Even in such a form, it is possible to provide the processing functions of the processing device 10 described in the embodiment.

《Computer-readable recording medium》
A program that causes a computer or other machine or device (hereinafter referred to as a computer or the like) to implement any of the functions described above can be recorded in a computer-readable recording medium. By causing a computer or the like to read and execute the program of this recording medium, the function can be provided.

Here, a computer-readable recording medium is a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read by a computer, etc. Say. Examples of such recording media that can be removed from a computer or the like include a flexible disk, a magneto-optical disk, and a Compact Disc Read Only Memory (CD-ROM). Also Compact Disc-Recordable
(CD-R), Compact Disc-Rewriterable (CD-RW), DVD, BD, Digital Audio
io Tape (DAT), 8 mm tape, memory cards such as flash memory, and the like. In addition, there are a hard disk, a ROM, and the like as recording media fixed to a computer or the like.

"others"
The above embodiments further include aspects referred to as appendices below. Components included in each appendix below can be combined with configurations included in other appendices.
(Appendix 1)
classifying a situation in which the subject is photographed into types from a photographed image of the subject photographed by a photographing device, and setting a first photographing condition corresponding to the classified type in the photographing device;
The captured image is composed of first information indicating a type classified with respect to the photographing situation and second information describing a processing effect obtained from a first photographing condition set corresponding to the classified type. displaying on a displayed display;
A processing device comprising a controller for executing
(Appendix 2)
the control unit erasing the second information displayed on the display unit after a first predetermined period of time has elapsed;
The processing device according to appendix 1, further executing: displaying on the display unit an operation component for accepting cancellation of the first imaging condition set in the imaging device, when the second information is erased.
(Appendix 3)
The control unit, when receiving a cancellation of the first imaging condition, sets a second imaging condition different from the first imaging condition to the imaging device;
The processing device according to appendix 1 or appendix 2, further executing: continuing the second photographing condition set in the photographing device for a second predetermined period.
(Appendix 4)
After receiving the cancellation of the first imaging condition, the control unit determines that the next captured image captured after a second predetermined period has elapsed is different from the captured image when the cancellation of the first imaging condition was received. Supplementary Note 1: Sometimes, the situation of photographing the subject photographed in the next photographed image is classified by type, and the first photographing conditions corresponding to the classified types are set in the photographing device again. 4. The processing apparatus according to any one of items 3 to 3.
(Appendix 5)
After receiving the cancellation of the first imaging condition, the control unit determines whether or not the photographed image photographed before the elapse of the second predetermined period is changed, and the next imaging performed after the second predetermined period elapses. 5. The processing device according to appendix 3 or 4, wherein the second imaging condition is set when the image matches the captured image when the cancellation to the first imaging condition is accepted.
(Appendix 6)
6. The processing device according to any one of appendices 1 to 5, wherein the control unit displays second information describing the processing effect together with the captured image of the subject reflecting the processing effect.
(Appendix 7)
classifying a situation in which the subject is photographed into types from a photographed image of the subject photographed by a photographing device, and setting a first photographing condition corresponding to the classified type in the photographing device;
The captured image is obtained by combining first information indicating a type classified with respect to the photographing situation and second information describing a processing effect obtained from a first photographing condition set corresponding to the classified type. displaying on a displayed display;
A program that makes a computer run

10 Processing Device 11 Processor 12 Main Storage Unit 13 Auxiliary Storage Unit 14 Input Unit 14a Photographing Storage Unit 14b Touch Sensor 15 Output Unit 15a LCD
16 Communication unit 101 Mode setting unit 201 Matching pattern DB
202 Classification type table B1 Connection bus

Claims (5)

classifying a situation in which the subject is photographed into types from a photographed image of the subject photographed by a photographing device, and setting a first photographing condition corresponding to the classified type in the photographing device;
First information indicating the classification of the photographing situation, and second information describing a processing effect obtained from the first photographing condition set corresponding to the classified classification, are combined into the captured image . is displayed on the display unit where is displayed;
with a control unit that executes
The control unit, when receiving a cancellation of the first imaging condition, sets a second imaging condition different from the first imaging condition to the imaging device;
continuing the second imaging condition set in the imaging device for a second predetermined period;
When the next photographed image photographed after the elapse of the second predetermined period after receiving the cancellation of the first photographing condition is different from the photographed image when the cancellation of the first photographing condition is accepted, the following photographing condition is accepted. A processing device for classifying a situation of photographing a subject photographed in a photographed image by type, and setting a first photographing condition corresponding to the classified type to the photographing device again. the control unit erasing the second information displayed on the display unit after a first predetermined period of time has elapsed ;
2. The method according to claim 1 , further comprising displaying, on the display unit, an operation component for receiving cancellation of the first imaging condition set in the imaging device, when the second information is erased. processing equipment. After receiving the cancellation to the first imaging condition, the control unit determines whether or not the photographed image photographed before the elapse of the second predetermined period is changed, and the next imaging performed after the second predetermined period elapses. 2. The processing device according to claim 1, wherein said second imaging condition is set when an image matches an image captured when cancellation of said first imaging condition is accepted. 4. The processing apparatus according to any one of claims 1 to 3 , wherein said control unit displays said second information describing said processing effect together with the captured image of said subject on which said processing effect is reflected. classifying a situation in which the subject is photographed into types from a photographed image of the subject photographed by a photographing device, and setting a first photographing condition corresponding to the classified type in the photographing device;
First information indicating the classification of the photographing situation, and second information describing a processing effect obtained from the first photographing condition set corresponding to the classified classification, are combined into the captured image . is displayed on the display unit where is displayed;
setting a second imaging condition different from the first imaging condition to the imaging device when a cancellation to the first imaging condition is received;
continuing the second imaging condition set in the imaging device for a second predetermined period;
When the next photographed image photographed after the elapse of the second predetermined period after receiving the cancellation of the first photographing condition is different from the photographed image when the cancellation of the first photographing condition is accepted, the following photographing condition is accepted. classifying the situation of photographing a subject photographed in the photographed image by type, and setting a first photographing condition corresponding to the classified type in the photographing device;
A program that makes a computer run

Images