JP7344348B2 - Imaging device, control method, program, and non-temporary recording medium - Google Patents

Description

The present invention relates to an imaging device, a method of controlling the imaging device, a program for causing the imaging device to execute the control method, and a non-temporary recording medium on which the program is recorded.

2. Description of the Related Art In recent years, digital cameras (imaging devices) have become more sophisticated and functional, and it is becoming increasingly difficult for users to fully utilize their functions and capture images of their choice. For this reason, cameras have been proposed that have a learning function for photographing conditions and the like. For example, Patent Document 1 describes a video camera that learns judgment parameters and stores the learning results.

Japanese Patent Application Publication No. 5-137057

The video camera described in the above-mentioned Patent Document 1 is complicated to operate because the user has to input the answer to the shooting environment and the judgment result of the shooting subject each time, and the video camera does not have a particular emotional reaction to the input. Because of this, it was not easy to feel attached to or have feelings for.

The present invention has been made in view of the above circumstances, and provides an imaging device, a control method for the imaging device, and a control method for the imaging device, which allows the user to easily take images according to the user's preferences and which the user can easily become attached to. It is an object of the present invention to provide a program for executing a method, and a non-temporary recording medium on which the program is recorded.

In order to achieve the above-mentioned object, an imaging device according to a first aspect of the present invention includes: a shooting control unit that causes a shooting unit to shoot an image; and a sensor unit that detects an operation related to a user's evaluation of the shot image. An imaging device comprising: an evaluation determining unit that analyzes an operation on the sensor unit and determines a user's evaluation of the captured image; and an emotion determining unit that determines the anthropomorphic imaging device's emotion in response to the evaluation. , an emotion expression section that pseudo-expresses the determined emotion using one or more outputs, and a learning section that learns the evaluation and reflects it in the shooting conditions used by the shooting control section.

The imaging device according to the first aspect learns the user's evaluation of the photographed image and reflects it in the photographing conditions used by the photographing control unit, so that the user can easily photograph an image according to his/her preference. can. Furthermore, since the anthropomorphic photographing device's emotions are expressed in response to the user's evaluation, the user is likely to become attached to the photographing device.

In the imaging device according to the second aspect, in the first aspect, the sensor unit detects at least one of a contact with the imaging device, an acceleration and/or angular velocity of the imaging device, and a sound with respect to the imaging device. The second aspect defines specific aspects of items detected by the sensor unit.

In the imaging device according to the third aspect, in the first or second aspect, the emotion expression section expresses emotion by outputting at least one of display, light emission, sound, sound effect, and vibration. The third aspect defines a specific aspect of output used for emotional expression. The user can perceptually recognize these outputs.

In the imaging device according to the fourth aspect, in any one of the first to third aspects, the emotion expression section expresses an emotion by changing and displaying a facial expression or a part of the face. According to the fourth aspect, it is easy for the user to become familiar with the imaging device and empathize with the imaging device.

In the imaging device according to a fifth aspect, in any one of the first to fourth aspects, the emotion determination unit determines joy and/or enjoyment as the emotion when the evaluation is positive; If the emotion is negative, sadness and/or anger is determined as the emotion. The fifth aspect defines a specific aspect of the relationship between evaluation and emotion.

In the imaging device according to a sixth aspect, in any one of the first to fifth aspects, the learning unit increases the priority of the imaging condition for the image with a positive evaluation, and increases the priority of the imaging condition for an image with a positive evaluation. The photographing control unit lowers the priority of the photographing conditions for the image with the highest priority and causes the photographing condition to be photographed with a higher priority. According to the sixth aspect, for example, "When photographing a scene similar to a previous photograph, the photographing conditions for images with positive evaluations are preferentially used, and the photographing conditions for images with negative evaluations are preferentially used. It is possible to perform processing such that the photographing conditions are not actively used.

In the imaging device according to the seventh aspect, in any one of the first to sixth aspects, the learning unit changes the imaging conditions according to the evaluation. According to the seventh aspect, the user can easily take an image according to his or her preference.

In the imaging device according to the eighth aspect, in any one of the first to seventh aspects, the photographing condition includes at least one of shutter speed, aperture value, and white balance. The eighth aspect defines specific aspects of the imaging conditions in which the user's evaluation is reflected.

In the imaging device according to a ninth aspect, in any one of the first to eighth aspects, the imaging control unit performs bracket photography of a plurality of images under different imaging conditions for the imaging unit, and the evaluation determining unit includes a plurality of evaluation determining units. The user's evaluation of the image selected from the images is determined. According to the ninth aspect, since a plurality of images under different photographing conditions can be obtained in a series of photographs by bracket photography, it is possible to easily determine the user's evaluation of the images.

In the imaging device according to a tenth aspect, in any one of the first to ninth aspects, the sensor section detects an instruction to print an image, and the learning section prioritizes shooting conditions for the image for which the print instruction is given. Raise the degree. In the tenth aspect, the learning unit raises the priority of the photographing conditions for the image for which the print instruction has been given based on the idea that "images printed at the user's will have a high degree of importance."

In the imaging device according to an eleventh aspect, in any one of the first to tenth aspects, the imaging control section has a plurality of imaging modes, and the learning section reflects the imaging conditions for each imaging mode. According to the eleventh aspect, since the learning unit reflects the shooting conditions for each shooting mode, detailed reflection is possible, and the user can easily shoot an image of his/her preference.

In the imaging device according to a twelfth aspect, in any one of the first to eleventh aspects, the evaluation determining unit analyzes the operation on the sensor unit to determine the user's evaluation of the expression of the imaging device, and the emotional expression unit updates the number, combination, and degree of outputs expressing emotions based on the evaluation of the expressions, and expresses the emotion based on the updated results. According to the twelfth aspect, since the way the camera expresses emotions changes depending on the user's evaluation, it is easy for the user to become attached to it.

In any one of the first to twelfth aspects, the imaging device according to a thirteenth aspect further includes a state detection section that detects a state of the imaging device, and an emotion determination section that determines an emotion according to the detected state. do. According to the thirteenth aspect, the emotion is determined based on the state of the imaging device in addition to the user's evaluation.

In the imaging device according to the fourteenth aspect, in the thirteenth aspect, the state detection unit detects at least one of the remaining battery capacity, remaining memory capacity, image processing load, and internal temperature of the imaging device. The fourteenth aspect specifically defines the state of the imaging device, and the emotion determining unit determines the emotion according to the states of these parameters.

An imaging device according to a fifteenth aspect includes a printer that prints a photographed image in any one of the first to fourteenth aspects. According to the fifteenth aspect, the user can print the captured image.

In order to achieve the above-mentioned object, a control method according to a sixteenth aspect of the present invention includes: a photographing control section that photographs an image in a photographing section; a sensor section that detects an operation related to a user's evaluation of the photographed image; A control method for an imaging device comprising: an evaluation determination step of analyzing an operation on a sensor unit to determine a user's evaluation of a captured image; and an emotion of determining an emotion of an anthropomorphic imaging device with respect to the evaluation. The present invention includes a determining step, an emotional expression step of pseudo-expressing the determined emotion using one or more outputs, and a learning step of learning the evaluation and reflecting it in the photographing conditions used by the photographing control unit. According to the 16th aspect, similarly to the 1st aspect, the user can easily take an image according to his or her preference. Furthermore, users tend to become attached to the imaging device. Note that the control method according to the sixteenth aspect may include the same configuration as the second to fifteenth aspects.

In order to achieve the above-mentioned object, a program according to a seventeenth aspect of the present invention includes a shooting control unit that causes a shooting unit to shoot an image, and a sensor unit that detects an operation related to a user's evaluation of the shot image. The provided imaging device is caused to execute the control method according to the sixteenth aspect. According to the seventeenth aspect, similarly to the first and sixteenth aspects, the user can easily take an image according to his or her preference. Furthermore, users tend to become attached to the imaging device. The seventeenth aspect may include the same configuration as the second to fifteenth aspects.

To achieve the above object, a non-transitory recording medium according to an eighteenth aspect of the present invention is a non-transitory recording medium on which a computer-readable code of a program according to the seventeenth aspect is recorded. The non-temporary recording medium according to the eighteenth aspect may be a recording medium such as a memory card, or may be various magneto-optical recording media or semiconductor recording media used in computers such as servers. Note that a non-transitory recording medium recording a computer-readable code of a program that further includes the same configuration as the second to fifteenth aspects for the program according to the seventeenth aspect may also be mentioned as an aspect of the present invention. can.

As explained above, according to the imaging device, the control method, the program, and the recording medium of the present invention, users can easily take images that match their preferences, and they can easily become attached to the imaging device. .

FIG. 1 is a front perspective view showing a digital camera with a printer according to a first embodiment. FIG. 2 is a rear perspective view showing the digital camera with printer according to the first embodiment. FIG. 3 is a front view of the instant film. FIG. 4 is a rear view of the instant film. FIG. 5 is a diagram showing the electrical configuration of a digital camera with a printer. FIG. 6 is a functional block diagram of the camera control section. FIG. 7 is a flowchart showing the procedure of processing related to learning and emotional expression. FIG. 8 is a diagram showing how an image is evaluated via a display. FIG. 9 is a diagram showing how an image is evaluated via a touch sensor. FIG. 10 is a diagram showing an example of emotional expression using eye marks. FIG. 11 is a diagram showing an example of emotional expression using facial marks. FIG. 12 is a diagram showing how a display is provided with a sub-display area for emotional expression. FIG. 13 is a flowchart illustrating processing for updating the mode of emotional expression. FIG. 14 is a flowchart showing emotional expression processing according to the camera state. FIG. 15 is a diagram showing a smartphone according to the second embodiment. FIG. 16 is a diagram showing the configuration of a smartphone according to the second embodiment.

Detailed descriptions of embodiments of the imaging device, the method of controlling the imaging device, and the program according to the present invention are as follows. In the description, reference is made to the accompanying drawings.

<First embodiment>
<Digital camera with printer>
The digital camera 10 (imaging device) with a printer according to the first embodiment is a digital camera with a built-in printer, and has a function of printing captured images on the spot. The digital camera 10 with a printer of this embodiment uses an instant film pack to print on instant film. Further, the digital camera 10 with a printer according to the present embodiment has a recording function, and can record audio in association with a photographed image.

<Exterior configuration>
FIG. 1 is a front perspective view showing an example of a digital camera with a printer. FIG. 2 is a rear perspective view of the digital camera with printer shown in FIG. 1.

As shown in FIGS. 1 and 2, a digital camera with a printer 10 has a portable camera body 12. The camera body 12 has a vertically long rectangular parallelepiped shape that is thinner in the front-rear direction and longer in the vertical direction than in the horizontal direction.

As shown in FIG. 1, the front side of the camera body 12 is provided with a photographing lens 14, a release button 16, a recording button 18, a strobe light emitting window 20, and the like. Further, one side surface of the camera body 12 is provided with a power button 22a, a menu button 22b, an OK button 22c, a mode switching button 22d, a microphone hole 24, a speaker hole 26, and the like. The release button 16 is a button for instructing recording of an image. The power button 22a is a button for turning on and off the power of the digital camera 10 with a printer. The menu button 22b is a button for calling a menu screen. The OK button is a button for instructing OK. The mode switching button 22d is a button for switching between auto print mode and manual print mode in the shooting mode.

As shown in FIG. 2, the back side of the camera body 12 is provided with a touch panel type display 28, a sub-display 29 (emotion expression section), a film lid cover 30, and various operation buttons. The sub-display 29 is a display for pseudo-expressing the emotions of the anthropomorphic digital camera with printer 10, as will be described in detail later. The film lid cover 30 is a cover that opens and closes the film loading chamber. The operation buttons include a joystick 32a, a print button 32b, a play button 32c, a cancel button 32d, and the like. The print button 32b is a button for instructing printing. The playback button 32c is a button for instructing switching to playback mode. The cancel button 32d is a button for instructing cancellation of an operation.

The upper surface of the camera body 12 is provided with a film outlet 34, as shown in FIGS. 1 and 2. The printed instant film is discharged from this film discharge port 34. Further, a touch sensor 45 (sensor section) is provided on the upper surface of the camera body 12. The touch sensor 45 detects contact, slide operation, etc. by a human body such as a user's finger or an operating device such as a pen type. As will be described in detail later, the user can operate the touch sensor 45 to input evaluations of captured images and emotional expressions.

Regarding the digital camera 10 with a printer, the side where the power button 22a etc. are provided is defined as the +X direction, the side where the film ejection port 34 is provided is defined as the +Y direction, and the side facing from the photographing lens 14 toward the subject (the display 28 etc.) is the +Z direction.

<Configuration of the printer part of a digital camera with a printer>
The printer-equipped digital camera 10 includes a film loading chamber (not shown), a film feeding mechanism 52, a film transporting mechanism 54, a print head 56, and the like as components of a printer section that is a printing section (see FIG. 5). An instant film pack having a structure in which a plurality of instant films are housed in a case is loaded into the film loading chamber. 3 is a front view of the instant film 42, and FIG. 4 is a rear view of the instant film 42. 3 and 4, the direction indicated by arrow F is the direction in which the instant film 42 is used, and the instant film 42 is conveyed in the direction indicated by arrow F. Therefore, when the instant film 42 is loaded into the digital camera 10 with a printer, the direction indicated by the arrow F is the direction in which the instant film 42 is ejected.

The instant film 42 is a self-developing instant film having a rectangular card shape. The instant film 42 has an exposure surface 42a on the back side and an observation surface 42b on the front side. The exposure surface 42a is a surface on which an image is recorded by exposure, and the observation surface 42b is a surface on which the recorded image is observed.

As shown in FIG. 3, the observation surface 42b of the instant film 42 is provided with an observation area 42h. Further, as shown in FIG. 4, the exposure surface 42a of the instant film 42 is provided with an exposure area 42c, a pod section 42d, and a trap section 42f. After exposure, the instant film 42 is developed by spreading a developing solution in the pod portion 42d onto the exposure area 42c. A developing solution pod 42e containing a developing solution is built into the pod portion 42d. The developing solution in the pod portion 42d is squeezed out from the pod portion 42d by passing the instant film 42 between a pair of rollers, and is spread onto the exposure area 42c. The developing solution left over during the development process is captured by the trap section 42f. An absorbent material 42g is built into the trap portion 42f.

The instant print pack is loaded into a film loading chamber (not shown) provided inside the camera body 12. During printing, the films are fed out one by one by a claw (not shown) of the film feeding mechanism 52, and are conveyed by rollers (not shown) of the film feeding mechanism 54. Further, during the conveyance process, a pair of developing rollers (not shown) crush the pod portion 42d of the instant film 42 to develop the developing solution. The print head 56 is composed of a line type exposure head, and records an image on the instant film 42 in a single pass by irradiating printing light line by line onto the exposure surface 42a of the instant film 42 transported by the film transport mechanism 54. . A frame 42i is provided around the observation area 42h, and the image is displayed inside the frame 42i.

<Electrical configuration of digital camera with printer>
FIG. 5 is a block diagram showing the main parts of the electrical configuration of the digital camera with printer 10. As shown in FIG.

As shown in the figure, the digital camera 10 with a printer includes a photographic lens 14, a touch sensor 45 (see FIGS. 1 and 2; sensor section), an acceleration sensor 46 (sensor section), an angular velocity sensor 47 (sensor section), and a vibrator. 48 (emotional expression section), an LED 49 (LED: Light-Emitting Diode, emotional expression section), and a temperature detection section 58 (sensor section). Further, the digital camera 10 with a printer includes a lens driving section 62, an image sensor 64, an image sensor driving section 66, an analog signal processing section 68, a digital signal processing section 70, a memory 72, a memory controller 74 (state detection section), a display 28 , a display controller 76, a communication section 78, and an antenna 80. The digital camera 10 with a printer further includes a film feed drive section 82, a film transport drive section 84, a head drive section 86, a strobe 88, a strobe light emission control section 90, a microphone 92, a speaker 94, an audio signal processing section 96, and a clock section 97. , an operation section 98, a battery 99, and a camera control section 100 (evaluation determination section, emotion determination section, emotion expression section, learning section, and state detection section).

The photographing lens 14 forms an optical image of the subject on the light receiving surface of the image sensor 64. The photographic lens 14 has a focus adjustment function and includes an aperture and a shutter (not shown). The lens drive unit 62 includes a motor and its drive circuit that drive the focus adjustment function of the photographic lens 14, a motor and its drive circuit that drive the aperture, and a shutter drive motor and its drive circuit, and includes a motor and its drive circuit that drive the shutter. The focus adjustment mechanism, diaphragm, and shutter are operated in accordance with instructions from the camera.

The image sensor 64 is configured with a two-dimensional solid-state image sensor, such as a CCD image sensor (CCD: Charge Coupled Device) or a CMOS image sensor (CMOS: Complementary Metal Oxide Semiconductor). The image sensor 64 has an imaging area with an aspect ratio corresponding to the printable area of the instant film used. The image sensor drive unit 66 includes a drive circuit for the image sensor 64, and operates the image sensor 64 in response to commands from the camera control unit 100.

In the digital camera with printer 10 of this embodiment, the photographing lens 14 and the image sensor 64 constitute a photographing section.

The analog signal processing unit 68 takes in the analog image signal for each pixel output from the image sensor 64, performs signal processing (for example, correlated double sampling processing, amplification processing, etc.), digitizes it, and outputs it.

The digital signal processing section 70 takes in the digital image signal output from the analog signal processing section 68, and performs signal processing (for example, gradation conversion processing, white balance correction processing, gamma correction processing, simultaneous processing, YC conversion processing, etc.). ) to generate image data. The digital signal processing unit 70 may perform image processing on the photographed image according to the photographing mode or a user's instruction.

The memory 72 is a non-temporary recording medium that stores image data and audio data obtained by photographing, and uses, for example, a memory card. The memory 72 is an example of a storage section. The memory controller 74 reads and writes data into the memory 72 under the control of the camera control unit 100.

The display 28 (emotional expression section) is configured with, for example, a liquid crystal display (LCD), an organic electro-luminescence display (OELD), or the like. In addition, the display 28 may be configured with a plasma display, a field emission display (FED), electronic paper, or the like. The display controller 76 causes the display 28 to display an image under the control of the camera control unit 100.

The communication unit 78 wirelessly communicates with another printer-equipped digital camera 10 (other device) via the antenna 80 under the control of the camera control unit 100 . The communication unit 78 can directly communicate with other devices over short distances using, for example, near field communication (NFC), Bluetooth (registered trademark), or the like. In addition, the communication unit 78 connects to an information communication network such as the Internet via a Wi-Fi spot (Wi-Fi: registered trademark), etc., and communicates with other digital cameras 10 with printers (other devices) regardless of the distance. can communicate with.

The film feed drive unit 82 includes a motor that drives a claw (not shown) of the film feed mechanism 52 and its drive circuit, and drives the motor to drive the claw under the control of the camera control unit 100. make it work.

The film transport drive unit 84 includes a motor and its drive circuit that drive a pair of transport rollers (not shown) of the film transport mechanism 54 and a motor and its drive circuit that drive a pair of developing rollers (not shown), and includes a motor and its drive circuit that drive a pair of developing rollers (not shown). The motor of the pair of conveying rollers and the motor of the pair of spreading rollers are driven to operate the pair of conveying rollers and the pair of spreading rollers.

The head drive section 86 includes a drive circuit for the print head 56 and drives the print head 56 under the control of the camera control section 100 .

The strobe 88 includes a xenon tube, an LED (Light Emitting Diode), or the like as a light source, and causes the light source to emit light to irradiate the subject with strobe light. Strobe light is emitted from a strobe light emitting window 20 (see FIG. 1) provided at the front of the camera body 12. The strobe light emission control section 90 includes a drive circuit for the strobe light 88 and causes the strobe light 88 to emit light in response to a command from the camera control section 100.

The microphone 92 collects external sound through a microphone hole 24 (see FIG. 2) provided in the camera body 12. The microphone 92 is an example of a sound collecting section. The speaker 94 outputs audio to the outside from the speaker hole 26 provided in the camera body 12. The audio signal processing unit 96 performs signal processing on the audio signal input from the microphone 92, digitizes it, and outputs it. Furthermore, the audio signal processing section 96 performs signal processing on the audio data given from the camera control section 100 and outputs it from the speaker 94 . The clock section 97 holds date and time information, and the camera control section 100 refers to this information to set the photographing time (date and time).

The operation unit 98 includes various operation members such as a release button 16, a recording button 18, a power button 22a, a menu button 22b, an OK button 22c, a joystick 32a, a print button 32b, a playback button 32c, and a cancel button 32d, and their signal processing. It includes a circuit and outputs a signal based on the operation of each operating member to the camera control section 100.

The battery 99 is a rechargeable and dischargeable secondary battery, and supplies power to each part of the digital camera with printer 10 under the control of the camera control unit 100.

The camera control unit 100 is a control unit that centrally controls the entire operation of the digital camera 10 with a printer. The camera control unit 100 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an EEPROM (Electronically Erasable and Programmable Read Only Memory), and the like. The camera control unit 100 is a computer composed of these CPUs and the like, and realizes various functions described below by executing a control program.

<Functional configuration of camera control unit>
FIG. 6 is a diagram showing the functional configuration of the camera control section 100. The camera control section 100 includes a shooting control section 100A (shooting control section), a communication control section 100B (communication section), and a display control section 100C (display control section). The camera control unit 100 also includes an evaluation determining unit 100D (evaluation determining unit), an emotion determining unit 100E (emotion determining unit), an emotional expression unit 100F (emotional expression unit), a learning unit 100G (learning unit), A state detection section 100H (state detection section) is provided. The camera control section 100 further includes a print control section 100I (print control section) and a storage control section 100J (storage control section).

The functions of each part of the camera control unit 100 described above can be realized using various processors and recording media. Various types of processors include, for example, a CPU, which is a general-purpose processor that executes software (programs) to realize various functions. The various processors described above also include programmable logic devices (PLDs) such as GPUs (Graphics Processing Units) and FPGAs (Field Programmable Gate Arrays), which are processors specialized in image processing. A programmable logic device is a processor whose circuit configuration can be changed after manufacturing. Note that when performing image learning and recognition, a configuration using a GPU is effective. Furthermore, the various types of processors mentioned above also include dedicated electric circuits, such as ASICs (Application Specific Integrated Circuits), which are processors having a circuit configuration specifically designed to execute specific processing.

The functions of each part may be realized by one processor, or by multiple processors of the same type or different types (for example, multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Furthermore, one processor may have multiple functions. As an example of configuring multiple functions with one processor, first, as typified by a computer, one processor is configured with a combination of one or more CPUs and software, and this processor can perform multiple functions. There are ways to achieve this. Second, there is a form that uses a processor that realizes the functions of the entire system with one IC (Integrated Circuit) chip, as typified by System On Chip (SoC). In this way, various functions are configured using one or more of the various processors described above as a hardware structure. Furthermore, the hardware structure of these various processors is more specifically an electric circuit (circuitry) that is a combination of circuit elements such as semiconductor elements. These electric circuits may be electric circuits that realize the above-mentioned functions using logical sum, logical product, logical negation, exclusive OR, and logical operations that are a combination of these.

When the above-mentioned processor or electric circuit executes software (program), the computer (the various processors and electric circuits that constitute the camera control unit 100, and/or a combination thereof) of the software to be executed executes the code that can be read. The software is stored in a non-temporary recording medium such as a ROM, and the computer refers to the software. The software stored in the non-temporary recording medium includes programs for photographing and printing images, expressing emotions, etc., and data used during execution. The non-temporary recording medium on which the code is recorded may be various types of magneto-optical recording devices, semiconductor memories, etc., instead of ROM. For example, RAM is used as a temporary storage area during processing using software.

<Processing related to learning and emotional expression>
FIG. 7 is a flowchart showing processes related to learning and emotional expression by the digital camera 10 with a printer configured as described above, and these processes are executed when the digital camera 10 with a printer is powered on. The user can turn on the power by operating the power button 22a or by operating the touch sensor 45 (sensor section).

When the user operates the release button 16, the shooting control unit 100A (shooting control unit) determines that there is a shooting instruction (YES in step S100), and changes at least one of the shutter speed, aperture value, and white balance. The photographing conditions to be included are determined (step S110). The shooting control unit 100A (shooting control unit) has a plurality of shooting modes (for example, auto mode, shutter speed priority mode, aperture priority mode, portrait mode, landscape mode, etc.), and determines shooting conditions according to the shooting mode. do. Further, if learning has been performed based on past shooting, the shooting control unit 100A determines shooting conditions that reflect the user's evaluation of the shot image. Then, the photographing control section 100A controls the photographing section (photographing lens 14, image sensor 64, etc.) to photograph an image according to the determined photographing conditions (step S120). The photographing control unit 100A can perform photographing under high-priority photographing conditions (described later). The photographing control section 100A may cause the photographing section to bracket photograph a plurality of images under different photographing conditions. Note that the digital signal processing section 70 may perform image processing on the photographed image based on the photographing mode or user instructions. The storage control unit 100J and the memory controller 74 store the photographed image in the memory 72 according to a user's instruction.

<Operations related to image evaluation>
The display control unit 100C displays the photographed image on the display 28 (step S130). By operating the digital camera with printer 10, the user can evaluate the captured image. FIG. 8 is a diagram showing an example of operations on the display 28 (sensor section). When giving a positive evaluation, the user can draw a circle M1 on the display 28 with a finger or a pen-type device, as shown in part (a) of FIG. On the other hand, when giving a negative evaluation, the user can draw a cross mark M2 on the display 28, as shown in part (b) of the figure. The user may draw a triangle on the display 28 when making an intermediate evaluation.

FIG. 9 is a diagram showing an example of an operation on the touch sensor 45 (sensor section). When making a positive evaluation, the user can stroke the touch sensor 45 in the direction of arrow F2 with a finger, a pen-type device, etc., as shown in part (a) of FIG. On the other hand, if a negative evaluation is to be made, the touch sensor 45 can be tapped (or struck) in the direction of arrow F3 with a finger or other device, as shown in part (b) of the figure.

In place of or in addition to the operations on the display 28 and the touch sensor 45, the user can shake (translate and/or rotate) the digital camera with printer 10. In this case, the acceleration sensor 46 (sensor section) and/or the angular velocity sensor 47 (sensor section) detect the operation (acceleration and/or angular velocity). Further, instead of or in addition to the above-described operation, the user may perform a voice operation via the microphone 92 (sensor section). For example, operations can be performed using intuitive voice messages such as ``Like'', ``Good job'', ``Try harder'', and ``You're no good''. The user may also perform operations using specific voice messages such as "I want a brighter image" or "I want the background to be blurred." Note that speaking (voice input) through the microphone 92 is a voice operation.

<Decision on evaluation>
The evaluation determination unit 100D (evaluation determination unit) analyzes the operation on the sensor unit such as the display 28 (step S140: evaluation determination step), and determines the user's evaluation of the photographed image (step S150: evaluation determination step). ). The evaluation determining unit 100D determines that the analysis result is, for example, "The user drew a circle on the display 28,""The user stroked the touch sensor 45,""The user tapped the touch sensor 45," or "The user attached a printer." In the case of "I brandished the digital camera 10," the user's evaluation can be determined to be "praise,""warning or scolding," and "scolding or getting angry," respectively. "Praise" is an example of positive evaluation, and "admonish, scold, get angry" are examples of negative evaluation.

In addition, if the analysis result is, for example, "The user said 'I like'" or "The user said 'You're not good,'" the evaluation determining unit 100D may respectively "praise" or " "Warning or scolding" can be determined as the user's evaluation. The evaluation determining unit 100D may determine the evaluation based on specific information instead of or in addition to such perceptual information. For example, the evaluation determining unit 100D may determine that an evaluation based on comments such as "Please make my skin look more beautiful" or "Since it is a portrait, I would like the background to be a little more blurred" is to be "warned". I can do it.

When determining the user's evaluation, the evaluation determining section 100D (evaluation determining section) associates the content and/or degree of the operation with the evaluation in advance, and when analyzing the operation, the evaluation determining section 100D (evaluation determining section) You can refer to what kind of evaluation corresponds to). The evaluation determining unit 100D can store such relationship information in, for example, an EEPROM (non-temporary recording medium) of the camera control unit 100. The evaluation determination unit 100D (evaluation determination unit) may accept editing of the relationship between operations and evaluations by the user.

Regarding the operations exemplified above, the evaluation determining unit 100D may change the degree of evaluation depending on the number of operations or the intensity of the operations. For example, the more times the user strokes the touch sensor 45 or the more strongly the user swings the digital camera 10 with a printer (the larger the acceleration and/or angular velocity), the higher the evaluation ("praise", "warn, scold", etc.) It is possible to increase the degree of

<Evaluation during bracket shooting>
If a plurality of images are captured by bracket photography, the display control unit 100C displays the plurality of images on the display 28 when determining the user's evaluation of the captured images. Then, the evaluation determining unit 100D receives the user's selection of the plurality of displayed images, and determines the user's evaluation of the selected image in the same manner as in the above example.

<Determination of emotions>
The emotion determining unit 100E (emotion determining unit) determines the emotion of the anthropomorphized digital camera with printer 10 (imaging device) in response to the user's evaluation (step S160: emotion determining step). The emotion determining unit 100E can determine joy and/or fun as the emotion when the evaluation is positive, and can determine sadness and/or anger as the emotion when the evaluation is negative. The emotion determination unit 100E can determine a stronger emotion as the degree of evaluation described above is higher.

The emotion determining unit 100E may determine "rebellion" as the emotional expression, for example, when the user subsequently denies the shooting conditions that were evaluated as "like" in the past.

<Expression of emotions>
The emotion expression unit 100F (emotion expression unit) expresses the determined emotion in a pseudo manner using one or more outputs (step S170: emotion expression step). The emotion expression unit 100F can express emotions by outputting at least one of display, light emission, sound, sound effect, and vibration. The emotion expression section 100F can express emotions by displaying characters, figures, symbols, etc. on the display 28, sub-display area 28a, and sub-display 29. Further, the emotion expression section 100F can express emotions by emitting light from the LED 49. When using the LEDs 49, the emotion expression section 100F may change the number and color of the LEDs 49 to emit light depending on the content and degree of the emotion. The emotion expression section 100F can express various colors by emitting light from a combination of red, green, and blue LEDs. In the case of an embodiment including the LED 49, the state detection unit 100H may use the LED 49 to express the remaining battery level, the number of printable sheets, and the like. Further, the emotional expression section 100F can express emotions by outputting audio and/or sound effects from the speaker 94 or by vibrating the vibrator 48.

<Example of emotional expression>
FIG. 10 is a diagram showing an example of emotional expression by changing the display of eyes (part of the face). The emotional expression unit 100F can display these examples on the sub-display 29. Part (a) of FIG. 10 shows a power-off (or sleep) state (sleeping or resting state), and in this state, the emotional expression unit 100F is operated by, for example, stroking the touch sensor 45. In this case, the display is changed to the state shown in part (b) of the figure (awake state). The emotional expression section 100F may keep the display shown in part (b) of the figure fixed, or may intermittently display a blinking-like display. Further, the emotional expression section 100F may express a state in which the eyes are moving by switching between the state shown in part (b) and the state shown in part (c) of FIG. 10. Part (d) of the figure is an example showing a state in which photographing is performed by a user's operation. Parts (e) to (g) of FIG. 10 are examples of displays expressing a "happy" or "delighted" state, a "sad" state, and an "angry" state, respectively.

Parts (a) to (g) of FIG. 10 are examples in which one eye display is used, but the emotional expression unit 100F uses the eye display as in the example of part (h) of the figure. It is possible to perform display using multiple types. In this case, the emotional expression unit 100F can perform display as shown in parts (a) to (g) of FIG. 10 for each eye.

FIG. 11 is a diagram showing an example of emotional expression by changing facial expressions. Parts (a) and (b) of the figure are examples of displays expressing a "happy" or "delighted" state, and a "sad" state, respectively. Note that the emotional expression unit 100F may use the face of an animal or a virtual character instead of a human face for emotional expression.

The emotional expression unit 100F may express emotions using a part of the display 28 instead of the display device for emotional expression (sub-display 29). For example, as shown in the modified example of FIG. 12, a sub-display area 28a is provided in a part of the display 28, and the emotional expression section 100F can display emotions in this sub-display area 28a (for example, according to the example shown in FIGS. 10 and 11). )It can be performed. When expressing emotions through display on a part of the display 28, the emotion expression section 100F may continue displaying on the sub-display area 28a all the time, or may display for a certain period of time when there is a change in emotion. After that, the display in the sub display area 28a may be stopped. In the modification shown in FIG. 12, the sub-display area 28a is provided in the upper right portion of the display 28, but the position where the sub-display area 28a is provided is not limited to the embodiment shown in this modification.

<Updating the mode of emotional expression>
The digital camera 10 with a printer can update the mode of emotional expression (what kind of output to use, how much expression to perform, etc.) according to the user's evaluation. For example, as shown in the flowchart of FIG. 13, when there is a user operation for the emotion expressed (output) in step S170 (YES in step S172), the evaluation determination unit 100D (evaluation determination unit) , touch sensor 45, microphone 92, etc.) to determine the user's evaluation of the emotional expression (step S174). Then, the emotion expression unit 100F updates the number, combination, and degree of outputs expressing emotions based on the user's evaluation (step S176). The next time the emotion expression unit 100F expresses an emotion, it expresses the emotion based on the updated result.

For example, when the user performs an operation to praise the digital camera 10 with a printer, the emotional expression changes from "change in eye display" (for example, from the state shown in part (b) of FIG. 10 to the state shown in part (e) of the same figure). Assume that the mode is such that three things are performed at the same time: change in state), output of sound from the speaker 94, and vibration by the vibrator 48. In this case, some users may find such expressions to be "excessive." In that case, the user can say "Hey, it's noisy" to the digital camera with printer 10, and in response, the evaluation determining unit 100D analyzes the voice operation via the microphone 92 (sensor unit) and Determine the rating. Based on this decision, the emotional expression unit 100F makes a decision such as "do not vibrate with the vibrator 48" (updates the number of outputs and combinations), "reduces the volume of audio output" (updates the degree of output), etc. changes can be made. By updating the mode of emotional expression in this way, not only the shooting conditions but also the emotional expression will be tailored to the user's preferences, so the user will become attached to his or her digital camera with printer 10 (imaging device). Cheap.

<Learning shooting conditions based on print instructions>
Further explanation for the flowchart of FIG. 7 follows. When a user instructs to print an image, it can be considered that the image is highly evaluated or highly important to the user. Therefore, when the image is printed (YES in step S180), the print button 32b etc. (sensor section) and the print control section 100I detect the instruction to print the image, and the learning section 100G (learning section) detects the instruction to print the image. The priority of the photographing conditions for the captured images is increased (step S190: learning process). For example, when an instruction is given to print an image that has been processed to brighten the skin tone of a person or an image that has been processed to blur the background of a person, the learning unit 100G determines whether the same shooting conditions (shutter speed, aperture value, white balance, etc.) can be used to a higher degree than other shooting conditions.

Note that the digital camera 10 with a printer may express emotions based on an operation related to the user's evaluation of the printed image, similar to the case where the emotional expression is performed based on the user's evaluation of the photographed image. Furthermore, the conditions for image processing on the photographed image may be changed.

<Reflection of user evaluation>
The learning unit 100G (learning unit) learns the user's evaluation and reflects it in the imaging conditions used by the imaging control unit 100A (step S200: learning process). For example, the learning unit 100G determines values for all or some of the shooting conditions (including, but not limited to, at least one of shutter speed, aperture value, and white balance) according to the evaluation. Can be changed. For example, in response to an evaluation based on the comment, ``Since it's a portrait, I would like the background to be a little more blurry,'' the aperture value can be changed to the wider side.

In learning, the evaluation result can be treated as a "signal that prompts learning," and the learning unit 100G learns each parameter of the imaging conditions according to the evaluation and learns new contents of the imaging conditions (parameter values, etc.). Write to the EEPROM of the camera control unit 100. The learning unit 100G can reflect in the shooting conditions by taking into account "which shooting conditions were evaluated positively (or negatively) and to what extent the evaluations were made", and Weighting may be applied between condition items (for example, evaluation of white balance is given more weight than other items). The learning unit 100G may use a neural network operated by a machine learning algorithm (deep learning, etc.) for learning. When the photographing control section 100A has a plurality of photographing modes, it is preferable that the learning section 100G reflects the photographing conditions for each photographing mode.

The photographing control unit 100A can perform photographing under new photographing conditions by referring to the EEPROM in which the above-described evaluation is reflected during photographing. Note that the learning unit 100G may perform learning based on the user's evaluation not only regarding the photographing conditions but also regarding image processing, and may reflect the learning on the image processing conditions. For example, in response to an evaluation based on the comment "Please make my skin look more beautiful," for an image where the subject is a person, the image processing conditions are changed to make the skin tones more vivid. can be processed.

<Emotional expressions depending on the status of the digital camera with printer>
FIG. 14 is a flowchart illustrating an example of emotional expression processing depending on the state of the digital camera with printer 10. In the example shown in FIG. 14, the state detection unit 100H (state detection unit) detects at least one of the remaining battery capacity, the remaining memory capacity, the image processing load, and the internal temperature (step S200: state detection step). . The state detection unit 100H detects the remaining capacity of the battery 99, the remaining capacity of the memory 72, the image processing load in the analog signal processing unit 68, the digital signal processing unit 70, the camera control unit 100, etc., and the internal temperature of the digital camera 10 with a printer. can be detected.

The state detection unit 100H can detect these states based on the outputs of the memory controller 74, temperature detection unit 58, and the like. Then, the emotion determining unit 100E (emotion determining unit) determines whether or not the detected state satisfies the criteria for expressing emotion (step S210), and if the criteria is met (YES in step S210), the emotion determining unit 100E (emotion determining unit) Then, the emotion of the anthropomorphized digital camera with printer 10 (imaging device) is determined (step S220: emotion determination step). For example, the emotion determining unit 100E can determine that "criteria for emotional expression are met" when the remaining capacity of the battery 99 or the remaining capacity of the memory 72 becomes 20% or less of the total capacity. Similarly, the emotion determining unit 100E can determine that "criteria for emotional expression are met" when the image processing load or internal temperature exceeds a threshold.

The emotion expression unit 100F (emotion expression unit) expresses the emotion determined in step S220 (step S230: emotion expression step). This emotional expression is performed by outputting at least one of display, light emission, sound, sound effect, and vibration, as in the case based on the evaluation of captured images (see Figures 10 and 11 and explanations regarding these figures). be able to. For example, when the remaining capacity of the battery 99 is low, the emotional expression unit 100F outputs a voice message from the speaker 94 saying, "It's running out of power! If you don't charge it quickly, I'm going to sleep!" At the same time, the vibrator 48 can vibrate (which can correspond to emotional expressions such as "going wild" or "complaining"). The emotional expression section 100F may express emotions through light emission or display.

Even in the case of emotional expression based on such an internal state, the mode of emotional expression can be updated based on the user's evaluation, as in the case of photographed images (see FIG. 13 and its explanation). Specifically, as shown in the flowchart of FIG. 14, when there is a user operation for the emotion expressed (output) in step S230 (YES in step S240), the evaluation determination unit 100D (evaluation determination unit) The user's evaluation of the emotional expression is determined by analyzing the operations on (the display 28, the touch sensor 45, the microphone 92, etc.) (step S250). Then, the emotion expression unit 100F updates the number, combination, and degree of outputs expressing emotions based on the user's evaluation (step S260). The next time the emotion expression unit 100F expresses an emotion, it expresses the emotion based on the updated result.

By updating the mode of emotional expression as described above, the mode of emotional expression based on the internal state will also be adapted to the user's preference, so that the user can easily become attached to his or her digital camera with printer 10 (imaging device). . Note that such emotional expression processing according to the state of the digital camera with printer 10 can be performed at any time during startup.

Through the above-described processing, the user of the digital camera 10 with a printer according to the first embodiment can easily take an image according to his or her preference, and can also use the digital camera 10 with a printer (imaging device) of his/her own preference. Easy to get attached to.

<Second embodiment>
Although the first embodiment describes the digital camera 10 with a printer, the configuration of the imaging device according to the present invention is not limited to this. Other imaging devices of the present invention may include, for example, a built-in or external PC camera (PC: Personal Computer), or a mobile terminal device with a shooting function as described below. .

Examples of the mobile terminal device that is an embodiment of the imaging device of the present invention include a mobile phone, a smartphone, a PDA (Personal Digital Assistant), and a portable game machine. The following explanation uses a smartphone as an example.

FIG. 15 is a diagram showing the appearance of a smartphone 500 (imaging device) that is an embodiment of the imaging device of the present invention, in which part (a) is a front view and part (b) is a rear view. The smartphone 500 shown in FIG. 15 has a flat case 502, and has a display panel 521 (display device) as a display section and an operation panel 522 (operation section) as an input section on one side of the case 502. The display input section 520 is provided with an integrated display input section 520. The housing 502 also includes a speaker 531, a microphone 532, an operation section 540 (operation section), camera sections 541 and 542 (imaging device, photographing section), and a strobe 543. Note that the configuration of the housing 502 is not limited to this, and for example, a configuration in which the display section and the input section are independent may be adopted, or a configuration having a folding structure or a sliding mechanism may be adopted.

FIG. 16 is a block diagram showing the configuration of smartphone 500 shown in FIG. 15. As shown in FIG. 16, the smartphone 500 includes a wireless communication section 511, a display input section 520, a communication section 530, an operation section 540, camera sections 541 and 542, a strobe 543, a storage section 550, and an external device. It includes an input/output section 560, a GPS receiving section 570 (GPS: Global Positioning System), a motion sensor section 580, and a power supply section 590. The smartphone 500 also includes a main control unit 601 (camera control unit, shooting control unit, communication control unit, display control unit, evaluation determination unit, emotion determination unit, emotion expression unit, learning unit, state detection unit, print control unit, storage control unit). Furthermore, the smartphone 500 has a wireless communication function as a main function that performs mobile wireless communication via a base station device and a mobile communication network.

The wireless communication unit 511 performs wireless communication with a base station device accommodated in a mobile communication network according to instructions from the main control unit 601, and uses such wireless communication to transfer various files such as audio data and image data. It sends and receives data, e-mail data, etc., and receives web data, streaming data, etc. The smartphone 500 can transmit image data to an external printer via the main control unit 601 and the wireless communication unit 511 to print the image data. Furthermore, the smartphone 500 may use the printer-equipped digital camera 10 according to the first embodiment as a printer.

Under the control of the main control unit 601, the display input unit 520 displays images (still images and/or moving images), text information, etc. to visually convey information to the user, and also allows the user to perform operations on the displayed information. It is a so-called touch panel that performs detection, and includes a display panel 521 and an operation panel 522.

In the display panel 521, an LCD (Liquid Crystal Display), an OELD (Organic Electro-Luminescence Display), or the like is used as a display device. The operation panel 522 is a device that is placed so that an image displayed on the display surface of the display panel 521 can be viewed, and that detects one or more coordinates that is operated by a user's finger or a conductor such as a pen. When such a device is operated by a user's finger or a conductor such as a pen, the operation panel 522 outputs a detection signal generated due to the operation to the main control unit 601. Next, the main control unit 601 detects the operation position (coordinates) on the display panel 521 based on the received detection signal. The display panel 521 corresponds to the display 28, sub-display 29, and sub-display area 28a in the digital camera with printer 10 according to the first embodiment, and displays emotions based on facial expressions or parts of the face (eyes, etc.). A representation (see FIGS. 10-12) can be made. Similarly, the operation panel 522 corresponds to the display 28, the touch sensor 45, and the operation unit 98, and the user can input evaluations of captured images and emotional expressions via the operation panel 522 (see FIGS. 8 and 9). can.

As shown in FIG. 15, a display panel 521 and an operation panel 522 of a smartphone 500 illustrated as an embodiment of the imaging device of the present invention are integrated to constitute a display input section 520. 522 is arranged to completely cover the display panel 521. When such an arrangement is adopted, the operation panel 522 may also have a function of detecting user operations in areas outside the display panel 521. In other words, the operation panel 522 has a detection area for an overlapping portion that overlaps the display panel 521 (hereinafter referred to as a display area) and a detection area for an outer edge portion that does not overlap the display panel 521 (hereinafter referred to as a non-display area). ) may also be provided.

The communication unit 530 includes a speaker 531 and a microphone 532, and converts the user's voice input through the microphone 532 (sensor unit) into audio data that can be processed by the main control unit 601 and outputs it to the main control unit 601. , audio data received by the wireless communication unit 511 or the external input/output unit 560 can be decoded and output from the speaker 531. Further, as shown in FIG. 15, for example, a speaker 531 can be mounted on the same surface as the display input section 520, and a microphone 532 can be mounted on the side surface of the housing 502. Under the control of the main control unit 601, the smartphone 500 can use the speaker 531 (emotion expression unit) to express (output) the emotions of the anthropomorphized smartphone 500 in a pseudo manner through voice and/or sound effects. Furthermore, the smartphone 500 can detect the user's evaluation of the captured image by voice using the microphone 532 (sensor unit).

The operation unit 540 is a hardware key using a key switch or the like, and is a device that receives instructions from the user. For example, as shown in FIG. 15, the operation unit 540 is mounted on the side of the housing 502 of the smartphone 500, and is turned on when pressed with a finger or the like, and turned off by the restoring force of a spring or the like when the finger is released. It is a button type switch.

The storage unit 550 (recording device) stores the control program and control data of the main control unit 601, application software, address data associated with the name and telephone number of the communication partner, data of e-mails sent and received, data downloaded by web browsing, etc. It stores web data, downloaded content data, and temporarily stores streaming data. Furthermore, the storage unit 550 includes an internal storage unit 551 built into the smartphone and an external storage unit 552 having a removable external memory slot. The storage unit 550 (state detection unit) detects the remaining capacity (memory remaining capacity) of the internal storage unit 551 and the external storage unit 552. Note that each of the internal storage section 551 and external storage section 552 that constitute the storage section 550 is realized using a known recording medium.

External input/output unit 560 serves as an interface with all external devices connected to smartphone 500. The smartphone 500 is directly or indirectly connected to other external devices via an external input/output unit 560 through communication or the like. Examples of communication means include Universal Serial Bus (USB), IEEE1394, and networks (eg, the Internet, wireless LAN). In addition, Bluetooth (registered trademark), RFID (Radio Frequency Identification), infrared communication (IrDA) (registered trademark), and the like can be cited as communication means. Furthermore, UWB (Ultra Wide Band) (registered trademark), ZigBee (registered trademark), etc. can also be mentioned as communication means.

Examples of external devices coupled to smartphone 500 include a wired/wireless headset, a wired/wireless external charger, and a wired/wireless data port. Further, a memory card and a SIM (Subscriber Identity Module Card)/UIM (User Identity Module Card) card connected via a card socket can also be mentioned as external devices. Also, external audio and video devices connected via audio and video I/O (Input/Output) terminals, external audio and video devices connected wirelessly, smartphones connected by wire/wireless, smartphones connected by wire/wireless External devices such as a PDA, a wired/wireless personal computer, and earphones can also be connected. The external input/output unit 560 can transmit data received from such an external device to each component inside the smartphone 500, and can transmit data inside the smartphone 500 to an external device.

The motion sensor unit 580 (sensor unit) includes, for example, a three-axis acceleration sensor, an angular velocity sensor, or a tilt sensor, and detects the physical movement of the smartphone 500 according to instructions from the main control unit 601. By detecting the physical movement of the smartphone 500, the moving direction, acceleration, and posture of the smartphone 500 are detected. Such detection results are output to the main control section 601. The motion sensor unit 580 can detect an operation (such as swinging the smartphone 500) related to the user's evaluation of the captured image and/or the mode of emotional expression. Power supply section 590 supplies power stored in a battery (not shown) to each section of smartphone 500 according to instructions from main control section 601. Further, the power supply section 590 (state detection section) detects the remaining capacity of the battery.

The main control unit 601 includes a microprocessor, operates according to the control program and control data stored in the storage unit 550, and centrally controls each unit of the smartphone 500 including the camera unit 541. Further, the main control unit 601 includes a mobile communication control function for controlling each part of the communication system and an application processing function in order to perform voice communication and data communication through the wireless communication unit 511.

The main control unit 601 also has an image processing function such as displaying video on the display input unit 520 based on image data (still image and moving image data) such as received data and downloaded streaming data. The image processing function refers to a function in which the main control unit 601 decodes image data, performs image processing on the decoded result, and displays the image on the display input unit 520. The main control unit 601 (state detection unit) detects the image processing load. Further, the main control unit 601 may detect the internal temperature of the smartphone 500 using a temperature detection unit (not shown).

The camera units 541 and 542 (photographing units) are digital cameras (imaging devices) that take electronic photographs using imaging elements such as CMOS and CCD. Further, under the control of the main control unit 601, the camera units 541 and 542 convert image data (moving images, still images) obtained by imaging into compressed image data such as MPEG or JPEG, and record it in the storage unit 550. Alternatively, it can be output through the external input/output section 560 or the wireless communication section 511. In the smartphone 500 shown in FIGS. 15 and 16, it is possible to take a picture using one of the camera parts 541 and 542, or it is also possible to take a picture using the camera parts 541 and 542 at the same time. When using the camera section 542, a strobe 543 can be used.

Furthermore, the camera units 541 and 542 can be used for various functions of the smartphone 500. For example, the smartphone 500 can display images acquired by the camera units 541 and 542 on the display panel 521. Furthermore, the smartphone 500 can use images from the camera units 541 and 542 as one of the operation inputs on the operation panel 522. Furthermore, when the GPS receiving unit 570 detects the position based on positioning information from the GPS satellites ST1, ST2, ..., STn, the smartphone 500 detects the position by referring to images from the camera units 541, 542. You can also do that. Furthermore, the smartphone 500 refers to the images from the camera units 541 and 542 and uses the camera unit 541 of the smartphone 500 without using the 3-axis acceleration sensor or in combination with the 3-axis acceleration sensor. It is also possible to determine the axial direction and the current usage environment. Of course, the smartphone 500 can also use images from the camera units 541 and 542 within the application software. In addition, the smartphone 500 converts still image or video image data into position information acquired by the GPS reception unit 570 and audio information acquired by the microphone 532 (speech to text conversion is performed by the main control unit etc. to become text information). It is also possible to add posture information etc. acquired by the motion sensor unit 580 and record it in the storage unit 550. Furthermore, the smartphone 500 can also output image data of these still images or moving images through the external input/output section 560 and the wireless communication section 511.

Similarly to the digital camera with printer 10 according to the first embodiment, the smartphone 500 configured as described above also performs the processing of the control method according to the present invention (determining the user's evaluation of the photographed image, (determining emotions, pseudo-expressing emotions, learning evaluations and reflecting them in shooting conditions, detecting states, etc.). Specifically, in the first embodiment, the processes (including the processes shown in the flowcharts shown in FIGS. 7, 13, and 14) executed by the camera control unit 100 (each unit shown in FIG. 6) are executed by the camera units 541, 542 in the smartphone 500. and the main control unit 601 can execute it. In addition, the functions of the operation unit 98, memory 72, memory controller 74, display 28, sub-display 29, and display controller 76 in the digital camera with printer 10 are the same as those of the operation unit 540, storage unit 550, operation panel 522, and display in the smartphone 500. This can be realized by the panel 521 and the main control unit 601.

As a result, the smartphone 500 according to the second embodiment has the same effect as the digital camera with printer 10 according to the first embodiment (the user can easily take images according to his/her preference, In addition, it is possible to obtain a feeling of attachment to the imaging device, etc.).

Note that the same processing as the digital camera with printer 10 according to the first embodiment (in accordance with the present invention) may be applied to a device such as the smartphone 500 (smartphone, tablet terminal, etc.) depending on its configuration (imaging unit, sensor unit, etc.). Application software (program) that causes such a control method to be performed can also be mentioned as an aspect of the present invention. Further, a non-transitory recording medium recording computer-readable code of such application software can also be mentioned as an aspect of the present invention. This "computer" can be realized using, for example, a processor such as the CPU described above and/or a combination thereof. In addition, such non-temporary recording media include recording media such as memory cards, and magneto-optical recording devices (hard disks, Blu-ray Discs (registered trademark), semiconductors, etc. used in computers such as servers on networks). memory, etc.).

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

10 Digital camera with printer 12 Camera body 14 Photographic lens 16 Release button 18 Recording button 20 Strobe light emitting window 22a Power button 22b Menu button 22c OK button 22d Mode switching button 24 Microphone hole 26 Speaker hole 28 Display 28a Sub-display area 29 Sub-display 30 Film lid cover 32a Joystick 32b Print button 32c Play button 32d Cancel button 34 Film outlet 42 Instant film 42a Exposure surface 42b Observation surface 42c Exposure area 42d Pod section 42e Developing solution pod 42f Trap section 42g Absorbing material 42h Observation area 42i Frame 45 Touch sensor 46 Acceleration sensor 47 Angular velocity sensor 48 Vibrator 49 LED
52 Film feeding mechanism 54 Film transport mechanism 56 Print head 58 Temperature detection section 62 Lens drive section 64 Image sensor 66 Image sensor drive section 68 Analog signal processing section 70 Digital signal processing section 72 Memory 74 Memory controller 76 Display controller 78 Communication section 80 Antenna 82 Film feed drive section 84 Film transport drive section 86 Head drive section 88 Strobe 90 Strobe light emission control section 92 Microphone 94 Speaker 96 Audio signal processing section 97 Clock section 98 Operation section 99 Battery 100 Camera control section 100A Shooting control section 100B Communication control section 100C Display control unit 100D Evaluation determination unit 100E Emotion determination unit 100F Emotion expression unit 100G Learning unit 100H State detection unit 100I Print control unit 100J Memory control unit 500 Smartphone 502 Housing 511 Wireless communication unit 520 Display input unit 521 Display panel 522 Operation panel 530 Call section 531 Speaker 532 Microphone 540 Operation section 541 Camera section 542 Camera section 543 Strobe 550 Storage section 551 Internal storage section 552 External storage section 560 External input/output section 570 GPS reception section 580 Motion sensor section 590 Power supply section 601 Main control section F Arrow F2 Arrow F3 Arrow M1 Circle M2 Cross mark S100 to S260 Processing steps in a digital camera with printer

Claims (18)

An imaging device comprising: a photographing control unit that causes a photographing unit to photograph an image; a sensor unit that detects an operation related to a user's evaluation of the photographed image; and an image processing unit that performs image processing on the photographed image. And,
an evaluation determining unit that analyzes an operation on the sensor unit and determines a user's evaluation of the captured image;
an emotion determination unit that determines an emotion of the anthropomorphic imaging device in response to the evaluation;
an emotion expression unit that pseudo-expresses the determined emotion using one or more outputs;
Equipped with
An imaging device that reflects a result of the evaluation in at least one of imaging conditions used by the imaging control unit and image processing conditions used by the image processing unit. The imaging device according to claim 1, wherein the sensor section detects at least one of a contact with the imaging device, an acceleration and/or angular velocity of the imaging device, and a sound directed to the imaging device. The emotion determining unit determines joy and/or enjoyment as the emotion when the evaluation is positive, and determines sadness and/or anger as the emotion when the evaluation is negative. 3. The imaging device according to 1 or 2. increasing the priority of the photographing conditions for images for which the evaluation was positive and lowering the priority for the photographing conditions for images for which the evaluation was negative;
The imaging device according to any one of claims 1 to 3, wherein the imaging control unit causes imaging to be performed under imaging conditions with a high priority. The imaging device according to any one of claims 1 to 4, wherein the imaging conditions are changed in accordance with the evaluation. The photographing control unit causes the photographing unit to bracket photograph a plurality of images under different photographing conditions,
The imaging device according to any one of claims 1 to 5, wherein the evaluation determining unit determines the user's evaluation for an image selected from the plurality of images. The sensor unit detects an instruction to print the image,
The imaging apparatus according to any one of claims 1 to 6, wherein the priority of the photographing condition for the image for which the print instruction has been given is increased. The evaluation determination unit analyzes the operation on the sensor unit and determines the user's evaluation of the expression of the imaging device,
8. The emotion expression unit updates the number, combination, and degree of the outputs expressing the emotion based on the evaluation of the expression, and expresses the emotion based on the result of the update. The imaging device according to item 1. further comprising a state detection unit that detects a state of the imaging device,
The imaging device according to any one of claims 1 to 8, wherein the emotion determining unit determines the emotion depending on the detected state. The imaging device according to claim 9, wherein the state detection unit detects at least one of remaining battery capacity, remaining memory capacity, image processing load, and internal temperature of the imaging device. The imaging device according to any one of claims 1 to 10, wherein the emotion expression section expresses the emotion by using at least one of display, light emission, sound, sound effect, and vibration as the output. The imaging device according to any one of claims 1 to 11, wherein the emotion expression section expresses the emotion by changing and displaying a facial expression or a part of the face. 13. The imaging device according to claim 1, wherein the photographing conditions include at least one of shutter speed, aperture value, and white balance. The photographing control unit has a plurality of photographing modes,
The imaging apparatus according to any one of claims 1 to 13, wherein the imaging conditions are reflected in each imaging mode. The imaging device according to any one of claims 1 to 14, further comprising a printer that prints the photographed image. An imaging device comprising: a photographing control unit that causes a photographing unit to photograph an image; a sensor unit that detects an operation related to a user's evaluation of the photographed image; and an image processing unit that performs image processing on the photographed image. A control method,
an evaluation determination step of analyzing the operation on the sensor unit and determining the user's evaluation of the captured image;
an emotion determination step of determining an emotion of the anthropomorphic imaging device in response to the evaluation;
an emotion expression step of pseudo-expressing the determined emotion using one or more outputs;
A control method that reflects a result of the evaluation on at least one of photographing conditions used by the photographing control section and image processing conditions used by the image processing section. 17. A program that causes an imaging device to execute the control method according to claim 16, comprising a photography control unit that causes a photography unit to photograph an image, and a sensor unit that detects an operation related to a user's evaluation of the photographed image. A non-transitory recording medium on which a computer-readable code of the program according to claim 17 is recorded.

Images