JP7790875B2 - Imaging device - Google Patents

Description

The present invention relates to an imaging device that allows voice input.

In recent years, imaging devices equipped with voice input functions have been proposed, such as technologies that recognize sounds emitted by the subject to assist in photography, and imaging devices that use voice recognition to decipher the voice of the photographer and then take a photo.

Patent Document 1 proposes technology that detects the direction and volume of a person speaking, adjusts the shooting direction to match the detected direction, and issues a warning if the detected volume is low.

Furthermore, Patent Document 2 proposes technology that recognizes audio input via an earphone microphone, understands recording instructions contained in the audio, and then executes recording.

On the other hand, many conventional digital cameras have built-in speakers that output electronic sounds such as the electronic shutter sound, warning sounds, and operation sounds so that the photographer or people nearby can know the digital camera's operating status. These electronic sounds emitted by digital cameras, or the sound of the mechanical shutter opening and closing when taking pictures, can be a nuisance to the subject artist or people nearby when photographing concerts or sporting scenes held in quiet environments. For this reason, cameras have been equipped with a silent mode that changes the shutter used when taking pictures from a mechanical shutter to an electronic shutter and also prevents all electronic sounds, including the electronic shutter sound, from being output from the speaker, allowing for appropriate suppression of image output.

JP 2017-034645 A JP 2003-219243 A

However, the silent mode of conventional imaging devices did not take into consideration the audio input function.

The present invention therefore aims to enable more appropriate audio input in imaging devices equipped with a silent mode.

For the above purpose, the imaging device of the present invention is an imaging device comprising an audio output means, a selection means for selecting the use of a silent mode that limits the output of audio from the audio output means, an audio input means, a notification means, and a control means for controlling the imaging device based on audio input via the audio input means, wherein when the use of the silent mode is selected, the control means controls the audio input means to increase the audio detection level , and when the use of the silent mode is selected, the notification means notifies the user that input will be accepted even if the audio is quieter than when not using the silent mode is selected .

The present invention aims to enable more appropriate audio input in an imaging device equipped with a silent mode.

1A and 1B are a configuration diagram and a block diagram of an imaging apparatus according to a first embodiment; 1 is an external view of an imaging device according to a first embodiment. 4 is a flowchart for explaining the operation of the imaging device according to the first embodiment. FIG. 4 is a diagram showing an example of a message displayed on the imaging device according to the first embodiment.

The following describes in detail the embodiments of the present invention, using the accompanying drawings.

The embodiment described below is an example of a means for realizing the present invention, and may be modified or changed as appropriate depending on the configuration of the device to which the present invention is applied and various conditions. It is also possible to combine the various embodiments as appropriate.

[First embodiment]
<Digital camera configuration>
The imaging device according to the first embodiment will be described below.

Figure 1 (A) is a diagram showing the configuration of an imaging device according to the first embodiment. The imaging optical system 100 includes an aperture 11, an image stabilization lens group 12, and a focus lens group 13, and is capable of directing an optical image to a camera body 200. The camera body 200 includes an image sensor 21 that photoelectrically converts the optical image of the imaging optical system 100, and a mechanical shutter 22 that adjusts the exposure time.

The camera body 200 is equipped with a rear LCD 23 on the rear panel and a small LCD 24 and optical system 25 in the viewfinder, allowing it to display images captured by the image sensor 21.

Note that if the image sensor has an electronic shutter function, a mechanical shutter is not necessary; even if a mechanical shutter is provided, the mechanical shutter remains fully open when adjusting the exposure time with the electronic shutter. When taking a picture, the shutter button (not shown) is lightly pressed to the first position, a so-called "half-press," and the shooting conditions such as shutter speed and aperture value are set by the autofocus and autoexposure mechanisms. Furthermore, by pressing the shutter button further from the half-press position to the second position, a so-called "full press," the mechanical shutter 22 or the electronic shutter function of the image sensor 21 is activated and an image is taken.

The mechanical shutter or electronic shutter described above is the exposure means that uses the image sensor to perform exposure.

Figure 1(B) is a block diagram of the imaging device of the first embodiment. The camera body 200 is equipped with an electrical circuit 20, which includes a CPU, image processing circuit, control circuit, connection detection circuit, etc.

The aperture 11, image stabilization lens group 12, focus lens group 13, and mechanical shutter 22 are each controlled by a control circuit via driving means (not shown).

The signal photoelectrically converted by the image sensor 21 can be converted into digital data via an image processing circuit and stored on a recording medium (not shown).

The viewfinder is equipped with an eye sensor 26 that can detect whether the photographer has placed their eye near the viewfinder.

The audio output unit 27 is a speaker mounted on the main unit and can output audio directly.

The audio input unit 28 is a microphone mounted on the main unit that collects audio and enables control via audio input.

The external audio output connection unit 29 is a means for connecting to an external audio output means such as earphones, and can output audio via the external audio output means. The connection to the external audio playback means may be wired or wireless.

The external audio input connection unit 30 is a connection means to an external audio input means such as a microphone, and can collect audio.

The external audio input connection unit 30 may be configured to connect the camera body 200 to an external audio input means using a physical connector, etc., or may be configured to implement a communication unit within the camera body 200 and electrically connect via wireless or other means.

The connection detection circuit implemented in the electrical circuit 20 is a connection detection means that detects the connection between an external audio output means, such as earphones, and the external audio output connection unit 29. The connection detection circuit implemented in the electrical circuit 20 is also a connection detection means that detects the connection between an external audio input means, such as an external microphone, and the external audio input connection unit 30.

The electrical circuit 20 is equipped with a sound detection level setting circuit (not shown), which is a circuit for setting the sound detection level on the camera body 200 at which the various settings of the camera body 200 described above can be changed. Setting the sound detection level higher allows the various settings of the camera body 200 to be changed with a quieter sound; conversely, setting the sound detection level lower requires a louder sound to change the various settings of the camera body 200.

The CPU is a setting change means that changes settings based on audio input from the audio input means, and can change various settings of the camera body 200 based on audio input from the audio input unit 28 or the external audio input connection unit 30. The CPU is also a processing device that can electrically control the components of the camera body 200.

Note that control signal lines are omitted in Figure 1, and only the flow of information between each element is shown by arrows.

Figure 2 is an external view of the imaging device 10, with Figure 2(A) showing the front and Figure 2(B) showing the rear.

The imaging device 10 is equipped with operation units operated by the photographer, including a power switch 31, dial keys 32, a shutter button 33, a direct button 34, a selection button 35, and a MENU button 36.

The photographer turns the power of the imaging device 10 on and off by operating the power switch 31.

In addition, the dial keys 32, direct buttons 34, selection buttons 35, and MENU button 36 can be used to change the shooting mode and perform other settings on the imaging device 10.

Furthermore, pressing the shutter button 33 halfway gives a focus command, and pressing the shutter button 33 all the way gives a capture command.

The imaging device 10 according to this embodiment has two shutter modes and is equipped with a shutter mode selection means for selecting the mode in response to the photographer's selection.

One shutter mode is the mechanical shutter mode. In this mode, the mechanical shutter 22 is controlled by the CPU to adjust the exposure time of the image sensor 21.

The other shutter mode is electronic shutter mode. In this mode, the mechanical shutter 22 is controlled by the mechanical shutter control means in a direction that does not block light entering the image sensor, and the CPU controls the start and end of charge accumulation, adjusting the exposure time of the image sensor 21.

In addition, since no mechanical shutter sound is produced in electronic shutter mode, a pseudo electronic shutter sound that simulates the mechanical shutter sound is generated by the audio playback circuit and can be output from the audio output unit 27.

The electronic shutter sound can be an electronic sound different from the mechanical shutter sound, and any sound is fine as long as it allows you to recognize that exposure has started and ended.

In addition, some photographers may not want the electronic shutter sound to be output, so the CPU's audio output selection means (not shown) can be used to select whether the electronic shutter sound output is on or off. When the electronic shutter sound output setting is set to on, the electronic shutter sound is output. When the electronic shutter sound output setting is set to off, the electronic shutter sound is not output.

Mechanical shutter mode and electronic shutter mode each have their own advantages. For example, the advantages of a mechanical shutter include less rolling shutter distortion and less image noise, while the advantages of an electronic shutter include faster shutter speeds and less vibration.

The imaging device 10 according to this embodiment also has a silent mode as a shooting mode, and is equipped with a shooting mode selection means that allows the photographer to select ON or OFF.

In this embodiment, silent mode is a mode that limits the sound output from the imaging device. In silent mode, the imaging device operates in electronic shutter mode rather than mechanical shutter mode to avoid generating the mechanical shutter sound mentioned above, and the electronic shutter sound output is also not turned on. This silent mode is necessary, for example, in shooting situations such as bird photography, where silence is required, or sports photography, where tension increases.

In this specification, the rear LCD 23 or small LCD 24 will be referred to as the display means.

The audio input unit 28 is also referred to as the main body microphone.

Furthermore, the external audio input means connected to the external audio input connection unit 30 is referred to as an external microphone.

Furthermore, detecting whether an external microphone is connected using the connection detection circuit is referred to as external microphone detection.

The eye sensor 26 is also referred to as the eye detection means, and the eye sensor 26 detecting whether the photographer has placed their eye near the viewfinder is referred to as eye detection. The eye sensor 26 may be a sensor that uses capacitance or infrared light.

<Operation of the imaging device>
Next, the operation of the imaging device 10 according to this embodiment will be described with reference to the flowchart of FIG.

Figure 3 is a flowchart explaining how the audio detection levels of the built-in microphone and external microphone are changed in response to silent mode, external microphone detection, and eye proximity detection. The processing shown in this flowchart is achieved by the CPU of the electrical circuit 20 controlling each part of the imaging device in accordance with input signals and programs.

In step S301, the CPU accepts the photographer's selection of whether silent mode is on or off.

In step S302, the CPU determines whether silent mode is selected as ON or OFF. If silent mode is OFF, the process proceeds to step S303.

In step S303, the CPU does not change the settings of the sound detection levels for the built-in microphone and external microphone as described below, but instead maintains the settings and ends processing.

On the other hand, if it is determined in step S302 that silent mode is ON, the process proceeds to step S304, where it is determined whether an external microphone and eye proximity are detected.

First, in step S304, the CPU determines whether "external microphone detection: not present" and "eye proximity detection: present."

If step S304 returns Yes, the process proceeds to step S305, where the CPU controls the audio detection level of the built-in microphone to be higher than when silent mode is OFF, so that the photographer can input audio via the built-in microphone in a quieter voice.

After completing step S305, the CPU proceeds to step S306, where it notifies the user that "the built-in microphone can recognize sounds at a lower volume than when silent mode is OFF." Here, the user is notified by, for example, displaying a message on the display means. An example of the message displayed on the display means in step S306 will be described later using Figure 4.

As described above, when silent mode is ON and "External microphone detection: No" and "Eye detection: Yes," the photographer's intention is to input voice quietly through the built-in microphone, so the voice detection level of the built-in microphone is increased as in step S305.

This allows for greater consideration of quietness to those around you when silent mode is on.

If step S304 returns No, the process proceeds to step S307, where the CPU determines whether "external microphone detection: Yes" and "eye proximity detection: No" are present.

If step S307 returns Yes, the process proceeds to step S308, where the CPU controls the external microphone's audio detection level to be higher than when silent mode is OFF, so that the photographer can input audio via the external microphone in a quieter voice.

After completing step S308, the CPU proceeds to step S309, where it displays a message on the display means stating that "Silent mode: Recognition from external microphone is possible at a quieter volume than when OFF." This notifies the user that "Silent mode: Recognition from external microphone is possible at a quieter volume than when OFF."

An example of the message displayed on the display means in step S309 will be described later using Figure 4.

As described above, when silent mode is ON and "External microphone detection: Yes" and "Eye detection: No," the photographer intends to input voice quietly through the external microphone, so the external microphone's voice detection level is increased as in step S308.

This allows for greater consideration of quietness to those around you when silent mode is on.

If step S307 returns No, the CPU proceeds to step S310 and determines whether "External microphone detection: Yes" and "Eye contact detection: Yes" are true.

If step S310 returns Yes, the process proceeds to step S311, where the CPU controls the audio detection level of either the main body or external microphone to be higher than when silent mode is OFF, so that the photographer can input audio in a quieter voice using either the main body or external microphone.

In step S311, the CPU determines whether the external microphone or the built-in microphone is closer to the photographer's mouth. It then increases the audio detection level of the microphone determined to be closer.

After completing step S311, the CPU proceeds to step S312, where it displays a message on the display indicating that "Silent mode from the built-in microphone or external microphone: Recognition is possible at a quieter volume than when silent mode is OFF." This notifies the user that "Silent mode from the built-in microphone or external microphone: Recognition is possible at a quieter volume than when silent mode is OFF."

An example of the message displayed on the display means in step S312 will be described later using Figure 4.

As described above, when silent mode is ON and "External microphone detection: Yes" and "Eye contact detection: Yes" are enabled, the photographer intends to input voice quietly from either the built-in microphone or the external microphone. Therefore, the voice detection level for either the built-in microphone or the external microphone is increased, as in step S311.

This allows for greater consideration of quietness to those around you when silent mode is on.

If step S310 returns No, the CPU ends processing without changing the audio detection levels of the built-in microphone and external microphone as described above.

Figure 4 shows an example of a message display that informs the photographer whether low-speech recognition is possible using the built-in microphone or the external microphone.

As mentioned above, in this embodiment, a message is displayed when silent mode is ON, so in Figures 4(a) to 4(c), a "SILENT" icon 400 is displayed to indicate that silent mode is ON.

Figure 4(a) shows an example of a message displayed on the display means in step S306 when it is determined in step S304 of Figure 3 that "external microphone detected: not present" and "eye proximity detected: not present." This example shows an icon 401 with "Small" written next to the built-in microphone.

Figure 4(b) shows an example of a message displayed on the display means in step S309 when it is determined in step S307 of Figure 3 that "External microphone detected: Yes" and "Eye proximity detected: No." This example shows an icon 402 with "Small" written next to the external microphone.

In step S312 of Figure 3, either Figure 4(a) or Figure 4(b) will be displayed depending on whether the audio detection level of the built-in microphone or the external microphone is increased, as described above.

Figure 4(c) shows an example of a message that indicates that when silent mode is ON and the volume of voice input exceeds a predetermined threshold, voice input can be accepted even at a lower voice level.

Figure 4(c) shows an example in which, in addition to the display shown in Figure 4(a), an icon 403 with the words "more small" written on it is also displayed.

This will encourage the photographer to speak even quieter.

As described above, according to this embodiment, the audio detection level of the built-in microphone or external microphone is automatically adjusted depending on the external microphone connection status and eye position during silent mode shooting, allowing the photographer to input audio in a quieter voice and reducing disturbance to those around them.

The above describes preferred embodiments of the present invention, but the present invention is not limited to these embodiments, and various modifications and variations are possible within the scope of the invention.

The present invention can also be realized by performing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of that system or device reads and executes the program code. In this case, the program and the storage media on which the program is stored constitute the present invention.

Claims (9)

An imaging device,
audio output means;
a selection means for selecting use of a silent mode that limits audio output from the audio output means;
A voice input means;
A notification means;
a control means for controlling the imaging device based on the sound input via the sound input means;
Equipped with
When the silent mode is selected, the control means controls the voice input means to increase a voice detection level,
When the user selects to use the silent mode, the notification means notifies the user that input will be accepted even if the sound is quieter than when the user selects not to use the silent mode. Finder and
a detection means for detecting whether the viewfinder is placed close to the eye,
The imaging device according to claim 1, characterized in that even when the silent mode is selected, the control means does not control the audio input means to increase the audio detection level when the viewfinder is not detected as being brought into contact with the viewfinder. Finder and
a detection means for detecting when an eye is placed near the finder;
Further comprising a connection means for connecting to an external voice input device,
2. The imaging device according to claim 1, wherein when the silent mode is selected, the imaging device is connected to the external audio input device, and when close contact with the viewfinder is detected, the control means controls the audio input means to increase the audio detection level. 4. The imaging device according to claim 3, wherein when the silent mode is selected, the external audio input device is connected, and no eye is detected near the viewfinder, the control means controls the external audio input means to increase the audio detection level. 5. The imaging device according to claim 1, wherein, when the silent mode is selected and the volume of the sound input to the sound input means exceeds a predetermined threshold, a warning is issued to the user based on the fact that the volume of the input sound exceeds the predetermined threshold. an audio output means for generating an electronic shutter sound;
an audio output selection means for accepting a selection as to whether or not to output an electronic shutter sound by the audio output means;
Furthermore,
The imaging device according to claim 1 , wherein the sound output selection means controls the device so that an electronic shutter sound is not output when the silent mode is selected. a shutter mode selection means for selecting whether to use a mechanical shutter or an electronic shutter for photography;
Furthermore,
the shutter mode selection means selects an electronic shutter mode when the silent mode is selected;
7. The imaging device according to claim 1, wherein the imaging device further comprises: a first lens; A method for controlling an imaging device having an audio output means and an audio input means, comprising:
a selection step of selecting use of a silent mode that limits audio output from the audio output means;
a notification step;
a control step of controlling an imaging device based on the voice input via the voice input means;
and
A control method for an imaging device, characterized in that, when the use of the silent mode is selected, the control step controls the voice input means to increase the voice detection level, and when the use of the silent mode is selected, the notification step notifies the user that input will be accepted even if the voice is quieter than when the use of the silent mode is not selected. 9. A computer-readable program for causing a computer having a voice output means and a voice input means to execute the control method according to claim 8.