JP7779896B2 - Control device, imaging device, control method, and program - Google Patents

Description

The technology disclosed herein relates to a control device, an imaging device, a control method, and a program.

JP 10-134272 A discloses a monitoring system for large-space disaster prevention and the like, which uses thermal images of large spaces to detect fires and intruders and perform environmental control, and which is characterized by comprising an infrared camera for extracting thermal images of specific temperature ranges using a temperature filter, a temperature filter selection means having multiple temperature filters with different temperature ranges from room temperature to the temperature range required for fire monitoring and selecting a temperature filter for the infrared camera from the multiple temperature filters, an image data storage means for storing processed thermal image data extracted from the infrared camera, and a control processing means for controlling the temperature filter selection means to select a temperature filter for the infrared camera in accordance with the switching timing of multiple preset monitoring modes, extracting thermal image data from the infrared camera for each monitoring mode, and performing processing for each monitoring mode.

International Publication No. WO 2005/71372 discloses an image processing system comprising an image capturing unit configured to acquire spectral images, which comprises a photographic optical system for forming an image of a subject, an image sensor unit for capturing the subject image formed by the photographic optical system and outputting an image signal, and a photographing operation unit for performing operations related to photographing the image, and which further comprises a mode display means for displaying mode-related information corresponding to each of a plurality of modes that the image processing system can take.

JP 2004-534941 A discloses a handheld infrared camera including a lens assembly, the lens assembly being supported by a housing configured to hold an electrical energy source and processing means for recording and processing information received through the lens assembly, and user control means for manually and visually controlling the device being provided on the housing, wherein the housing is substantially elongated, the lens assembly is mounted at one end, and the opposite end is formed as a user handle, and one side of the housing is provided with a collection of manual control means intended to be operated with the user's thumb and visual control means, the visual control means being positioned between the collection of manual control means and the lens assembly and adapted to be visible when the infrared camera is held away from the user's eyes and body, and the infrared camera is intended to be operated with one hand.

One embodiment of the technology disclosed herein provides a control device, an imaging device, a control method, and a program that can differentiate the control content of a control target between a first mode and a second mode.

A first aspect of the technology disclosed herein is a control device comprising a processor and memory connected to or built into the processor, the processor having a first mode for capturing an image based on light received by an image sensor of an imaging device, and a second mode for deriving temperature based on near-infrared light received by the image sensor, and the control factors for the first mode and the second mode are different.

A second aspect of the technology disclosed herein is a control device according to the first aspect, in which the control factor includes a display control factor that is displayed on a display.

A third aspect of the technology disclosed herein is a control device according to the second aspect, wherein the processor, in the first mode, sets, as the display control factor, an image display factor that causes an image obtained by receiving light by an image sensor to be displayed on a display, and in the second mode, sets, as the display control factor, a temperature information display factor that causes temperature information indicating a temperature to be displayed on a display.

A fourth aspect of the technology disclosed herein is a control device according to any one of the first to third aspects, wherein the control factor includes a light-projection control factor that operates a light-projector, and the processor, in the second mode, sets a light-projection suppression control factor that suppresses light projection by the light-projector as the light-projection control factor.

A fifth aspect of the technology disclosed herein is a control device according to any one of the first to fourth aspects, wherein the control factor includes an imaging setting factor related to imaging settings.

A sixth aspect of the technology disclosed herein is a control device according to the fifth aspect, wherein the imaging settings include at least one of settings related to a floodlight, settings related to shutter speed, settings related to aperture, settings related to photometry, settings related to image sensor sensitivity, settings related to high dynamic range, and settings related to vibration isolation control.

A seventh aspect of the technology disclosed herein is a control device according to any one of the first to sixth aspects, wherein the control factor includes an image processing setting factor related to image processing settings.

An eighth aspect of the technology disclosed herein is a control device according to the seventh aspect, wherein the image processing settings include at least one of settings related to noise reduction, settings related to sharpness, settings related to contrast, and settings related to tone.

A ninth aspect of the technology disclosed herein is a control device comprising a processor and memory connected to or built into the processor, wherein the processor has a first mode for capturing an image based on light received by an image sensor of an imaging device, and a second mode for deriving temperature based on near-infrared light received by the image sensor, and the control device sets the first mode when the projector is on, and sets the second mode when the projector is off.

A tenth aspect of the technology disclosed herein is a control device according to the ninth aspect, wherein the processor, in the second mode, switches from the second mode to the first mode depending on the temperature.

An eleventh aspect of the technology disclosed herein is a control device according to the tenth aspect, in which the floodlight emits pulsed light, and the processor repeats the operation of setting a first mode during the light emission period of the pulsed light and setting a second mode during the light emission stop period of the pulsed light, depending on the light emission timing of the pulsed light.

A twelfth aspect of the technology disclosed herein is a control device according to any one of the first to eleventh aspects, in which the processor outputs a composite image that combines a first captured image obtained by receiving light by the image sensor with temperature information indicating the temperature.

A thirteenth aspect of the technology disclosed herein is an imaging device comprising a control device according to any one of the first to twelfth aspects and an image sensor.

A fourteenth aspect of the technology disclosed herein is a control method that includes switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which temperature is derived based on near-infrared light received by the image sensor, and differentiating control factors between the first mode and the second mode.

A fifteenth aspect of the technology disclosed herein is a control method that includes switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which temperature is derived based on near-infrared light received by the image sensor, and setting the first mode when the operation of the projector is on, and setting the second mode when the operation of the projector is off.

A sixteenth aspect of the technology disclosed herein is a program for causing a computer to execute processing including switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which temperature is derived based on near-infrared light received by the image sensor, and differentiating control factors between the first mode and the second mode.

A seventeenth aspect of the technology disclosed herein is a program for causing a computer to execute processing including switching between a first mode in which an image is captured based on light received by an image sensor of an imaging device and a second mode in which temperature is derived based on near-infrared light received by the image sensor, and setting the first mode when the projector is on and setting the second mode when the projector is off.

FIG. 1 is a perspective view showing an example of a camera according to a first embodiment. FIG. 2 is a block diagram showing an example of the internal configuration of the camera according to the first embodiment. FIG. 2 is a block diagram showing an example of the electrical configuration of the camera according to the first embodiment. 3A to 3C are explanatory diagrams illustrating an example of the configuration and operation of a turret filter according to the first embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of a CPU according to the first embodiment. FIG. 2 is a block diagram showing an example of the configuration of a CPU serving as a mode switching processing unit according to the first embodiment. FIG. 2 is a block diagram showing an example of a configuration of a CPU as an imaging processing unit according to the first embodiment. FIG. 2 is a front view showing an example of a captured image obtained by imaging processing according to the first embodiment. FIG. 2 is a block diagram showing an example of the configuration of a temperature measurement processing unit of a CPU according to the first embodiment. FIG. 4 is an explanatory diagram showing an example of a function of a CPU as a wavelength selection unit according to the first embodiment; FIG. 10 is a front view showing a first example of a composite image obtained by the temperature measurement process according to the first embodiment. FIG. 10 is a front view showing a second example of a composite image obtained by the temperature measurement process according to the first embodiment. FIG. 10 is a front view showing a third example of a composite image obtained by the temperature measurement process according to the first embodiment. FIG. 10 is a front view showing a fourth example of a composite image obtained by the temperature measurement process according to the first embodiment. 10 is a flowchart showing an example of the flow of a mode switching process according to the first embodiment. 5 is a flowchart showing an example of the flow of an imaging process according to the first embodiment. 10 is a flowchart illustrating an example of the flow of a temperature measurement process according to the first embodiment. FIG. 10 is a front view showing a modified example of the captured image obtained by the imaging process according to the first embodiment. FIG. 10 is a front view showing a modified example of a composite image obtained by the temperature measurement process according to the first embodiment. FIG. 11 is a block diagram showing an example of the configuration of a CPU serving as a mode switching processing unit according to a second embodiment. 10 is a flowchart showing an example of the flow of a mode switching process according to the second embodiment. FIG. 11 is a block diagram showing an example of the configuration of a CPU serving as a parameter change processing unit according to the third embodiment. FIG. 11 is a block diagram showing an example of the configuration of a CPU serving as an imaging processing unit according to a third embodiment. FIG. 11 is a block diagram showing an example of the configuration of a temperature measurement processing unit of a CPU according to a third embodiment. 13 is a flowchart showing an example of the flow of a parameter change process according to the third embodiment. FIG. 13 is a block diagram showing an example of the configuration of a CPU serving as a mode switching processing unit according to the fourth embodiment. 13 is a flowchart showing an example of the flow of a mode switching process according to the fourth embodiment. FIG. 13 is a block diagram showing an example of a configuration of a CPU serving as an integrated display processing unit according to the fifth embodiment. 13 is a flowchart showing an example of the flow of an integrated display process according to the fifth embodiment. FIG. 10 is a block diagram showing an example of an electrical configuration of an imaging device according to a first modified example. FIG. 10 is a block diagram showing an example of an electrical configuration of an imaging device according to a second modified example.

Below, examples of embodiments of a control device, imaging device, control method, and program relating to the technology disclosed herein are described with reference to the attached drawings.

First, let us explain the terminology used in the following explanation.

CPU is an abbreviation for "Central Processing Unit". GPU is an abbreviation for "Graphics Processing Unit". NVM is an abbreviation for "Non-Volatile Memory". RAM is an abbreviation for "Random Access Memory". IC is an abbreviation for "Integrated Circuit". ASIC is an abbreviation for "Application Specific Integrated Circuit". PLD is an abbreviation for "Programmable Logic Device". FPGA is an abbreviation for "Field-Programmable Gate Array". SoC is an abbreviation for "System-on-a-chip". SSD is an abbreviation for "Solid State Drive". HDD is an abbreviation for "Hard Disk Drive". EEPROM is an abbreviation for "Electrically Erasable and Programmable Read Only Memory". SRAM is an abbreviation for "Static Random Access Memory". I/F is an abbreviation for "Interface". USB is an abbreviation for "Universal Serial Bus". CMOS is an abbreviation for "Complementary Metal Oxide Semiconductor". CCD is an abbreviation for "Charge Coupled Device". LAN is an abbreviation for "Local Area Network". WAN is an abbreviation for "Wide Area Network". BPF is an abbreviation for "Band Pass Filter". Ir is an abbreviation for "Infrared Rays". EL is an abbreviation for "Electro Luminescence".

In the description of this specification, "vertical" refers to vertical in the sense of being perfectly vertical, as well as being within the tolerances generally accepted in the technical field to which the technology of the present disclosure belongs, and that do not violate the spirit of the technology of the present disclosure. In the description of this specification, "horizontal" refers to horizontal in the sense of being perfectly horizontal, as well as being within the tolerances generally accepted in the technical field to which the technology of the present disclosure belongs, and that do not violate the spirit of the technology of the present disclosure. In the description of this specification, "parallel" refers to parallel in the sense of being perfectly parallel, as well as being within the tolerances generally accepted in the technical field to which the technology of the present disclosure belongs, and that do not violate the spirit of the technology of the present disclosure. In the description of this specification, "orthogonal" refers to orthogonal in the sense of being perfectly perpendicular, as well as being within the tolerances generally accepted in the technical field to which the technology of the present disclosure belongs, and that do not violate the spirit of the technology of the present disclosure. In the description of this specification, "coincidence" refers to coincidence in the sense of being perfectly coincident, as well as being within the tolerances generally accepted in the technical field to which the technology of the present disclosure belongs, and that do not violate the spirit of the technology of the present disclosure. In the description of this specification, "equally spaced" refers to not only perfectly evenly spaced intervals, but also equal intervals that include errors that are generally acceptable in the technical field to which the technology of the present disclosure belongs and that do not contradict the spirit of the technology of the present disclosure.

[First embodiment]
First, a first embodiment will be described. As shown in FIG. 1 , a camera 1 includes a camera body 10 and a lens unit 20. The camera 1 has a function of capturing visible light to obtain a visible light image, a function of capturing near-infrared light to obtain a near-infrared light image, and a function of measuring the temperature of a subject based on electromagnetic waves emitted by thermal radiation from the subject. The camera 1 is an example of an "imaging device" according to the technology of the present disclosure.

A camera-side mount 12 for attaching the lens unit 20 is provided on the front surface 11 of the camera body 10. In addition, an illumination window 13 for irradiating illumination light IL toward the subject is provided on the front surface 11 of the camera body 10.

The camera body 10 is equipped with a projector 14 that generates illumination light IL. The projector 14 is, for example, an LED that emits near-infrared light with a peak wavelength of 1550 nm as illumination light IL. The projector 14 may also be a halogen light. The illumination light IL generated by the projector 14 passes through the irradiation window 13 and is emitted forward from the camera body 10. The projector 14 is an example of a "projector" according to the technology disclosed herein.

The camera body 10 also includes an image sensor 15. The image sensor 15 captures light L incident from the subject through the lens unit 20. The image sensor 15 has a light receiving surface 15A. The light L incident on the lens unit 20 is focused on the light receiving surface 15A by the lens unit 20. An image is obtained by focusing the light L on the light receiving surface 15A. A plurality of photodiodes are arranged in a matrix on the light receiving surface 15A.

As an example, the multiple photodiodes include multiple silicon photodiodes sensitive to visible light and multiple indium gallium arsenide photodiodes sensitive to near-infrared light. Hereinafter, the silicon photodiodes will be referred to as Si diodes, and the indium gallium arsenide photodiodes will be referred to as InGaAs diodes. The multiple Si diodes generate and output analog image data corresponding to the visible light they receive. The multiple InGaAs diodes generate and output analog image data corresponding to the near-infrared light they receive. Hereinafter, unless a distinction is required, visible light and near-infrared light incident on the image sensor 15 will be referred to as light.

In the first embodiment, a CMOS image sensor is used as the image sensor 15, but the technology of the present disclosure is not limited to this. For example, the technology of the present disclosure can be applied even if the image sensor 15 is another type of image sensor, such as a CCD image sensor. The image sensor 15 is an example of an "image sensor of an imaging device" according to the technology of the present disclosure.

The lens unit 20 comprises a lens barrel 21 and a lens side mount 22. The lens side mount 22 is provided at the rear end of the lens barrel 21. The lens side mount 22 is configured to be connectable to the camera side mount 12 of the camera body 10. The lens unit 20 is detachably attached to the camera body 10 via the lens side mount 22. Note that the lens unit 20 may also be fixed to the camera body 10 in an undetachable manner.

2, the lens unit 20 includes an objective lens 30, a focus lens 31, a zoom lens 32, an aperture 33, a blur correction lens 34, a turret filter 35, and an adjustment lens 37. The objective lens 30, the focus lens 31, the zoom lens 32, the aperture 33, the blur correction lens 34, the turret filter 35, and the adjustment lens 37 are arranged in this order from the subject side to the image side along the optical axis OA of the lens unit 20.

The objective lens 30 is fixed to the tip of the lens barrel 21 and is a lens that focuses light. The focus lens 31 is a lens that adjusts the focal position of the image. The zoom lens 32 is a lens that adjusts the zoom magnification.

The diaphragm 33 is an optical element for adjusting the amount of light. The diaphragm 33 has an aperture 33A. Light guided by the zoom lens 32 passes through the aperture 33A. The diaphragm 33 is a movable diaphragm in which the diameter of the aperture 33A is variable. The amount of light guided by the zoom lens 32 is changed by the diaphragm 33. The blur correction lens 34 is a lens for correcting image blur.

The turret filter 35 has multiple optical filters. The turret filter 35 is an optical element that selectively transmits light of multiple wavelength bands contained in the light (for example, visible light and near-infrared light of different wavelength bands within the near-infrared wavelength band) by switching between optical filters inserted into the optical path of the light within the lens unit 20. The optical path of the light within the lens unit 20 is located, for example, on the optical axis OA. Hereinafter, the optical path of the light within the lens unit 20 will be simply referred to as the optical path. The configuration of the turret filter 35 will be described in detail later using Figure 4.

The adjustment lens 37 is a lens for adjusting the difference in focal length when switching between the multiple optical filters provided in the turret filter 35.

The order of the focus lens 31, zoom lens 32, aperture 33, blur correction lens 34, turret filter 35, and adjustment lens 37 may be other than that described above. Each of the objective lens 30, focus lens 31, zoom lens 32, blur correction lens 34, and adjustment lens 37 may be a single lens or a lens group having multiple lenses. The lens unit 20 may also include other lenses in addition to the focus lens 31, zoom lens 32, blur correction lens 34, and adjustment lens 37. The lens unit 20 may also include optical elements such as a half mirror or a polarizing element.

2, the lens unit 20 includes a zoom drive mechanism 42, an aperture drive mechanism 43, a blur correction drive mechanism 44, a turret drive mechanism 45, and an adjustment drive mechanism 47. The zoom drive mechanism 42, the aperture drive mechanism 43, the blur correction drive mechanism 44, the turret drive mechanism 45, and the adjustment drive mechanism 47 are electrically connected to electrical contacts 38 provided at the rear end of the lens barrel 21.

The camera body 10 is equipped with a control circuit 50. The control circuit 50 is electrically connected to electrical contacts 58 provided on the camera-side mount 12. When the lens-side mount 22 is connected to the camera-side mount 12 and the lens unit 20 is attached to the camera body 10, the electrical contacts 38 are connected to the electrical contacts 58, and the control circuit 50 is electrically connected to the zoom drive mechanism 42, aperture drive mechanism 43, image blur correction drive mechanism 44, turret drive mechanism 45, and adjustment drive mechanism 47.

The zoom drive mechanism 42, aperture drive mechanism 43, blur correction drive mechanism 44, turret drive mechanism 45, and adjustment drive mechanism 47 are all drive mechanisms that include actuators such as motors.

As an example, as shown in Figure 3, the control circuit 50 includes a computer 60, a zoom drive circuit 52, an aperture drive circuit 53, a blur correction drive circuit 54, a turret drive circuit 55, and an adjustment drive circuit 57. The zoom drive circuit 52, the aperture drive circuit 53, the blur correction drive circuit 54, the turret drive circuit 55, and the adjustment drive circuit 57 are connected to the computer 60 via an input/output I/F 59.

The computer 60 includes a CPU 61, an NVM 62, and a RAM 63. The CPU 61, the NVM 62, and the RAM 63 are interconnected via a bus 64, which is connected to the input/output I/F 59.

NVM 62 is a non-transitory storage medium that stores various parameters and programs. For example, NVM 62 is an EEPROM. However, this is merely one example, and an HDD and/or SSD may be used as NVM 62 instead of or in addition to EEPROM. RAM 63 temporarily stores various information and is used as work memory. CPU 61 reads necessary programs from NVM 62 and executes the read programs in RAM 63. CPU 61 controls the entire camera 1 in accordance with the programs executed on RAM 63.

The CPU 61 is an example of a "processor" according to the technology of the present disclosure, and the RAM 63 is an example of a "memory" according to the technology of the present disclosure. Furthermore, the computer 60 is an example of a "control device" according to the technology of the present disclosure.

The zoom drive circuit 52 adjusts the positions of the focus lens 31 and the zoom lens 32 by driving the zoom drive mechanism 42 in accordance with instructions from the computer 60. The focus lens 31 and the zoom lens 32 move along the optical axis OA of the lens unit 20 by receiving power from the zoom drive mechanism 42.

The aperture drive circuit 53 changes the diameter of the aperture 33A (see Figure 2) provided in the aperture 33 by driving the aperture drive mechanism 43 in accordance with instructions from the computer 60.

The blur correction drive circuit 54 adjusts the position of the blur correction lens 34 by driving the blur correction drive mechanism 44 in accordance with instructions from the computer 60 and feedback signals output from the feedback circuit 75 (described below). The blur correction lens 34 moves along a plane perpendicular to the optical axis OA of the lens unit 20 when power is applied from the blur correction drive mechanism 44. Specifically, the blur correction lens 34 moves in a direction that corrects blur in the image obtained by focusing light on the image sensor 15.

The turret drive circuit 55 adjusts the rotational position of the turret filter 35 by driving the turret drive mechanism 45 in accordance with instructions from the computer 60. The turret filter 35 rotates along a plane perpendicular to the optical axis OA of the lens unit 20 when power is applied from the turret drive mechanism 45. The rotational operation of the turret filter 35 will be described in detail later using Figure 4.

The adjustment drive circuit 57 adjusts the position of the adjustment lens 37 by driving the adjustment drive mechanism 47 in accordance with instructions from the computer 60. The adjustment lens 37 moves along the optical axis OA of the lens unit 20 by being powered by the adjustment drive mechanism 47.

3, the camera body 10 includes an image sensor driver 71, a signal processing circuit 72, a light projection control circuit 73, a vibration sensor 74, a feedback circuit 75, a display 76, a display control circuit 77, an input device 78, an input circuit 79, and an external I/F 80. The image sensor driver 71, the signal processing circuit 72, the light projection control circuit 73, the feedback circuit 75, the display control circuit 77, the input circuit 79, and the external I/F 80 are connected to the computer 60 via the input/output I/F 59.

The image sensor driver 71 causes the image sensor 15 to capture light in accordance with instructions from the computer 60. The signal processing circuit 72 generates and outputs digital image data by performing various signal processing operations on the analog image data output from the image sensor 15.

The light projection control circuit 73 switches the light projector 14 on and off in accordance with instructions from the computer 60. When the light projector 14 is switched on, it outputs illumination light, and when it is switched off, it stops outputting illumination light.

The vibration sensor 74 is, for example, a gyro sensor, and detects vibrations of the camera 1. The gyro sensor included in the vibration sensor 74 detects vibrations around the pitch axis and yaw axis of the camera 1. The vibration sensor 74 converts the vibrations around the pitch axis and the yaw axis detected by the gyro sensor into vibrations in a two-dimensional plane parallel to the pitch axis and yaw axis, thereby detecting vibrations acting on the camera 1 in the direction of the pitch axis and the direction of the yaw axis. The vibration sensor 74 outputs a vibration detection signal corresponding to the detected vibrations.

The vibration sensor 74 may be an acceleration sensor. Instead of the vibration sensor 74, a motion vector obtained by comparing successive captured images stored in the NVM 62 and/or RAM 63 in chronological order may be used as the vibration. The vibration ultimately used may be derived based on the vibration detected by a physical sensor and the motion vector obtained by image processing.

The feedback circuit 75 generates a feedback signal by performing various signal processing operations on the vibration detection signal output from the vibration sensor 74. The feedback circuit 75 is connected to the shake correction drive circuit 54 via the input/output I/F 59, and outputs the feedback signal to the shake correction drive circuit 54 in accordance with instructions from the computer 60.

The display 76 is, for example, a liquid crystal display or an EL display, and displays images and/or text information, etc. The display control circuit 77 causes the display 76 to display images in accordance with instructions from the computer 60.

The input device 78 is, for example, a device such as a touch panel and/or a switch, and accepts instructions given by the user. The input circuit 79 outputs an input signal according to the instructions given by the user to the input device 78. The external I/F 80 is an interface that is communicatively connected to an external device.

As an example, as shown in FIG. 4, the turret filter 35 includes a disk 81. The disk 81 is provided with a plurality of optical filters, including an Ir cut filter 82, a first BPF 83A, a second BPF 83B, a third BPF 83C, and a fourth BPF 83D, spaced at equal intervals along the circumferential direction of the disk 81. Hereinafter, unless there is a need to distinguish between them, the Ir cut filter 82, the first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D will be referred to as optical filters. Also, below, unless there is a need to distinguish between them, the first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D will be referred to as BPFs 83.

The turret filter 35 selectively inserts and removes multiple optical filters into and from the optical path using a turret system. Specifically, as the turret filter 35 rotates in the direction of the arc arrow R shown in Figure 4, the Ir cut filter 82, the first BPF 83A, the second BPF 83B, the third BPF 83C, and the fourth BPF 83D are selectively inserted and removed from the optical path (for example, the optical path on the optical axis OA). When an optical filter is inserted into the optical path, the optical axis OA passes through the center of the optical filter, and the center of the optical filter inserted into the optical path coincides with the center of the light-receiving surface of the image sensor 15.

The Ir cut filter 82 is an optical filter that cuts out infrared light and transmits only light other than infrared light. The BPF 83 is an optical filter that transmits near-infrared light. The first BPF 83A, second BPF 83B, third BPF 83C, and fourth BPF 83D each transmit near-infrared light of a different wavelength band.

The first BPF 83A is an optical filter that corresponds to a wavelength band around 1000 nm (nanometers). As an example, the first BPF 83A transmits only near-infrared light in the wavelength band from 950 nm to 1100 nm. Hereinafter, the near-infrared light that passes through the first BPF 83A will be referred to as the first near-infrared light.

The second BPF 83B is an optical filter that corresponds to a wavelength band around 1250 nm. As an example, the second BPF 83B transmits only near-infrared light in the wavelength band from 1150 nm to 1350 nm. Hereinafter, the near-infrared light that passes through the second BPF 83B will be referred to as second near-infrared light.

The third BPF 83C is an optical filter that corresponds to a wavelength band around 1550 nm. As an example, the third BPF 83C transmits only near-infrared light in the wavelength band from 1500 nm to 1750 nm. Hereinafter, the near-infrared light that passes through the third BPF 83C will be referred to as third near-infrared light.

The fourth BPF 83D is an optical filter that corresponds to a wavelength band around 2150 nm. As an example, the fourth BPF 83D transmits only near-infrared light in the wavelength band from 2000 nm to 2400 nm. Hereinafter, the near-infrared light that passes through the fourth BPF 83D will be referred to as the fourth near-infrared light.

In the following, unless there is a need to distinguish between them, the first near-infrared light, the second near-infrared light, the third near-infrared light, and the fourth near-infrared light will be referred to as near-infrared light. Note that each of the bands listed here includes errors that are generally acceptable in the technical field to which the technology of the present disclosure pertains, and that do not deviate from the spirit of the technology of the present disclosure. Furthermore, each of the wavelength bands listed here is merely an example, and each may be a different wavelength band.

When an Ir cut filter 82 is inserted into the optical path and visible light transmitted through the Ir cut filter 82 is focused on the light-receiving surface of the image sensor 15, multiple Si diodes arranged on the light-receiving surface output analog image data obtained by capturing the received visible light. This achieves the function of capturing a visible light image by capturing visible light. Furthermore, when a BPF 83 is inserted into the optical path and near-infrared light transmitted through the BPF 83 is focused on the light-receiving surface of the image sensor 15, multiple InGaAs diodes arranged on the light-receiving surface output analog image data obtained by capturing the received near-infrared light. This achieves the function of capturing a near-infrared light image by capturing near-infrared light.

As described above, camera 1 has the function of capturing visible light to obtain a visible light image, and the function of capturing near-infrared light to obtain a near-infrared light image. In addition to the functions of capturing visible light images and near-infrared light images, camera 1 also has the function of measuring the temperature of a subject based on electromagnetic waves emitted by the subject due to thermal radiation. In the first embodiment, two-color thermometry is used to improve measurement accuracy. To achieve temperature measurement using two-color thermometry, it is necessary, for example, to capture light in two different wavelength bands. In the first embodiment, a turret filter 35 is used as a means for generating light in two different wavelength bands, and, as an example, near-infrared light in two wavelength bands is used for temperature measurement.

As an example, as shown in FIG. 5, the imaging support processing is realized by the CPU 61 executing the imaging support processing program 100. The imaging support processing program 100 is an example of a "program" related to the technology of the present disclosure. In the example shown in FIG. 5, the imaging support processing program 100 is stored in the NVM 62, and the CPU 61 reads the imaging support processing program 100 from the NVM 62 and executes it on the RAM 63.

The CPU 61 performs image capture support processing in accordance with the image capture support processing program 100 executed on the RAM 63. By executing the image capture support processing program 100 on the RAM 63, the CPU 61 functions as a mode switching processing unit 110, an image capture processing unit 120, and a temperature measurement processing unit 130.

The CPU 61 has two operating modes, an image capture mode and a temperature measurement mode, and switches between the image capture mode and the temperature measurement mode. The image capture processing unit 120 is a processing unit that operates when the operating mode of the CPU 61 is switched to the image capture mode. The image capture processing unit 120 is a processing unit that executes image capture processing to display on the display 76 a visible light image obtained by capturing visible light with the image sensor 15, or a near-infrared light image obtained by capturing near-infrared light with the image sensor 15.

The temperature measurement processing unit 130 is a processing unit that operates when the operating mode of the CPU 61 is switched to the temperature measurement mode. The temperature measurement processing unit 130 is a processing unit that calculates the temperature distribution of the subject based on the near-infrared light image obtained by capturing near-infrared light with the image sensor 15, and executes a temperature measurement process that displays temperature information created based on the temperature distribution of the subject on the display 76.

The mode switching processing unit 110 is a processing unit that executes mode switching processing to switch the operating mode of the CPU 61 between an image capture mode and a temperature measurement mode. Below, the mode switching processing unit 110, image capture processing unit 120, and temperature measurement processing unit 130 will be described in order.

The mode switching processing unit 110 has a mode selection information acquisition unit 111, a mode determination unit 112, a flag setting unit 113, a light projection control unit 114, and a mode setting unit 115.

As an example, as shown in FIG. 6, the mode selection information acquisition unit 111 selectively acquires, for example, via a receiving device, image capture mode selection information that selects image capture mode as the operating mode and temperature measurement mode selection information that selects temperature measurement mode as the operating mode. The receiving device accepts various types of information and outputs the accepted information to the CPU 61. Examples of receiving devices include the input circuit 79 and the external I/F 80. Note that, for ease of explanation, hereinafter, image capture mode selection information and temperature measurement mode selection information will be referred to as mode selection information unless a distinction is required.

Various instructions are input from the user to the input device 78. The input circuit 79 outputs information to the CPU 61 according to the instructions input to the input device 78. The input circuit 79 outputs mode selection information to the CPU 61 according to a mode selection instruction given by the user to the input device 78. The mode selection information acquisition unit 111 acquires the mode selection information input from the input circuit 79. The external I/F 80 receives mode selection information output from an external device (not shown) and outputs the received mode selection information to the CPU 61. The mode selection information acquisition unit 111 acquires the mode selection information input from the external I/F 80.

The mode determination unit 112 determines whether the operation mode selected by the mode selection information acquired by the mode selection information acquisition unit 111 is the image capture mode or the temperature measurement mode. If the mode selection information acquired by the mode selection information acquisition unit 111 is image capture mode selection information, the mode determination unit 112 determines that the operation mode selected by the mode selection information is the image capture mode. Furthermore, if the mode selection information acquired by the mode selection information acquisition unit 111 is temperature measurement mode selection information, the mode determination unit 112 determines that the operation mode selected by the mode selection information is the temperature measurement mode.

RAM 63 has a display control flag storage area 141 and a light projection control flag storage area 142. The display control flag storage area 141 stores a display control flag 151 that specifies the image to be displayed on the display 76. The light projection control flag storage area 142 stores a light projection control flag 152 that specifies the operation of the light projector 14.

When the mode determination unit 112 determines that the operating mode is the imaging mode, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag storage area 141, and sets the light-projection-on control flag 152A as the light-projection control flag 152 in the light-projection control flag storage area 142. When the mode determination unit 112 determines that the operating mode is the temperature measurement mode, the flag setting unit 113 sets the composite image display flag 151B as the display control flag 151 in the display control flag storage area 141, and sets the light-projection-off control flag 152B as the light-projection control flag 152 in the light-projection control flag storage area 142. Hereinafter, unless there is a need to distinguish between them, the display control flag 151 and the light-projection control flag 152 will be referred to as control flags.

When the flag setting unit 113 sets the light-projection on control flag 152A, the light-projection control unit 114 outputs an on command to the light-projection control circuit 73. The on command is a command to switch the projector 14 on. Furthermore, when the flag setting unit 113 sets the light-projection off control flag 152B, the light-projection control unit 114 outputs an off command to the light-projection control circuit 73. The off command is a command to switch the projector 14 off. Note that "on" refers to a setting in which the projector 14 projects light, and "off" refers to a setting in which the projector 14 does not project light.

When the captured image display flag 151A is set as the display control flag 151, the mode setting unit 115 sets the capture mode as the operating mode of the CPU 61. Furthermore, when the composite image display flag 151B is set as the display control flag 151, the mode setting unit 115 sets the temperature measurement mode as the operating mode of the CPU 61.

In the first embodiment, the imaging mode is an example of a "first mode" according to the technology of the present disclosure, and the temperature measurement mode is an example of a "second mode" according to the technology of the present disclosure. Furthermore, the display control flag 151 and the light-projection control flag 152 are examples of a "control factor" according to the technology of the present disclosure. Furthermore, the display 76 and the light-projector 14 are examples of a "controlled object" according to the technology of the present disclosure, and the image displayed on the display 76 and the operation of the light-projector 14 are examples of "control content for a controlled object" according to the technology of the present disclosure. Furthermore, the display control flag 151 is an example of a "display control factor" according to the technology of the present disclosure, the captured image display flag 151A is an example of a "captured image display factor" according to the technology of the present disclosure, and the composite image display flag 151B is an example of a "temperature information display factor" according to the technology of the present disclosure. Furthermore, the light-projection on control flag 152A and the light-projection off control flag 152B are examples of a "light-projection control factor" according to the technology of the present disclosure, the light-projection on control flag 152A is an example of a "light-projection on control factor" according to the technology of the present disclosure, and the light-projection off control flag 152B is an example of a "light-projection suppression control factor" according to the technology of the present disclosure.

As an example, as shown in Figure 7, the imaging processing unit 120 has a wavelength selection unit 121, a turret control unit 122, an imaging control unit 123, and a display control unit 124.

The wavelength selection unit 121 selects one wavelength band to be used for imaging from multiple wavelength bands in accordance with a wavelength selection instruction received by the input device 78. As an example, the wavelength selection unit 121 selects one wavelength band from the following: a visible light wavelength band, a first near-infrared light wavelength band of 950 nm to 1100 nm, a second near-infrared light wavelength band of 1150 nm to 1350 nm, a third near-infrared light wavelength band of 1500 nm to 1750 nm, and a fourth near-infrared light wavelength band of 2000 nm to 2400 nm. Note that, although an example in which a wavelength band is selected in accordance with a wavelength selection instruction received by the input device 78 has been described here, a wavelength band may also be selected in accordance with various conditions (e.g., the temperature of the subject and/or the imaging conditions).

The turret control unit 122 outputs a rotation command to the turret drive circuit 55 to insert into the optical path an optical filter corresponding to the wavelength band selected by the wavelength selection unit 121 from among the multiple optical filters. Upon receiving the rotation command, the turret drive circuit 55 drives the turret drive mechanism 45 to rotate the turret filter 35 to a position where the optical filter corresponding to the rotation command is inserted into the optical path.

The imaging control unit 123 outputs an imaging command to the image sensor driver 71. The imaging command is a command to cause the image sensor 15 to capture light. The image sensor 15 captures light emitted from the subject and outputs analog image data obtained by capturing the light. The signal processing circuit 72 performs various signal processing on the analog image data output from the image sensor 15 to generate and output digital image data.

The display control unit 124 displays the captured image 161A on the display 76 based on the digital image data generated by the signal processing circuit 72. The captured image 161A is displayed, for example, as a moving image, but may also be displayed as a still image.

Figure 8 shows an example of a captured image 161A displayed on the display 76 as a result of imaging processing being performed by the imaging processing unit 120. In the example shown in Figure 8, the captured image 161A displayed on the display 76 shows a fire 164 on a curtain 163 installed on the indoor side of a window 162 in a building.

As an example, as shown in Figure 9, the temperature measurement processing unit 130 has a wavelength selection unit 131, a first turret control unit 132, a first imaging control unit 133, a second turret control unit 134, a second imaging control unit 135, a temperature derivation unit 136, and a display control unit 137.

As an example, as shown in FIG. 10, the wavelength selection unit 131 selects two wavelength bands to be used in the two-color thermometry, namely, a first wavelength band and a second wavelength band. As an example, the wavelength selection unit 131 selects, as the first wavelength band and the second wavelength band, two wavelength bands from among the first near-infrared light wavelength band of 950 nm to 1100 nm, the second near-infrared light wavelength band of 1150 nm to 1350 nm, the third near-infrared light wavelength band of 1500 nm to 1750 nm, and the fourth near-infrared light wavelength band of 2000 nm to 2400 nm. Also, as an example, the wavelength selection unit 131 selects, as the first wavelength band and the second wavelength band, two adjacent wavelength bands from the first near-infrared light wavelength band, the second near-infrared light wavelength band, the third near-infrared light wavelength band, and the fourth near-infrared light wavelength band.

Also, as an example, the wavelength selection unit 131 selects two wavelength bands from the wavelength band of the first near-infrared light, the wavelength band of the second near-infrared light, the wavelength band of the third near-infrared light, and the wavelength band of the fourth near-infrared light as the first wavelength band and the second wavelength band based on the temperature of the subject.Also, as an example, the wavelength selection unit 131 selects shorter wavelength bands from the wavelength band of the first near-infrared light, the wavelength band of the second near-infrared light, the wavelength band of the third near-infrared light, and the wavelength band of the fourth near-infrared light as the temperature of the subject increases.

For example, in the case of a fire, the temperature of the subject is predicted based on information regarding the temperature expected from the fire situation and/or information input by the user to the input device 78. Information regarding the temperature expected from the fire situation is acquired through the external I/F 80 shown in FIG. 9. Information regarding the temperature expected from the fire situation may be information regarding the standard fire temperature with respect to the elapsed time since the fire started. The standard fire temperature is defined in ISO 834. Note that the wavelength selection unit 131 may switch wavelength bands in accordance with a wavelength selection instruction received by the input device 78 shown in FIG. 9.

As an example, as shown in Figure 9, the first turret control unit 132 outputs a first rotation command to the turret drive circuit 55 to insert into the optical path a BPF 83 corresponding to the first wavelength band selected by the wavelength selection unit 131 from among the multiple BPFs 83 (see Figure 4). Upon receiving the first rotation command, the turret drive circuit 55 drives the turret drive mechanism 45 to rotate the turret filter 35 to a position where the BPF corresponding to the first rotation command is inserted into the optical path.

The first imaging control unit 133 outputs a first imaging command to the image sensor driver 71. The first imaging command is a command to cause the image sensor 15 to capture light. The image sensor 15 captures the first near-infrared light that has passed through the BPF 83 corresponding to the first wavelength band, and outputs first analog image data obtained by capturing the first near-infrared light. The signal processing circuit 72 generates and outputs first digital image data by performing various signal processing operations on the first analog image data output from the image sensor 15.

The second turret control unit 134 outputs a second rotation command to the turret drive circuit 55 to insert into the optical path the BPF 83 corresponding to the second wavelength band selected by the wavelength selection unit 131 from among the multiple BPFs 83. Upon receiving the second rotation command, the turret drive circuit 55 drives the turret drive mechanism 45 to rotate the turret filter 35 to a position where the BPF corresponding to the second rotation command is inserted into the optical path.

The second imaging control unit 135 outputs a second imaging command to the image sensor driver 71. The second imaging command is a command to cause the image sensor 15 to capture light L. The image sensor 15 captures the second near-infrared light that has passed through the BPF corresponding to the second wavelength band, and outputs second analog image data obtained by capturing the second near-infrared light. The signal processing circuit 72 generates and outputs second digital image data by performing various signal processing operations on the second analog image data output from the image sensor 15.

The temperature derivation unit 136 calculates the temperature distribution of the subject using two-color thermometry based on the first digital image data and the second digital image data. Specifically, for each of the multiple physical pixels in the image sensor 15, the temperature derivation unit 136 extracts the value of a first signal output by the physical pixel from the first digital image data and extracts the value of a second signal output by the physical pixel from the second digital image data. The temperature derivation unit 136 then derives the temperature measured by the physical pixel for each of the multiple physical pixels using two-color thermometry based on the value of the first signal and the value of the second signal. A calculation formula based on two-color thermometry or a data matching table may be used to derive the temperature. The temperature derivation unit 136 then calculates the temperature distribution of the subject by deriving the temperatures measured by each of the multiple physical pixels.

The display control unit 137 generates temperature information related to temperature based on the temperature distribution of the subject obtained by the temperature derivation unit 136. The display control unit 137 then outputs a composite image 161B in which the temperature information is combined with a captured image obtained based on the first digital image data or the second digital image data, and displays the composite image 161B on the display 76. Examples of temperature information include information indicating areas where the temperature is above a predetermined threshold, information indicating specific temperature values, information indicating multiple zones divided into predetermined temperature ranges together with specific temperature values, and information indicating the temperature distribution in a color tone according to the temperature.

Figure 11 shows a first example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing performed by the temperature measurement processing unit 130. The composite image 161B of the first example is an image in which temperature information 166 indicating areas where the temperature is above a predetermined threshold is composited with the captured image 165. In the first example, the temperature information 166 is, for example, information indicating a rectangular frame, but information other than a frame may also be used. The frame may also be a shape other than a rectangle. The frame may also be displayed in a color corresponding to the temperature. If the frame is displayed in a color corresponding to the temperature, a scale indicating the temperature corresponding to the color may be displayed together with the frame. The temperature information 166 may also include a character string indicating a specific temperature value. The specific temperature value may be the maximum and/or minimum temperature value. The temperature information 166 may also be displayed statically or flashing.

Figure 12 shows a second example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing being performed by the temperature measurement processing unit 130. The composite image 161B of the second example is an image in which multiple pieces of temperature information 167A, 167B, and 167C indicating specific temperature values are composited with the captured image 165. The specific temperature values may be maximum and/or minimum temperature values. Furthermore, the multiple pieces of temperature information 167A, 167B, and 167C may be displayed statically or flashing.

Figure 13 shows a third example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing being performed by the temperature measurement processing unit 130. The composite image 161B of the third example is an image in which temperature information 168 indicating multiple sections divided into predetermined temperature ranges along with specific temperature values is composited onto the captured image 165. The specific temperature values may be maximum and/or minimum temperature values. Furthermore, the temperature information 168 may be displayed statically or flashing.

Figure 14 shows a fourth example of a composite image 161B displayed on the display 76 as a result of the temperature measurement processing performed by the temperature measurement processing unit 130. The composite image 161B of the fourth example is an image in which temperature information 169, which indicates the temperature distribution using a color tone corresponding to the temperature, is superimposed on the captured image 165. The temperature distribution of the fourth example shown in Figure 14 displays the temperature of each section of the third example shown in Figure 13 using a color tone corresponding to the temperature. The color tone is defined, for example, at a constant hue angle (e.g., 0.01° per 1°C) centered on a reference temperature (e.g., 3000°C). Alternatively, the temperature distribution may be visualized using achromatic shades instead of a color tone. The temperature information 169 may include an indicator indicating the temperature corresponding to the color tone. The temperature information 169 may also include a character string indicating a specific temperature value. The specific temperature value may be the maximum and/or minimum temperature value. The temperature information 169 may be displayed statically or flashing.

Temperature information 166, 167A, 167B, 167C, 168, and 169 are examples of "temperature information" according to the technology of the present disclosure. Captured image 161A obtained in imaging mode is an example of a "captured image" and a "first captured image" according to the technology of the present disclosure. Composite image 161B obtained in temperature measurement mode is an example of a "composite image" according to the technology of the present disclosure. Note that, hereinafter, captured image 161A obtained in imaging mode and composite image 161B obtained in temperature measurement mode will be referred to as "images" unless a distinction needs to be made.

Next, we will explain the control method of camera 1 as the operation of the first embodiment.

First, referring to Figure 15, we will explain the mode switching processing performed by the mode switching processing unit 110 (see Figure 6) among the imaging support processing performed by the CPU 61.

In step S11, the mode selection information acquisition unit 111 acquires mode selection information.

In step S12, the mode determination unit 112 determines whether the operation mode selected by the mode selection information is the image capture mode or the temperature measurement mode, based on the mode selection information acquired by the mode selection information acquisition unit 111. If it is determined in step S12 that the operation mode is the image capture mode, the process shown in FIG. 15 proceeds to step S13, and if it is determined that the operation mode is the temperature measurement mode, the process shown in FIG. 15 proceeds to step S16.

In step S13, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag memory area 141, and sets the light projection on control flag 152A as the light projection control flag 152 in the light projection control flag memory area 142.

In step S14, the light projection control unit 114 turns on the light projector 14.

In step S15, the mode setting unit 115 sets the imaging mode as the operating mode of the CPU 61.

In step S16, the flag setting unit 113 sets a composite image display flag 151B as the display control flag 151 in the display control flag memory area 141, and sets a light emission off control flag 152B as the light emission control flag 152 in the light emission control flag memory area 142.

In step S17, the light projection control unit 114 turns off the light projector 14.

In step S18, the mode setting unit 115 sets the temperature measurement mode as the operating mode of the CPU 61.

Next, with reference to Figure 16, we will explain the imaging processing performed by the imaging processing unit 120 (see Figure 7) among the imaging support processing performed by the CPU 61.

In step S21, the wavelength selection unit 121 selects one wavelength band to be used for imaging from multiple wavelength bands in accordance with the wavelength selection instruction received by the input device 78.

In step S22, the turret control unit 122 rotates the turret filter 35 to a position where an optical filter corresponding to the wavelength band selected by the wavelength selection unit 121 from among the multiple optical filters is inserted into the optical path.

In step S23, the imaging control unit 123 causes the image sensor 15 to capture the light. The image sensor 15 outputs analog image data obtained by capturing the light, and the signal processing circuit 72 performs various signal processing on the analog image data to generate and output digital image data.

In step S24, the display control unit 124 displays the captured image 161A on the display 76 based on the digital image data generated by the signal processing circuit 72.

Next, with reference to Figure 17, we will explain the temperature measurement processing performed by the temperature measurement processing unit 130 (see Figure 9) among the imaging support processing performed by the CPU 61.

In step S31, the wavelength selection unit 131 selects two wavelength bands to be used in the two-color temperature measurement method, namely, a first wavelength band and a second wavelength band.

In step S32, the first turret control unit 132 rotates the turret filter 35 to a position where the BPF 83 corresponding to the first wavelength band selected by the wavelength selection unit 131 from among the multiple BPFs 83 (see Figure 4) is inserted into the optical path.

In step S33, the first imaging control unit 133 causes the image sensor 15 to capture the first near-infrared light that has passed through the BPF 83 corresponding to the first wavelength band. The image sensor 15 outputs first analog image data obtained by capturing the first near-infrared light, and the signal processing circuit 72 performs various signal processing on the first analog image data to generate and output first digital image data.

In step S34, the second turret control unit 134 rotates the turret filter 35 to a position where the BPF 83 corresponding to the second wavelength band selected by the wavelength selection unit 131 from among the multiple BPFs 83 is inserted into the optical path.

In step S35, the second imaging control unit 135 causes the image sensor 15 to capture the second near-infrared light that has passed through the BPF 83 corresponding to the second wavelength band. The image sensor 15 outputs second analog image data obtained by capturing the second near-infrared light, and the signal processing circuit 72 performs various signal processing on the second analog image data to generate and output second digital image data.

In step S36, the temperature derivation unit 136 calculates the temperature distribution of the subject using two-color thermometry based on the first digital image data and the second digital image data.

In step S37, the display control unit 137 generates temperature information related to temperature based on the temperature distribution of the subject obtained by the temperature derivation unit 136. Then, the display control unit 137 outputs a composite image 161B in which the temperature information is combined with a captured image obtained based on the first digital image data or the second digital image data, and displays the composite image 161B on the display 76.

In each of the imaging mode and the temperature measurement mode, the CPU 61 controls the zoom drive mechanism 42 to adjust the focal position by moving the focus lens 31 along the optical axis OA, and controls the zoom lens 32 to adjust the zoom magnification. In each of the imaging mode and the temperature measurement mode, the CPU 61 also controls the blur correction drive mechanism 44 to correct image blur by moving the blur correction lens 34. In each of the imaging mode and the temperature measurement mode, the CPU 61 also controls the aperture drive mechanism 43 to adjust the amount of light passing through the aperture 33 by changing the diameter of the opening 33A provided in the aperture 33. In each of the imaging mode and the temperature measurement mode, the CPU 61 also controls the adjustment drive mechanism 47 to adjust the focal position by moving the adjustment lens 37.

The control method for camera 1 according to the first embodiment is an example of a "control method" according to the technology disclosed herein.

Next, we will explain the effects of the first embodiment.

In the first embodiment, the CPU 61 has an imaging mode in which the image sensor 15 captures light, and a temperature measurement mode in which the temperature is derived based on the near-infrared light received by the image sensor 15. The imaging mode and the temperature measurement mode have different control flags. Therefore, the control content of the controlled object can be made different between the imaging mode and the temperature measurement mode.

For example, in the first embodiment, the control flag includes a display control flag 151 to be displayed on the display 76. Therefore, as an example of differentiating the control content of the control object between the imaging mode and the temperature measurement mode, the image displayed on the display 76 can be different.

In addition, in the first embodiment, the control flag includes a light-projection control flag 152 that operates the light-projector 14. Therefore, as an example of differentiating the control content of the controlled object between the imaging mode and the temperature measurement mode, the operation of the light-projector 14 can be different.

In this way, in the first embodiment, the control content of the controlled object can be made different between the imaging mode and the temperature measurement mode, so that the operation of the imaging device can be controlled to be appropriate for each mode, compared to, for example, when the control flag is the same for the imaging mode and the temperature measurement mode.

Furthermore, in the imaging mode, the CPU 61 sets the display control flag 151 to an image display flag 151A that causes the display 76 to display the image 161A obtained by receiving light by the image sensor 15. As a result, the image 161A that does not include temperature information is displayed on the display 76. Therefore, in the imaging mode, the visibility of the image 161A can be improved compared to when the image 161A includes temperature information, for example.

Furthermore, in the temperature measurement mode, the CPU 61 sets the display control flag 151 to a composite image display flag 151B that causes a composite image 161B including temperature information indicating the temperature to be displayed on the display 76. As a result, the composite image 161B including the temperature information is displayed on the display 76. Therefore, in the temperature measurement mode, the user can accurately grasp the temperature of the subject compared to, for example, when temperature information is not displayed on the display 76.

In addition, in the imaging mode, the CPU 61 sets the light projection control flag 152 to the light projection on control flag 152A, which switches the floodlight 14 on. This switches the floodlight 14 on in the imaging mode. Therefore, in the imaging mode, the amount of light emitted from the subject can be secured. This allows the user to check the indoor environment through the captured image 161A, for example, even in a situation where the room is filled with smoke due to a fire.

In addition, in the temperature measurement mode, the CPU 61 sets the light projection control flag 152 to a light projection off control flag 152B that switches the projector 14 off. This switches the projector 14 off in the temperature measurement mode. This prevents the illumination light from the projector 14 from being mixed with the near-infrared light emitted from the subject. Furthermore, the accuracy of temperature measurement can be improved compared to, for example, a case in which the illumination light from the projector 14 is mixed with the near-infrared light emitted from the subject.

The CPU 61 also switches the projector 14 on and off in response to switching between the image capture mode and the temperature measurement mode. This provides greater convenience than, for example, a situation where the user needs to switch the projector 14 on and off.

In addition, in the temperature measurement mode, the CPU 61 outputs a composite image 161B that combines the captured image obtained by receiving light by the image sensor 15 with temperature information indicating the temperature. Therefore, by displaying the composite image 161B on the display 76, the user can easily grasp the condition and temperature of the subject.

Next, we will explain a modified example of the first embodiment.

In the first embodiment, as shown in FIG. 8, an example is shown in which an image 161A of a fire 164 on a curtain 163 on the indoor side of a window 162 of a building is displayed on the display 76, but the image 161A may be any image. For example, as shown in FIG. 18, the image 161A may be an image obtained by capturing an image of a person's arm 170.

In the first embodiment, as shown in Figures 11 to 14, an example is shown in which a composite image 161B is displayed on the display 76, which is a composite image of a captured image of a curtain on the indoor side of a building window that is on fire and temperature information. However, the composite image 161B may be any image that combines a captured image and temperature information. For example, as shown in Figure 19, the composite image 161B may be an image in which temperature information 172 indicating a temperature distribution is combined with a captured image 171 obtained by capturing an image of a person's arm 170. The combination may be, for example, the superposition of multiple images using alpha blending, or the embedding of temperature information into the captured image.

In the first embodiment, instead of setting the light-emission-off control flag 152B by the flag setting unit 113 shown in FIG. 6, the flag setting unit 113 may set a light-emission suppression control flag. When the light-emission suppression control flag is set by the flag setting unit 113, the light-emission control unit 114 may output a light-emission suppression command to the light-emission control circuit 73, and the light-emission control circuit 73 may suppress the light emission of the projector 14 (i.e., suppress the amount of light emitted from the projector 14) in accordance with the light-emission suppression command. "Suppression" refers to, for example, an operation of reducing the amount of light below a reference amount. The reference amount may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).

Second Embodiment
Next, a second embodiment will be described.

In the second embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment. Below, we will explain the differences between the second embodiment and the first embodiment.

As an example, as shown in FIG. 20, the mode switching processing unit 110 has a status signal acquisition unit 181, a status signal determination unit 182, a flag setting unit 113, a light projection control unit 114, and a mode setting unit 115.

The status signal acquisition unit 181 acquires a status signal output from the light-projection control circuit 73 according to the operating state of the light-projector 14. When the light-projector 14 is on, the light-projection control circuit 73 outputs an on-state signal indicating that the light-projector 14 is on as a status signal, and when the light-projector 14 is off, the light-projection control circuit 73 outputs an on-state signal indicating that the light-projector 14 is off as a status signal.

The status signal determination unit 182 determines whether the status signal acquired by the status signal acquisition unit 181 is an on-state signal indicating that the floodlight 14 is on.

When the status signal determination unit 182 determines that the status signal is an on-state signal, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag storage area 141. Furthermore, when the status signal determination unit 182 determines that the status signal is not an on-state signal, the flag setting unit 113 sets the composite image display flag 151B as the display control flag 151 in the display control flag storage area 141.

When the captured image display flag 151A is set as the display control flag 151, the mode setting unit 115 sets the capture mode as the operating mode of the CPU 61. Furthermore, when the composite image display flag 151B is set as the display control flag 151, the mode setting unit 115 sets the temperature measurement mode as the mode of the CPU 61.

In the second embodiment, the imaging mode is an example of a "first mode" according to the technology of the present disclosure, and the temperature measurement mode is an example of a "second mode" according to the technology of the present disclosure. Furthermore, the display control flag 151 is an example of a "control factor" according to the technology of the present disclosure. Furthermore, the display 76 is an example of a "control object" according to the technology of the present disclosure, and the image displayed on the display 76 is an example of a "control content for the control object" according to the technology of the present disclosure. Furthermore, the display control flag 151 is an example of a "display control factor" according to the technology of the present disclosure, the captured image display flag 151A is an example of a "captured image display factor" according to the technology of the present disclosure, and the composite image display flag 151B is an example of a "temperature information display factor" according to the technology of the present disclosure.

Next, we will explain the operation of the second embodiment, including the control method for camera 1.

In the second embodiment, the imaging process performed by the imaging processing unit 120 and the temperature measurement process performed by the temperature measurement processing unit 130 are the same as in the first embodiment. In the second embodiment, the mode switching process performed by the mode switching processing unit 110 differs from that in the first embodiment. Below, the mode switching process performed by the mode switching processing unit 110 in the second embodiment will be described with reference to Figure 21.

In step S41, the status signal acquisition unit 181 acquires the status signal output from the light projection control circuit 73 depending on the operating status of the light projector 14.

In step S42, the status signal determination unit 182 determines whether the status signal is an on-state signal. If it is determined in step S42 that the status signal is an on-state signal, the process shown in FIG. 21 proceeds to step S43. If it is determined that the status signal is not an on-state signal, the process shown in FIG. 21 proceeds to step S45.

In step S43, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag memory area 141.

In step S44, the mode setting unit 115 sets the imaging mode as the operating mode of the CPU 61.

In step S45, the flag setting unit 113 sets the composite image display flag 151B as the display control flag 151 in the display control flag memory area 141.

In step S46, the mode setting unit 115 sets the temperature measurement mode as the operating mode of the CPU 61.

The control method for camera 1 according to the second embodiment is an example of a "control method" according to the technology disclosed herein.

Next, we will explain the effects of the second embodiment that differ from the first embodiment.

In the second embodiment, the CPU 61 sets the imaging mode when the projector 14 is on, and sets the temperature measurement mode when the projector 14 is off. This improves convenience compared to, for example, a case where the imaging mode and the temperature measurement mode are not switched in response to the on/off operation of the projector 14.

[Third embodiment]
Next, a third embodiment will be described.

In the third embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment. Below, we will explain the differences between the third embodiment and the first embodiment.

As an example, as shown in FIG. 22, the CPU 61 functions as a parameter change processing unit 190 in addition to the above-mentioned mode switching processing unit 110, image capture processing unit 120, and temperature measurement processing unit 130. The parameter change processing unit 190 is a processing unit that operates when the CPU 61 is in image capture mode and when it is in temperature measurement mode. The parameter change processing unit 190 is a processing unit that sets different mode-specific parameters 211 for the image capture mode and the temperature measurement mode. The parameter change processing unit 190 has a mode determination unit 191 and a mode-specific parameter setting unit 192.

The mode determination unit 191 determines whether the operating mode of the CPU 61 is the imaging mode or the temperature measurement mode.

RAM 63 has a parameter memory area 201 for storing mode-specific parameters 211.

When the mode determination unit 191 determines that the operating mode of the CPU 61 is the image capture mode, the mode-specific parameter setting unit 192 performs various parameter setting processes based on the image capture conditions, etc., to derive image capture mode parameters 211A corresponding to the image capture mode. Then, the mode-specific parameter setting unit 192 sets the image capture mode parameters 211A as mode-specific parameters 211 in the parameter storage area 201.

Furthermore, when the mode determination unit 191 determines that the operating mode of the CPU 61 is the temperature measurement mode, the mode-specific parameter setting unit 192 performs various parameter setting processes based on the temperature measurement conditions, etc., to derive temperature measurement mode parameters 211B corresponding to the temperature measurement mode. Then, the mode-specific parameter setting unit 192 sets the temperature measurement mode parameters 211B as mode-specific parameters 211 in the parameter storage area 201.

The imaging mode parameters 211A include a first imaging setting parameter 212A set for imaging, and a first image processing setting parameter 213A set for image processing of the captured image. Similarly, the temperature measurement mode parameters 211B include a second imaging setting parameter 212B set for imaging, and a second image processing setting parameter 213B set for image processing of the captured image.

The first imaging setting parameters 212A and the second imaging setting parameters 212B include parameters related to the light projector 14, parameters related to the shutter speed, parameters related to the aperture 33, parameters related to photometry, parameters related to the sensitivity of the image sensor 15, parameters related to high dynamic range, and parameters related to vibration isolation control. The parameters related to the sensitivity of the image sensor 15 include parameters related to the gain of the image sensor 15 and/or parameters related to the conversion efficiency of the image sensor 15.

The first image processing setting parameters 213A and the second image processing setting parameters 213B include parameters related to noise reduction, parameters related to sharpness, parameters related to contrast, and parameters related to tone.

The first imaging setting parameters 212A included in the imaging mode parameters 211A are set as follows, for example.
The parameters relating to the light projector 14 are set to parameters that allow the light projector 14 to project light.
The shutter speed parameters are set to parameters that set the shutter speed equal to or greater than a reference speed. The shutter speed is defined as the time from when the first curtain of a mechanical shutter begins to open until the second curtain of a mechanical shutter finishes closing, the time from when the first curtain of an electronic shutter begins to operate until the second curtain of a mechanical shutter finishes closing, or the time from when the electronic shutter begins to operate until the second curtain of a mechanical shutter finishes operating. The reference speed may be a fixed value or a variable value that is changed according to instructions input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameters related to the aperture 33 are set to parameters that set the aperture amount to a reference aperture amount or greater. The aperture amount is proportional to the diameter of the opening 33A provided in the aperture 33. The reference aperture amount may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The photometry parameters are set to parameters that perform photometry using the average photometry method or the multi-pattern photometry method. Photometry is the measurement of the brightness of a subject.
The parameter related to the gain of the image sensor 15 is set to a parameter that sets the gain of the image sensor 15 to a reference gain or greater. The gain of the image sensor 15 refers to, for example, the analog gain of an A/D converter (not shown) connected to the photodiode of the image sensor 15. The reference gain may be a fixed value, or may be a variable value that is changed in accordance with an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameter related to the conversion efficiency of the image sensor 15 is set to a parameter that makes the conversion efficiency of the image sensor 15 equal to or greater than a reference conversion efficiency. The conversion efficiency of the image sensor 15 refers to the efficiency of converting the charge accumulated in a variable capacitor (not shown) connected to a photodiode included in the image sensor 15 into a voltage. The reference conversion efficiency may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameters related to the high dynamic range are set to parameters that turn on the high dynamic range. The high dynamic range is a display technology that improves the contrast between light and dark areas (i.e., the light-to-dark ratio) of the captured image 161A. Turning on the high dynamic range means widening the dynamic range beyond the reference range. The reference range may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the capture conditions).
The parameters related to vibration isolation control are set to parameters that turn on vibration isolation control. Vibration isolation control is control that moves the vibration isolation lens 34 in a direction that corrects image blur. Turning vibration isolation control on means performing control that moves the vibration isolation lens 34.

The noise reduction parameter is set to a parameter that increases the degree of noise reduction beyond the first reference degree. Noise reduction is image processing that reduces noise appearing in a captured image, and the level of noise reduction refers to increasing or decreasing the rate at which noise appears in the captured image is reduced. The first reference degree may be a fixed value or a variable value that is changed in accordance with an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the image capturing conditions).
The sharpness parameter is set to a parameter that increases the degree of sharpness above the second reference degree. Sharpness refers to the enhancement of the contours of a captured image, and the enhancement of sharpness refers to increasing or decreasing the degree to which the contours of a captured image are enhanced. The second reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The contrast-related parameter is set to a parameter that increases the degree of contrast greater than the third reference degree. Contrast refers to the difference in brightness and/or color of the captured image, and increasing or decreasing the difference in brightness and/or color of the captured image. The third reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the image capturing conditions).
The parameter related to tone is set to a parameter that increases the degree of tone intensity above the fourth reference degree. Tone refers to the color tone of the captured image, and tone intensity refers to increasing or decreasing the degree of color tone of the captured image. The fourth reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the image capturing conditions).

Further, the second imaging setting parameters 212B included in the temperature measurement mode parameters 211B are set as follows, for example.
The parameters relating to the light projector 14 are set to parameters that prevent the light projector 14 from projecting light.
The shutter speed parameter is set to a parameter that sets the shutter speed below a reference speed, which may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameters related to the aperture 33 are set to parameters that make the aperture amount less than a reference amount. The reference aperture amount may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The photometry parameters are set to parameters for performing photometry in highlight-weighted, center-weighted, or spot metering.
The parameter related to the gain of the image sensor 15 is set to a parameter that sets the gain of the image sensor 15 to a value less than the reference gain. The reference gain may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameter related to the conversion efficiency of the image sensor 15 is set to a parameter that makes the photoelectric conversion efficiency of the image sensor 15 less than the reference conversion efficiency. The reference conversion efficiency may be a fixed value, or may be a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameter related to the high dynamic range is set to a parameter that turns off the high dynamic range. Turning off the high dynamic range means setting the dynamic range to a reference range. The reference range may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameters relating to the vibration reduction control are set to parameters that turn off the vibration reduction control.

Further, the second image processing setting parameters 213B included in the temperature measurement mode parameters 211B are set as follows, for example.
The noise reduction parameters are set to parameters that set the degree of noise reduction to a first reference degree or less. The first reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameter related to sharpness is set to a parameter that sets the degree of sharpness to a second reference degree or less. The second reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The contrast-related parameter is set to a parameter that sets the degree of contrast to a third reference degree or less. The third reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).
The parameter related to the tone is set to a parameter that sets the degree of tone intensity to a fourth reference degree or less. The fourth reference degree may be a fixed value or a variable value that is changed according to an instruction input by the user to the input device 78 and/or various conditions (e.g., the temperature of the subject and/or the imaging conditions).

As an example, as shown in FIG. 23, when the CPU 61 is in the imaging mode, the imaging control unit 123 performs imaging settings related to imaging in accordance with the first imaging setting parameters 212A included in the imaging mode parameters 211A stored in the parameter storage area 201.
(1) The imaging control unit 123 sets the light projector 14 to project light, and outputs an ON command to the light projection control circuit 73 .
(2) The imaging control unit 123 adjusts the shutter speed by setting the shutter speed to a value equal to or greater than the reference speed.
(3) The imaging control unit 123 sets the aperture amount to a reference amount or more as a setting related to the aperture 33 , and outputs an aperture command corresponding to the set aperture amount to the aperture drive circuit 53 .
(4) The imaging control unit 123 sets the photometry method to the average photometry method or the multi-pattern photometry method as a setting related to photometry.
(5) The imaging control unit 123 sets the gain of the image sensor 15 to a reference gain or higher as a setting related to the gain of the image sensor 15 .
(6) The imaging control unit 123 sets the photoelectric conversion efficiency of the image sensor 15 to a value equal to or greater than the reference photoelectric conversion efficiency as a setting related to the photoelectric conversion efficiency of the image sensor 15. The imaging control unit 123 outputs a sensitivity command corresponding to the set gain and photoelectric conversion efficiency to the image sensor driver 71.
(7) The imaging control unit 123 sets the high dynamic range to ON as a setting related to the high dynamic range.
(8) The imaging control unit 123 sets the vibration reduction control to ON as a setting related to vibration reduction control, and outputs a vibration reduction command to the vibration reduction drive circuit 54 .

Also, as an example, as shown in Figure 23, when the CPU 61 is in the imaging mode, the display control unit 124 performs image processing settings related to image processing in accordance with the first image processing setting parameters 213A included in the imaging mode parameters 211A stored in the parameter memory area 201.
(9) As a setting related to noise reduction, the display control unit 124 sets the degree of noise reduction to be greater than the first reference degree.
(10) The display control unit 124 sets the sharpness-related setting by setting the degree of sharpness to be greater than the second reference degree.
(11) The display control unit 124 sets the contrast-related setting such that the degree of contrast is greater than the third reference degree.
(12) As a setting related to tone, the display control unit 124 sets the degree of tone intensity to be greater than the fourth reference degree.

As an example, as shown in Figure 24, when the CPU 61 is in temperature measurement mode, the first imaging control unit 133 and the second imaging control unit 135 perform imaging settings related to imaging in accordance with the second imaging setting parameters 212B included in the temperature measurement mode parameters 211B stored in the parameter memory area 201.
(1) The first imaging control unit 133 and the second imaging control unit 135 set the light projector 14 so that the light projector 14 does not project light, and output an OFF command to the light projection control circuit 73 .
(2) The first imaging control unit 133 and the second imaging control unit 135 adjust the shutter speed by setting the shutter speed to a value less than the reference speed.
(3) The first imaging control unit 133 and the second imaging control unit 135 set the aperture amount to less than the reference amount as the setting for the aperture 33, and output an aperture command corresponding to the set aperture amount to the aperture drive circuit 53.
(4) The first imaging control unit 133 and the second imaging control unit 135 set the metering method to highlight-weighted metering, center-weighted metering, or spot metering as a setting related to metering.
(5) The first imaging control unit 133 and the second imaging control unit 135 set the gain of the image sensor 15 to a value less than the reference gain.
(6) The first imaging control unit 133 and the second imaging control unit 135 set the photoelectric conversion efficiency of the image sensor 15 to less than the reference photoelectric conversion efficiency as a setting related to the photoelectric conversion efficiency of the image sensor 15. The first imaging control unit 133 and the second imaging control unit 135 output sensitivity commands corresponding to the set gain and photoelectric conversion efficiency to the image sensor driver 71.
(7) The first imaging control unit 133 and the second imaging control unit 135 set the high dynamic range to off as a setting related to the high dynamic range.
(8) The first imaging control unit 133 and the second imaging control unit 135 set the anti-shake control to OFF as the setting related to the anti-shake control, and output a command to stop the anti-shake operation to the anti-shake drive circuit 54 .

Also, as an example, as shown in Figure 24, when the CPU 61 is in temperature measurement mode, the display control unit 137 performs image processing settings related to image processing in accordance with the second image processing setting parameters 213B included in the temperature measurement mode parameters 211B stored in the parameter memory area 201.
(9) As a setting related to noise reduction, the display control unit 137 sets the degree of noise reduction to a first reference degree or less.
(10) The display control unit 137 sets the sharpness level to a second reference level or less as a setting related to sharpness.
(11) The display control unit 137 sets the contrast level to a third reference level or less as a setting related to contrast.
(12) As a setting related to tone, the display control unit 137 sets the degree of tone intensity to a fourth reference degree or less.

In the third embodiment, the settings related to the floodlight 14, the settings related to the shutter speed, the settings related to the aperture 33, the settings related to photometry, the settings related to the sensitivity of the image sensor 15, the settings related to high dynamic range, and the settings related to vibration isolation control are examples of "imaging settings" according to the technology of the present disclosure. Furthermore, the first imaging setting parameter 212A and the second imaging setting parameter 212B are examples of "imaging setting factors related to imaging settings" and "control factors" according to the technology of the present disclosure. Furthermore, the settings related to noise reduction, the settings related to sharpness, the settings related to contrast, and the settings related to tone are examples of "image processing settings" according to the technology of the present disclosure. Furthermore, the first image processing setting parameter 213A and the second image processing setting parameter 213B are examples of "image processing setting factors related to image processing settings" and "control factors" according to the technology of the present disclosure.

Next, we will explain the operation of the third embodiment, including the control method for camera 1.

In the third embodiment, the mode switching processing performed by the mode switching processing unit 110, the imaging processing performed by the imaging processing unit 120, and the temperature measurement processing performed by the temperature measurement processing unit 130 are the same as in the first embodiment. The third embodiment differs from the first embodiment in that the parameter change processing is performed by the parameter change processing unit 190. Below, the parameter change processing performed by the parameter change processing unit 190 according to the third embodiment will be described with reference to FIG. 25.

In step S51, the mode determination unit 112 determines whether the operating mode of the CPU 61 is the image capture mode or the temperature measurement mode. If it is determined in step S51 that it is the image capture mode, the process shown in FIG. 25 proceeds to step S52, and if it is determined that it is the temperature measurement mode, the process shown in FIG. 25 proceeds to step S53.

In step S52, the mode-specific parameter setting unit 192 derives the imaging mode parameters 211A corresponding to the imaging mode and sets the imaging mode parameters 211A as the mode-specific parameters 211 in the parameter memory area 201.

In step S53, the mode-specific parameter setting unit 192 derives a temperature measurement mode parameter 211B corresponding to the temperature measurement mode and sets the temperature measurement mode parameter 211B as a mode-specific parameter 211 in the parameter memory area 201.

The control method for camera 1 according to the third embodiment is an example of a "control method" according to the technology disclosed herein.

Next, we will explain the effects of the third embodiment that differ from the first embodiment.

In the third embodiment, the imaging setting parameters related to imaging settings differ between the imaging mode and the temperature measurement mode. That is, as an example, the first imaging setting parameter 212A is set in the imaging mode, and the second imaging setting parameter 212B is set in the temperature measurement mode. Therefore, compared to a case where the imaging setting parameters are the same in the imaging mode and the temperature measurement mode, for example, better image quality can be obtained in the imaging mode, and measurement accuracy can be ensured in the temperature measurement mode while reducing the burden on the CPU 61, for example.

The imaging settings also include settings related to the projector 14. In imaging mode, the CPU 61 sets the projector 14 to project light, and in temperature measurement mode, it sets the projector 14 not to project light. Therefore, in imaging mode, better image quality can be obtained by ensuring the amount of light emitted from the subject, compared to, for example, when the projector 14 projects light. On the other hand, in temperature measurement mode, better measurement accuracy can be ensured by suppressing the mixing of illumination light from the projector 14 with near-infrared light emitted from the subject, compared to, for example, when the projector 14 projects light.

The imaging settings also include settings related to the shutter speed. In imaging mode, the CPU 61 sets the shutter speed to a reference speed or higher, and in temperature measurement mode, sets the shutter speed to a speed lower than the reference speed. In other words, the CPU 61 sets the shutter speed in imaging mode to be longer than the shutter speed in temperature measurement mode. This ensures that the amount of light incident on the image sensor 15 is sufficient in imaging mode, thereby achieving good image quality for the captured image. Meanwhile, in temperature measurement mode, measurement accuracy can be ensured by suppressing the inclusion of noise in the first analog image data and second analog image data output from the image sensor 15.

The imaging settings also include settings related to the aperture 33. In imaging mode, the CPU 61 sets the aperture amount to a reference amount or more, and in temperature measurement mode, sets the aperture amount to less than the reference amount. In other words, the CPU 61 sets the aperture amount in imaging mode to be greater than the aperture amount in temperature measurement mode. This ensures that the amount of light incident on the image sensor 15 is sufficient in imaging mode, thereby achieving good image quality for the captured image. Meanwhile, in temperature measurement mode, measurement accuracy can be ensured by suppressing the inclusion of noise in the first analog image data and second analog image data output from the image sensor 15.

The imaging settings also include settings related to photometry. In imaging mode, the CPU 61 sets the photometry method to average photometry or multi-pattern photometry, and in temperature measurement mode, sets the photometry method to highlight-weighted photometry, center-weighted photometry, or spot photometry. This ensures that the amount of light radiated from the entire subject and incident on the image sensor 15 is sufficient in imaging mode, thereby achieving good image quality for the captured image. Meanwhile, in temperature measurement mode, measurement accuracy is ensured by preventing the amount of light radiated from the hottest area of the subject and incident on the image sensor 15 from saturating.

The imaging settings also include settings related to the sensitivity of the image sensor 15. Parameters related to the sensitivity of the image sensor 15 include parameters related to the gain of the image sensor 15 and parameters related to the conversion efficiency of the image sensor 15. In the imaging mode, the CPU 61 sets the gain of the image sensor 15 to a reference gain or higher, and in the temperature measurement mode, sets the gain of the image sensor 15 to a value less than the reference gain. That is, the CPU 61 sets the gain in the imaging mode higher than the gain in the temperature measurement mode. This allows analog image data corresponding to the exposure to be obtained in the imaging mode, thereby achieving good image quality for the captured image. Meanwhile, in the temperature measurement mode, measurement accuracy can be ensured by preventing noise from being included in the first analog image data and second analog image data output from the image sensor 15 and by preventing the peak values of the first analog image data and second analog image data from saturating in response to light emitted from the hottest area of the subject.

In addition, in the imaging mode, the CPU 61 sets the conversion efficiency of the image sensor 15 to a value equal to or greater than the reference conversion efficiency, and in the temperature measurement mode, it sets the conversion efficiency of the image sensor 15 to a value less than the reference conversion efficiency. In other words, the CPU 61 sets the conversion efficiency in the imaging mode higher than the conversion efficiency in the temperature measurement mode. This allows analog image data corresponding to the exposure to be obtained in the imaging mode, thereby achieving good image quality for the captured image. Meanwhile, in the temperature measurement mode, measurement accuracy can be ensured by preventing noise from being included in the first analog image data and second analog image data output from the image sensor 15 and by preventing the peak values of the first analog image data and second analog image data from saturating in response to light emitted from the hottest area of the subject.

The imaging settings also include settings related to the high dynamic range. The CPU 61 sets the high dynamic range to on in imaging mode and to off in temperature measurement mode. This allows the dynamic range to be wider than the standard range in imaging mode, thereby achieving good image quality for the captured image. On the other hand, in temperature measurement mode, the dynamic range is set to the standard range, ensuring measurement accuracy.

The imaging settings also include settings related to vibration isolation control. The CPU 61 sets vibration isolation control to on in imaging mode and to off in temperature measurement mode. This suppresses image blurring in imaging mode, thereby enabling good image quality to be obtained for captured images. On the other hand, in temperature measurement mode, the burden on the CPU 61 can be reduced by reducing the amount of calculation processing required by the CPU 61 to suppress image blurring.

Furthermore, in the third embodiment, the image processing setting parameters related to image processing settings differ between the imaging mode and the temperature measurement mode. That is, as an example, the first image processing setting parameter 213A is set in the imaging mode, and the second image processing setting parameter 213B is set in the temperature measurement mode. Therefore, compared to a case where the image processing setting parameters are the same in the imaging mode and the temperature measurement mode, for example, better image quality can be obtained for the captured image in the imaging mode, and the load on the CPU 61 can be reduced in the temperature measurement mode, for example.

The image processing settings also include settings related to noise reduction. In image capture mode, the CPU 61 sets the degree of noise reduction greater than the first reference degree, and in temperature measurement mode, sets the degree of noise reduction less than the first reference degree. In other words, the CPU 61 sets the noise reduction in image capture mode to be stronger than the noise reduction in temperature measurement mode. This reduces the noise contained in the captured image in image capture mode, thereby achieving good image quality for the captured image. Meanwhile, in temperature measurement mode, the burden on the CPU 61 can be reduced by reducing the amount of calculation processing required by the CPU 61 to reduce noise.

The image processing settings also include settings related to sharpness. In the image capture mode, the CPU 61 sets the degree of sharpness greater than the second reference degree, and in the temperature measurement mode, the degree of sharpness less than the second reference degree. In other words, the CPU 61 sets the sharpness in the image capture mode to be stronger than the sharpness in the temperature measurement mode. This increases the sharpness of the captured image in the image capture mode, thereby enabling the capture image to have good image quality. Meanwhile, in the temperature measurement mode, the burden on the CPU 61 can be reduced by reducing the amount of calculation processing required by the CPU 61 to adjust the sharpness.

The image processing settings also include settings related to contrast. In the image capture mode, the CPU 61 sets the contrast level to a level greater than the third reference level, and in the temperature measurement mode, the contrast level is set to a level equal to or less than the third reference level. In other words, the CPU 61 sets the contrast in the image capture mode to be stronger than the contrast in the temperature measurement mode. This increases the contrast of the captured image in the image capture mode, thereby enabling the capture image to have good image quality. Meanwhile, in the temperature measurement mode, the burden on the CPU 61 can be reduced by reducing the amount of calculation processing required by the CPU 61 to adjust the contrast.

The image processing settings also include settings related to tone. In the image capture mode, the CPU 61 sets the degree of tone intensity greater than the fourth reference degree, and in the temperature measurement mode, it sets the degree of tone intensity equal to or less than the fourth reference degree. In other words, the CPU 61 sets the tone in the image capture mode to be stronger than the tone in the temperature measurement mode. This increases the contrast of the captured image in the image capture mode, thereby enabling the capture image to have good image quality. Meanwhile, in the temperature measurement mode, the burden on the CPU 61 can be reduced by reducing the amount of calculation processing required by the CPU 61 to adjust the contrast.

Next, we will explain a modified example of the third embodiment.

In the third embodiment, the settings related to the projector 14, the shutter speed, the aperture 33, the photometry, the sensitivity of the image sensor 15, the high dynamic range, and the vibration isolation control are different between the imaging mode and the temperature measurement mode, but the combinations of imaging settings that are different between the imaging mode and the temperature measurement mode may be other than those described above. For example, the high dynamic range setting may be set to on in both the imaging mode and the temperature measurement mode. Furthermore, the vibration isolation control setting may be set to on in both the imaging mode and the temperature measurement mode.

Furthermore, the imaging settings that are made different between the imaging mode and the temperature measurement mode may be other than those described above, as long as they include at least one of settings related to the projector 14, settings related to the shutter speed, settings related to the aperture 33, settings related to photometry, settings related to the sensitivity of the image sensor 15, settings related to high dynamic range, and settings related to vibration isolation control.Furthermore, the imaging settings that are made different between the imaging mode and the temperature measurement mode may include various imaging settings related to the camera 1, in addition to settings related to the projector 14, settings related to the shutter speed, settings related to the aperture 33, settings related to photometry, settings related to the sensitivity of the image sensor 15, settings related to high dynamic range, and settings related to vibration isolation control.

In addition, in the third embodiment, the settings related to noise reduction, sharpness, contrast, and tone are different between the imaging mode and the temperature measurement mode, but the combinations of image processing settings that are made different between the imaging mode and the temperature measurement mode may be other than those described above.

In addition, the image processing settings that are made different between the image capture mode and the temperature measurement mode may be other than those described above, as long as they include at least one of noise reduction settings, sharpness settings, contrast settings, and tone settings.In addition, the image processing settings that are made different between the image capture mode and the temperature measurement mode may include various image processing settings related to the camera 1, in addition to noise reduction settings, sharpness settings, contrast settings, and tone settings.

In addition, in the third embodiment, the CPU 61 sets the projector 14 not to emit light in the temperature measurement mode, but it may also set the projector 14 to suppress light emission (i.e., to suppress the amount of light emitted from the projector 14).

[Fourth embodiment]
Next, a fourth embodiment will be described.

In the fourth embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment. Below, we will explain the differences between the fourth embodiment and the first embodiment.

As an example, as shown in FIG. 26, the mode switching processing unit 110 has a mode determination unit 112, a measured temperature acquisition unit 221, a temperature measurement mode termination determination unit 222, a flag setting unit 113, a light projection control unit 114, and a mode setting unit 115.

The mode determination unit 112 determines whether the operating mode of the CPU 61 is the imaging mode or the temperature measurement mode.

When the mode determination unit 112 determines that the operating mode of the CPU 61 is the temperature measurement mode, the measured temperature acquisition unit 221 acquires the temperature of the subject measured in the temperature measurement mode (hereinafter referred to as the measured temperature). The measured temperature may be the value of the temperature distribution of the subject, the maximum value of the temperature distribution of the subject, the most frequent value of the temperature distribution of the subject, the median value of the temperature distribution of the subject, or the average value of the temperature distribution of the subject.

The temperature measurement mode termination determination unit 222 determines whether to terminate the temperature measurement mode based on the measured temperature acquired by the measured temperature acquisition unit 221. As an example, the temperature measurement mode termination determination unit 222 derives a value based on the measured temperature acquired by the measured temperature acquisition unit 221 and determines whether to terminate the measurement mode by determining whether the derived value is equal to or less than a threshold value. The value based on the measured temperature may be any value derived from the measured temperature, such as the measured temperature itself, or a value such as the amount of radiant heat calculated based on the measured temperature. A calculation formula or a data matching table may also be used to derive the value based on the measured temperature. If the value based on the measured temperature is equal to or less than the threshold value, the temperature measurement mode termination determination unit 222 determines to terminate the temperature measurement mode.

When the temperature measurement mode termination determination unit 222 determines that the temperature measurement mode is to be terminated, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag memory area 141, and sets the light emission on control flag 152A as the light emission control flag 152 in the light emission control flag memory area 142.

When the light-projection ON control flag 152A is set by the flag setting unit 113, the light-projection control unit 114 outputs an ON command to the light-projection control circuit 73. The ON command is a command to switch the light-projector 14 ON.

The mode setting unit 115 sets the imaging mode as the mode of the CPU 61.

Next, we will explain the operation of the fourth embodiment, including the control method of camera 1.

In the fourth embodiment, the imaging process performed by the imaging processing unit 120 and the temperature measurement process performed by the temperature measurement processing unit 130 are the same as in the first embodiment. In the third embodiment, the mode switching process performed by the mode switching processing unit 110 differs from that in the first embodiment. Below, the mode switching process performed by the mode switching processing unit 110 in the fourth embodiment will be described with reference to Figure 27.

In step S61, the mode determination unit 112 determines whether the CPU 61 is in the image capture mode or the temperature measurement mode. If it is determined in step S61 that it is in the image capture mode, the process shown in FIG. 27 proceeds to step S62, and if it is determined that it is in the temperature measurement mode, the process shown in FIG. 27 ends.

In step S62, the measured temperature acquisition unit 221 acquires the measured temperature measured in the temperature measurement mode.

In step S63, the temperature measurement mode termination determination unit 222 determines whether or not to terminate the temperature measurement mode based on the measured temperature acquired by the measured temperature acquisition unit 221. If it is determined in step S63 that the temperature measurement mode is to be terminated, the process shown in FIG. 27 proceeds to step S64, and if it is determined that the temperature measurement mode is not to be terminated, the process shown in FIG. 27 terminates.

In step S64, the flag setting unit 113 sets the captured image display flag 151A as the display control flag 151 in the display control flag memory area 141, and sets the light projection on control flag 152A as the light projection control flag 152 in the light projection control flag memory area 142.

In step S65, the light projection control unit 114 switches the light projector 14 on.

In step S66, the mode setting unit 115 sets the imaging mode as the mode of the CPU 61.

The control method for camera 1 according to the fourth embodiment is an example of a "control method" according to the technology disclosed herein.

Next, we will explain the effects of the fourth embodiment that differ from the first embodiment.

In the fourth embodiment, the CPU 61 switches from temperature measurement mode to image capture mode in response to the temperature of the subject in the temperature measurement mode. Therefore, convenience can be improved compared to, for example, a case in which the mode does not switch from temperature measurement mode to image capture mode in response to the temperature of the subject.

Fifth Embodiment
Next, a fifth embodiment will be described.

In the fifth embodiment, the configuration of the camera 1 is changed as follows compared to the first embodiment. Below, we will explain the differences between the fifth embodiment and the first embodiment.

As an example, as shown in FIG. 28, the CPU 61 functions as an integrated display processing unit 230. The integrated display processing unit 230 is a processing unit that causes the projector 14 to emit pulsed light, sets the image capture mode during the light emission period of the pulsed light, and sets the temperature measurement mode during the light emission stop period of the pulsed light, repeating this operation in accordance with the light emission timing of the pulsed light. The projector 14 emits pulsed light to perform intermittent light projection. The integrated display processing unit 230 has a pulsed light emission control unit 241, an image capture processing unit 120, a pulsed light emission stop control unit 242, a temperature measurement processing unit 130, and an integrated display control unit 243.

The pulse light emission control unit 241 outputs a pulse light emission command to the light projection control circuit 73 and controls the light projector 14 to emit pulse light.

The imaging processing unit 120 has a wavelength selection unit 121, a turret control unit 122, and an imaging control unit 123. The functions of the wavelength selection unit 121, the turret control unit 122, and the imaging control unit 123 are the same as in the first embodiment. The imaging processing unit 120 performs imaging processing to obtain a captured image by causing the image sensor 15 to capture visible light or near-infrared light.

The pulse emission stop control unit 242 outputs a pulse emission stop command to the light projection control circuit 73, and controls the light projector 14 to stop emitting pulses.

The temperature measurement processing unit 130 has a wavelength selection unit 131, a first turret control unit 132, a first imaging control unit 133, a second turret control unit 134, a second imaging control unit 135, and a temperature derivation unit 136. The functions of the wavelength selection unit 131, the first turret control unit 132, the first imaging control unit 133, the second turret control unit 134, the second imaging control unit 135, and the temperature derivation unit 136 are the same as in the first embodiment. The temperature measurement processing unit 130 calculates the temperature distribution of the subject based on the near-infrared light image obtained by capturing near-infrared light with the image sensor 15, and performs temperature measurement processing to generate temperature information based on the temperature distribution of the subject.

The integrated display control unit 243 outputs an integrated image 251 that integrates the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130, and displays the integrated image 251 on the display 76. The integrated image 251 may be an image that combines the captured image obtained by the imaging processing unit 120 with the temperature information obtained by the temperature measurement processing unit 130, or may be an image that displays the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130 side by side. The temperature information may also be, for example, information indicating an area where the temperature is above a predetermined threshold, information indicating a specific temperature value, information indicating multiple zones divided into predetermined temperature ranges together with specific temperature values, or information indicating the temperature distribution in a color tone according to the temperature.

In the fifth embodiment, the captured image is an example of a "captured image" and a "first captured image" according to the technology of the present disclosure, and the temperature information is an example of "temperature information" according to the technology of the present disclosure. Furthermore, the integrated image 251 is an example of a "composite image" according to the technology of the present disclosure.

Next, we will explain the operation of the fifth embodiment, including the control method of camera 1.

The fifth embodiment differs from the first embodiment in that the integrated display processing unit 230 executes the integrated display processing. Below, the integrated display processing executed by the integrated display processing unit 230 according to the fifth embodiment will be described with reference to Figure 29.

In step S71, the pulse light emission control unit 241 causes the projector 14 to emit pulse light.

In step S72, the imaging processing unit 120 obtains an image by causing the image sensor 15 to capture visible light or near-infrared light.

In step S73, the pulse emission stop control unit 242 causes the projector 14 to stop emitting pulses.

In step S74, the temperature measurement processing unit 130 calculates the temperature distribution of the subject based on the near-infrared light image obtained by capturing near-infrared light with the image sensor 15, and generates temperature information based on the temperature distribution of the subject.

In step S75, the integrated display control unit 243 outputs an integrated image 251 that integrates the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130, and displays the integrated image 251 on the display 76.

The control method for camera 1 according to the fifth embodiment is an example of a "control method" relating to the technology disclosed herein.

Next, we will explain the differences between the effects of the fifth embodiment and the first embodiment.

In the fifth embodiment, the projector 14 emits pulsed light, and the CPU 61 repeats the operation of setting the imaging mode during the light emission period of the pulsed light and setting the temperature measurement mode during the light emission stop period of the pulsed light according to the light emission timing of the pulsed light. This makes it possible to obtain an integrated image that combines the captured image obtained in the imaging mode with the temperature information obtained in the temperature measurement mode.

The CPU 61 also outputs an integrated image 251 that integrates the captured image obtained by the imaging processing unit 120 and the temperature information obtained by the temperature measurement processing unit 130. Therefore, even without switching between imaging mode and temperature measurement mode, the integrated image 251, in which the captured image and temperature information are integrated, is displayed on the display 76, allowing the user to visually grasp the relationship between the subject's condition and temperature.

Next, we will explain variant examples common to the first to fifth embodiments.

In the first to fifth embodiments, the CPU 61 has an imaging mode and a temperature measurement mode, but it may also have modes other than the imaging mode and the temperature measurement mode.

In addition, in the first to fifth embodiments, the CPU 61 sets the display control flag 151 and the light projection control flag 152 differently between the imaging mode and the temperature measurement mode, but it may also set control flags other than the display control flag 151 and the light projection control flag 152 differently.

In addition, in the first to fifth embodiments, the display control flags 151 are set as a captured image display flag 151A that causes the captured image 161A to be displayed on the display 76, and a composite image display flag 151B that causes the captured image to be composited with temperature information to be displayed on the display 76. However, a display control flag 151 other than the captured image display flag 151A and the composite image display flag 151B may also be set. Furthermore, in the temperature measurement mode, instead of the composite image display flag 151B, a temperature information display flag that causes temperature information to be displayed on the display 76 may be set, and the temperature information may be displayed on the display 76. The temperature information display flag is an example of a "temperature information display factor" related to the technology disclosed herein.

In addition, in the first to fifth embodiments, image blur is corrected by moving the blur correction lens 34. However, image blur may also be corrected by moving the image sensor 15, which is an example of an "optical element" according to the technology of the present disclosure. Image blur may also be corrected using image processing technology based on multiple captured images.

In addition, in the first to fifth embodiments, when measuring temperature using two-color thermometry, two wavelength bands are selected from the wavelength bands of 950 nm to 1100 nm, 1150 nm to 1350 nm, 1500 nm to 1750 nm, and 200 nm to 2400 nm, but two wavelength bands may also be selected from wavelength bands other than these.

In addition, in the first to fifth embodiments, near-infrared light is used for temperature measurement using two-color thermometry, but light other than near-infrared light, such as visible light, may also be used.

Furthermore, in the first to fifth embodiments, camera 1 is given as an example of an imaging device, but the technology of the present disclosure is not limited to this and may be a digital camera built into various electronic devices such as a smart device, a wearable terminal, a cell observation device, an ophthalmic observation device, or a surgical microscope.

Furthermore, in the first to fifth embodiments, the functional configuration of the CPU 61 and the order of processing performed by the CPU 61 are examples and may be modified in various ways.

In addition, among the multiple technologies in the first to fifth embodiments, technologies that can be combined may be combined as appropriate.

Furthermore, while the first to fifth embodiments have been described with reference to exemplary embodiments in which the imaging support processing is executed by the computer 60 within the camera 1, the technology of the present disclosure is not limited to this. For example, as shown in FIG. 30, the imaging support processing may be executed by a computer 314 within an external device 312 that is communicatively connected to the camera 1 via a network 310 such as a LAN or WAN. In the example shown in FIG. 30, the computer 314 includes a CPU 316, storage 318, and memory 320. The imaging support processing program 100 is stored in the storage 318.

Camera 1 requests external device 312 to execute imaging support processing via network 310. In response, CPU 316 of external device 312 reads imaging support processing program 100 from storage 318 and executes imaging support processing program 100 on memory 320. CPU 316 performs imaging support processing in accordance with imaging support processing program 100 executing on memory 320. CPU 316 then provides the processing results obtained by executing the imaging support processing to camera 1 via network 310.

Furthermore, the imaging support process may be distributed between camera 1 and external device 312, or may be distributed among multiple devices including camera 1 and external device 312. In the example shown in Figure 30, camera 1 and external device 312 are examples of "imaging devices" according to the technology of the present disclosure.

Furthermore, in the first to fifth embodiments, an example in which the imaging support processing program 100 is stored in the NVM 62 has been described, but the technology of the present disclosure is not limited to this. For example, as shown in FIG. 31, the imaging support processing program 100 may be stored in a storage medium 330. The storage medium 330 is a non-transitory storage medium. An example of the storage medium 330 is any portable storage medium such as an SSD or USB memory.

The imaging support processing program 100 stored in the storage medium 330 is installed on the computer 60. The CPU 61 executes imaging support processing in accordance with the imaging support processing program 100.

In addition, the image capture support processing program 100 may be stored in the memory of another computer or server device connected to the computer 60 via a communication network (not shown), and the image capture support processing program 100 may be downloaded and installed on the computer 60 in response to a request from the camera 1.

It is not necessary to store the entire imaging support processing program 100 in the memory unit of another computer or server device connected to the computer 60, or in the NVM 62; only a portion of the imaging support processing program 100 may be stored.

Furthermore, the example shown in Figure 31 illustrates an example in which the computer 60 is built into the camera 1, but the technology disclosed herein is not limited to this, and for example, the computer 60 may be provided external to the camera 1.

In the example shown in Figure 31, CPU 61 is a single CPU, but it may be multiple CPUs. Also, a GPU may be applied instead of CPU 61.

In addition, while the example shown in FIG. 31 illustrates a computer 60, the technology of the present disclosure is not limited to this, and devices including ASICs, FPGAs, and/or PLDs may be applied instead of the computer 60. Furthermore, a combination of hardware and software configurations may be used instead of the computer 60.

The following various processors can be used as hardware resources for executing the imaging support processing described in the first to fifth embodiments. Examples of processors include a CPU, which is a general-purpose processor that functions as a hardware resource for executing imaging support processing by executing software, i.e., a program. Examples of processors also include dedicated electrical circuits, such as FPGAs, PLDs, or ASICs, which are processors with a circuit configuration designed specifically for executing specific processing. Each processor has built-in or connected memory, and each processor executes imaging support processing by using the memory.

The hardware resource that executes the imaging support process may consist of one of these various processors, or may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the imaging support process may consist of a single processor.

Examples of a system configured with a single processor include, first, a system in which one or more CPUs are combined with software to form a single processor, which functions as a hardware resource that executes the imaging support process. Second, a system in which a processor is used to realize the functions of the entire system, including multiple hardware resources that execute the imaging support process, on a single IC chip, as typified by SoCs. In this way, imaging support processing is realized using one or more of the various processors listed above as hardware resources.

More specifically, the hardware structure of these various processors can be an electrical circuit that combines circuit elements such as semiconductor devices. Furthermore, the above-described imaging support process is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps can be added, or the processing order can be rearranged, all within the scope of the invention.

The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations, as long as they do not deviate from the spirit of the technology of the present disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

In this specification, "A and/or B" is synonymous with "at least one of A and B." In other words, "A and/or B" means that it may be just A, just B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and/or B" applies when three or more things are expressed connected by "and/or."

All publications, patent applications, and technical standards mentioned in this specification are incorporated by reference herein to the same extent as if each individual publication, patent application, and technical standard was specifically and individually indicated to be incorporated by reference.

Claims (15)

a processor;
a memory connected to or embedded in the processor;
The processor:
a first mode for capturing an image of light incident from a subject onto an image sensor of an imaging device and received by the image sensor , and a second mode for deriving a temperature based on near-infrared light incident from the subject onto the image sensor and received by the image sensor,
a control device that sets the first mode when a floodlight that irradiates illumination light toward the subject is in an on state, and sets the second mode when the floodlight is in an off state; The control device according to claim 1 , wherein a control factor is different between the first mode and the second mode. The control device according to claim 2 , wherein the control factors include a display control factor that is displayed on a display. The processor:
In the first mode, a captured image display factor is set as the display control factor, which causes the display to display a captured image obtained by receiving the light by the image sensor;
The control device according to claim 3 , wherein in the second mode, a temperature information display factor is set as the display control factor, which causes the display to display temperature information indicating the temperature. the control factor includes a light projecting control factor that operates a light projector;
The control device according to claim 2 , wherein the processor, in the second mode, sets a light-emission suppression control factor that suppresses light emission from the light emitter as the light-emission control factor. The control device according to claim 2 , wherein the control factors include an imaging setting factor related to imaging settings. The control device according to claim 6 , wherein the imaging settings include at least one setting of a setting related to a projector, a setting related to a shutter speed, a setting related to an aperture, a setting related to photometry, a setting related to the sensitivity of the image sensor, a setting related to a high dynamic range, and a setting related to vibration isolation control. The control device according to claim 2 , wherein the control factors include an image processing setting factor relating to image processing settings. The control device according to claim 8 , wherein the image processing settings include at least one of a noise reduction setting, a sharpness setting, a contrast setting, and a tone setting. The control device according to claim 1 , wherein the processor switches from the second mode to the first mode in response to the temperature in the second mode. The light projector emits pulsed light,
The control device according to claim 10 , wherein the processor repeats an operation of setting the first mode during a light emission period of the pulsed light emission and setting the second mode during a light emission stop period of the pulsed light emission in accordance with a light emission timing of the pulsed light emission. The control device according to claim 1 , wherein the processor outputs a composite image obtained by combining a first captured image obtained by receiving light by the image sensor with temperature information indicating the temperature. A control device according to any one of claims 1 to 12;
the image sensor;
An imaging device comprising: Switching between a first mode in which light incident from a subject onto an image sensor of an imaging device and received by the image sensor is captured, and a second mode in which temperature is derived based on near-infrared light incident from the subject onto the image sensor and received by the image sensor; and
setting the first mode when an operation of a floodlight that irradiates illumination light toward the subject is on, and setting the second mode when the operation of the floodlight is off. On the computer,
Switching between a first mode in which light incident from a subject onto an image sensor of an imaging device and received by the image sensor is captured, and a second mode in which temperature is derived based on near-infrared light incident from the subject onto the image sensor and received by the image sensor; and
setting the first mode when an operation of a floodlight that irradiates illumination light toward the subject is on, and setting the second mode when the operation of the floodlight is off.