JP7520191B2 - Terahertz wave detection device, terahertz wave detection method, and information processing device - Google Patents

Description

The present invention relates to a terahertz wave detection device, a terahertz wave detection method, and an information processing device.

It is known that various VCO gases and the like show absorption spectra with characteristic frequencies in the terahertz wave (0.1 THz to 10 THz, hereinafter referred to as "THz waves"). It is also known that THz waves have a longer wavelength than infrared light and are less susceptible to the effects of aerosols. Therefore, Non-Patent Document 1 discloses a study on the application of THz waves to the analysis of VCO gases, taking advantage of the properties of THz waves.

Gapless THz comb spectroscopy (Laser Research, Vol. 42, No. 9, pp. 1-6, September 2014)

Non-Patent Document 1 refers to the generation of terahertz waves without a spectral gap, but does not provide a display of the results of analysis performed with THz waves. Terahertz waves have a longer wavelength than light, and imaging of received terahertz waves does not provide the same resolution as a visible light image, so there is room for further ingenuity in order to present the results of analysis using THz waves as an image.

The present invention has been made in view of the above-mentioned circumstances, and has an object to provide a display technique that makes it easier to view the results of analysis using terahertz waves.

In order to solve the above problems, the present invention provides a terahertz wave transmitter/receiver including an emitter that emits terahertz waves and a receiver that receives reflected terahertz waves reflected by a reflecting object present behind an object to which the terahertz waves are irradiated, a camera, a display, and an information processing device including the terahertz wave transmitter/receiver, the camera, and the display, wherein the emitter irradiates terahertz waves based on a transmission signal obtained by sweeping frequencies including a specific frequency, and the information processing device performs an analysis process for analyzing the received terahertz waves, and based on the analysis result of the analysis process, superimposes an image based on the analysis result on an image captured by the camera. and a display image generation process for generating a display image for displaying the display on the display, wherein the analysis process includes a distance calculation process for calculating the distance from the terahertz wave transmitter/receiver to the reflecting object , and a distribution calculation process for calculating a movement in distribution of the object based on the intensity of the terahertz wave emitted from the transmitter, the attenuation of the received terahertz wave relative to the terahertz wave irradiated from the transmitter, and the distance, and the display image generation process generates a display image corresponding to the movement in distribution in accordance with the background of the image captured by the camera, and displays the display image on the display by superimposing the display image on the background image.

According to the present invention, it is possible to provide a display technique that makes it easier to view the results of an analysis using terahertz waves. Objects, configurations, and effects other than those described above will be made clear in the following embodiments.

1 is a front view of a THz wave detection device according to a first embodiment; 1 is a side cross-sectional view of a THz wave detection device according to a first embodiment; Hardware configuration diagram of a THz wave detection device according to a first embodiment Functional block diagram of a THz wave detection device according to a first embodiment A diagram explaining the transmission and reception of THz waves. A diagram showing the signal strength of the received signal Flowchart showing the operation flow of the THz wave detection device Diagram explaining how to visualize gas FIG. 13 is a diagram showing an example of image synthesis processing; FIG. 13 is a diagram showing an example of image synthesis processing; FIG. 1 is an external view of a THz wave detection device according to a second embodiment. Controller functional configuration diagram FIG. 13 is a diagram showing an application example of the THz wave detection device according to the second embodiment. FIG. 1 shows the relationship between the distance between a THz wave detector and a gas to be analyzed. FIG. 1 shows the relationship between the distance between a THz wave detector and a gas to be analyzed. 10 is a flowchart showing the process flow of the THz wave detection device according to the third embodiment, particularly the gas visualization application unit. A diagram explaining the feature quantity that represents the time change in the distribution of the concentration of the analyzed gas. FIG. 1 shows an example of a concentration distribution diagram. A diagram showing a composite image A flowchart showing a process flow of a gas visualization application unit according to a fourth embodiment. 13 is a front view of a THz wave detection device according to a fifth embodiment. 13 is a side cross-sectional view of a THz wave detection device according to a fifth embodiment. 13 is a flowchart showing a process flow of the gas visualization application unit in the fifth embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
The same configurations and processing steps are denoted by the same reference numerals, and duplicated explanations will be omitted.

[First embodiment]
In the first embodiment, an example in which a THz wave detection device 100 is applied to a gas visualization device will be described. Fig. 1A is a front view of the THz wave detection device according to the first embodiment. Fig. 1B is a front view of the THz wave detection device according to the first embodiment.
Fig. 2 is a side cross-sectional view of the THz wave detection device according to the first embodiment Fig. 2 is a hardware configuration diagram of the THz wave detection device according to the first embodiment

The THz wave detection device 100 shown in Fig. 1A is configured by externally attaching a THz wave transceiver 1 to a smartphone 10 as an information processing device. The information processing device may be another mobile information terminal, for example, a tablet terminal. The THz wave detection device 100 may also be configured by connecting the THz wave transceiver 1 to a computer.

As shown in FIG. 1B , the smartphone 10 includes an expansion I/F 125, and the THz wave transceiver 1 is connected to the expansion I/F 125.

The smartphone 10 has a display 141 and a front camera 143 on the front side.
Furthermore, the smartphone 10 is equipped with a rear camera 144 on the rear surface.
The housing contains a processor 107 .

2 is a block diagram showing an example of the internal configuration of the smartphone 10. In FIG. 2, the smartphone 10 includes a CPU (Central Processing Unit) 101, a system bus 10
2, a ROM (Read Only Memory) 103, a RAM (Random Access Memory) 104, a storage 110, a communication processor 120, an expansion interface 125, an operation unit 130, a video processor 140, an audio processor 150, and a sensor 160.

The CPU 101 is a microprocessor unit that controls the entire smartphone 10. The system bus 102 is a data communication path for transmitting and receiving data between the CPU 101 and each operation block in the smartphone 10.

The ROM 103 is a memory in which basic operation programs such as an operating system and other operation programs are stored, and is, for example, an EEPROM (Electrically Erasable and Programmable ROM).
A rewritable ROM such as a Programmable Read Only Memory (ROM) or a flash ROM is used. The RAM 104 serves as a work area when the basic operation program and other operation programs are executed. The ROM 103 and the RAM 104 may be integrated with the CPU 101. The ROM 103 may not be an independent configuration as shown in FIG. 2, but may use a part of the storage area in the storage 110. The processor 107 includes the CPU 101,
The ROM 103, the RAM 104, and the storage 110 are connected via a system bus 102.

The storage 110 stores the operation program and operation setting values of the smartphone 10, images captured by the smartphone 10, information on the user of the smartphone 10, and the like.

A part of the storage 110 may replace all or part of the functions of the ROM 103. The storage 110 needs to hold the stored information even when no power is being supplied from an external source to the smartphone 10. Therefore, for example, a device such as a flash ROM, a solid state drive (SSD), or a hard disk drive (HDD) is used.

The operation programs stored in the ROM 103 and the storage 110 can be updated and their functions expanded by downloading from each server device (not shown) on the wide area public network.

The communication processor 120 includes a LAN (Local Area Network) communicator 121 and a telephone network communicator 122.
The LAN communication device 121 is connected to a wide area public network via an access point (AP) device (not shown) by wireless connection such as Wi-Fi (registered trademark), and transmits and receives data to and from each server device on the wide area public network. The telephone network communication device 122 performs telephone communication (calls) and transmits and receives data by wireless communication with a base station (not shown) of a mobile telephone communication network. The NFC communication device 123 performs wireless communication with a corresponding reader/writer when in close proximity. The Bluetooth communication device 124 transmits and receives data by wireless communication with a corresponding terminal. The LAN communication device 121, the telephone network communication device 122, the NFC communication device 123, the Bluetooth communication device 124, and the like.
The ueTooth communication device 124 includes an encoding circuit, a decoding circuit, an antenna, etc. The communication processor 120 may further include an infrared communication device or other communication device.

The expansion interface 125 is a group of interfaces for expanding the functions of the smartphone 10. In this embodiment, the expansion interface 125 includes a video/audio interface, a USB (Universal S
It consists of a video/serial bus interface, memory interface, etc.
The audio interface inputs video/audio signals from external video/audio output devices, and outputs video/audio signals to external video/audio input devices. The USB interface connects to a PC (Personal Computer) or the like to send and receive data. It may also connect a keyboard or other USB devices. The memory interface connects to a memory card or other memory medium to send and receive data.

The operation device 130 is an instruction input device for inputting operation instructions to the smartphone 10, and in this embodiment, is configured with a touch panel and an operation key with an array of button switches arranged on top of the display 141. Note that only one of them may be provided, or a keyboard or the like connected to the expansion interface 125 may be used to input operation instructions to the smartphone 1.
0 may be used. Also, the smartphone 10 may be operated using a separate mobile terminal device connected by wired or wireless communication. Also, the display 141 may have the touch panel function.

The video processor 140 is composed of a display 141, an image signal processor 142, a front camera 143, and a rear camera 144.
The rear camera 144 is a camera arranged on the same surface (front) as the front camera 143, and is used for taking so-called selfies, for example, by checking the image of one's face captured by the front camera 143 on the display 141.
is a camera disposed on the opposite side (rear side) of the display 141.

The display 141 is a display device such as a liquid crystal panel, and displays image data processed by the image signal processor 142 and provides it to the user of the smartphone 10. The image signal processor 142 includes a video RAM (not shown), and the display 141 is driven based on image data input to the video RAM.
If necessary, it will convert the format, display menus and other OSDs (On-Screen Display)
The front camera 143 and the rear camera 14
4 is a CCD (Charge-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor)
A camera unit that functions as an imaging device that inputs image data of the surroundings and objects by converting light input from the lens into an electrical signal using electronic devices such as a photoconductor sensor.

The audio processor 150 includes a speaker 151, an audio signal processor 152, and a microphone 153. The speaker 151 provides an audio signal processed by the audio signal processor 152 to the user of the smartphone 10. The microphone 153 converts the user's voice, etc., into audio data and inputs it.

The sensor 160 is a group of sensors for detecting the state of the smartphone 10. In this embodiment, the sensor 160 includes a GPS (Global Positioning System) receiver 161, a gyro sensor 162,
The smartphone 10 includes a geomagnetic sensor 163, an acceleration sensor 164, an illuminance sensor 165, and a human presence sensor 166. These sensors make it possible to detect the position, inclination, direction, movement, and surrounding brightness of the smartphone 10. The smartphone 10 may further include a pressure sensor such as an air pressure sensor. The location information is acquired by the G
The information is obtained by the PS receiver 161, but if it cannot be obtained in a location where GPS signals are difficult to receive, the information may be obtained from location information of a Wi-Fi AP device by the LAN communication device 121, or from base station information by the telephone network communication device 122.

2 includes many components that are not essential to the present embodiment, such as the communication processor 120, but the effects of the present embodiment are not impaired even if these components are not included. In addition, components not shown, such as a digital broadcast receiving function and an electronic money payment function, may be further added.

FIG. 3 is a functional block diagram of the THz wave detection device 100 according to the first embodiment.
The wave detection device 100 is configured such that the THz wave transceiver 1 and the rear camera 144 are connected to the input stage of the processor 107 , and a display 141 is connected to the output stage of the processor 107 .

The processor 107 mainly includes an analysis unit 2 and a visualization unit 4. The analysis unit 2 and the visualization unit 4 are configured by hardware constituting the processor 107 executing software that realizes the functions of the THz wave detection device 100.

The THz wave transmitter/receiver includes a transmitter 11, a receiver 12, a transmission control unit 13, and an antenna 14.

The THz wave transmitter and receiver 1 is directed toward a three-dimensional space including a target gas 6.
A transmission wave 15a is emitted from an antenna 14 attached to the target gas 6. The target gas 6 absorbs a specific frequency spectrum. The reflected terahertz wave 15b passes through the target gas 6 and is reflected by the background reflecting object 5. The reflected terahertz wave 15b is received by the antenna 14.

The transmission control unit 13 controls the transmitter 11 to sweep the spectrum frequency to generate a THz
The receiver 12 controls the transmitter 11 to output a wave (transmission signal) to the transmitter 11. The transmitter 11 converts the transmission signal into a transmission wave 15a (THz wave), and irradiates the transmission wave 15a from the antenna 14 toward a two-dimensional area including the target gas 6. The receiver 12 acquires the reflected terahertz wave 15b received by the antenna 14, converts it into a received signal, and sends it to the analysis unit 2.

The transmission wave 15a is irradiated onto the two-dimensional region by scanning the irradiation direction horizontally or vertically for each unit, with the period for sweeping the frequency of the spectrum being one unit.
The scanning means for the irradiation direction may be a mechanical means using a galvanometer mirror or the like, or may be an electrical means using a phased array antenna in which multiple antenna elements are arranged in an array and varying the phase of the THz wave signal input to each antenna element. The scanning synchronization signal is shared with the visualization unit 4.

The analysis unit 2 includes a frequency difference detector 21, a detector 22, a frequency detector 23, and a reflection distance calculation unit 2.
4, reference intensity detection unit 25, attenuation amount detection unit 26, normalized concentration calculation unit 27, attenuation ratio calculation unit 28
, and a gas discriminator 29 .

On the other hand, the visualization unit 4 includes a depth image generation unit 41 , a density image generation unit 42 , a graphic image generation unit 43 , and an image synthesis unit 44 .

The frequency difference detector 21 obtains the frequency difference Δf 0 between the transmission signal and the reception signal from the interference signal between the transmission signal and the reception signal, and outputs the frequency difference Δf 0 to the reflection distance calculation unit 24 .

The reflection distance calculation unit 24 calculates the reflection distance d between the antenna 14 and the background reflecting object 5 from Δf0, and outputs the reflection distance d to both the normalized density calculation unit 27 and the depth image generation unit 41.

The detector 22 detects the envelope of the received signal and outputs the result to a reference intensity detector 25 and an attenuation amount detector 26 .

The reference intensity detection unit 25 detects the reference intensity R in a frequency range where the target gas 6 does not spectrally absorb THz waves, based on the envelope of the received signal. The reference intensity detection unit 25 outputs the reference intensity R to the attenuation ratio calculation unit 28.

The attenuation amount detection unit 26 detects a dip in the envelope of the received signal at a specific frequency where the target gas 6 is undergoing spectral absorption, and detects the amount of attenuation S from the amount of the dip. The attenuation amount detection unit 26 outputs the amount of attenuation S to the attenuation ratio calculation unit 28.

Furthermore, attenuation detector 26 outputs the timing of the dip to frequency detector 23. Frequency detector 23 detects frequency f1 of the received signal at which the dip occurs, and outputs it to gas discriminator 29.

Gas identifier 29 identifies the type of gas whose absorption spectrum has frequency f1 and outputs the identified type to graphic image generator 43 .

The attenuation ratio calculation section 28 calculates the attenuation ratio R/S from the reference intensity R and the attenuation amount S, and outputs it to the normalized concentration calculation section 27 .

The normalized density calculation unit 27 calculates a normalized density R/S/d by dividing the attenuation ratio R/S by the reflection distance d. The normalized density calculation unit 27 outputs the normalized density R/S/d to the density image generation unit 42.

The rear camera 144 includes an imaging unit 1441 and a camera control unit 1442.
The imaging unit 1441 includes an imaging device such as a CMOS sensor and an imaging lens.
A visible light or infrared light image of the two-dimensional area irradiated with the THz wave is captured. The camera control unit 1442 converts the signal from the imaging unit 1441 into an RGB signal. Note that a part of the captured area may correspond to the area irradiated with the THz wave signal. The front camera 143 includes an imaging unit 1431 and a camera control unit 1432, similar to the rear camera 144. An embodiment using the front camera 143 will be described in the third embodiment.

The depth image generating unit 41 receives the reflection distance d as an input, and synchronizes with the irradiation and scanning of the THz wave by:
A two-dimensional image is generated, for example by converting the reflection distance d into a monochromatic intensity.

The density image generating unit 42 receives the normalized density R/S/d as input, and converts the normalized density R/S/d into a monochromatic intensity value or maps it to a predetermined color in synchronization with the irradiation and scanning of the THz waves, thereby generating a two-dimensional image.

The graphic image generating unit 43 obtains text data as gas type information, and further converts the text data into graphic image data to obtain a graphic image.

The image synthesis unit 44 receives a depth image, a density image, a graphic image, and even a camera image as input, synthesizes these images, and outputs the result to the display 141 .

FIG. 4 is a diagram for explaining a method for analyzing gas and odor.
and relates to analysis unit 2.

Fig. 4A is a diagram for explaining a transmission signal 201 and a reception signal 202 of a THz wave, in which the transmission wave 15a and the reflected terahertz wave 15b are respectively inside and outside the antenna 14. Fig. 4A shows the transmission signal 201 and the reception signal 202 with respect to three axes of time, signal strength, and frequency.

The transmission signal 201 shown by the dashed line changes in TH while keeping the signal strength constant in unit time Tm.
A sweep operation is performed to gradually change the frequency in the z-wave region. The frequency range of the sweep is as follows:
When one unit of sweep is completed, the transmission signal 201 performs the next sweep operation, but the irradiation location is different according to the above-mentioned irradiation scanning.

The received signal 202 shown by the solid line is slightly delayed from the transmitted signal 201. This is due to the reflection distance d that it travels back and forth. Due to this delay, when observed at the same time,
There is a frequency difference Δf0 between the transmission signal 201 and the reception signal 202.
The signal intensity of 2 dips at a particular frequency f1 because the gas 6 to be analyzed has a spectral absorption at frequency f1.

4B is a diagram showing the signal strength of the received signal 202. As explained in FIG. 4B, there is a dip at frequency f1. The reference strength R is the signal strength when there is no absorption by gas,
It is possible to obtain the average value by sampling multiple points on the flat portion, avoiding the recessed portions.
The signal intensity S of the depression is the signal intensity attenuated by gas absorption, and represents the degree of absorption by the gas. The higher the gas concentration, the greater the attenuation and the smaller S. The attenuation rate due to gas absorption is R/S.

The reflection distance calculation unit 24 calculates the reflection distance d by the following formula (1).

The normalized concentration calculation unit 27 calculates the normalized gas concentration (also referred to as normalized concentration) by the following formula (2).

Figure 5 is a flowchart showing the operation flow of the THz wave detection device 100.

When the THz wave detection device 100 is started, an initial setting is performed (S10).
00 executes in parallel an image capture process (S11) using the rear camera 144 and a series of processes including measurement by the THz wave transmitter/receiver 1, that is, THz wave irradiation control (S12) toward the analysis target (which in this embodiment is the area where the analysis target gas is located), THz wave irradiation (S13), and reflected terahertz wave reception (S14). S12 to S14 are the THz wave control process S1, and control is performed in S12 to irradiate the target area with THz waves. For example, the irradiation level of the THz waves, the time unit of the sweep, the frequency width, etc. In S13, irradiation of the THz waves is executed and instructed, and a detection signal of the received signal, which is a reflected terahertz wave, is obtained in S14.

After receiving the reflected terahertz wave (S14), the frequency difference detector 21 performs a frequency difference detection process (S
15), a reference intensity detection process by the reference intensity detection unit 25 (S16), an attenuation intensity detection process by the attenuation amount detection unit 26 (S17), and a frequency detection process by the frequency detector 23 (S18).
S15 to S25 constitute the analysis process S2.

After the frequency difference detection process (S15), the reflection distance calculation unit 24 calculates the reflection distance d (S19), and records the result in the RAM 104 or the storage 110 (S23). The reflection distance calculation unit 24 then outputs the reflection distance d to the depth image generation unit 41, which then generates a depth image 51 (see FIG. 6) (S26).

After the reference intensity detection process (S16), the damping ratio calculation unit 28 executes a calculation process of the gas damping rate R/S (S20). Next, the normalized concentration calculation unit 27 executes a normalized concentration calculation process (S
21) is executed and recorded in the RAM 104 or the storage 110 (S24). The normalized density calculation unit 27 then outputs the normalized density R/S/d to the density image generation unit 42, and the density image generation unit 42 generates a density image 52 (see FIG. 6) (S27).

After the attenuation intensity detection process (S17), frequency detector 23 detects the depressed (attenuated) frequency f1 (S18), and gas identifier 29 identifies the type of gas, i.e., identifies the components of the gas, based on frequency f1 (S22), and records this in RAM 104 or storage 110 (S25).
Gas identifying unit 29 then outputs the component identification results as text data to graphic image generating unit 43, which then generates graphic image 53 (see FIG. 6) (S28).

The rear camera 144 captures a background image (S11) and acquires a camera image (S29).
.

The image synthesis unit 44 acquires the depth image 51, the density image 52, the graphic image 53, and the camera image 54, synthesizes these four images (S30), and displays them on the display 141 (S31).

The CPU 101 determines whether the conditions for determining whether or not the repetition is necessary, for example, whether the scanning is completed or whether or not the application is to be continued (S32), and if it determines that the repetition is necessary (S3
2/Yes) Return to S11 and S12. If it is determined that repetition is not necessary (S32/No), the process ends.

Figure 6 is a diagram explaining how to visualize gas.

The depth image 51 is a two-dimensional image obtained by converting the reflection distance d into a monochromatic brightness in synchronization with the irradiation and scanning of the THz waves. The depth image 51 is inferior in definition to a camera image taken with visible light because the THz waves have a longer wavelength than visible light.
This visualizes the reflection distance d to the background reflecting object, and it is possible to observe the background covered with aerosols, etc. Therefore, obstacles and emergency exits during evacuation can be detected from the camera image 54.
The relationship between the range in which the THz waves are two-dimensionally scanned and the angle of view of the camera image is detected and stored in advance for the corresponding range.

The gas concentration image 52 is similarly obtained by synchronizing the irradiation and scanning of the THz wave with the normalized concentration R/S
The gas concentration R/S is normalized by the reflection distance d, and the risk of the gas can be visualized in terms of concentration and distance.

The graphic image 53 is obtained by converting text data of gas type information into graphic image data. In addition to gas types, the graphic image 53 is also useful as an auxiliary visualization image for easily displaying warning messages according to the degree of danger and changes in gas over time.

The camera image 54 is a camera image captured by the rear camera 144. Since the camera image 54 is an image of visible light reflected by the background reflecting object 5, it is called a background image.

The composite/display image 55 is an image obtained by compositing the depth image 51, the density image 52, the graphic image 53, and the camera image 54, and serves as a display image. The four images constitute four layer images of the composite image, and a composite image that is easy to view can be obtained by alpha blending as a compositing method. The depth image 51 and the camera image 54 can be used complementarily. In an environment such as an aerosol, when the camera image 54 is unstable, it is also possible to composite the image by mainly displaying the depth image 51 or replacing a part of the camera image 54 with the depth image 51. Also, from the camera image 54 and the depth image 51, characteristic points such as an exit door of the camera image 54 and obstacles on an evacuation route may be recognized and displayed.

The image synthesis unit 44 acquires a depth image 51, a density image 52, a graphic image 53, and a camera image 54. The image synthesis unit 44 then compares the camera image 54 with the depth image 51 to synthesize the camera image 54.
6 , when the distance from the THz wave detecting device 100 to the chair in the depth image 51 is compared with the distance from the THz wave detecting device 100 to the gas 520, the distance from the THz wave detecting device 100 to the gas 520 is shorter, and therefore the gas 520 is drawn superimposed on the chair captured in the depth image 51 so as to appear to be in front.

7A and 7B are diagrams showing an example of image synthesis processing. In Fig. 7A and Fig. 7B, a density image 521 and a camera image 541 are the same image. On the other hand, depth images 511 and 512 are different, with the table being located farther away from the gas in depth image 511 and the table being located closer to the gas in depth image 512. In this case, the image synthesis unit 44 generates a synthesis/display image 551 in which the gas is depicted in front of the table in Fig. 7A. The image synthesis unit 44 also generates
In FIG. 7B, a composite display image 552 is generated in which gas is depicted on the back surface of the table.

As described above, according to the first embodiment, the gas concentration image 52 is displayed by superimposing it on the background image based on the depth image 51 or the camera image 54, thereby making it possible to visualize the position of the gas relative to the background image. The camera image 54 can provide a high-resolution background image, and in an aerosol or other environment, the depth image 51 allows the background to be confirmed, and background images can be obtained in a variety of environments. Furthermore, this embodiment can be used not only for gas analysis, but also for analysis in places where bad odors are generated, such as kitchens.

[Second embodiment]
The second embodiment will be described with reference to Fig. 8 to Fig. 10. The second embodiment is an example in which a THz wave detection device 100a is configured by attaching a THz wave transceiver 1 to a wearable terminal 300. The THz wave transceiver 1 may be integrated into the wearable terminal 300. A user of the THz wave detection device 100a can use the THz wave detection device 100a while the THz wave detection device 100a is attached to the body, and can keep both hands free.

8 is an external view of a THz wave detection device 100a according to the second embodiment. As shown in Fig. 8, the THz wave detection device 100a is configured by mounting a THz wave transceiver 1a and a camera 3 on a wearable terminal 300.

The wearable terminal 300 includes a top of the head holder 303 and a side of the head holder 304, a glasses-type optical unit 302 provided in front of the side of the head holder 304, a screen 305 provided in front of the glasses-type optical unit 302, and an image projector 301 provided on the top of the head holder 303.

The THz wave transmitter/receiver 1 a and the camera 3 are attached, for example, to the top of the head holder 303 .

The THz wave detection device 100 a further includes a controller 7 b electrically or communicatively connected to the THz wave transmitter/receiver 1 a, the camera 3, the image projector 301, the eyeglass-type optical unit 302, and the screen 305.

The controller 7 is a smartphone 10 with the camera 3 and display functions removed. The screen 305, the image projector 301, and the eyeglass-type optical unit 302 correspond to the display 141. The top of the head holder 303 and the side of the head holder 304 are TH
It is used to attach the camera 3, the THz wave transmitter/receiver 1a, and the display to the head of a user of the z-wave detection device 100a.

The image projector 301 projects the composite/display image 55 onto the screen 305. At this time, the depth image 51 can be displayed in 3D to give perspective according to the reflection distance d.
For this reason, the composite/display image 55 is composed of an image to be viewed by the left eye and an image to be viewed by the right eye. An electronic shutter 102a (see FIG. 9) is built into the eyeglass-type optical unit 302, and when an image to be viewed by the left eye is projected, the eyeglass-type optical unit 302 controls the left eye side to be in a transparent state and the right eye side to be in a blocked state by the electronic shutter. When an image to be viewed by the right eye is projected, the eyeglass-type optical unit 302
The right eye side is then controlled to a transparent state, and the left eye side is controlled to a blocked state by an electronic shutter.

The screen 305 may be a semi-transparent screen. In this case, the camera image 54 is not included in the composite and display image 55. The background image seen through the semi-transparent screen 305 and the composite and display image 55 consisting of at least one of the depth image 51, density image 52, and graphic image 53 projected by the image projector 301 onto the semi-transparent screen 305 are viewed together. The camera image 54 is used for positioning and the like when obtaining the composite and display image 55. The user can safely view the T while viewing the real image of the background through the semi-transparent screen 305.
A Hz wave detection device 100a can be used.

9 is a functional configuration diagram of the controller 7. The controller 7 includes a CPU 71, a RAM
The camera includes an SD memory 74b, a communication I/F 75, a graphics processor 76, a touch panel display 45a, a USB(R) I/F 77, and an optical system control unit 78. The USB(R) I/F 77 is connected to the THz wave transceiver 1a and the camera 3. The optical system control unit 78 is connected to the electronic shutter 102a and controls the opening and closing of the electronic shutter 102a.

The THz wave transmitter/receiver 1a is equipped with a USB I/F 14.

The controller loads the program stored in the FROM 73 into the RAM 72 and executes the program.
The FROM 73 stores, as programs related to the analysis and visualization of gases and odors, a THz wave control processor 731, a camera control processor 732, an analysis processor 733, a visualization processor 734, and a gas visualization application (abbreviation of application) 735.
5. Here, the THz wave control process unit 731 includes the THz wave transceiver 1 in FIG.
In particular, the camera control process unit 732 is related to the operation of the transmission control unit 13. The camera control process unit 732 is related to the operation of the camera control unit 1432 or 1442 in the front camera 143 or the rear camera 144 in FIG.
3. The analysis process unit 733 is related to the operation of the analysis unit 2 in Fig. 3. The visualization process unit 734 and the gas visualization application unit 735 correspond to the visualization unit 4 in Fig. 3.

After being launched, the gas visualization application unit 735 not only controls the user interface, but also calls the THz wave control process unit 731, the camera control process unit 732, the analysis process unit 733, and the visualization process unit 734, and performs analysis and visualization of gases and odors.

The SD memory 74b stores application data and the like.
The controller 7 transmits and receives data to and from the CPU 71 via the communication I/F 75. The communication I/F 75 is a communication interface for 3G or 4G mobile communication, wireless LAN, or the like, and connects to a server (not shown) via the Internet. The controller 7 may cause the server to execute part of the program it is executing, thereby reducing its own processing load.

The graphic processor 76 generates an image to be displayed on the display screen of the touch panel display 45a from application data generated by the program.
The camera image data obtained by the touch panel display 4 is also captured and displayed.
In addition to the display screen, 5a has a touch panel as a user input operation section.

The USB I/F 77 is a serial bus interface, and connects the controller 7 to the THz wave transceiver 1 a and the camera 3 .

The THz wave transceiver 1a is a THz wave transceiver 1 according to the first embodiment, which is equipped with a USB I/F 14
Data is transmitted and received between the USB I/F 14 and the USB IF 77 of the controller 7. At this time, instead of transmitting and receiving the received THz wave signal, for example, the detected envelope may be converted into digital data and transmitted and received.

Fig. 10 is a diagram showing an application example of the THz wave detection device 100a according to the second embodiment. The THz wave detection device 100b in Fig. 10 differs from the THz wave detection device 100a in that the THz wave transmitter/receiver 1 and the camera 3 are integrally configured, for example, built into the THz wave detection device 100a or attached in close contact therewith. The THz wave detection device 100b has an opening 31a for the camera 3 and an antenna 14a for the THz wave transmitter/receiver 1. The THz wave detection device 100b also has a built-in controller 7a.

The THz wave detection device 100 b transmits and receives a communication signal 75 a , and is communicatively connected to a server device 92 via a communication base station 90 and the Internet 91 .

The server device 92 transmits a part of the program to be executed by the controller 7 to the server device 9
2, thereby reducing the processing load of the controller 7a. For example, the frequency f1 of the absorption spectrum may be notified to the server device 92, and the gas type corresponding to the frequency f1 may be identified using a database in the server device 92, and the result may be returned to the controller 7a.

Also, the depth image 51 and the camera image 54 may be transmitted to a server device 92, and the server device 92 may recognize characteristic parts of the background image.

In addition, in response to an alert issued by the controller 7a, the server device 92 may identify the degree of danger, notify the police or fire department, and have the controller 7a present specific evacuation instructions.

As described above, according to the second embodiment, a gas and odor visualization device can be realized by utilizing a general-purpose information device.

[Third embodiment]
A third embodiment will be described with reference to Figures 11A, 11B, and 12. The third embodiment is characterized in particular by the function of measuring the distance to the gas.

FIG. 11A is a diagram showing the relationship of the distance between the THz wave detection device 100b and the gas 6 to be analyzed.

The telescopic device 80 in FIG. 11A includes a handle 83, a telescopic rod 82 attached to one end of the handle 83 and capable of expanding and contracting in length, and a support base 81 attached to the tip side of the telescopic rod 82 (the side opposite to the handle 83).
The THz wave detection device 100b is fixed to the support base 81. The user grasps the handle 83 and adjusts the length of the extendable rod 82 to measure and visualize the gas 6 to be analyzed with the THz wave detection device 100b attached to the support base 81.
It is possible to vary the distance between the electrode 80b and the target gas 6. Here, whether the expandable rod 82 is in an expanded or contracted state is also captured together with the measurement data.

FIG. 11B shows a diagram illustrating the relationship of the distance between the THz wave detection device 100b and the gas 6 to be analyzed.

At position P1 of the THz wave detection device 100b, the stretchable rod 82 is in a contracted state, and the angle at which it faces the target gas 6 is θ1. On the other hand, at position P2 of the THz wave detection device 100b, the stretchable rod 82 is in an extended state, and the distance to the target gas 6 is shortened by the analysis distance difference l, and the angle at which it faces the target gas 6 is θ2. At this time, the distance Lg to the target gas 6
is given by equation (3).

FIG. 12 shows a THz wave detection device 100b according to the third embodiment, particularly a gas visualization application unit 7
35 is a flowchart showing the process flow of the method of the present invention.

The gas visualization application unit 735 starts up and performs initial settings (S10), then executes a THz wave control process (S1) and an analysis process S2. At this time, the expandable rod 82 is in a contracted state, and a first concentration image of the target gas 6 is generated (S34).

Next, the user extends the extendable rod 82 to change the measurement distance (S35), and again executes the THz wave control process (S1) and the analysis process S2.

Then, the visualization process unit 734 generates a second concentration image of the target gas 6 (S3
6).

The analysis process unit 733 calculates the above formula (3) to obtain the distance Lg to the gas (S3
7).

Then, the analysis process unit 733 recalculates the normalized concentrations R/S/Lg (S38).

The analysis process unit 733 records the normalized densities R/S/Lg (S24) and obtains a third density image (S39). S34 to S38 constitute a first extended process S4 of the analysis process S2.

The visualization process unit 734 generates the depth image 51 (S26), the graphic image 53 (S28), and the camera image 54 (S39), in addition to the third density image (S39).
29). Then, an image synthesis process (S30) is performed using the third density image and at least one of the depth image 51, the graphic image 53, and the camera image 54, and a synthesis/display image 55 is displayed (S31). If the repetition condition is satisfied (S32/Yes), the series of processes is repeated, and if the repetition condition is not satisfied (S32/No), the process ends.

As described above, according to the third embodiment, when normalizing the gas concentration, the distance Lg to the target gas is used instead of the reflection distance d to the background reflector, which makes it possible to more accurately indicate the degree of risk, etc., represented by the normalized gas concentration.

[Fourth embodiment]
The fourth embodiment will be described with reference to Figs. 13A to 15. Fig. 13A is a diagram for explaining a feature quantity representing a change in the concentration distribution of the target gas 6 over time. Fig. 13A shows the distribution of the target gas 6 in a two-dimensional region, and the point having the peak value of the concentration is used as a reference, and X+ and X
The density distribution is evaluated in four directions: the - axis, the Y+ and Y- axes, the V+ and V- axes, and the U+ and U- axes.

13B shows an example of a concentration distribution diagram. The concentration distribution diagram in FIG. 13B is an example of X+ and X- axes, and the point of the peak concentration value D0 is set as 0 point, and the concentration analysis values are D1, D2, ..., in the X+ direction.
This is a distribution diagram continuing in the X-direction with D-1, D-2, ....

S _** in FIG. 13B (** indicates an axial direction such as X+ or X-) is a value for evaluating the degree of spread of the concentration distribution diagram in FIG. 13A, and is calculated by the formula (4). The evaluation of spread is X
This is performed for each of X+ and X-.

FIG. 13B shows the coordinate values having the density peak value, the peak density value, the spread evaluation values S _x− , S _x
+ , S _Y- , S _Y+ , S _U- , S _U+ , S _V- , and S _V+ at the current time t1 and the values at the previous time t0. The right column shows the calculated evaluation value of the change in gas concentration distribution spread over time.

14 shows a composite display image 553 displayed in this embodiment. A graphic image for making the distribution spread easier to see is superimposed on the composite display image 55 (see FIG. 6) in the first embodiment. The composite display image 553 is a graphic image in which G10, G11, G12, and G13 are superimposed. G10 is a change in the concentration peak coordinates (R, φ), G11 and G12 are
is a value obtained by selecting the evaluation values of the time changes of S _X− to S _V+ that have the largest changes,
The arrows are of a size that corresponds to the evaluation value. The time-dependent change in the spread of these gases is used to predict dangerous areas, and G13 advises the evacuation direction.

15 is a flowchart showing a process flow of the gas visualization application unit 735 according to the fourth embodiment. The gas visualization application unit 735 starts up and performs initial settings (S10), and then executes a THz wave control process S1 and an analysis process S2.

The gas visualization application unit 735 reads out the recorded concentration data (S40) and detects the point where the concentration reaches a peak value (S41). When there are multiple gases to be analyzed, the gas visualization application unit 735 performs the process for each of them.

Next, the gas visualization application unit 735 calculates evaluation parameters such as the spread of the distribution (S42
), and record (S43).

The gas visualization application unit 735 reads out evaluation parameters such as the spread of distribution at the previous time (
The gas visualization application unit 735 calculates the time variation of the parameter (S44), and calculates the time variation of the parameter (S45).
Evaluation parameters with significant time changes are selected (S46).

The gas visualization application unit 735 detects the exits and obstacles of the evacuation route from the background image (S47
), and determine a recommended evacuation direction (S48). S40 to S49 constitute a second extended analysis process S5 of analysis process S2.

The gas visualization application unit 735 displays the significant evaluation parameters and the evacuation direction in the display process S3.
(S49).

The gas visualization application unit 735 generates the composite/display image 553 shown in Fig. 14 and displays it on the display 141 (S3). Then, in S32, it is determined whether to continue and the process ends.

As described above, according to the fourth embodiment, it is possible to calculate an evaluation value corresponding to the change over time in gas concentration distribution, predict the change over time in a dangerous area, and present instructions such as effective evacuation routes in a composite image.

[Fifth embodiment]
The fifth embodiment will be described with reference to Fig. 16 and Fig. 17. Fig. 16A is a front view of a THz wave detection device 100c according to the fifth embodiment. Fig. 16B is a front view of a THz wave detection device 100c according to the fifth embodiment.
FIG. 1 is a side cross-sectional view of the z-wave detection device 100c.

In FIG. 16A, the THz wave detection device 100c includes a housing cover 41 so as to cover the controller 7.
0 and equipped with a THz wave transmitter/receiver 1a. The THz wave detection device 100c analyzes the user's odor and other characteristics while photographing the user with the front camera 143. For example, it detects the components of fragrances contained in laundry softeners, helping the user to be considerate so as not to bother those around them.

The THz wave detection device 100c includes a touch panel display 45a. A person is displayed on the touch panel display 45a, and a mark G14 is superimposed on the person. The shape of the mark G14 corresponds to the cause of the odor registered in advance, and the strength of the odor is indicated by the number of horizontal bars G15 at the top of the screen.

17 is a flowchart showing a process flow of the gas visualization application unit 735 in the fifth embodiment. After being started, the gas visualization application unit 735 performs initial setting (S10), and then executes a THz wave control process S1 and an analysis process S2.

The gas visualization application unit 735 recognizes a person area from the camera image received from S29 (
The gas visualization application unit 735 uses the density image to create a graphic image (S28), and creates the mark G14 shown in Fig. 16A and the like (S29).

The gas visualization application unit 735 performs image synthesis processing to generate a synthesis/display image 554 (
S30), and the composite/display image 554 is displayed on the touch panel display 45a (S3
1). Then, in S32, it is determined whether to continue and the process ends.

As described above, according to the fifth embodiment, the camera unit of a smartphone or the like for taking self-portraits can be utilized to easily analyze the odor, etc., of the photographer himself/herself.

The present invention is not limited to the embodiments described with reference to Fig. 1 to Fig. 17, and it is possible to replace a part of the configuration of one embodiment with another embodiment. It is also possible to add the configuration of another embodiment to the configuration of one embodiment. All of these belong to the scope of the present invention, and furthermore, the numerical values, messages, etc. appearing in the text and figures are merely examples, and the use of different ones does not impair the effects of the present invention.

The functions of the present invention may be implemented in hardware, partly or in whole, by designing them as an integrated circuit, for example. They may also be implemented in software by a microprocessor unit, CPU, etc. interpreting and executing an operating program. Furthermore, the scope of software implementation is not limited, and hardware and software may be used together.

In the above embodiment, the detection object is the gas 6 to be analyzed, and the background reflectors are the scenery in the real space in which the gas 6 to be analyzed floats, for example, structures inside a vehicle, a room, etc. However, the THz wave detection device 100 may be used as an inspection device at the time of product shipment. In that case, the product may be the background reflector,
The object to be detected may be a foreign object in the product, for example, a foreign object mixed in food.
It may be used to check for foreign objects in non-food items such as tires. It may also be used as a pharmaceutical shipping inspection device to inspect the coating of multi-layered medicines. It may also be used to identify the contents of plastic bottles at baggage inspection points at airports, or to identify the contents of suitcases without opening them.

1: THz wave transmitter/receiver 2: Analysis section 3: Camera 4: Visualization section 5: Background reflector 6: Gas to be analyzed 7: Controller 10: Smartphone 11: Transmitter 12: Receiver 13: Transmission control section 14: Antenna 15a: Transmission wave 15b: Reflected terahertz wave 45a: Display with touch panel

Claims (11)

a terahertz wave transmitter/receiver including a transmitter that transmits a terahertz wave and a receiver that receives a reflected terahertz wave reflected by a reflecting object present behind an object onto which the terahertz wave is irradiated;
A camera and
A display and
an information processing device including the terahertz wave transceiver, the camera, and the display;
The transmitter irradiates a terahertz wave based on a transmission signal swept over a frequency range including a specific frequency,
The information processing device includes:
An analysis process for analyzing the received terahertz waves;
a display image generating process for generating a display image for superimposing an image based on the analysis result on an image captured by the camera based on the analysis result of the analysis process, and displaying the display image on the display;
In the analysis process ,
a distance calculation process for calculating a distance from the terahertz wave transceiver to the reflecting object ;
a distribution calculation process for calculating a movement of the distribution of the object based on the intensity of the terahertz wave emitted from the transmitter , the attenuation of the received terahertz wave relative to the terahertz wave irradiated from the transmitter, and the distance;
Run
In the display image generation process,
generating a display image according to the movement of the distribution in accordance with the background of the image captured by the camera, and displaying the display image on the display by superimposing the display image on the background image;
A terahertz wave detection device. 2. The terahertz wave detection device according to claim 1,
In the display image generation process,
A depth image generating process is further performed to generate a depth image in which a display mode is changed according to the distance;
using the depth image as the background image, and superimposing a display image corresponding to the movement of the distribution on the depth image and displaying the superimposed image on the display;
A terahertz wave detection device. 2. The terahertz wave detection device according to claim 1,
In the display image generation process, an image captured by the camera is used as the background image, and a display image corresponding to the movement of the distribution is superimposed on the image captured by the camera and displayed on the display.
A terahertz wave detection device. 2. The terahertz wave detection device according to claim 1,
In the distribution calculation process, when a signal intensity of a flat portion where there is no absorption by the object is R, a signal intensity of a frequency attenuated due to the object absorbing the terahertz wave is S, and the distance is d, the distribution of the object is calculated by the following formula (1), and a movement of the distribution is calculated based on information about the calculated distribution:
Distribution of objects = R / S / d (1)
A terahertz wave detection device. 2. The terahertz wave detection device according to claim 1,
the object is an invisible gas,
the display image according to the shift in distribution is an image illustrating the shift in distribution of the gas;
an image illustrating the movement of the gas distribution is superimposed on the background image and displayed on the display;
A terahertz wave detection device. 2. The terahertz wave detection device according to claim 1,
the terahertz wave detection device is attached to a support base that supports the terahertz wave detection device, and an extension device including an extension rod connected to the support base;
The object is measured a plurality of times by the terahertz wave detection device while varying the amount of expansion and contraction of the expansion rod;
In the distribution calculation process, maximum angles θ1 and θ2 when the width direction end of the object is measured from the terahertz wave detection device in each measurement are calculated, and an analysis distance difference resulting from the difference in the amount of expansion and contraction between the multiple measurements is set to 1. A distance Lg from the terahertz wave detection device to the object is calculated by the following formula (2):
When the signal intensity of a flat portion where there is no absorption by the object is R, the signal intensity of a frequency attenuated due to the object absorbing the terahertz wave is S, and the distance Lg is Lg, the distribution of the object is calculated by the following formula (3), and a shift of the distribution is calculated based on information about the calculated distribution.
Lg=ltanθ1/(tanθ2-tanθ1)...(2)
Distribution of objects = R / S / Lg (3)
A terahertz wave detection device. 2. The terahertz wave detection device according to claim 1,
In the display image generation process,
acquiring information about a shift in distribution of the object along a plurality of axes, determining an evaluation parameter corresponding to the shift in distribution, and generating graphic image data showing a time series change in the evaluation parameter as a display image corresponding to the shift in distribution;
the graphic image data is displayed on the display in a superimposed manner on the background image;
A terahertz wave detection device. 8. The terahertz wave detection device according to claim 7,
In the display image generation process,
Further generating a graphic image showing a path moving in a direction different from the direction of change of the distribution movement based on the time series change of the evaluation parameter;
a graphic image showing the route is further superimposed on the background image and displayed on the display;
A terahertz wave detection device. 4. The terahertz wave detection device according to claim 3,
The target substance is an odor component,
In the analysis process, an odor component is identified based on the reflected terahertz wave,
The display image generating process generates a graphic image showing the type of the identified odor component,
A region in the image captured by the camera that represents the real space in which the odor component is detected is identified, and a graphic image showing the type of the identified odor component is superimposed on the identified region of the background image and displayed on the display.
A terahertz wave detection device. A step of irradiating a two-dimensional area including an object with terahertz waves based on a transmission signal including a specific frequency;
acquiring an image of a background captured by a camera;
receiving a reflected terahertz wave reflected by a reflecting object present behind the object ;
analyzing the received reflected terahertz wave;
generating a display image based on an analysis result based on the analysis result in the step of analyzing the reflected terahertz wave;
and displaying the display image on a display by superimposing the display image on an image of the background captured by the camera,
the terahertz wave is a terahertz wave based on a transmission signal whose frequency is swept,
In the step of analyzing the received reflected terahertz wave ,
Calculating a distance from a transmitter /receiver of the terahertz wave to the reflecting object;
Calculating a movement of the distribution of the objects based on the intensity of the terahertz waves, the attenuation of the reflected terahertz waves relative to the terahertz waves, and the distance;
In the step of generating a display image based on the analysis result,
generating a display image according to the movement of the distribution in accordance with the background of the image captured by the camera;
A terahertz wave detection method comprising: a transmitter that transmits terahertz waves and a receiver that receives terahertz waves reflected by a reflecting object present behind an object onto which the terahertz waves are irradiated;
An information processing device having a camera and a display,
The terahertz wave transmitter/receiver emits terahertz waves based on a transmission signal swept over a frequency range including a specific frequency;
The information processing device includes:
an analysis process for analyzing the received reflected terahertz wave;
a display image generating process for generating a display image by superimposing an image based on the analysis result on the image captured by the camera based on the analysis result of the analysis process, and outputting the display to the display;
In the analysis process ,
a distance calculation process for calculating a distance from the terahertz wave transceiver to the reflecting object;
a distribution calculation process for calculating a movement of the distribution of the object based on the intensity of the terahertz wave emitted from the transmitter, the attenuation of the received terahertz wave relative to the terahertz wave irradiated from the transmitter, and the distance;
Run
In the display image generation process,
a display image corresponding to the movement of the distribution is generated in accordance with the background of the image captured by the camera, and the display image is superimposed on the background image and displayed on the display;
23. An information processing apparatus comprising:

Images