Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
JP6139982B2 - Fire detection device and fire detection method - Google Patents
[go: Go Back, main page]

JP6139982B2 - Fire detection device and fire detection method - Google Patents

Fire detection device and fire detection method Download PDF

Info

Publication number
JP6139982B2
JP6139982B2 JP2013109465A JP2013109465A JP6139982B2 JP 6139982 B2 JP6139982 B2 JP 6139982B2 JP 2013109465 A JP2013109465 A JP 2013109465A JP 2013109465 A JP2013109465 A JP 2013109465A JP 6139982 B2 JP6139982 B2 JP 6139982B2
Authority
JP
Japan
Prior art keywords
ridge line
area
smoke
image
series change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2013109465A
Other languages
Japanese (ja)
Other versions
JP2014229156A (en
Inventor
門馬 英一郎
英一郎 門馬
小野 隆
隆 小野
弘道 江幡
弘道 江幡
敦 万本
敦 万本
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hochiki Corp
Original Assignee
Hochiki Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hochiki Corp filed Critical Hochiki Corp
Priority to JP2013109465A priority Critical patent/JP6139982B2/en
Publication of JP2014229156A publication Critical patent/JP2014229156A/en
Application granted granted Critical
Publication of JP6139982B2 publication Critical patent/JP6139982B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Image Analysis (AREA)
  • Fire-Detection Mechanisms (AREA)
  • Fire Alarms (AREA)

Description

本発明は、監視カメラで撮像した監視領域の画像から火災による煙を検知する火災検知装置及び火災検知方法に関する。
The present invention relates to a fire detection device and a fire detection method for detecting smoke from a fire from an image of a monitoring area captured by a monitoring camera.

従来、監視カメラで撮像した監視領域の画像に対し画像処理を施すことにより、火災を検知するようにした様々な装置やシステムが提案されている。   Conventionally, various devices and systems have been proposed in which a fire is detected by performing image processing on an image of a monitoring area captured by a monitoring camera.

このような火災検知装置にあっては、火災発生に対する初期消火や避難誘導の観点から火災の早期発見が重要である。   In such a fire detection device, early detection of a fire is important from the viewpoint of initial extinguishing and evacuation guidance for the occurrence of a fire.

このため従来装置(特許文献1)にあっては、画像から火災に伴う煙により起きる現象として、透過率又はコントラストの低下、輝度値の特定値への収束、輝度分布範囲が狭まることによる輝度の分散の低下、煙による輝度の平均値の変化、エッジの総和量の低下、低周波帯域の強度増加を導出し、これらを総合的に判断して煙の検出を可能としている。   For this reason, in the conventional device (Patent Document 1), as a phenomenon caused by smoke from the fire from the image, the transmittance or contrast decreases, the luminance value converges to a specific value, and the luminance distribution range narrows. A decrease in dispersion, a change in the average value of luminance due to smoke, a decrease in the total amount of edges, and an increase in intensity in the low frequency band are derived, and these are comprehensively judged to enable smoke detection.

ところで、火災初期の段階で多い燻焼燃焼では、ごく微量の煙が立ち上がり、時間の経過と共に煙の量が増し、最終的には煙層が天井面に沿って発生し、従来の煙感知器は、天井面に発生した煙層を検知するようにしている。   By the way, in the smoldering combustion which is often in the early stage of fire, a very small amount of smoke rises, the amount of smoke increases with the passage of time, and finally a smoke layer is generated along the ceiling surface. Detects smoke layers generated on the ceiling.

このように、ごく微量の煙が立ち上がる火災初期の段階で火災を検知することが重要になるが、従来の画像に対し画像処理を施して煙を検知する装置にあっては、例えば立ち立ち上る煙の動き(流動)を検知するようにしているが、この流動検知のためには十分な量の煙が立ち昇る段階にならないと検知することが困難であり、細い筋のようになってごく微量の煙が立ち上がる火災の初期で検知することはできないという問題があった。   As described above, it is important to detect a fire at an early stage when a very small amount of smoke rises. However, in a conventional device for detecting smoke by performing image processing on an image, for example, rising smoke The movement (flow) is detected, but it is difficult to detect unless a sufficient amount of smoke rises to detect this flow, and it becomes a very small amount like a thin line. There was a problem that it could not be detected in the early stage of the fire where the smoke of the fire rose.

この問題を解決するため本願出願人にあっては、監視カメラにより撮像した監視領域の画像から、煙により発生する稜線の直線成分を抽出し、その傾きと発生頻度について時系列での変化を求め、煙による特徴的な変化を検知することで、火災の初期の段階で多い燻焼燃焼により発生するごく微量の煙の立ち上りを検知して火災を判断する火災検知装置を提案している(特願2013−101883)。
In order to solve this problem, the applicant of the present application extracts a linear component of a ridge line generated by smoke from an image of a monitoring area captured by a monitoring camera, and obtains a change in time series with respect to the inclination and the occurrence frequency. Has proposed a fire detection device that detects fires by detecting the very small amount of smoke rising due to smoldering combustion, which occurs frequently in the early stages of fire, by detecting characteristic changes caused by smoke. Application 2013-101883).

特開2008−046916号公報JP 2008-046916 A 特開平7−245757号公報JP-A-7-245757 特開2010−238028号公報JP 2010-238028 A

実際に起きる火災の状況は様々であり、燻焼火災とはならずに、急速に煙を発生する場合もあり、これに対する対応も必要となる。   The actual fire situations vary, and it may not be a smoldering fire, but smoke may be generated rapidly, and it is necessary to respond to this.

このような急速に発生する煙を画像処理により検知する方法として、従来、通常状態で撮像した監視領域の画像を所定画素サイズの領域に分割し、領域毎に空間微分処理して画素の空間微分値の総和(エッジ量)を求め、空間微分値の総和が最も大きい領域(輝度差の最も大きい領域)を検出領域に設定してその空間微分値の総和を基準値に定め、設定した検出領域の空間微分値の総和を検知して監視し、煙が発生した場合には空間微分値の総和が低下することから、検知した空間微分値の総和と基準値の比率をみることで、検出領域に入った物体が煙であるかの判定の目安としている。   As a method of detecting such rapidly generated smoke by image processing, conventionally, an image of a monitoring area captured in a normal state is divided into areas of a predetermined pixel size, and spatial differentiation of each pixel is performed by performing spatial differentiation processing for each area. The sum of the values (edge amount) is calculated, the region with the largest sum of the spatial differential values (the region with the largest luminance difference) is set as the detection region, the sum of the spatial differential values is set as the reference value, and the set detection region The sum of the spatial differential values is detected and monitored, and if smoke is generated, the sum of the spatial differential values decreases. It is used as a standard for determining whether the object that has entered is smoke.

しかしながら、空間微分値総和の比率から煙を判定する方法は、監視画像の中の輝度差が最大となる例えば窓ガラスを含んだ領域を検出領域に設定して空間微分総和の比率を検知しているが、監視画像の中で輝度差が最大となる領域の出現位置は監視領域により様々であり、しかも監視画像の中の火災による煙とは相関のない特定の位置に検出領域が設定される場合もあり、煙が監視領域全域に拡散したような状態にならないと、空間微分値総和の比率から煙が入ったことを判定できない問題がある。   However, the method of determining smoke from the ratio of the spatial differential sum is to detect the ratio of the spatial differential sum by setting, for example, an area including a window glass in which the luminance difference in the monitoring image is maximum. However, the appearance position of the area where the luminance difference is maximum in the monitoring image varies depending on the monitoring area, and the detection area is set at a specific position that does not correlate with fire smoke in the monitoring image. In some cases, there is a problem that it cannot be determined that smoke has entered from the ratio of the sum of the spatial differential values unless smoke is diffused over the entire monitoring area.

また、監視領域によっては、監視画像全体に均一な明るさで輝度差が少ない場合もあり、検出領域に設定した領域の空間微分値の総和(エッジ量)が最初から少なく、煙が入っても空間微分値総和の比率の変化が小さく、検出領域に入った物体が煙であるかそれ以外の要因かの判定がつかない場合もある。   Also, depending on the monitoring area, there may be a small brightness difference in the entire monitoring image with a uniform brightness, the total sum of the spatial differential values (edge amount) of the area set as the detection area is small from the beginning, even if smoke enters In some cases, the change of the ratio of the sum of the spatial differential values is small, and it may not be possible to determine whether the object that has entered the detection region is smoke or other factors.

本発明は、監視画面の定常的な背景が煙の発生により見えなくなるマスク現象から煙の発生を検知して火災を判断可能とする火災検知装置及び火災検知方法を提供することを目的とする。
An object of the present invention is to provide a fire detection device and a fire detection method that can detect a fire by detecting the generation of smoke from a mask phenomenon in which the stationary background of the monitoring screen is not visible due to the generation of smoke.

(装置)
本発明は、火災検知装置に於いて、
監視領域の画像を撮像する撮像手段と、
撮像手段で撮像した画像にエッジ強調処理を施して稜線を抽出する稜線抽出手段と、
稜線抽出手段で抽出した稜線の画像を複数の画像領域に分割し、画像領域毎に稜線の直線成分を抽出する直線成分抽出手段と、
画像領域毎に、直線成分抽出手段で抽出した直線成分の時系列での変化を検出する時系列変化検出手段と、
時系列検出手段で検出した直線成分の時系列変化が背景による特徴的な所定の時系列変化となる画像領域を背景稜線領域として抽出する背景稜線領域抽出手段と、
背景稜線抽出手段で抽出した背景稜線領域につき、時系列変化検出手段で検出した直線成分の時系列変化が消失した場合、当該背景稜線領域を煙候補領域と判断する煙候補判断手段と、
煙候補判断手段で検知した煙候補領域の分布に基づいて火災を判断する火災判断手段と、
を備えたことを特徴とする。
(apparatus)
The present invention provides a fire detection device,
An imaging means for capturing an image of the monitoring area;
Ridge line extraction means for performing edge enhancement processing on the image captured by the imaging means and extracting a ridge line;
A linear component extracting unit that divides the image of the ridge line extracted by the ridge line extracting unit into a plurality of image regions, and extracts a linear component of the ridge line for each image region;
For each image area, time-series change detecting means for detecting a change in time series of the linear component extracted by the linear component extracting means;
A background ridge line area extracting means for extracting, as a background ridge line area, an image area in which the time series change of the linear component detected by the time series detection means becomes a characteristic predetermined time series change due to the background;
For the background ridge line area extracted by the background ridge line extraction means, when the time series change of the linear component detected by the time series change detection means disappears, a smoke candidate determination means for determining the background ridge line area as a smoke candidate area;
A fire judgment means for judging a fire based on a distribution of smoke candidate areas detected by the smoke candidate judgment means;
It is provided with.

(直線成分の傾きと発生頻度)
直線成分抽出手段は、画像領域毎に直線成分の傾きと発生頻度を抽出し、
時系列変化検出手段は、抽出した直線成分の傾きと発生頻度の時系列変化を求め、
背景稜線領域抽出手段は、直線成分の傾きが一定で発生頻度も一定となる直線成分の時系列変化となる画像領域を背景稜線領域として抽出し、
煙候補判断手段は、時系列変化検出手段で検出した直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下となった場合に、当該背景稜線領域を煙候補領域と判断する。
(Linear component slope and frequency of occurrence)
The linear component extraction means extracts the slope and occurrence frequency of the linear component for each image area,
The time-series change detecting means obtains the time-series change of the slope and occurrence frequency of the extracted linear component,
The background ridge line area extraction means extracts an image area that is a time-series change of a linear component in which the slope of the straight line component is constant and the occurrence frequency is constant, as a background ridge line area,
The smoke candidate determination means determines that the background ridge line area is a smoke candidate area when the occurrence frequency of all the slopes in the time series change of the linear component detected by the time series change detection means is equal to or less than a preset value. To do.

(煙候補範囲の推定による火災判断)
火災判断手段は、少なくとも監視画面の最も右寄りで最上部、最も左よりで最上部、及び最下部横方向の略中央の3点の煙候補領域の分布を検知した場合、3点の煙候補領域を頂点とする領域を煙分布範囲と推定し、当該煙分布範囲の領域数が所定値以上の場合に火災を判断する。
煙候補判断手段は、抽出された全ての背景稜線領域について直線成分の時系列変化を監視する。
(Fire judgment by estimating smoke candidate range)
If the fire judging means detects a distribution of three smoke candidate areas at least on the most right side of the monitoring screen, the uppermost part from the left, the uppermost part from the left, and the substantially horizontal center of the lowermost part, the three smoke candidate areas A region having the apex at the top is estimated as the smoke distribution range, and a fire is determined when the number of the smoke distribution range is greater than or equal to a predetermined value.
The smoke candidate determination means monitors a time-series change of the linear component for all the extracted background ridge line regions.

(方法)
本発明は、火災検知方法に於いて、
撮像手段により監視領域の画像を撮像し、
撮像手段で撮像した画像に稜線抽出手段によりエッジ強調処理を施して稜線を抽出し、
稜線抽出手段で抽出した稜線の画像を複数の画像領域に分割し、直線成分抽出手段により画像領域毎に稜線の直線成分を抽出し、
画像領域毎に、直線成分抽出手段で抽出した直線成分の時系列での変化を時系列変化検出手段により検出し、
時系列検出手段で検出した直線成分の時系列変化が背景による特徴的な所定の時系列変化となる画像領域を背景稜線領域抽出手段により背景稜線領域として抽出し、
背景稜線抽出手段で抽出した背景稜線領域につき、時系列変化検出手段で検出した直線成分の時系列変化が消失した場合、煙候補判断手段により当該背景稜線領域を煙候補領域と判断し、
煙候補判断手段で検知した煙候補領域の分布に基づいて火災判断手段により火災を判断する、
ことを特徴とする。
(Method)
The present invention provides a fire detection method,
An image of the monitoring area is captured by the imaging means,
Edge enhancement processing is performed on the image captured by the image capturing unit by the ridge line extracting unit to extract the ridge line,
The image of the ridge line extracted by the ridge line extraction means is divided into a plurality of image areas, the linear component of the ridge line is extracted for each image area by the straight line component extraction means,
For each image area, a time-series change detecting unit detects a time-series change of the linear component extracted by the linear component extracting unit,
An image area in which the time-series change of the linear component detected by the time-series detection means becomes a characteristic predetermined time-series change due to the background is extracted as a background ridge line area by the background ridge line area extraction means,
For the background ridge line area extracted by the background ridge line extracting means, when the time series change of the linear component detected by the time series change detecting means disappears, the smoke candidate determining means determines the background ridge line area as a smoke candidate area,
Based on the distribution of the smoke candidate area detected by the smoke candidate judging means, the fire judging means judges the fire,
It is characterized by that.

なお、本発明の火災検知方法による他の特徴は、前述した火災検知装置の場合と基本的に同じになることから、その説明を省略する。
The other features of the fire detection method of the present invention are basically the same as those of the above-described fire detection device, and thus the description thereof is omitted.

(基本的な効果)
本発明の火災検知装置及び火災検知方法によれば、撮像手段で撮像した画像にエッジ強調処理を施して稜線を抽出した稜線画像を複数の画像領域に分割し、分割した画像領域毎に、稜線の直線成分を抽出して時系列での変化を検出し、直線成分の時系列変化が背景による特徴的な所定の時系列変化となる画像領域を背景稜線領域として抽出し、背景稜線領域につき、時系列変化検出手段で検出した直線成分の時系列変化が消失した場合、当該背景稜線領域を煙候補領域と判断し、煙候補領域の分布に基づいて火災を判断するようにしたため、監視画像から抽出された背景稜線を含む領域が全て背景稜線領域として監視領域となり、監視画像から抽出した稜線画像には多数の背景稜線が存在するため、監視領域全体に亘り多数の監視領域を分散配置して監視し、煙の発生により背景稜線領域の直線成分の時系列変化が消失したら、煙が入ったと推定して煙候補領域とし、更に、火災による煙は急速に上昇して天井側で広がることから、煙候補領域の分布をみることで、確実に火災を判断することを可能とする。
(Basic effect)
According to the fire detection device and the fire detection method of the present invention, an edge enhancement process is performed on an image captured by an imaging unit to extract a ridge line, and the ridge line image is divided into a plurality of image areas. Extracting the linear component of the time series to detect the change in time series, extracting the image area where the time series change of the linear component becomes a characteristic predetermined time series change due to the background as the background ridge line area, When the time-series change of the linear component detected by the time-series change detection means disappears, the background ridge line area is determined as the smoke candidate area, and the fire is determined based on the distribution of the smoke candidate area. All the areas including the extracted background ridgeline become the monitoring area as the background ridgeline area, and there are many background ridgelines in the ridgeline image extracted from the monitoring image. Therefore, many monitoring areas are distributed over the entire monitoring area. If the time series change of the linear component in the background ridge line area disappears due to the generation of smoke, it is assumed that smoke has entered and is designated as a smoke candidate area. Since it spreads, it is possible to judge a fire reliably by looking at the distribution of smoke candidate areas.

(稜線直線成分の傾きと発生頻度による効果)
また、稜線画像につき画像領域毎に直線成分の傾きと発生頻度を抽出しこの直線成分の傾きと発生頻度の時系列変化を求め、傾きが一定で発生頻度も一定となる背景の特徴的な直線成分の時系列変化となる画像領域を背景稜線領域として抽出し、直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下となった場合に、当該背景稜線領域を煙候補領域と判断するようにしたため、人の通過や照明の変化などで一時的に直線成分が消失しても、直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下とならない限り、煙候補領域とは判断せず、煙以外の要因による背景稜線のマスク現象(背景隠蔽現象)を誤って煙が入ったと判断せず、火災により急速に上昇して広がる煙を捕らえて火災を検知することを可能とする。
(Effects of slope and frequency of ridge line components)
In addition, the slope and occurrence frequency of the straight line component are extracted for each image area of the ridge line image, and the time series change of the slope and the occurrence frequency of the straight line component is obtained. The characteristic straight line of the background in which the slope is constant and the occurrence frequency is constant. When an image area that is a time-series change of the component is extracted as a background ridge line area, and the occurrence frequency of all the slopes in the time-series change of the linear component is less than or equal to a preset value, the background ridge line area is selected as a smoke candidate Since it is determined to be a region, even if the linear component disappears temporarily due to the passage of people or changes in lighting, the frequency of occurrence of all inclinations in the time-series change of the linear component does not fall below a preset value. As long as it is not judged as a smoke candidate area, it is not judged that the background ridge line masking phenomenon (background concealment phenomenon) due to factors other than smoke accidentally entered smoke, and the fire that catches and spreads smoke that rises rapidly due to the fire Detect To allow the door.

また、背景画像から空間微分値となる稜線を抽出し、続いて稜線の直線成分(傾きと発生頻度)を抽出し、更に、直線成分の時系列変化(傾き毎の発生頻度)を検出して背景稜線領域を特定しているため、輝度差が大きいことで空間微分値総和(エッジ量)が最大となる領域を検出してこの領域の空間微分値総和の比率に基づき煙の存在を判定する従来の手法に比べ、輝度差に直接依存することなく背景稜線が1本でも存在する領域であれば背景稜線領域として抽出し、このため背景稜線領域は監視画面の全体に亘って抽出され、監視画面のどの位置から煙の吹き上がった場合であっても、対応する背景稜線領域に煙が入った場合の変化から煙の存在(煙候補領域)を判定できる。
Also, a ridge line that is a spatial differential value is extracted from the background image, and then a straight line component (slope and occurrence frequency) of the ridge line is extracted, and further, a time series change ( occurrence frequency for each slope) of the linear component is detected. Since the background ridge line area is specified, the area where the spatial differential sum (edge amount) is maximized due to the large luminance difference is detected, and the presence of smoke is determined based on the ratio of the spatial differential sum of this area. Compared with the conventional method, if there is even one background ridgeline without directly depending on the luminance difference, it is extracted as a background ridgeline region. For this reason, the background ridgeline region is extracted over the entire monitoring screen. Regardless of the position where smoke blows from the screen, the presence of smoke (smoke candidate area) can be determined from the change when smoke enters the corresponding background edge area.

(煙候補範囲を推定した火災判断による効果)
火災による煙は急速に上昇した後、天井に当って広がることから、煙の発生により監視領域の中に複数の煙候補領域が出現した場合、少なくとも監視画面の最も右寄りで最上部、最も左よりで最上部、及び最下部横方向の略中央の3点の煙候補領域を頂点とする領域を煙分布範囲と推定し、当該煙分布範囲の領域数が所定値以上の場合に火災を判断することで、急速に上昇して広がっていく煙の分布を捕らえて確実に火災を検知することを可能とする。
(Effect of fire judgment that estimated smoke candidate range)
The smoke from the fire rises rapidly and then hits the ceiling, so if multiple smoke candidate areas appear in the monitoring area due to the occurrence of smoke, at least the uppermost and the leftmost part of the monitoring screen In the uppermost and lowermost lateral direction, the center of the three candidate smoke areas is estimated as the smoke distribution range, and a fire is judged when the number of areas in the smoke distribution range is greater than or equal to a predetermined value. This makes it possible to detect the fire reliably by capturing the smoke distribution that rises and spreads rapidly.

また、監視領域によっては、背景稜線が少ない場合があり、この場合には、背景稜線領域が離散的に存在し、煙が入った場合に煙候補領域となる領域も少なくなるが、少なくとも3点の煙候補領域が出現すれば煙分布範囲を推定することができ、白い壁面などを含む背景稜線が少ない監視領域であっても、確実に火災を検知可能とする。
Further, depending on the monitoring area, there may be few background ridge lines. In this case, the background ridge line areas exist discretely, and the area that becomes a smoke candidate area when smoke enters decreases, but at least three points If the smoke candidate area appears, the smoke distribution range can be estimated, and a fire can be reliably detected even in a monitoring area with a small background ridgeline including a white wall surface.

本発明の火災検知装置設置した監視領域を示した説明図Explanatory drawing which showed the monitoring area | region where the fire detection apparatus of this invention was installed 画像処理装置の機能構成の概略を示したブロック図Block diagram showing outline of functional configuration of image processing apparatus 画像の領域分割を示した説明図Explanatory diagram showing image segmentation 背景となる領域の直線成分の時系列変化を示した説明図Explanatory diagram showing the time-series change of the linear component of the background area 図4の直線成分の傾きと発生頻度を表したベクトルの時系列変化を示した説明図FIG. 4 is an explanatory diagram showing time-series changes of vectors representing the slope and occurrence frequency of the linear component in FIG. 背景となる他の領域の直線成分の時系列変化を示した説明図Explanatory drawing showing the time-series change of the linear component of other areas that are the background 図6の直線成分の傾きと発生頻度を表したベクトルの時系列変化を示した説明図Explanatory drawing which showed the time series change of the vector showing the inclination of linear component of FIG. 6, and the occurrence frequency 稜線画像から抽出した背景稜線領域の分布を示した説明図Explanatory drawing showing the distribution of the background ridge line area extracted from the ridge line image 火災により煙か噴き上げている稜線画像を示した説明図Explanatory drawing showing a ridgeline image of smoke or spout from fire 図9の煙による背景のマスクに対し判断した煙候補領域の分布を示した説明図Explanatory drawing which showed distribution of the smoke candidate area | region judged with respect to the background mask by the smoke of FIG. 図10の煙候補領域の分布から推定した煙分布範囲を決める逆三角形の頂点の抽出を示した説明図Explanatory drawing which showed extraction of the vertex of the inverted triangle which determines the smoke distribution range estimated from the distribution of the smoke candidate area | region of FIG. 図11の逆三角形により推定される煙分布範囲を示した説明図Explanatory drawing which showed the smoke distribution range estimated by the inverted triangle of FIG. 煙候補範囲を決める逆三角形とこれにより推定される煙分布範囲の時系列変化の例を示した説明図Explanatory diagram showing an example of the time series change of the smoke distribution range estimated by the inverted triangle that determines the smoke candidate range 図2の画像処理装置の動作を示したフローチャートFlowchart showing the operation of the image processing apparatus of FIG.

[火災検知装置の概要]
図1は本発明による火災検知装置を設置した監視領域を示した説明図であり、図1(A)は側面を示し、図1(B)は監視カメラから見た正面を示す。
[Outline of fire detection device]
FIG. 1 is an explanatory view showing a monitoring area where a fire detection device according to the present invention is installed. FIG. 1 (A) shows a side view, and FIG. 1 (B) shows a front view seen from a monitoring camera.

図1(A)に示すように、監視領域11には撮像手段として機能する監視カメラ10が設置され、図1(B)に示す監視領域の状態を撮像して画像を得ている。   As shown in FIG. 1A, a monitoring camera 10 functioning as an imaging unit is installed in the monitoring area 11, and an image is obtained by imaging the state of the monitoring area shown in FIG.

監視領域11には、例えばごみ入れ15、テレビ16、ソファ17、時計18などの備品が置かれており、また部屋の上下左右のコーナーや壁の縦方向や横方向に直線的な筋が現れている。   In the monitoring area 11, equipment such as a trash can 15, a television 16, a sofa 17, and a clock 18 are placed, and straight lines appear in the vertical and horizontal corners of the room and in the vertical and horizontal directions of the wall. ing.

監視カメラ10で撮像した画像は伝送路を介して管理人室などに設置した画像処理装置12に伝送され、画像処理によりごみ入れ15などの火源から吹き上げる煙を画像処理により検知して火災を判断し、火災検知信号を火災報知設備14に出力して火災警報を出力するようにしている。
An image captured by the monitoring camera 10 is transmitted to an image processing apparatus 12 installed in a manager's room or the like via a transmission path, and smoke blown from a fire source such as a garbage can 15 is detected by image processing to detect a fire. Judgment is made, and a fire detection signal is output to the fire alarm equipment 14 to output a fire alarm.

[検出原理]
本発明により煙を検知して火災を判断する原理を説明すると次のようになる。図1に示すように、監視領域11を監視カメラ10で撮像した場合、撮影した画像には多種多様な背景画像が現れており、火災による煙が吹き上げて拡散した場合、煙により背景がマスクされて見えなくなることから、煙による背景のマスク現象に基づき煙の存在を捉えて火災を判断する。
[Detection principle]
The principle of detecting smoke by detecting smoke according to the present invention will be described as follows. As shown in FIG. 1, when the surveillance area 11 is imaged by the surveillance camera 10, a variety of background images appear in the captured image. When smoke from a fire blows up and diffuses, the background is masked by the smoke. The fire is judged based on the presence of smoke based on the background mask phenomenon caused by smoke.

煙によりマスクされて消失する背景を特定するため、本発明にあっては、監視カメラ10で撮像した画像にエッジ強調処理を施して稜線を抽出して稜線画像を生成し、この稜線画像を複数の画像領域に分割して画像領域毎に稜線の直線成分を抽出し、更に、抽出した直線成分の時系列での変化を検出し、検出した直線成分の時系列変化が背景による特徴的な所定の時系列変化となる画像領域を背景稜線領域として抽出して監視する。   In order to identify a background masked by smoke and disappearing, in the present invention, edge enhancement processing is performed on an image captured by the monitoring camera 10 to extract a ridgeline, and a ridgeline image is generated. The straight line component of the edge line is extracted for each image area, the change of the extracted straight line component in the time series is detected, and the time series change of the detected straight line component is characteristically determined by the background. The image area that changes in time series is extracted as a background ridge line area and monitored.

背景稜線領域は、煙により背景がマスクされた場合、直線成分の時系列変化が消失することから、これを検知して背景稜線領域を煙候補領域と判断し、更に、検知した煙候補領域の分布に基づいて火災を判断する。   When the background is masked by smoke, the background ridge line area disappears from the time-series change of the linear component, so this is detected and the background ridge line area is determined as the smoke candidate area. Determine fire based on distribution.

画像領域毎に抽出される稜線の直線成分は、その傾きと発生頻度であり、固定的に存在する背景稜線の直線成分は、傾きが一定で発生頻度も一定となることから、背景稜線直線成分に固有な時系列変化(傾き毎の発生頻度)となる画像領域を背景稜線領域として抽出する。そして、煙により背景画像がマスクされて見え難くなくなると、これに対応した背景稜線領域について検出している直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下となることから、この背景稜線領域を煙候補領域と判断する。
The straight line component of the ridge line extracted for each image area is its slope and frequency of occurrence, and the straight line component of the background ridge line that exists fixedly has a constant slope and constant frequency of occurrence. An image area having a time-series change ( frequency of occurrence for each inclination) inherent to the image is extracted as a background ridge line area. When the background image is masked by smoke and becomes difficult to see, the frequency of occurrence of all inclinations in the time-series change of the linear component detected for the background ridge line region corresponding to the background image becomes less than a preset value. Therefore, the background ridge line area is determined as the smoke candidate area.

また、火災による煙は火源から吹き上げて天井側で横に広がることから、複数の煙候補領域を判断した場合に、少なくとも監視画面の最も右寄りで最上部、最も左よりで最上部、及び最下部横方向の略中央の3点の煙候補領域の分布を検知し、この3点の煙候補領域を頂点とする領域を煙分布範囲と推定し、当該煙分布範囲の領域数が所定値以上の場合に火災を判断する。これにより煙を監視する背景稜線領域が極端に少ない場合であっても、少なくとも3点以上存在することで、煙分布補範囲を推定して火災を判断可能とする。   In addition, since smoke from a fire blows up from the fire source and spreads sideways on the ceiling side, when multiple smoke candidate areas are judged, at least the uppermost part on the right side of the monitoring screen, the uppermost part on the left side, and the uppermost part. Detects the distribution of three smoke candidate areas at the center in the lower horizontal direction, estimates the area having the three smoke candidate areas as apexes as the smoke distribution area, and the number of areas in the smoke distribution area exceeds a predetermined value In case of a fire is judged. As a result, even if the background ridge line region for monitoring smoke is extremely small, the presence of at least three or more points makes it possible to estimate the smoke distribution supplementary range and determine fire.

また3点の煙候補領域を頂点とする煙分布範囲と推定した時系列変化から、監視領域における煙の拡散の様子を捉えて火災と判断することを可能とする。   Further, it is possible to determine a fire by capturing the state of smoke diffusion in the monitoring area from a time series change estimated as a smoke distribution range having three smoke candidate areas as apexes.

一方、煙以外の要因、例えば無地の洋服などを着た人の移動による背景のマスク現象については、一時的なマスク現象であれば、稜線直線成分の傾きと発生頻度が減少又は零となっても、再び元の傾きと発生頻度に回復し、煙候補領域としての抽出が継続しないため、火災を誤って判断することはない。
On the other hand, with respect to factors other than smoke, for example, the background mask phenomenon caused by the movement of people wearing plain clothes etc., if the mask phenomenon is temporary, the slope and frequency of the ridge line component will decrease or become zero. However, since the original inclination and frequency of occurrence are restored again and extraction as a smoke candidate area is not continued, a fire is not erroneously determined.

[火災検知装置]
(火災検知装置の機能構成)
図3は本発明による火災検知装置の機能構成の概略を示したブロック図である。図3に示すように、火災検知装置は、監視カメラ10と画像処理装置12で構成され、画像処理装置12は、そのハードウェアとしてCPU、メモリ、各種の入出力ポート等を備えたコンピュータ回路等で構成される。
[Fire detection device]
(Functional configuration of fire detection device)
FIG. 3 is a block diagram schematically showing the functional configuration of the fire detection device according to the present invention. As shown in FIG. 3, the fire detection apparatus includes a monitoring camera 10 and an image processing apparatus 12. The image processing apparatus 12 includes a computer circuit having a CPU, a memory, various input / output ports and the like as hardware. Consists of.

画像処理装置12は、CPUによるプログラムの実行により実現される機能として、稜線抽出手段として機能する稜線抽出部32、直線成分抽出手段として機能する直線成分抽出部34、時系列変化検出手段として機能する時系列変化検出部36、背景稜線領域抽出手段として機能する背景稜線領域抽出部38、煙候補領域判断手段として機能する煙候補判断部40及び火災判断手段として機能する火災判断部42を設けている。また、伝送部30は監視カメラ10で撮像した画像データを受信する適宜の伝送インタフェースが使用される。   The image processing device 12 functions as a ridge line extraction unit 32 that functions as a ridge line extraction unit, a linear component extraction unit 34 that functions as a linear component extraction unit, and a time-series change detection unit as functions realized by execution of a program by the CPU. A time series change detection unit 36, a background ridge line region extraction unit 38 that functions as a background ridge line region extraction unit, a smoke candidate determination unit 40 that functions as a smoke candidate region determination unit, and a fire determination unit 42 that functions as a fire determination unit are provided. . The transmission unit 30 uses an appropriate transmission interface that receives image data captured by the monitoring camera 10.

撮像手段として機能する監視カメラ10は、伝送部30の伝送制御により動画像データとして、例えば毎秒30フレームとなる監視領域の画像データを伝送し、画像処理装置12に設けた図示しないメモリに記憶する。   The monitoring camera 10 functioning as an imaging unit transmits image data of a monitoring area, for example, 30 frames per second as moving image data by transmission control of the transmission unit 30 and stores it in a memory (not shown) provided in the image processing device 12. .

稜線抽出部32は、メモリに記憶したフレーム単位の画像から稜線を抽出して稜線画像を生成する。例えばこの場合、稜線抽出部32は画像に対しエッジ強調処理の1つであるゾーベルフィルタ(Sobel Filter)を適用し、例えば図3の稜線画像20に示すように、ごみ入れ稜線15a、テレビ稜線16a、ソファ稜線17a、時計稜線18aを含む稜線を抽出して稜線画像とする。なお、稜線抽出部32による稜線抽出処理は、全フレーム画像を対象とせず、処理速度の関係で所定フレーム数を間引きしたフレーム毎に行うようにしても良い。   The ridge line extraction unit 32 generates a ridge line image by extracting a ridge line from an image in frame units stored in the memory. For example, in this case, the ridge line extraction unit 32 applies a Sobel filter, which is one of the edge enhancement processes, to the image. For example, as shown in the ridge line image 20 in FIG. The ridge line including 16a, the sofa ridge line 17a, and the clock ridge line 18a is extracted to form a ridge line image. Note that the ridge line extraction processing by the ridge line extraction unit 32 may be performed for each frame in which a predetermined number of frames are thinned out because of the processing speed, without targeting all frame images.

ゾーベルフィルタは、ある注目画素を中心とした上限左右の9つの画素値に対し、水平方向と垂直方向の2つの係数行列による所定の係数を乗算して総和を求めることで、画像中に存在するある領域の境界(エッジ)を検出可能とする微分処理であり、これを適用して、稜線抽出部32は図に示すように画像から稜線を抽出する。
The Sobel filter is present in the image by multiplying the nine pixel values at the upper left and right with a certain target pixel as the center by multiplying a predetermined coefficient by two coefficient matrices in the horizontal and vertical directions to obtain the sum. a differentiation process that allows detecting the boundary of the region (edges) in which, by applying this ridge extraction unit 32 as shown in FIG. 3, extracts a ridge line from the image.

直線成分抽出部34は、稜線抽出部32で抽出し稜線画像20を図3の点線で示すように、複数の領域、例えば64×64画素の領域に分割し、領域毎に例えばハフ変換(Hough変換)を施して稜線の直線成分を抽出する。ハフ変換は画像中の直線線分を抽出する方法として知られており、画像中のn個の点に対し、ρ―θ平面上ではn個の曲線が得られ、この内、m個の曲線が1点で交わっていれば、このm個の点に対応する画像上のm個の点は同一直線上にあることとなり、これにより直線成分を抽出できる。   The straight line component extraction unit 34 divides the ridge line image 20 extracted by the ridge line extraction unit 32 into a plurality of regions, for example, 64 × 64 pixel regions, as shown by dotted lines in FIG. 3, for example, Hough transform (Hough transform) for each region. (Conversion) to extract the linear component of the ridgeline. The Hough transform is known as a method for extracting a straight line segment in an image. For n points in the image, n curves are obtained on the ρ-θ plane. Of these, m curves are obtained. Are intersected at one point, m points on the image corresponding to the m points are on the same straight line, and thereby a linear component can be extracted.

時系列変化検出部36は、直線成分抽出部34によるハフ変換で抽出した直線成分の傾きと発生頻度の時系列変化(傾き毎の発生頻度)を求める。この場合、時系列変化検出部36は、直線成分抽出部34で抽出した直線成分の傾きと発生頻度をメモリに所定回数分、先入れ先出し(ファーストイン・ファーストアウト)で順次格納しながら、直線成分の傾きとその発生頻度を時系列変化として求める処理を繰り返す。
The time-series change detection unit 36 obtains a time-series change ( occurrence frequency for each inclination) of the slope and occurrence frequency of the straight line component extracted by the Hough transform by the straight line component extraction unit 34. In this case, the time-series change detecting unit 36 stores the inclination and occurrence frequency of the straight line component extracted by the straight line component extracting unit 34 in the memory a predetermined number of times in a first-in first-out (first-in first-out) manner. The process of obtaining the slope and its occurrence frequency as a time series change is repeated.

背景稜線領域抽出部38は、時系列変化検出部36で検出した直線成分の時系列変化の中から、背景稜線による特徴的な所定の時系列変化となる画像領域を背景稜線領域として抽出する。   The background ridge line area extraction unit 38 extracts, as a background ridge line area, an image area having a characteristic predetermined time series change due to the background ridge line from the time series change of the linear component detected by the time series change detection unit 36.

図4は図3の背景となる領域A11について、間引きフレームの4周期分の時刻t1〜t4で抽出した直線成分の時系列変化を示している。領域A11では背景に上下に4本の直線成分が定常的に存在しており、このため、時刻t1〜t4の全てで、領域A11に存在する直線成分は、上方をθ1=0°とすると発生頻度は4本となる。   FIG. 4 shows a time-series change of the straight line component extracted at times t1 to t4 for four cycles of the thinned frame in the area A11 as the background of FIG. In the area A11, four linear components are constantly present in the upper and lower parts in the background. Therefore, at all times t1 to t4, the linear components existing in the area A11 are generated when θ1 = 0 ° upward. The frequency is four.

図5は図4の領域A11の直線成分の時系列変化を示した説明図であり、直線成分を傾きθと発生頻度の長さを持つベクトルを累積して示している。   FIG. 5 is an explanatory diagram showing a time-series change of the linear component in the area A11 of FIG. 4, and the linear component is shown by accumulating vectors having a slope θ and the length of occurrence frequency.

図5に示すように、時刻1でベクトルB1は(θ1,1)となり、時刻t2〜t4では、その時系列変化に応じて一定の発生頻度=4により累積的に増加していく。   As shown in FIG. 5, the vector B1 becomes (θ1, 1) at time 1 and increases from time t2 to t4 in a cumulative manner with a constant occurrence frequency = 4 according to the time series change.

図6は図3の背景となる領域A12について、間引きフレームの4周期分の時刻t1〜t4で抽出した直線成分の時系列変化を示している。領域A12では背景に、縦方向に1本、横方向に6本の直線成分が定常的に存在しており、領域下辺の中央を原点とした二次元座標において、右側をθ5=+90°、左側をθ6=−90°、左斜め上方をθ7とすると、時刻t1〜t4の全てで、
θ1の発生頻度は1本
θ5の発生頻度は2本
θ6の発生頻度は2本
θ7の発生頻度は2本
となり、傾き及び発生頻度は変化せず、一定である。
FIG. 6 shows a time-series change of the straight line components extracted at times t1 to t4 for four cycles of the thinned frame in the area A12 as the background of FIG. In the area A12, one straight line component in the vertical direction and six straight line elements in the horizontal direction are constantly present in the background, and in the two-dimensional coordinates with the origin at the center of the lower side of the area, the right side is θ5 = + 90 ° and the left side Is θ6 = −90 ° and the diagonally upper left is θ7, at all times t1 to t4,
The frequency of occurrence of θ1 is one, the frequency of occurrence of θ5 is two, the frequency of occurrence of θ6 is two, the frequency of occurrence of θ7 is two, and the inclination and the frequency of occurrence are constant and constant.

図7は図6の領域A12の直線成分の時系列変化を示した説明図であり、直線成分を傾きθと発生頻度の長さを持つベクトルを累積して示している。   FIG. 7 is an explanatory diagram showing a time-series change of the linear component in the area A12 of FIG. 6, and shows the linear component accumulated by a vector having a slope θ and a length of occurrence frequency.

図7に示すように、時刻t1で
ベクトルB1は(θ1,1)
ベクトルB5は(θ5,2)
ベクトルB6は(θ6,2)
ベクトルB7は(θ7,2)
となり、時刻t2〜t4では、その時系列変化に応じて一定の発生頻度により累積的に増加していく。
As shown in FIG. 7, at time t1, the vector B1 is (θ1, 1).
Vector B5 is (θ5,2)
The vector B6 is (θ6, 2)
The vector B7 is (θ7,2)
From time t2 to time t4, it increases cumulatively at a constant frequency according to the time series change.

このように時系列変化検出部36により検知された背景稜線領域の直線成分の時系列変化は、図5及び図7の時刻t4に示したように、傾きが一定で発生頻度も一定の直線成分の時系列変化となる背景稜線に特徴的な定常パターンとなり、背景稜線領域抽出部38は背景稜線に特徴的な定常パターン(時系列変化)となる画像領域を背景稜線領域として抽出する。   Thus, the time-series change of the linear component of the background ridge line area detected by the time-series change detection unit 36 is a linear component with a constant slope and a constant frequency of occurrence as shown at time t4 in FIGS. The background ridge line area extraction unit 38 extracts an image area that is a steady pattern (time series change) characteristic of the background ridge line as a background ridge line area.

図8は、図3の稜線画像から抽出した背景稜線領域の分布を示した説明図であり、ハッチング領域で示すように、ごみ入れ稜線15a、テレビ稜線16a、ソファ稜線17a、時計稜線18a、部屋のコーナーの筋や壁の筋などを含む領域が背景稜線領域として抽出され、この背景稜線領域について煙による変化を監視する。これに対し背景稜線が存在しない領域は空白で示す空き領域となっており、監視領域から除外されている。   FIG. 8 is an explanatory diagram showing the distribution of the background ridge line area extracted from the ridge line image of FIG. 3, and as shown by the hatched area, the dust ridge line 15a, the TV ridge line 16a, the sofa ridge line 17a, the clock ridge line 18a, the room A region including a corner stripe and a wall stripe is extracted as a background ridge line area, and the background ridge line area is monitored for changes due to smoke. On the other hand, the area where the background ridge line does not exist is an empty area indicated by a blank, and is excluded from the monitoring area.

図2の煙候補判断部40は、図8に示した背景稜線領域につき、時系列変化検出部36で検出した直線成分の時系列変化が消失した場合、この背景稜線領域を煙候補領域と判断する。即ち、煙候補判断部40は、時系列変化検出部36で検出した直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下となった場合に、当該背景稜線領域を煙候補領域と判断する。
The smoke candidate determination unit 40 of FIG. 2 determines that the background ridge line region is a smoke candidate region when the time series change of the linear component detected by the time series change detection unit 36 disappears for the background ridge line region shown in FIG. To do. That is, when the frequency of occurrence of all inclinations in the time-series change of the linear component detected by the time-series change detection unit 36 is equal to or less than a preset value, the smoke candidate determination unit 40 smokes the background ridge line region. Judged as a candidate area.

図9はごみ入れ稜線15aとして示すごみ入れを火源として火災による煙24が噴き上げた場合の稜線画像20であり、煙24の存在により、それまで見えていた背景稜線がマスクされ、煙候補判断部40は煙24によりマスクされた背景稜線領域を煙候補領域と図10の黒塗りの領域に示すように判断し、煙候補範囲26を生成する。   FIG. 9 is a ridge line image 20 when the smoke 24 from the fire is spouted with the trash can shown as the trash can ridge line 15a as a fire source. The unit 40 determines the background edge line area masked by the smoke 24 as shown in the smoke candidate area and the black area in FIG. 10, and generates the smoke candidate area 26.

図2の火災判断部42は、煙候補判断部40で判断した図10の煙候補領域による煙領域範囲26の分布に基づいて火災を判断する。例えば、火災判断部42は、図10の煙候補範囲26を生成した画面において、最も左寄りで最上部の領域A1、最も右寄りで最上部の領域A2、及び最下部横方向の略中央の領域A3の3点の煙候補領域の分布を図11に示すように検知し、3点の煙候補領域A1〜A3を頂点とする略逆三角形の範囲に対応する複数の領域を、図12に示すように、煙分布範囲28と推定し、この煙分布範囲28の領域数が所定値以上の場合に火災を判断する。この場合、最小の逆三角形の範囲に対応する領域数は3領域であることから、火災判断部42は、例えば3領域以上となる所定の閾値領域の場合に火災と判断する。   The fire determination unit 42 in FIG. 2 determines a fire based on the distribution of the smoke region range 26 by the smoke candidate region in FIG. 10 determined by the smoke candidate determination unit 40. For example, the fire determination unit 42, on the screen where the smoke candidate range 26 of FIG. 10 is generated, is the leftmost and uppermost area A1, the rightmost and uppermost area A2, and the lowermost horizontal area A3. As shown in FIG. 12, the distribution of the three smoke candidate regions is detected as shown in FIG. 11, and a plurality of regions corresponding to a range of a substantially inverted triangle having the three smoke candidate regions A1 to A3 as vertices are shown in FIG. The smoke distribution range 28 is estimated, and a fire is determined when the number of areas of the smoke distribution range 28 is equal to or greater than a predetermined value. In this case, since the number of areas corresponding to the minimum inverted triangle range is 3, the fire determination unit 42 determines that there is a fire in the case of a predetermined threshold area that is, for example, 3 areas or more.

図13は、逆三角形を形成する3点の煙候補範囲とこれにより推定される煙分布範囲の時系列変化の例を示した説明図である。図13の時刻t1は煙が吹き上がり始めた場合であり、煙分布範囲を決める逆三角形は小さいが、時刻t2,t3に示すように、時間の経過に伴って煙分布範囲を決める逆三角形が上方に広がるように変化し、煙分布範囲が拡大して行くことになる。従って、図2の火災判断部42は、このような煙分布範囲が拡大していく時系列変化をみることで、より確実に火災を判断することが可能となる。   FIG. 13 is an explanatory diagram showing an example of a time-series change of the three smoke candidate ranges forming an inverted triangle and the smoke distribution range estimated thereby. Time t1 in FIG. 13 is a case where smoke starts to blow up, and the inverted triangle that determines the smoke distribution range is small, but as shown at times t2 and t3, the inverted triangle that determines the smoke distribution range with time elapses. It changes so that it spreads upward, and the smoke distribution range will expand. Therefore, the fire determination unit 42 in FIG. 2 can more reliably determine a fire by observing such a time-series change in which the smoke distribution range expands.

[火災判断動作]
図14は図4の画像処理装置による火災検知動作を示したフローチャートである。
[Fire judgment operation]
FIG. 14 is a flowchart showing a fire detection operation by the image processing apparatus of FIG.

図14において、画像処理装置12は、ステップS1(以下「ステップ」は省略)で監視カメラ10により動画画像として例えば30フレーム/秒で撮像した監視領域の画像を取得してメモリに記憶し、S2で稜線検出部32によるゾーベルフィルタの適用により画像から稜線を抽出する。
In FIG. 14, the image processing apparatus 12 acquires an image of a monitoring area captured at, for example, 30 frames / second as a moving image by the monitoring camera 10 in step S1 (hereinafter “step” is omitted), and stores the acquired image in a memory. Then, a ridge line is extracted from the image by applying a Sobel filter by the ridge line detection unit 32 .

続いてS3で直線成分抽出部34により稜線の画像を複数の領域に分割し、S4で領域毎にハフ変換を施して稜線の直線成分を抽出した後、S5に進んで時系列変化検出部36により、S3で抽出した直線成分の傾きと発生頻度による時系列変化を求め、S6で背景領域抽出部38により領域毎に直線成分の傾きと発生頻度の時系列変化の中から背景による特徴的な直線成分の傾きと発生頻度となる所定の時系列変化をもつ領域を背景稜線領域として抽出する。
Subsequently, in S3, the image of the ridge line is divided into a plurality of regions by the straight line component extraction unit 34, and the Hough transform is performed for each region in S4 to extract the straight line component of the ridge line. Then, the process proceeds to S5 and the time series change detection unit 36 To obtain a time-series change due to the slope and occurrence frequency of the straight line component extracted in S3, and in S6, the background region extraction unit 38 determines the characteristic of the background from the time-series change of the slope and occurrence frequency of the straight line component for each region. An area having a predetermined time-series change that becomes the inclination and occurrence frequency of the straight line component is extracted as a background ridge line area.

続いてS7で煙候補判断部40により背景稜線領域の中で背景稜線の消失を検知した領域を煙候補領域として抽出し、S8で火災判断部42により煙候補領域の分布から火災を判断し、その結果としてS9で火災を判断した場合はS10で火災検知信号を火災報知設備に出力して火災警報を出力させる。一方、S9で火災を検知しなかった場合は、S1に戻り、同様な処理を繰り返す。   Subsequently, in S7, the smoke candidate determination unit 40 extracts the area where the disappearance of the background ridge line is detected as the smoke candidate region, and in S8, the fire determination unit 42 determines the fire from the distribution of the smoke candidate region, As a result, when a fire is determined in S9, a fire detection signal is output to the fire alarm facility in S10 to output a fire alarm. On the other hand, if no fire is detected in S9, the process returns to S1 and the same processing is repeated.

〔本発明の変形例〕
(稜線抽出)
上記の実施形態にあっては、画像にゾーベルフィルタを適用して煙の稜線を抽出しているが、プレヴィットフィルタ(Prewitt Filter)等のエッジ強調処理に用いた適宜のフィルタを適用しても良い。
[Modification of the present invention]
(Ridge line extraction)
In the above embodiment, the sobel filter is applied to the image to extract the edge of the smoke, but an appropriate filter used for edge enhancement such as a Previtt filter is applied. Also good.

(直線成分抽出)
上記の実施形態にあっては、ハフ変換を適用して煙の稜線を抽出しているが、Line Segment Detector(LSD)等の画像から直線成分を抽出する処理方法を適用しても良い。
(Linear component extraction)
In the above embodiment, the smoke ridge line is extracted by applying the Hough transform. However, a processing method for extracting a linear component from an image such as Line Segment Detector (LSD) may be applied.

(画像処理装置)
上記の実施形態にあっては、監視カメラと画像処理装置を分離配置して伝送路により接続しているが、両者を一体化した装置としても良い。
(Image processing device)
In the above embodiment, the surveillance camera and the image processing apparatus are separately arranged and connected by a transmission path, but an apparatus in which both are integrated may be used.

また、本発明は上記の実施形態に限定されず、その目的と利点を損なうことのない適宜の変形を含み、更に上記の実施形態に示した数値による限定は受けない。
The present invention is not limited to the above-described embodiment, includes appropriate modifications without impairing the object and advantages thereof, and is not limited by the numerical values shown in the above-described embodiment.

10:監視カメラ
11:監視領域
12:画像処理装置
14:火災報知設備
15:ごみ入れ
16:テレビ
17:ソファ
18:時計
20:稜線画像
24:煙
26:煙候補範囲
28:煙分布範囲
30:伝送部
32:稜線抽出部
34:直線成分抽出部
36:時系列変化検出部
38:背景稜線領域抽出部
40:煙候補判断部
42:火災判断部
10: Surveillance camera 11: Monitoring area 12: Image processing device 14: Fire alarm equipment 15: Garbage bin 16: Television 17: Sofa 18: Clock 20: Edge image 24: Smoke 26: Smoke candidate range 28: Smoke distribution range 30: Transmission unit 32: ridge line extraction unit 34: straight line component extraction unit 36: time-series change detection unit 38: background ridge line region extraction unit 40: smoke candidate determination unit 42: fire determination unit

Claims (8)

監視領域の画像を撮像する撮像手段と、
前記撮像手段で撮像した画像にエッジ強調処理を施して稜線を抽出する稜線抽出手段と、
前記稜線抽出手段で抽出した稜線の画像を複数の画像領域に分割し、前記画像領域毎に稜線の直線成分を抽出する直線成分抽出手段と、
前記画像領域毎に、前記直線成分抽出手段で抽出した直線成分の時系列での変化を検出する時系列変化検出手段と、
前記時系列検出手段で検出した直線成分の時系列変化が背景による特徴的な所定の時系列変化となる画像領域を背景稜線領域として抽出する背景稜線領域抽出手段と、
前記背景稜線抽出手段で抽出した背景稜線領域につき、前記時系列変化検出手段で検出した直線成分の時系列変化が消失した場合、当該背景稜線領域を煙候補領域と判断する煙候補判断手段と、
前記煙候補判断手段で検知した煙候補領域の分布に基づいて火災を判断する火災判断手段と、
を備えたことを特徴とする火災検知装置。
An imaging means for capturing an image of the monitoring area;
A ridge line extracting unit that performs edge enhancement processing on the image captured by the imaging unit and extracts a ridge line;
A linear component extraction unit that divides the image of the ridge line extracted by the ridge line extraction unit into a plurality of image regions, and extracts a linear component of the ridge line for each image region;
Time-series change detecting means for detecting a change in time series of the linear component extracted by the linear component extracting means for each image region;
A background ridge line area extracting means for extracting, as a background ridge line area, an image area in which the time series change of the linear component detected by the time series detection means becomes a characteristic predetermined time series change due to the background;
For the background ridge line area extracted by the background ridge line extraction means, when the time series change of the linear component detected by the time series change detection means disappears, a smoke candidate determination means for determining the background ridge line area as a smoke candidate area;
Fire determination means for determining a fire based on the distribution of smoke candidate areas detected by the smoke candidate determination means;
A fire detection device comprising:
請求項1記載の火災検知装置に於いて、
前記直線成分抽出手段は、前記画像領域毎に直線成分の傾きと発生頻度を抽出し、
前記時系列変化検出手段は、抽出した直線成分の傾きと発生頻度の時系列変化を求め、
前記背景稜線領域抽出手段は、傾きが一定で発生頻度も一定となる直線成分の時系列変化となる画像領域を背景稜線領域として抽出し、
前記煙候補判断手段は、前記時系列変化検出手段で検出した直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下となった場合に、当該背景稜線領域を煙候補領域と判断する、
ことを特徴とする火災検知装置。
In the fire detection device according to claim 1,
The linear component extraction means extracts the slope and occurrence frequency of the linear component for each image area,
The time series change detection means obtains the time series change of the slope and occurrence frequency of the extracted linear component,
The background ridge line area extraction unit extracts an image area that is a time-series change of a linear component having a constant inclination and a constant occurrence frequency as a background ridge line area,
The smoke candidate determination means determines the background ridge line area as the smoke candidate area when the occurrence frequency of all the slopes in the time series change of the linear component detected by the time series change detection means is equal to or less than a preset value. To judge,
A fire detection device characterized by that.
請求項1記載の火災検知装置に於いて、
前記火災判断手段は、少なくとも監視画面の最も右寄りで最上部、最も左よりで最上部、及び最下部横方向の略中央の3点の煙候補領域の分布を検知した場合、前記3点の煙候補領域を頂点とする領域を煙分布範囲と推定し、当該煙分布範囲の領域数が所定値以上の場合に火災を判断することを特徴とする火災検知装置。
In the fire detection device according to claim 1,
If the fire determination means detects a distribution of at least three smoke candidate areas at the uppermost position on the rightmost side of the monitoring screen, the uppermost position from the leftmost position, and the approximate middle in the lowest horizontal direction, A fire detection device, wherein a region having a candidate region as a vertex is estimated as a smoke distribution range, and a fire is determined when the number of regions in the smoke distribution range is equal to or greater than a predetermined value.
請求項1記載の火災検知装置に於いて、In the fire detection device according to claim 1,
前記煙候補判断手段は、前記抽出された全ての背景稜線領域について前記直線成分の時系列変化を監視することを特徴とする火災検知装置。The smoke candidate judging means monitors a time-series change of the linear component for all the extracted background ridgeline regions.
撮像手段により監視領域の画像を撮像し、
前記撮像手段で撮像した画像に稜線抽出手段によりエッジ強調処理を施して稜線を抽出し、
前記稜線抽出手段で抽出した稜線の画像を複数の画像領域に分割し、直線成分抽出手段により前記画像領域毎に稜線の直線成分を抽出し、
前記画像領域毎に、前記直線成分抽出手段で抽出した直線成分の時系列での変化を時系列変化検出手段により検出し、
前記時系列検出手段で検出した直線成分の時系列変化が背景による特徴的な所定の時系列変化となる画像領域を背景稜線領域抽出手段により背景稜線領域として抽出し、
前記背景稜線抽出手段で抽出した背景稜線領域につき、前記時系列変化検出手段で検出した直線成分の時系列変化が消失した場合、煙候補判断手段により当該背景稜線領域を煙候補領域と判断し、
前記煙候補判断手段で検知した煙候補領域の分布に基づいて火災判断手段により火災を判断する、
ことを特徴とする火災検知方法。
An image of the monitoring area is captured by the imaging means,
The image picked up by the image pickup means is subjected to edge enhancement processing by a ridge line extraction means to extract a ridge line,
The image of the ridge line extracted by the ridge line extraction unit is divided into a plurality of image regions, and the linear component of the ridge line is extracted for each image region by the linear component extraction unit,
For each of the image areas, a time-series change detecting unit detects a change in the time-series of the linear component extracted by the linear component extracting unit,
An image region in which the time-series change of the straight line component detected by the time-series detection unit becomes a characteristic predetermined time-series change due to the background is extracted as a background ridge line region by the background ridge line region extraction unit,
For the background ridge line area extracted by the background ridge line extraction means, when the time series change of the linear component detected by the time series change detection means disappears, the smoke candidate determination means determines the background ridge line area as a smoke candidate area,
Determining a fire by the fire determination means based on the distribution of the smoke candidate area detected by the smoke candidate determination means;
A fire detection method characterized by that.
請求項記載の火災検知方法に於いて、
前記直線成分抽出手段は、前記画像領域毎に直線成分の傾きと発生頻度を抽出し、
前記時系列変化検出手段は、抽出した直線成分の傾きと発生頻度の時系列変化を検出し、
前記背景稜線領域抽出手段は、直線成分の傾きが一定で発生頻度も一定となる時系列変化の画像領域を背景稜線領域として抽出し、
前記煙候補判断手段は、前記時系列変化検出手段で検出した直線成分の時系列変化における全ての傾きの発生頻度が予め設定された値以下となった場合に、当該背景稜線領域を煙候補領域と判断する、
ことを特徴とする火災検知方法。
In the fire detection method according to claim 5 ,
The linear component extraction means extracts the slope and occurrence frequency of the linear component for each image area,
The time series change detecting means detects a time series change of the slope and occurrence frequency of the extracted linear component,
The background ridge line area extraction means extracts a time-series change image area in which the slope of the straight line component is constant and the occurrence frequency is constant, as a background ridge line area,
The smoke candidate determination means determines the background ridge line area as the smoke candidate area when the occurrence frequency of all the slopes in the time series change of the linear component detected by the time series change detection means is equal to or less than a preset value. To judge,
A fire detection method characterized by that.
請求項記載の火災検知方法に於いて、
前記火災判断手段は、少なくとも監視画面の最も右寄りで最上部、最も左よりで最上部、及び最下部横方向の略中央の3点の煙候補領域の分布を検知し、前記3点の煙候補領域を頂点とする略逆三角形の領域を煙分布範囲と推定し、当該煙分布範囲の領域数が所定値以上の場合に火災を判断することを特徴とする火災検知方法。
In the fire detection method according to claim 5 ,
The fire determination means detects a distribution of three smoke candidate areas at least on the most right side of the monitoring screen, on the uppermost part, on the farthest left and on the uppermost part, and at the substantially central part in the lowermost lateral direction. A fire detection method characterized by estimating a substantially inverted triangular area having an area as a vertex as a smoke distribution range, and determining a fire when the number of areas in the smoke distribution range is equal to or greater than a predetermined value.
請求項5記載の火災検知方法に於いて、In the fire detection method according to claim 5,
前記煙候補判断手段は、前記抽出された全ての背景稜線領域について前記直線成分の時系列変化を監視することを特徴とする火災検知方法。The smoke candidate judging means monitors a time-series change of the linear component for all the extracted background ridgeline regions.
JP2013109465A 2013-05-24 2013-05-24 Fire detection device and fire detection method Active JP6139982B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2013109465A JP6139982B2 (en) 2013-05-24 2013-05-24 Fire detection device and fire detection method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2013109465A JP6139982B2 (en) 2013-05-24 2013-05-24 Fire detection device and fire detection method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2017089312A Division JP2017168117A (en) 2017-04-28 2017-04-28 Fire detection device and fire detection method

Publications (2)

Publication Number Publication Date
JP2014229156A JP2014229156A (en) 2014-12-08
JP6139982B2 true JP6139982B2 (en) 2017-05-31

Family

ID=52128931

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2013109465A Active JP6139982B2 (en) 2013-05-24 2013-05-24 Fire detection device and fire detection method

Country Status (1)

Country Link
JP (1) JP6139982B2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104899895B (en) * 2015-05-19 2019-04-09 三峡大学 A method for detecting the complexity of moving target trajectory in transmission line channel fireworks video
JP2017168117A (en) * 2017-04-28 2017-09-21 ホーチキ株式会社 Fire detection device and fire detection method
CN109978896A (en) * 2019-04-04 2019-07-05 辽宁鼎汉奇辉电子系统工程有限公司 A kind of goods train carriage pyrotechnics monitoring method based on image processing techniques
KR102499401B1 (en) * 2020-11-11 2023-02-10 국방과학연구소 Device for analyzing explosives media propagation characteristic image, drone therefor and method thereof
CN116665136B (en) * 2023-07-31 2023-10-31 山东长兴塑料助剂股份有限公司 Chemical production safety risk real-time monitoring system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7769204B2 (en) * 2006-02-13 2010-08-03 George Privalov Smoke detection method and apparatus
TWI385602B (en) * 2008-10-17 2013-02-11 Ind Tech Res Inst Smoke detection method and system
JP5518359B2 (en) * 2009-03-31 2014-06-11 能美防災株式会社 Smoke detector
JP5261546B2 (en) * 2011-07-25 2013-08-14 能美防災株式会社 Smoke detector

Also Published As

Publication number Publication date
JP2014229156A (en) 2014-12-08

Similar Documents

Publication Publication Date Title
JP7395684B2 (en) Smoke detection device and smoke identification method
JP6139982B2 (en) Fire detection device and fire detection method
TWI543608B (en) Blocking detection method for camera and electronic apparatus with cameras
JP5701005B2 (en) Object detection apparatus, object detection method, surveillance camera system, and program
TWI508027B (en) Three dimensional detecting device and method for detecting images thereof
KR101840042B1 (en) Multi-Imaginary Fence Line Setting Method and Trespassing Sensing System
CN101916372A (en) Smoke detection device and method based on multi-feature fusion of video
KR101512658B1 (en) A device and method for detecting for fire flame using stereo camera and fuzzy logic
JP6231333B2 (en) Fire detection device and fire detection method
JP6139977B2 (en) Fire detection device and fire detection method
JP6096589B2 (en) Fire detection device and fire detection method
JP6664689B2 (en) Flame detector
TWI493510B (en) Falling down detection method
JP2017168117A (en) Fire detection device and fire detection method
JP2020126439A (en) Fire detection device and fire detection method
JP5015838B2 (en) Smoke detector
KR20110037486A (en) Intelligent video surveillance
JP6317490B2 (en) Fire detection device and fire detection method
JP2010218046A (en) Smoke detection device
JP6317073B2 (en) Fire detection device and fire detection method
CN101930541A (en) Video-based flame detection device and method
JP5215707B2 (en) Smoke detector
JP6124739B2 (en) Image sensor
JP5309069B2 (en) Smoke detector
CN111091024B (en) Small target filtering method and system based on video recognition result

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160217

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170125

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170125

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170321

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170405

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170428

R150 Certificate of patent or registration of utility model

Ref document number: 6139982

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150