Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
JP7078330B2 - Algae adhesion measuring device - Google Patents
[go: Go Back, main page]

JP7078330B2 - Algae adhesion measuring device - Google Patents

Algae adhesion measuring device Download PDF

Info

Publication number
JP7078330B2
JP7078330B2 JP2018045972A JP2018045972A JP7078330B2 JP 7078330 B2 JP7078330 B2 JP 7078330B2 JP 2018045972 A JP2018045972 A JP 2018045972A JP 2018045972 A JP2018045972 A JP 2018045972A JP 7078330 B2 JP7078330 B2 JP 7078330B2
Authority
JP
Japan
Prior art keywords
algae
value
amount
color
color tone
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2018045972A
Other languages
Japanese (ja)
Other versions
JP2019158618A (en
Inventor
正樹 本多
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central Research Institute of Electric Power Industry
Original Assignee
Central Research Institute of Electric Power Industry
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central Research Institute of Electric Power Industry filed Critical Central Research Institute of Electric Power Industry
Priority to JP2018045972A priority Critical patent/JP7078330B2/en
Publication of JP2019158618A publication Critical patent/JP2019158618A/en
Application granted granted Critical
Publication of JP7078330B2 publication Critical patent/JP7078330B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Image Analysis (AREA)

Description

本発明は、基材への藻類、例えば、珪藻、海藻の付着の状況を測定する藻類の付着測定装置に関する。 The present invention relates to an algae adhesion measuring device for measuring the state of adhesion of algae, for example, diatoms and seaweeds to a substrate.

海底の人工的な漁礁や、河川の底の石や人工漁礁には、魚介類の餌となる海藻や珪藻類(藻類)が付着している。漁礁の基材としては、例えば、産業施設の焼却灰を活用した基材が利用されている。魚類の餌となる海藻や珪藻類(藻類)の付着が有効に行われる技術が従来から種々提案されている(特許文献1参照)。特許文献1の技術では、焼却灰等を骨材として用い、藻類の胞子を埋設した構造体が提案されている。これにより、副産物を有効に活用した人工漁礁が得られる。 Seaweeds and diatoms (algae) that feed on fish and shellfish adhere to artificial reefs on the seabed and stones and artificial reefs on the bottom of rivers. As the base material of the fishing reef, for example, a base material utilizing incinerator ash of an industrial facility is used. Various techniques have been conventionally proposed for effectively adhering seaweeds and diatoms (algae) that feed fish (see Patent Document 1). In the technique of Patent Document 1, a structure in which incinerated ash or the like is used as an aggregate and algae spores are embedded is proposed. As a result, an artificial reef that makes effective use of by-products can be obtained.

人工的な漁礁に藻類がどの程度付着したかを把握することで、漁礁として機能しているか否かを判断することができる。また、河川の底の石に藻類がどのような状態で付着したかを把握することで、環境等の評価を行う場合の指標として用いることができる。 By grasping how much algae have adhered to the artificial reef, it is possible to judge whether or not it is functioning as a reef. In addition, by grasping the state of algae adhering to the stones at the bottom of the river, it can be used as an index when evaluating the environment and the like.

藻類の付着状況の検出は、一般的に、基材に付着した藻類を、直接、または、間接的に採取し、採取したサンプルに基づいて付着量等を求めているのが現状である。このため、実際の漁礁や石等の基材に付着した藻類の一部を剥がし、漁礁としての機能や餌が付着した石としての機能の一部を破壊する必要があった。 In the current situation, the detection of the algae adhesion state is generally performed by directly or indirectly collecting the algae adhering to the substrate and determining the amount of the algae attached based on the collected sample. For this reason, it was necessary to peel off a part of the algae attached to the base material such as an actual fishing reef or stone, and to destroy a part of the function as a fishing reef or the function as a stone to which bait was attached.

実際の漁礁を用いずに、実験的に漁礁を構築することも考えられるが、実験的に漁礁を構築して藻類を剥がして付着量等を求める場合、海中や河川の中の実際の環境での付着状況の結果を得ることが困難であり、付着状況を正確に把握することができないのが実情であった。 It is conceivable to construct a fishing reef experimentally without using an actual fishing reef, but when constructing a fishing reef experimentally and removing algae to determine the amount of adhesion, etc., in the actual environment in the sea or river. It was difficult to obtain the result of the adhesion status of, and it was not possible to accurately grasp the adhesion status.

特開2012-210190号公報Japanese Unexamined Patent Publication No. 2012-210190

本発明は上記状況に鑑みてなされたもので、基材に付着した藻類(例えば、珪藻、海藻)を剥がすことなく実際の環境での付着状況を把握することができる藻類の付着測定装置を提供することを目的とする。 The present invention has been made in view of the above situation, and provides an algae adhesion measuring device capable of grasping the adhesion state in an actual environment without peeling off the algae (for example, diatom, seaweed) adhering to the base material. The purpose is to do.

上記目的を達成するための請求項1に係る本発明の藻類の付着測定装置は、藻類が付着した基材を撮像する撮像手段と、前記撮像手段で撮像された画像情報が入力され、入力された前記画像情報の色調パラメータの情報を把握する色調把握手段と、前記色調把握手段で把握された前記画像情報の色調パラメータの情報が入力されると共に、前記色調パラメータ、及び、藻類の付着量の相関関係が記憶され、前記相関関係に基づいて、入力された前記画像情報の前記色調パラメータに対する藻類の付着量を導出する藻類導出手段とを備え、前記藻類は、珪藻、海藻であり、前記色調把握手段で把握される前記色調パラメータは、RGB(赤、緑、青)モデルであり、前記藻類導出手段は、前記RGBモデルのGを除く2つの成分(RB)の指定値を用いた色指定値と、特定色素との関係で、入力された前記画像情報の中の前記色指定値に対する前記特定色素の量を求め、求められた前記特定色素の量に基づいて藻類の付着量を導出することを特徴とする。 In the algae adhesion measuring device of the present invention according to claim 1 for achieving the above object, an image pickup means for imaging a base material to which algae is attached and image information captured by the image pickup means are input and input. The color tone grasping means for grasping the color tone parameter information of the image information and the color tone parameter information of the image information grasped by the color tone grasping means are input, and the color tone parameter and the amount of algae adhered are input. The correlation is stored, and based on the correlation, the algae is provided with an algae deriving means for deriving the amount of algae attached to the color tone parameter of the input image information, and the algae are diatoms and seaweeds, and the color tone. The color tone parameter grasped by the grasping means is an RGB (red, green, blue) model, and the algae derivation means is a color designation using designated values of two components (RB) excluding G of the RGB model. In relation to the value and the specific dye, the amount of the specific dye with respect to the color specified value in the input image information is obtained, and the amount of algae attached is derived based on the obtained amount of the specific dye. It is characterized by that.

請求項1に係る本発明では、撮像手段により藻類が付着した基材が撮像され、撮像された画像情報が色調把握手段に入力されて画像情報の色調パラメータの情報が把握され、画像情報の色調パラメータが藻類導出手段に入力され、色調パラメータ、及び、藻類の付着量の相関関係に基づいて、画像情報の色調パラメータに対する藻類の付着量が導出される。
そして、基材に付着した珪藻、海藻を剥がすことなく実際の環境での藻類の付着状況を把握することができる。
また、色調パラメータとして、RGB(赤、緑、青)モデルを用い、赤色成分、緑色成分、青色成分の度合いに応じて藻類の付着状況を把握することができる。
また、2つの成分(RB)の指定値、即ち、R(赤)とB(青)のそれぞれの色の度合いの値を用いた色指定値と、特定色素とを用いて藻類の付着量を導出することができる。
In the present invention according to claim 1, the base material to which algae are attached is imaged by the image pickup means, the captured image information is input to the color tone grasping means, the information of the color tone parameter of the image information is grasped, and the color tone of the image information is obtained. The parameter is input to the algae derivation means, and the amount of algae attached to the color tone parameter of the image information is derived based on the correlation between the color tone parameter and the amount of algae attached.
Then, it is possible to grasp the algae adhesion state in the actual environment without peeling off the diatoms and seaweeds adhering to the base material.
Further, using an RGB (red, green, blue) model as a color tone parameter, it is possible to grasp the adhesion state of algae according to the degree of the red component, the green component, and the blue component.
In addition, the specified value of the two components (RB), that is, the color specified value using the value of the degree of each color of R (red) and B (blue), and the attached amount of algae using the specific dye. Can be derived.

これにより、基材に付着した藻類を剥がすことなく実際の環境での付着状況を把握することが可能になる。例えば、漁礁の構成部材の一部を基材(プレート等)とし、基材を装置に設置して画像を得る。画像が得られた後の基材を元の漁礁に戻すことにより、漁礁としての機能を破壊することなく(藻類を剥がすことなく)、実際の環境での付着状況を把握することができる。 This makes it possible to grasp the adhesion state in the actual environment without peeling off the algae adhering to the base material. For example, a part of the constituent members of the fishing reef is used as a base material (plate or the like), and the base material is installed in the device to obtain an image. By returning the base material after the image is obtained to the original fishing reef, it is possible to grasp the adhesion situation in the actual environment without destroying the function as the fishing reef (without peeling off the algae).

因みに、特許第5990127号公報には、色空間を構成するパラメータ(色調パラメータ:RGB色空間)を用いて微細藻類の生長状態を判定する技術が開示されている。しかし、特許第5990127号公報に開示された技術は、溶液の画像を取得して、微細藻類の溶液の画像から色情報を抽出して微細藻類の生長状態を判定する技術である。このため、特許第5990127号公報に開示された技術は、基材に付着した藻類の画像に基づいて、藻類を基材から剥がすことなく(例えば、漁礁としての機能を破壊することなく)藻類の状況を把握する本願発明とは、技術内容が相違している。 Incidentally, Japanese Patent No. 5990127 discloses a technique for determining the growth state of microalgae using a parameter (color tone parameter: RGB color space) constituting the color space. However, the technique disclosed in Japanese Patent No. 5990127 is a technique for acquiring an image of a solution and extracting color information from the image of the solution of the microalgae to determine the growth state of the microalgae. Therefore, the technique disclosed in Japanese Patent No. 5990127 is based on an image of algae adhering to a base material, without peeling the algae from the base material (for example, without destroying the function as a fishing reef). The technical content is different from that of the present invention for grasping the situation.

色空間の色調パラメータとしては、生物の種類に応じて、CMYK(シアン、マゼンダ、黄、黒)、I(グレーレベル強度)、L(Labの輝度チャンネル)、H(色相)、S(彩度)、V(明度)を用いることができる。 Color space color parameters include CMYK (cyan, magenda, yellow, black), I (gray level intensity), L (Lab brightness channel), H (hue), and S (saturation), depending on the type of organism. ), V (brightness) can be used.

また、請求項2に係る本発明の藻類の付着測定装置は、請求項1に記載の藻類の付着測定装置において、前記色指定値は、前記RGBモデルの2つの成分の(RB)の指定値の差(R-B)であり、前記特定色素は、クロロフィルであることを特徴とする。 Further, the algae adhesion measuring apparatus of the present invention according to claim 2 is the algae adhesion measuring apparatus according to claim 1 , wherein the color designation value is a designation value of (RB) of two components of the RGB model. (RB), the specific dye is characterized by being chlorophyll.

請求項2に係る本発明では、2つの成分(RB)の指定値、即ち、R(赤)とB(青)のそれぞれの色の度合いの値の差(Rの指定値-Bの指定値)を色指定値とし、色指定値に対するクロロフィル量に基づいて、藻類の付着量を導出する。 In the present invention according to claim 2 , the designated value of the two components (RB), that is, the difference in the degree of each color of R (red) and B (blue) (designated value of R-designated value of B). ) Is set as the specified color value, and the amount of algae attached is derived based on the amount of chlorophyll with respect to the specified color value.

また、請求項3に係る本発明の藻類の付着測定装置は、請求項2に記載の藻類の付着測定装置において、前記藻類導出手段には、前記基材に応じて、前記RGBモデルの成分に相当するRB基準値と前記クロロフィルの量との関係が検量線マップとして記憶され、前記藻類導出手段は、前記検量線マップの前記基準値に対し、前記色指定値を反映させることで、前記クロロフィルの量を求め、藻類の付着量を導出することを特徴とする。 Further, the algae adhesion measuring apparatus of the present invention according to claim 3 is the algae adhesion measuring apparatus according to claim 2 , wherein the algae derivation means is a component of the RGB model according to the substrate. The relationship between the corresponding RB reference value and the amount of the chlorophyll is stored as a calibration curve map, and the algae derivation means reflects the color designation value with respect to the reference value of the calibration curve map to cause the chlorophyll. It is characterized by obtaining the amount of algae and deriving the amount of algae attached.

請求項3に係る本発明では、Rの指定値-Bの指定値に相当するRB基準値と、クロロフィルの量との関係の検量線マップが基材に対して設けられ、検量線マップを用いて、実際の画像の色指定値(Rの指定値-Bの指定値)に対するクロロフィルの量を対応させ、クロロフィルの量に基づいて藻類の付着量を導出する。 In the present invention according to claim 3 , a calibration curve map of the relationship between the RB reference value corresponding to the designated value of R − the designated value of B and the amount of chlorophyll is provided on the base material, and the calibration curve map is used. Then, the amount of chlorophyll is made to correspond to the color specified value of the actual image (specified value of R-specified value of B), and the amount of algae attached is derived based on the amount of chlorophyll.

また、請求項4に係る本発明の生物の付着測定装置は、請求項1から請求項3のいずれか一項に記載の藻類の付着測定装置において、前記RGBモデルの2つの成分の(RB)の指定値の差(R-B)である前記色指定値は、前記画像情報のRの値、Gの値、Bの値の加算値が加味されて補正されていることを特徴とする。 Further, the biological adhesion measuring device of the present invention according to claim 4 is the algae adhesion measuring device according to any one of claims 1 to 3 , wherein the two components (RB) of the RGB model are used. The color-designated value, which is the difference between the designated values (RB), is characterized in that the added value of the R value, the G value, and the B value of the image information is added and corrected.

請求項4に係る本発明では、色指定値(R-B)は、画像情報のRの値、Gの値、Bの値の加算値が加味されて補正されるので、画像の明るさの度合いによらず(明るくても暗くても)、藻類の付着量を評価することができる。そして、色指定値(R-B)は、画像情報のRの値、Gの値、Bの値の加算値が加味されて補正されるので、基材の色に拘わらず、藻類の付着量を評価することができる。 In the present invention according to claim 4 , since the color designation value (RB) is corrected by adding the added value of the R value, the G value, and the B value of the image information, the brightness of the image is increased. The amount of algae attached can be evaluated regardless of the degree (whether it is bright or dark). Then, the color designation value (RB) is corrected by adding the addition value of the R value, the G value, and the B value of the image information, so that the amount of algae attached is not limited to the color of the base material. Can be evaluated.

本発明の藻類の付着測定装置は、基材に付着した藻類を剥がすことなく実際の環境での付着状況を把握することが可能になる。 The algae adhesion measuring device of the present invention makes it possible to grasp the adhesion state in an actual environment without peeling off the algae adhered to the substrate.

本発明の一実施例に係る藻類の付着測定装置の概略構成図である。It is a schematic block diagram of the algae adhesion measuring apparatus which concerns on one Example of this invention. 本発明の一実施例に係る藻類の付着測定装置の概略ブロック図である。It is a schematic block diagram of the algae adhesion measuring apparatus which concerns on one Example of this invention. 色空間におけるRGB(赤、緑、青)の分布を表すグラフである。It is a graph which shows the distribution of RGB (red, green, blue) in a color space. 藻類が付着した基材の外観図(写真の図)である。It is an external view (photograph figure) of the base material to which algae adhered. 検量線マップである。It is a calibration curve map. 検量線マップである。It is a calibration curve map.

本発明の藻類の付着測定装置は、基材に付着した珪藻、海藻等の藻類の量を測定することで藻類の付着状況を測定する装置であり、藻類が付着した基材を撮影し、撮影された画像の色調パラメータであるRGB(赤、緑、青)モデルの情報を把握し、RGB(赤、緑、青)モデルの指標と藻類の付着量との相関関係に基づいて、撮影された画像のRGB(赤、緑、青)モデルの情報に対する藻類の付着量を導出するものである。 The algae adhesion measuring device of the present invention is a device for measuring the algae adhesion state by measuring the amount of algae such as diatoms and seaweeds adhering to the base material, and the base material to which the algae is attached is photographed and photographed. The information of the RGB (red, green, blue) model, which is the color tone parameter of the image, was grasped, and the image was taken based on the correlation between the index of the RGB (red, green, blue) model and the amount of algae attached. It derives the amount of algae attached to the information of the RGB (red, green, blue) model of the image.

これにより、基材に付着した藻類を剥がすことなく実際の環境での付着状況を把握することが可能になる。 This makes it possible to grasp the adhesion state in the actual environment without peeling off the algae adhering to the base material.

図1には本発明の一実施例に係る藻類の付着測定装置の全体構成を説明するための概略状況、図2には本発明の一実施例に係る藻類の付着測定装置の制御状況を説明するためのブロック構成、図3には色空間におけるRGB(赤、緑、青)の分布を説明するためのグラフを示してある。 FIG. 1 illustrates a schematic situation for explaining the overall configuration of the algae adhesion measuring device according to an embodiment of the present invention, and FIG. 2 illustrates a control status of the algae adhesion measuring device according to an embodiment of the present invention. FIG. 3 shows a graph for explaining the distribution of RGB (red, green, blue) in the color space.

図1に示すように、付着測定装置1のベース台2には、藻類3が付着した基材4が設置される。基材4は、例えば、実際の海底の漁礁の構成部材の一部を構成する部材とされている。ベース台2には支持柱5が設けられ、支持柱5には基材4の表面を撮影(撮像)するカメラ6(撮像手段)が備えられている。カメラ6で撮影された画像は、制御手段8に送られる。 As shown in FIG. 1, the base material 4 to which the algae 3 are attached is installed on the base 2 of the adhesion measuring device 1. The base material 4 is, for example, a member that constitutes a part of a component of an actual seabed fishing reef. The base 2 is provided with a support pillar 5, and the support pillar 5 is provided with a camera 6 (imaging means) for photographing (imaging) the surface of the base material 4. The image taken by the camera 6 is sent to the control means 8.

制御手段8では、画像情報の色調パラメータの情報が把握され(色調把握手段)、色調パラメータと藻類3の付着量の相関関係が記憶される。そして、制御手段8では、記憶された相関関係に基づいて、入力された画像情報の色調パラメータに対する藻類3の付着量が導出される(藻類導出手段)。 In the control means 8, the information of the color tone parameter of the image information is grasped (color tone grasping means), and the correlation between the color tone parameter and the adhesion amount of the algae 3 is stored. Then, in the control means 8, the amount of adhesion of the algae 3 to the color tone parameter of the input image information is derived based on the stored correlation (algae derivation means).

つまり、カメラ6により藻類3が付着した実際の環境の基材4が撮影され、撮影された画像情報が制御手段8に入力されて画像情報の色調パラメータ{色空間におけるRGB(赤、緑、青)モデル}の情報が把握される。つまり、画像情報のRGB(赤、緑、青)モデルの情報である赤色成分の度合いを表す値である指定値、緑色成分の度合いを表す値である指定値、青色成分の度合いを表す値である指定値の情報が把握される。 That is, the base material 4 in the actual environment to which the algae 3 are attached is photographed by the camera 6, and the photographed image information is input to the control means 8 to input the color tone parameter of the image information {RGB (red, green, blue in the color space). ) Model} information is grasped. That is, the specified value that represents the degree of the red component, which is the information of the RGB (red, green, blue) model of the image information, the specified value that represents the degree of the green component, and the value that represents the degree of the blue component. Information on a specified value is grasped.

そして、指定値の情報に基づいた情報である(色指定値)と、藻類3の付着量の相関関係に基づいて、画像情報のRGB(赤、緑、青)モデルの情報(色指定値)に対する藻類3の付着量が求められる。 Then, based on the correlation between the information based on the specified value information (color specified value) and the adhesion amount of the algae 3, the RGB (red, green, blue) model information (color specified value) of the image information is used. The amount of algae 3 attached to the algae 3 is determined.

このため、基材4に付着した藻類3を剥がすことなく、実際の環境での付着状況を把握することが可能になる。付着状況が把握された基材4(藻類3が剥がされていない基材4)を、例えば、漁礁の構成部材として元に戻し、更に、藻類3を付着させることで、一つの基材4を用いて連続して藻類3の付着状況を時系列に把握することが可能になる。つまり、例えば、漁礁としての機能を破壊することなく、実際の環境での付着状況を把握することが可能になる。 Therefore, it is possible to grasp the adhesion state in the actual environment without peeling off the algae 3 adhering to the base material 4. The base material 4 (the base material 4 from which the algae 3 has not been peeled off) whose adhesion status has been grasped is returned to its original state as, for example, a constituent member of the fishing reef, and further, the algae 3 is adhered to the one base material 4. By using this, it becomes possible to continuously grasp the adhesion status of algae 3 in chronological order. That is, for example, it becomes possible to grasp the adhesion state in the actual environment without destroying the function as a fishing reef.

具体的には、図2に示すように、制御手段8には、カメラ6により撮影された画像が入力される入力手段11が備えられ、入力手段11に入力された画像は演算手段12に送られる。演算手段12では、画像情報のRGB(赤、緑、青)モデルの情報である赤色成分の度合いを表す値である指定値Ri、緑色成分の度合いを表す値である指定値Gi、青色成分の度合いを表す値である指定値Biの情報が把握される(色調把握手段)。尚、iは画像の各画素を示してある。 Specifically, as shown in FIG. 2, the control means 8 is provided with an input means 11 for inputting an image taken by the camera 6, and the image input to the input means 11 is sent to the calculation means 12. Be done. In the calculation means 12, the designated value Ri, which is a value representing the degree of the red component, which is the information of the RGB (red, green, blue) model of the image information, the designated value Gi, which is the value representing the degree of the green component, and the blue component. Information on the designated value Bi, which is a value indicating the degree, is grasped (color tone grasping means). In addition, i shows each pixel of an image.

そして、演算手段12では、指定値G(Gi)を除く2つの成分(RB)の指定値R(Ri)、B(Bi)を用いた色指定値が演算される。色指定値は、R-B(Ri-Bi)で設定される。図3に基づいて、色指定値として、2つの成分(RB)の指定値R(Ri)、B(Bi)を用いる理由を説明する。 Then, the calculation means 12 calculates a color designated value using the designated values R (Ri) and B (Bi) of the two components (RB) excluding the designated value G (Gi). The color designation value is set by RB (Ri-Bi). The reason why the designated values R (Ri) and B (Bi) of the two components (RB) are used as the color designated values will be described with reference to FIG.

図3は撮影された画像15に対する色成分の頻度分布を示してある。 FIG. 3 shows the frequency distribution of color components with respect to the captured image 15.

図3(a)は、縦軸が3つの成分の指定値G(Gi)、R(Ri)、B(Bi)の加算値に対する赤色成分である指定値R(Ri)の度合いで、横軸が各画素(明るさの度合いが小さい側から大きい側の各画素)における指定値G(Gi)、R(Ri)、B(Bi)の加算値である。 In FIG. 3A, the vertical axis represents the degree of the designated value R (Ri), which is the red component with respect to the added value of the designated values G (Gi), R (Ri), and B (Bi) of the three components, and the horizontal axis. Is the addition value of the designated values G (Gi), R (Ri), and B (Bi) in each pixel (each pixel from the side where the degree of brightness is small to the side where the degree of brightness is large).

図3(b)は、縦軸が3つの成分の指定値G(Gi)、R(Ri)、B(Bi)の加算値に対する緑色成分である指定値G(Gi)の度合いで、横軸が各画素(明るさの度合いが小さい側から大きい側の各画素)における指定値G(Gi)、R(Ri)、B(Bi)の加算値である。 In FIG. 3B, the vertical axis represents the degree of the designated value G (Gi), which is a green component with respect to the added value of the designated values G (Gi), R (Ri), and B (Bi) of the three components, and the horizontal axis. Is the addition value of the designated values G (Gi), R (Ri), and B (Bi) in each pixel (each pixel from the side where the degree of brightness is small to the side where the degree of brightness is large).

図3(c)は、縦軸が3つの成分の指定値G(Gi)、R(Ri)、B(Bi)の加算値に対する青色成分である指定値B(Bi)の度合いで、横軸が各画素(明るさの度合いが小さい側から大きい側の各画素)における指定値G(Gi)、R(Ri)、B(Bi)の加算値である。 In FIG. 3 (c), the vertical axis represents the degree of the designated value B (Bi), which is the blue component with respect to the added value of the designated values G (Gi), R (Ri), and B (Bi) of the three components, and the horizontal axis. Is the addition value of the designated values G (Gi), R (Ri), and B (Bi) in each pixel (each pixel from the side where the degree of brightness is small to the side where the degree of brightness is large).

図3(a)に示すように、藻類を写した画像15では、赤色成分である指定値R(Ri)の度合いは、明るさの度合いが小さい側で高い度合いが多くなり、明るさの度合いが大きい側で度合いが少ない分布が存在する。 As shown in FIG. 3A, in the image 15 in which the algae are captured, the degree of the designated value R (Ri), which is a red component, increases on the side where the degree of brightness is small, and the degree of brightness increases. There is a distribution with a small degree on the large side.

図3(b)に示すように、藻類を写した画像15では、緑色成分である指定値G(Gi)の度合いは、明るさの度合いが小さい側から大きい側の全ての領域で同程度の少ない度合いで存在する(同じ頻度で分布が少ない)。 As shown in FIG. 3 (b), in the image 15 showing the algae, the degree of the designated value G (Gi), which is a green component, is about the same in all the regions from the side where the degree of brightness is small to the side where the degree of brightness is large. It is present to a lesser extent (less frequently distributed).

図3(c)に示すように、藻類を写した画像15では、青色成分である指定値B(Bi)の度合いは、明るさの度合いが小さい側で低い度合いが多くなり、明るさが大きい側で度合いが少ない分布が存在する。 As shown in FIG. 3 (c), in the image 15 in which the algae are captured, the degree of the designated value B (Bi), which is a blue component, is higher on the side where the degree of brightness is smaller and is higher on the side where the degree of brightness is smaller. There is a lesser distribution on the side.

図3(b)に示すように、緑色成分である指定値G(Gi)の度合いは、明るさによって頻度に変化が少なく、図3(a)(c)に示すように、赤色成分である指定値R(Ri)と青色成分である指定値B(Bi)の度合いは、明るさが小さい側で逆向きの頻度の変化が見られる。 As shown in FIG. 3 (b), the degree of the designated value G (Gi), which is a green component, has little change in frequency depending on the brightness, and is a red component as shown in FIGS. 3 (a) and 3 (c). As for the degree of the designated value R (Ri) and the designated value B (Bi) which is a blue component, a change in the frequency in the opposite direction can be seen on the side where the brightness is small.

このため、藻類を写した画像15では、指定値G(Gi)を除く2つの成分(RB)の指定値R(Ri)、B(Bi)を用いて色指定値とすることで、明るさの色成分の特徴を捉えた指標となることがわかる。具体的には、色指定値として、RGBモデルの2つの成分の指定値の差(Ri-Bi)が色指定値として演算される。 Therefore, in the image 15 in which the algae are captured, the brightness is set by using the designated values R (Ri) and B (Bi) of the two components (RB) excluding the designated value G (Gi) as the color designated values. It can be seen that it is an index that captures the characteristics of the color components of. Specifically, as the color designation value, the difference (Ri-Bi) between the designated values of the two components of the RGB model is calculated as the color designation value.

藻類の付着量を判断する色調パラメータとして、RGB(赤、緑、青)モデルを用いることで、赤色成分、緑色成分、青色成分の度合いに応じて藻類の付着状況を把握することができる。 By using an RGB (red, green, blue) model as a color tone parameter for determining the amount of algae attached, it is possible to grasp the algae adhesion state according to the degree of the red component, the green component, and the blue component.

RGBモデルの2つの成分の指定値の差である色指定値(Ri-Bi)は、画像情報のRの値、Gの値、Bの値の加算値が加味されて補正されている。即ち、色指定値(Ri-Bi)は、例えば、全ての画素のRの値、Gの値、Bの値の加算値を画素数で除した値として補正されている。 The color specified value (Ri-Bi), which is the difference between the specified values of the two components of the RGB model, is corrected by adding the added values of the R value, the G value, and the B value of the image information. That is, the color designation value (Ri-Bi) is corrected as, for example, a value obtained by dividing the added value of the R value, the G value, and the B value of all the pixels by the number of pixels.

図2に戻り、制御手段8には記憶手段21(藻類導出手段)が備えられ、記憶手段21にはRGBモデルの色指定値(Ri-Bi)に相当するRB基準値と、特定色素としてのクロロフィルの量との関係が検量線マップ22として記憶されている。検量線マップ22は、基材4の種類毎に複数記憶されている。 Returning to FIG. 2, the control means 8 is provided with a storage means 21 (algae derivation means), and the storage means 21 has an RB reference value corresponding to a color designation value (Ri-Bi) of an RGB model and a specific dye. The relationship with the amount of chlorophyll is stored as the calibration curve map 22. A plurality of calibration curve maps 22 are stored for each type of the base material 4.

図4から図6に基づいて、検量線マップ22に付いて説明する。 The calibration curve map 22 will be described with reference to FIGS. 4 to 6.

図4には検量線マップを作成するためのサンプルの外観であり、(a)(b)(c)(d)の順に藻類の付着量が多くなっているサンプルを示してある。また、図5には、サンプルにおける色指定値(Ri-Bi)に相当するRB基準値とクロロフィル量との関係を表す検量線マップであり、例えば、石炭灰を含む基材4に対するクロロフィル量の付着量を示してある。また、図6には異なる基材の検量線マップを示してある。 FIG. 4 shows the appearance of a sample for creating a calibration curve map, and shows a sample in which the amount of algae attached increases in the order of (a), (b), (c), and (d). Further, FIG. 5 is a calibration curve map showing the relationship between the RB reference value corresponding to the color designation value (Ri-Bi) in the sample and the amount of chlorophyll. The amount of adhesion is shown. Further, FIG. 6 shows a calibration curve map of different base materials.

図4(a)(b)(c)(d)に相当するサンプルの藻類を剥がし、それぞれクロロフィル量を検出した。図5に示したように、藻類の付着量が多くなるにしたがって、色指定値(Ri-Bi)に相当するRB基準値が大きくなり、藻類の付着量が多くなるにしたがって、クロロフィル量が多くなることが確認された。 The algae of the samples corresponding to FIGS. 4 (a), (b), (c) and (d) were peeled off, and the amount of chlorophyll was detected in each. As shown in FIG. 5, as the amount of algae attached increases, the RB reference value corresponding to the color designation value (Ri-Bi) increases, and as the amount of algae attached increases, the amount of chlorophyll increases. It was confirmed that it would be.

また、図6に示したように、例えば、天然石や材料が異なるコンクリート等の基材A(実線で示してある)、基材B(一点鎖線で示してある)、基材C(二点鎖線で示してある)の場合であっても、藻類の付着量が多くなるにしたがって、色指定値(Ri-Bi)に相当するRB基準値が大きくなることが確認されている。 Further, as shown in FIG. 6, for example, a base material A (indicated by a solid line), a base material B (indicated by a one-dot chain line), and a base material C (two-dot chain line) such as natural stone or concrete made of different materials. Even in the case of (shown by), it has been confirmed that the RB reference value corresponding to the color designation value (Ri-Bi) increases as the amount of algae adhered increases.

これにより、基材A、基材B、基材Cの場合も、藻類の付着量が多くなるにしたがって(RB基準値が大きくなるにしたがって)、クロロフィル量が多くなる傾向にあることが確認された。 As a result, it was confirmed that in the case of the base material A, the base material B, and the base material C, the amount of chlorophyll tends to increase as the amount of algae adhered increases (as the RB reference value increases). rice field.

図2に戻り、演算手段12で演算された、指定値G(Gi)を除く2つの成分(RB)の指定値R(Ri)、B(Bi)を用いた色指定値(Ri-Bi)、及び、記憶手段21に記憶された基材4に対応する検量線マップ22は、藻類導出手段23に入力される。 Returning to FIG. 2, the color designated value (Ri-Bi) using the designated values R (Ri) and B (Bi) of the two components (RB) excluding the designated value G (Gi) calculated by the calculation means 12. , And the calibration curve map 22 corresponding to the base material 4 stored in the storage means 21 is input to the algae derivation means 23.

藻類導出手段23では、演算手段12で演算された色指定値(Ri-Bi)が検量線マップ22と比較され、即ち、RB基準値に対し演算された色指定値(Ri-Bi)が反映され、演算された色指定値(Ri-Bi)に対するクロロフィル量が求められる。そして、求められたクロロフィル量に基づき、演算された色指定値(Ri-Bi)に対する藻類の付着量が導出される。 In the algae derivation means 23, the color designation value (Ri-Bi) calculated by the calculation means 12 is compared with the calibration curve map 22, that is, the color designation value (Ri-Bi) calculated with respect to the RB reference value is reflected. The amount of chlorophyll with respect to the calculated color designation value (Ri-Bi) is obtained. Then, based on the obtained chlorophyll amount, the amount of algae attached to the calculated color designation value (Ri-Bi) is derived.

上記構成の付着測定装置1では、例えば、測定対象となる基材4(藻類の付着量を測定したい基材4)をベース台2に載置し、カメラ6で藻類の状況を撮影する。撮影された画像は、制御手段8に入力され、制御手段8では、色空間におけるRGB(赤、緑、青)モデルに基づいて色指定値(Ri-Bi)が演算される。 In the adhesion measuring device 1 having the above configuration, for example, the base material 4 to be measured (the base material 4 for which the amount of algae adhered is to be measured) is placed on the base base 2, and the state of the algae is photographed by the camera 6. The captured image is input to the control means 8, and the control means 8 calculates a color designation value (Ri-Bi) based on an RGB (red, green, blue) model in the color space.

次に、(Rの指定値-Bの指定値)である色指定値(Ri-Bi)に相当するRB基準値と、クロロフィルの量との関係の検量線マップ22に対し、画像の色指定値(Ri-Bi)が対応付けされ、実際の画像の色指定値(Ri-Bi)に対するクロロフィルの量が検量線マップ22から求められる。 Next, the color of the image is specified with respect to the calibration curve map 22 regarding the relationship between the RB reference value corresponding to the color specified value (Ri-Bi) which is (specified value of R-specified value of B) and the amount of chlorophyll. The values (Ri-Bi) are associated with each other, and the amount of chlorophyll with respect to the color specified value (Ri-Bi) of the actual image is obtained from the calibration curve map 22.

そして、求められたクロロフィルの量に基づいて藻類の付着量が導出される。つまり、実際の画像の色指定値(Ri-Bi)により藻類の付着量が導出される。 Then, the amount of algae attached is derived based on the obtained amount of chlorophyll. That is, the amount of algae attached is derived from the color designation value (Ri-Bi) of the actual image.

このため、カメラ6で撮影した画像の情報により、藻類を剥がすことなく、実際の環境で、基材4に付着した藻類の状況(付着量)を検出することができる。つまり、藻類が生育している過程で、任意の時点での藻類の付着量を求めることができ、一つの基材4を管理することで、即ち、多くの基材を用いて経時的に順番に藻類を剥がすことなく、藻類の付着の経過を判断することができ、海中の環境を把握することができる。 Therefore, it is possible to detect the state (adhesion amount) of the algae adhering to the base material 4 in the actual environment without peeling off the algae from the information of the image taken by the camera 6. That is, in the process of growing algae, the amount of algae attached at any time can be determined, and by managing one base material 4, that is, using many base materials in order over time. It is possible to determine the progress of algae adhesion without peeling off the algae, and to grasp the underwater environment.

例えば、漁礁の構成部材の一部を基材4(プレート等)とし、基材4を装置に設置して画像を得て、基材4藻類を剥がすことなく、藻類の状況(付着量)を検出する。そして、画像が得られた後の基材4を元の漁礁の構成部材として戻すことにより、漁礁としての機能を破壊することなく(藻類を剥がすことなく)、実際の環境での付着状況を把握することができることになる。 For example, a part of the constituent members of the fishing reef is used as a base material 4 (plate, etc.), and the base material 4 is installed in a device to obtain an image, and the algae status (adhesion amount) can be measured without peeling off the base material 4 algae. To detect. Then, by returning the base material 4 after the image is obtained as a constituent member of the original fishing reef, the adhesion state in the actual environment can be grasped without destroying the function as the fishing reef (without peeling off the algae). Will be able to.

上述した付着測定装置1として、河川等の環境を把握するため、川底の石等(基材)に付着する藻の量を測定することも可能であり、測定対象となる藻類や基材の種類により、色調パラメータを適宜選択、組み合わせることができる。 As the adhesion measuring device 1 described above, in order to grasp the environment of a river or the like, it is possible to measure the amount of algae adhering to stones or the like (base material) on the riverbed, and the type of algae or base material to be measured. Allows the color tone parameters to be appropriately selected and combined.

本発明は、基材への生物、例えば、珪藻、海藻を含む藻類の付着の状況を測定する生物の付着測定装置の産業分野で利用することができる。 INDUSTRIAL APPLICABILITY The present invention can be used in the industrial field of an organism adhesion measuring device for measuring the state of attachment of organisms, for example, diatoms and algae including seaweeds to a substrate.

1 付着測定装置
2 ベース台
3 藻類
4 基材
5 支持柱
6 カメラ
8 制御手段
11 入力手段
12 演算手段
15 画像
21 記憶手段
22 検量線マップ
23 藻類導出手段

1 Adhesion measuring device 2 Base stand 3 Algae 4 Base material 5 Support pillar 6 Camera 8 Control means 11 Input means 12 Calculation means 15 Image 21 Storage means 22 Calibration curve map 23 Algae derivation means

Claims (4)

藻類が付着した基材を撮像する撮像手段と、
前記撮像手段で撮像された画像情報が入力され、入力された前記画像情報の色調パラメータの情報を把握する色調把握手段と、
前記色調把握手段で把握された前記画像情報の色調パラメータの情報が入力されると共に、前記色調パラメータ、及び、藻類の付着量の相関関係が記憶され、前記相関関係に基づいて、入力された前記画像情報の前記色調パラメータに対する藻類の付着量を導出する藻類導出手段とを備え、
前記藻類は、珪藻、海藻であり、
前記色調把握手段で把握される前記色調パラメータは、RGB(赤、緑、青)モデルであり、
前記藻類導出手段は、
前記RGBモデルのGを除く2つの成分(RB)の指定値を用いた色指定値と、特定色素との関係で、入力された前記画像情報の中の前記色指定値に対する前記特定色素の量を求め、求められた前記特定色素の量に基づいて藻類の付着量を導出する
ことを特徴とする藻類の付着測定装置。
An imaging means for imaging a base material to which algae are attached, and
An image information captured by the image pickup means is input, and a color tone grasping means for grasping information on a color tone parameter of the input image information and a color tone grasping means.
The information of the color tone parameter of the image information grasped by the color tone grasping means is input, and the correlation between the color tone parameter and the adhesion amount of algae is stored, and the input is input based on the correlation. It is provided with an algae derivation means for deriving the amount of algae attached to the color tone parameter of image information.
The algae are diatoms and seaweeds.
The color tone parameter grasped by the color tone grasping means is an RGB (red, green, blue) model.
The algae derivation means is
The amount of the specific dye with respect to the color specified value in the input image information in relation to the color specified value using the specified values of the two components (RB) excluding G of the RGB model and the specific dye. And derive the amount of algae attached based on the obtained amount of the specific dye.
An algae adhesion measuring device characterized by this.
請求項1に記載の藻類の付着測定装置において、
前記色指定値は、前記RGBモデルの2つの成分の(RB)の指定値の差(R-B)であり、
前記特定色素は、クロロフィルである
ことを特徴とする藻類の付着測定装置。
In the algae adhesion measuring device according to claim 1 ,
The color designated value is the difference (RB) between the designated values (RB) of the two components of the RGB model.
The specific dye is an algae adhesion measuring device characterized by being chlorophyll.
請求項2に記載の藻類の付着測定装置において、
前記藻類導出手段には、
前記基材に応じて、前記RGBモデルの成分に相当するRB基準値と前記クロロフィルの量との関係が検量線マップとして記憶され、
前記藻類導出手段は、
前記検量線マップの前記基準値に対し、前記色指定値を反映させることで、前記クロロフィルの量を求め、藻類の付着量を導出する
ことを特徴とする藻類の付着測定装置。
In the algae adhesion measuring device according to claim 2 .
The algae derivation means includes
Depending on the base material, the relationship between the RB reference value corresponding to the component of the RGB model and the amount of the chlorophyll is stored as a calibration curve map.
The algae derivation means is
An algae adhesion measuring device, characterized in that the amount of chlorophyll is obtained by reflecting the color designation value with respect to the reference value of the calibration curve map, and the algae adhesion amount is derived.
請求項1から請求項3のいずれか一項に記載の藻類の付着測定装置において、
前記RGBモデルの2つの成分の(RB)の指定値の差(R-B)である前記色指定値は、前記画像情報のRの値、Gの値、Bの値の加算値が加味されて補正されている
ことを特徴とする藻類の付着測定装置。
In the algae adhesion measuring apparatus according to any one of claims 1 to 3 .
The color designation value, which is the difference (RB) between the two components of the RGB model (RB), is added to the addition value of the R value, the G value, and the B value of the image information. Algae adhesion measuring device characterized by being corrected.
JP2018045972A 2018-03-13 2018-03-13 Algae adhesion measuring device Expired - Fee Related JP7078330B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2018045972A JP7078330B2 (en) 2018-03-13 2018-03-13 Algae adhesion measuring device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018045972A JP7078330B2 (en) 2018-03-13 2018-03-13 Algae adhesion measuring device

Publications (2)

Publication Number Publication Date
JP2019158618A JP2019158618A (en) 2019-09-19
JP7078330B2 true JP7078330B2 (en) 2022-05-31

Family

ID=67993360

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018045972A Expired - Fee Related JP7078330B2 (en) 2018-03-13 2018-03-13 Algae adhesion measuring device

Country Status (1)

Country Link
JP (1) JP7078330B2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111986201B (en) * 2020-09-28 2023-12-22 南方电网科学研究院有限责任公司 A method and device for measuring algae density on the surface of an insulator
CN112378724B (en) * 2020-11-27 2023-09-15 大连海洋大学 A method for measuring river ecosystem functions

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006284525A (en) 2005-04-05 2006-10-19 Port & Airport Research Institute Water quality estimating method using broken water image, and broken water image processing type water quality estimating system
JP2013022932A (en) 2011-07-26 2013-02-04 Seiko Epson Corp Printing method, printing device, printing matter, and molding
JP2013213783A (en) 2012-04-04 2013-10-17 Nippon Telegr & Teleph Corp <Ntt> Method, apparatus and program for measuring component amount of micro algae
WO2015120144A1 (en) 2014-02-05 2015-08-13 Board Of Regents, The University Of Texas System Methods and systems for diagnostics
JP2017003475A (en) 2015-06-11 2017-01-05 日本電信電話株式会社 Method and apparatus for measuring amount of microalgae component

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08242886A (en) * 1995-03-08 1996-09-24 Dam Suigenchi Kankyo Seibi Center Method for measuring phytoplankton concentration

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006284525A (en) 2005-04-05 2006-10-19 Port & Airport Research Institute Water quality estimating method using broken water image, and broken water image processing type water quality estimating system
JP2013022932A (en) 2011-07-26 2013-02-04 Seiko Epson Corp Printing method, printing device, printing matter, and molding
JP2013213783A (en) 2012-04-04 2013-10-17 Nippon Telegr & Teleph Corp <Ntt> Method, apparatus and program for measuring component amount of micro algae
WO2015120144A1 (en) 2014-02-05 2015-08-13 Board Of Regents, The University Of Texas System Methods and systems for diagnostics
JP2017003475A (en) 2015-06-11 2017-01-05 日本電信電話株式会社 Method and apparatus for measuring amount of microalgae component

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MURPHY, T. E. et al. ,Rapid Algal Culture Diagnostics for Open Ponds Using Multispectral Image Analysis,Biotechnology Progress ,2013年11月22日,Vol. 30,pp. 233-240,doi:10.1002/btpr.1843
SARRAFZADEH, M. H. et al.,Michroalgae biomass quantification by digital image processing and RGB color analysis,J. Appl. Phycol.,2015年03月24日,Vol. 27,pp. 205-209,doi:10.1007/s10811-014-0285-7
菅 和利, ほか ,橋上から撮影したデジタル画像を用いた礫付着藻類クロロフィル量の連続モニタリング手法の開発,河川技術論文集,2012年06月,第18巻,第1-6ページ,http://library.jsce..or.jp/jsce/open/00906/2012/18-0001.pdf

Also Published As

Publication number Publication date
JP2019158618A (en) 2019-09-19

Similar Documents

Publication Publication Date Title
Shortis et al. A review of underwater stereo-image measurement for marine biology and ecology applications
Purser et al. Use of machine-learning algorithms for the automated detection of cold-water coral habitats: a pilot study
Ranjan et al. Detection and classification of leaf disease using artificial neural network
JP3462412B2 (en) Automatic feeding device for aquatic organisms
Cocito et al. 3-D reconstruction of biological objects using underwater video technique and image processing
CN114994691B (en) A visualization-based method for analyzing the distribution of fishery resources clusters
Mertens et al. Dirt detection on brown eggs by means of color computer vision
Able et al. Application of mobile dual-frequency identification sonar (DIDSON) to fish in estuarine habitats
JP7078330B2 (en) Algae adhesion measuring device
Karatayev et al. Benthic video image analysis facilitates monitoring of Dreissena populations across spatial scales
Lati et al. Robust methods for measurement of leaf-cover area and biomass from image data
Zhao et al. Survey of freshwater mussels using high‐resolution acoustic imaging sonar and deep learning‐based object detection in Lake Izunuma, Japan
Teixidó et al. Hierarchical segmentation-based software for cover classification analyses of seabed images (Seascape)
JP6523063B2 (en) Method and apparatus for measuring amount of microalga component
Ponsioen et al. Remote sensing of salmonid spawning sites in freshwater ecosystems: The potential of low-cost UAV data
Wong et al. Local densities and habitat preference of the critically endangered spotted handfish (Brachionichthys hirsutus): Large scale field trial of GPS parameterised underwater visual census and diver attached camera
Hyžný et al. Paracapsulapagurus poponguinensis, a new hermit crab (Decapoda, Anomura, Paguroidea) from the Maastrichtian of Senegal
JP2024173219A (en) Turbidity evaluation method
KR102100664B1 (en) System for measuring cultured fish and method thereof
Oladi et al. Photographic application of the Coral Health Chart in turbid environments: The efficiency of image enhancement and restoration methods
Berov et al. An optimised method for scuba digital photography surveys of infralittoral benthic habitats: a case study from the SW Black Sea Cystoseira-dominated macroalgal communities
CN118071035B (en) Method for repairing water flow structure of fish habitat
CN110738698B (en) Floating type submarine data measurement method and device and electronic equipment
Mahalakshmi et al. Automated crop inspection and pest control using image processing
Lochhead et al. Dry‐lab benchmarking of a structure from motion workflow designed to monitor marine benthos in three dimensions

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210114

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20211013

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20211117

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220106

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220518

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220518

R150 Certificate of patent or registration of utility model

Ref document number: 7078330

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees