Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
JP6079072B2 - Hot length measuring method and apparatus - Google Patents
[go: Go Back, main page]

JP6079072B2 - Hot length measuring method and apparatus - Google Patents

Hot length measuring method and apparatus Download PDF

Info

Publication number
JP6079072B2
JP6079072B2 JP2012200379A JP2012200379A JP6079072B2 JP 6079072 B2 JP6079072 B2 JP 6079072B2 JP 2012200379 A JP2012200379 A JP 2012200379A JP 2012200379 A JP2012200379 A JP 2012200379A JP 6079072 B2 JP6079072 B2 JP 6079072B2
Authority
JP
Japan
Prior art keywords
long material
length
imaging
hot long
hot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2012200379A
Other languages
Japanese (ja)
Other versions
JP2014055833A (en
Inventor
和宏 三上
和宏 三上
光喜 須加原
光喜 須加原
児玉 俊文
俊文 児玉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JFE Steel Corp
Original Assignee
JFE Steel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JFE Steel Corp filed Critical JFE Steel Corp
Priority to JP2012200379A priority Critical patent/JP6079072B2/en
Publication of JP2014055833A publication Critical patent/JP2014055833A/en
Application granted granted Critical
Publication of JP6079072B2 publication Critical patent/JP6079072B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)

Description

本発明は、熱間長尺材の測長方法及び装置に関し、詳しくは熱間状態の長尺材(例えば鋼管や棒鋼或いは鋳片等)の長さを非接触式で計測する、熱間長尺材の測長方法及び装置に関する。   The present invention relates to a method and an apparatus for measuring a length of a hot long material, and more specifically, a hot length that measures the length of a long material in a hot state (for example, a steel pipe, a steel bar, or a cast piece) in a non-contact manner. The present invention relates to a length measuring method and apparatus for a scale.

長尺材の長さを非接触式で計測する従来の測長技術として以下のものが知られている。
(従来技術1) 静止させた測長すべき長尺材の両端部を複数個のカメラ(イメージセンサを撮像素子としたデジタルカメラの意。以下同じ)で撮像し、該撮像した画像の画像処理から得られたデータと、前記カメラの個別の設置位置間の離間距離データとから前記長尺材の長さを算出するもの(例えば特許文献1参照)。
(従来技術2) 搬送中の長尺材の先端部は端部検出用のセンサ(端部センサという。具体例として投受光式の光電センサが示されている)を複数個、個別に設置してなる第1の端部検出器で検出し、後端部は1個のカメラで撮像し、該撮像した画像の画像処理データと、前記カメラ乃至前記第1の端部検出器の端部センサ個別の設置位置間の離間距離データとから前記長尺材の長さを算出するもの(例えば特許文献2参照)。
(従来技術3) 前記従来技術2において、更に後端部の形状が矩形端形状ではなくヤリ形状である事に起因する測長誤差を補正する手段として、前記カメラ設置位置から近い上流側で前記長尺材後端部の相異なる搬送高さ方向位置の搬送幅方向両端を検出する複数の端部センサで構成した第2の端部検出器を具備したもの(例えば特許文献3参照)。
The following are known as conventional length measurement techniques for measuring the length of a long material in a non-contact manner.
(Prior Art 1) Both ends of a stationary long material to be measured are imaged by a plurality of cameras (a digital camera using an image sensor as an image sensor; the same applies hereinafter), and image processing of the captured images The length of the long material is calculated from the data obtained from the above and the distance data between the individual installation positions of the camera (for example, see Patent Document 1).
(Prior Art 2) The front end of the long material being transported is individually provided with a plurality of end detection sensors (referred to as end sensors; a light emitting / receiving photoelectric sensor is shown as a specific example). And the rear end is imaged by one camera, the image processing data of the captured image, and the end sensor of the camera through the first end detector. The length of the long material is calculated from the distance data between the individual installation positions (see, for example, Patent Document 2).
(Prior Art 3) In the prior art 2, as a means for correcting a length measurement error caused by the shape of the rear end portion being not a rectangular end shape but a spear shape, the upstream side close to the camera installation position is A second end detector comprising a plurality of end sensors for detecting both ends in the transport width direction at different transport height direction positions of the rear end of the long material (see, for example, Patent Document 3).

特開平04−184205号公報Japanese Patent Laid-Open No. 04-184205 特開昭57−022507号公報JP-A-57-022507 特開平10−082617号公報Japanese Patent Laid-Open No. 10-082617

前述の従来技術によると、測長精度を確保するには、前記カメラを複数個、個別に設置して用いるか、若しくは前記カメラを1個のみ設置し且つ前記長尺材の一端側或いは更に他端側に前記端部センサを複数個、個別に設置するか、の二者択一又は該二者の組み合わせを採るしか無いが、何れを採るにしても前記カメラや前記端部センサの設置個数が多くなり、設備費が嵩むのが難点である。   According to the above-described prior art, in order to ensure the measurement accuracy, a plurality of the cameras are individually installed or used, or only one camera is installed and one end side of the long material or the other There are only two alternatives, or a combination of the two, to individually install a plurality of the end sensors on the end side, but in any case, the number of cameras and the end sensors to be installed However, it is difficult to increase the equipment cost.

つまり、従来技術では測長精度確保の為にカメラやセンサを多数設置せねばならず、設備費が嵩むと云う課題があった。   In other words, in the prior art, a large number of cameras and sensors must be installed in order to ensure measurement accuracy, and there is a problem that equipment costs increase.

本発明者らは、前記課題を解決する為に鋭意検討し、その結果、熱間搬送中の長尺材全体を1個のカメラの1回撮像で撮像視野に収める場合、撮像トリガには1個の検出器(例えばHMD(Hot Metal Detector:熱塊検出器))による検出信号を用い、且つ撮像視野拡大に伴い増大するレンズ歪み(収差)による、長尺材の実物に対する撮像データ処理後の画像の寸法誤差には、光点目盛尺の撮像データに基づく長さ換算で対処する事により、カメラと検出器各1個ずつの設置下でも良好な測長精度が得られるとの知見を得、本発明を成した。   In order to solve the above-mentioned problems, the present inventors have intensively studied. As a result, when the entire long material being hot transported is captured in the imaging field by one imaging of one camera, the imaging trigger is 1 After detection of image data on an actual long material using detection signals from individual detectors (for example, a HMD (Hot Metal Detector)) and lens distortion (aberration) that increases as the imaging field of view increases. Acquired the knowledge that good length measurement accuracy can be obtained even if one camera and one detector are installed by dealing with the dimensional error of the image by length conversion based on the image data of the light spot scale. The present invention has been made.

即ち本発明は以下の通りである。
(1)搬送路を搬送される、種々の外径寸法の熱間長尺材の測長方法であって、
前記熱間長尺材の全長が視野内に入る撮像視野を持ち、前記搬送路の特定領域を撮像する1個の撮像手段の視野内に、前記熱間長尺材が搬送されたことを検知し、
該検知した時点で、前記撮像手段により撮像された前記熱間長尺材の静止画像を取得し、
該静止画像における熱間長尺材の長さ方向存在位置と、前記特定領域内に前記熱間長尺材の長さ方向に目盛を配列した光点目盛尺を撮像してなる光点撮像データを画像処理して予め導出してある、前記熱間長尺材の外径寸法に応じた、画像中の長さ方向二以上の区域で相異なる長さ換算係数とから、
前記熱間長尺材の長さを算出することを特徴とする熱間長尺材の測長方法。
(2)搬送路を搬送される、種々の外径寸法の熱間長尺材の測長装置であって、
前記熱間長尺材の全長が視野内に入る撮像視野を持ち、前記搬送路の特定領域を撮像する1個の撮像手段と、
前記搬送路の特定位置における熱間長尺材の有無を検出し、前記特定領域内に前記熱間長尺材の全長が搬送されたことを検知する検知手段と、
該検知手段の検知信号にもとづき、前記撮像手段により撮像された前記熱間長尺材の全長を含む静止画像を取得し、
前記取得した静止画像における熱間長尺材の長さ方向存在位置と、前記撮像視野内で、前記熱間長尺材の長さ方向に目盛を配列した光点目盛尺を撮像してなる光点撮像データを画像処理して予め導出してある、前記熱間長尺材の外径寸法に応じた、画像中の長さ方向二以上の区域で相異なる長さ換算係数とから、
前記熱間長尺材の長さを算出する画像処理手段と、
を有することを特徴とする熱間長尺材の測長装置。
That is, the present invention is as follows.
(1) A method for measuring a length of a hot long material having various outer diameter dimensions, which is conveyed along a conveyance path,
It has an imaging field of view where the entire length of the hot long material falls within the field of view, and it is detected that the hot long material has been transported within the field of view of one imaging means that images a specific area of the transport path. And
At the time of the detection, obtain a still image of the hot long material imaged by the imaging means,
Light spot imaging data obtained by imaging the position in the length direction of the hot long material in the still image and the light spot scale in which the scale is arranged in the length direction of the hot long material in the specific region From the length conversion coefficient different in the two or more areas in the length direction in the image according to the outer diameter dimension of the hot long material , which is derived in advance by image processing,
A method for measuring a length of a hot long material, comprising calculating a length of the hot long material.
(2) It is a length measuring device for hot long materials having various outer diameter dimensions that are transported along a transport path,
An imaging field having an imaging field in which the entire length of the hot long material falls within the field of view;
Detecting means for detecting presence or absence of a hot long material at a specific position of the transport path, and detecting that the entire length of the hot long material is transported in the specific region;
Based on the detection signal of the detection means, obtain a still image including the entire length of the hot long material imaged by the imaging means,
Light obtained by imaging the position of the hot long material in the length direction of the acquired still image and the light spot scale in which the scale is arranged in the length direction of the hot long material within the imaging field of view. From the length conversion coefficient different in two or more areas in the length direction in the image according to the outer diameter size of the hot long material , which is derived in advance by image processing the point imaging data,
Image processing means for calculating the length of the hot long material;
A length measuring apparatus for hot long materials, comprising:

本発明によれば、撮像手段と検知手段との各1個ずつの設置により画像処理手段の援用下でレンズ歪みによる測長誤差を小さくすることができ、熱間長尺材の測長精度確保と設備コスト節減とを両立させることができる。   According to the present invention, it is possible to reduce the measurement error due to lens distortion with the aid of the image processing means by installing each one of the imaging means and the detection means, and ensure the measurement accuracy of the hot long material. And equipment cost savings.

本発明の一実施形態における熱間長尺材撮像時を示す模式図である。It is a schematic diagram which shows the time of hot long material imaging in one Embodiment of this invention. 長尺材画像及び長尺材画像長さの導出要領を示す概略説明図である。It is a schematic explanatory drawing which shows the derivation | leading-out point of a long material image and a long material image length. 本発明の一実施形態における光点目盛尺撮像時を示す模式図である。It is a schematic diagram which shows the time of the light spot scale image pick-up in one Embodiment of this invention. 光点目盛画像からの長さ変換係数の導出要領を示す概略説明図である。It is a schematic explanatory drawing which shows the derivation | leading-out point of the length conversion coefficient from a light spot scale image. 長尺材画像及び長尺材画像長さの導出要領を示す概略説明図である。It is a schematic explanatory drawing which shows the derivation | leading-out point of a long material image and a long material image length.

本発明の一実施形態における熱間長尺材撮像時を示す模式図である図1において、長尺材1は例えばピアサーミル(図示省略)出側の鋼管1である。鋼管1は、搬送対象材を材長方向に水平搬送する搬送ローラ群からなる搬送路2で一方向に搬送3されている。鋼管1は熱間ゆえ熱センサ4で熱観測でき、該熱センサ4が搬送路2の特定位置PSにおける鋼管の有無を検知する。   In FIG. 1, which is a schematic diagram illustrating imaging of a long hot material in one embodiment of the present invention, the long material 1 is, for example, a steel pipe 1 on the exit side of a piercer mill (not shown). The steel pipe 1 is conveyed 3 in one direction by a conveyance path 2 composed of a conveyance roller group that horizontally conveys a material to be conveyed in the material length direction. Since the steel pipe 1 is hot, heat can be observed by the heat sensor 4, and the heat sensor 4 detects the presence or absence of the steel pipe at the specific position PS in the conveyance path 2.

1個のみ設置された撮像手段であるカメラ5は、搬送路2の特定領域Bを撮像するよう配置されており、その撮像視野SAの中心軸線であるカメラ視線6を、搬送路2上の特定領域Bを鋼管1が搬送された時の管中心軸と直交させた状態としてある。そして、カメラ5の対物最短距離である撮像距離Lが所定距離例えば6500mmのとき、撮像視野SA内に、搬送路2を搬送される種々の鋼管1のうち管長さが最大例えば8500mmの長さ範囲が収まるようにしてある。   A single camera 5, which is an imaging means, is arranged to image a specific area B of the transport path 2, and a camera line of sight 6 that is the central axis of the imaging field of view SA is specified on the transport path 2. The region B is in a state of being orthogonal to the tube center axis when the steel pipe 1 is conveyed. And when the imaging distance L which is the shortest objective distance of the camera 5 is a predetermined distance, for example, 6500 mm, a length range in which the tube length is a maximum of, for example, 8500 mm among the various steel pipes 1 that are conveyed on the conveying path 2 in the imaging field of view SA. To fit.

なお、本実施形態では、設置スペースの制約上、カメラ5は搬送路2の斜め上方に設置したが、これに限定されるものではない。
熱センサ4例えばHMD4は、その熱観測視線7を搬送路2の撮像視野SAへの入口地点に向けて該入口地点を特定位置PSとして、該特定位置PSを熱観測地点とし該熱観測地点を通過する熱間の鋼管1の熱観測データを採りつつ、該採った熱観測データをシーケンス制御手段11に送信する。シーケンス制御手段11は熱観測データの立下りに反応して撮像トリガ信号9を画像処理手段8に自動送信する。すなわち、熱センサ(HMD)4とシーケンス制御手段30は、搬送路の特定位置PSにおける熱間長尺材の有無を検出し、特定領域B内に熱間長尺材(鋼管1)の全長が搬送されたことを検知する検知手段を構成しており、前記撮像トリガ信号9が、特定領域B内に熱間長尺材の全長が搬送されたことを知らせる検知信号となる。尚、画像処理手段8は市販のパソコンシステムに市販の画像処理アプリケーションソフトウエアをインストールしたものである。
In the present embodiment, the camera 5 is installed obliquely above the transport path 2 due to installation space limitations, but the present invention is not limited to this.
The thermal sensor 4, for example, the HMD 4 directs the thermal observation line of sight 7 toward the entrance point to the imaging field of view SA of the conveyance path 2, sets the entrance point as the specific position PS, and sets the specific position PS as the heat observation point. While taking the heat observation data of the steel pipe 1 between the passing heat, the obtained heat observation data is transmitted to the sequence control means 11. The sequence control means 11 automatically transmits an imaging trigger signal 9 to the image processing means 8 in response to the fall of the heat observation data. That is, the thermal sensor (HMD) 4 and the sequence control means 30 detect the presence or absence of a hot long material at a specific position PS on the conveyance path, and the total length of the hot long material (steel pipe 1) is within the specific region B. The detection means which detects having conveyed is comprised, and the said imaging trigger signal 9 turns into a detection signal which notifies that the full length of a hot long material was conveyed in the specific area | region B. FIG. The image processing means 8 is obtained by installing commercially available image processing application software on a commercially available personal computer system.

カメラ5は、特定領域Bを常時撮像し、動画である1次撮像データ10が画像処理手段に送られる。画像処理手段8は、シーケンス制御手段30からの撮像トリガ信号9を受信すると、カメラ5から送られてくる1次撮像データ10(動画データ)から、撮像トリガ信号を受信した時点の静止画像を取得する。撮像トリガ信号9の送信から画像処理手段8が静止画像を取得するまでの所要時間は極微小で無視できるから、静止画像取得時点では、熱観測データの立下りを齎した鋼管1の尾端部が熱観測地点(特定位置PS)に位置し、鋼管1全部が撮像視野SA内に収まっており、従って、前記静止画像は、鋼管1全体についての輝度情報を含むものである。   The camera 5 always images the specific area B, and the primary imaging data 10 that is a moving image is sent to the image processing means. When the image processing unit 8 receives the imaging trigger signal 9 from the sequence control unit 30, the image processing unit 8 acquires a still image at the time of receiving the imaging trigger signal from the primary imaging data 10 (moving image data) sent from the camera 5. To do. Since the time required from the transmission of the imaging trigger signal 9 until the image processing means 8 acquires a still image is extremely small and can be ignored, the tail end portion of the steel pipe 1 in which the falling of the thermal observation data is hesitant at the time of still image acquisition Is located at the heat observation point (specific position PS), and the entire steel pipe 1 is within the imaging field of view SA. Therefore, the still image includes luminance information about the entire steel pipe 1.

又、静止画像は高速シャッタスピード(約4ms)のワンショット撮像なので、搬送速度が変動しても撮像データが乱れることはない。
画像処理手段8では、静止画像を画像処理して長尺材画像を導出し、該長尺材画像から長尺材画像長さを導出する。その導出要領を図2に示す。まず、静止画像の輝度情報を可視化した輝度画像11を画面8Dに表示する。画面8Dは、画面の法線がカメラ視線6に対応し、画面の横軸であるX軸が搬送路2との平行軸に対応し、画面の縦軸であるY軸がカメラ視線6と搬送路2平行軸とに垂直な軸に対応する画面設定とされている(以下同じ)。したがって、輝度画像11における長尺材部11Aは画面のY軸上のほぼ中心に位置して表示される。
Further, since the still image is a one-shot image pickup at a high shutter speed (about 4 ms), the image pickup data is not disturbed even if the conveyance speed is changed.
The image processing means 8 performs image processing on the still image to derive a long material image, and derives the long material image length from the long material image. The derivation procedure is shown in FIG. First, the luminance image 11 obtained by visualizing the luminance information of the still image is displayed on the screen 8D. In the screen 8D, the normal line of the screen corresponds to the camera line of sight 6, the X axis which is the horizontal axis of the screen corresponds to the parallel axis to the transport path 2, and the Y axis which is the vertical axis of the screen is transported from the camera line of sight 6. The screen setting corresponds to an axis perpendicular to the parallel axis of the path 2 (the same applies hereinafter). Therefore, the long material portion 11A in the luminance image 11 is displayed at a position substantially at the center on the Y axis of the screen.

輝度画像11において長尺材部11Aの輝度は長尺材部以外の部分11Bの輝度に比べて段違いに高いので、実験や操業実績に基いて定めた相応しい閾値を用いて長尺材部11Aと長尺材部以外の部分11Bとの境界を判別できる。そこで、予め設定した前記閾値を用い、画面X軸全域についてY軸方向に輝度点検して輝度が閾値以上であるY軸領域(領域AYという)を同定し、該領域AYについてX軸方向に輝度点検して輝度が閾値以上であるX軸領域(領域AXという)を同定する。得られた前記領域AXと前記領域AYとの共通部分が前記長尺材部11Aの画像すなわち長尺材画像である。   In the luminance image 11, the luminance of the long material portion 11 </ b> A is significantly higher than the luminance of the portion 11 </ b> B other than the long material portion, and therefore the long material portion 11 </ b> A and the long material portion 11 </ b> A are The boundary with the portion 11B other than the long material portion can be determined. Therefore, using the threshold value set in advance, the luminance is inspected in the Y-axis direction for the entire screen X-axis to identify the Y-axis region (referred to as region AY) whose luminance is equal to or greater than the threshold value, and the luminance in the X-axis direction for the region AY Inspection is performed to identify an X-axis region (referred to as region AX) having a luminance equal to or higher than a threshold value. The common part of the obtained area AX and area AY is an image of the long material portion 11A, that is, a long material image.

画像処理手段8は、引き続き、前記長尺材画像から長尺材(鋼管1)の長さを求めるが、それには、まず、前記長尺材画像のX軸方向両端に位置する画素のX軸座標すなわち、先端部X座標X1,尾端部X座標X2を読取る。画素サイズがδであるとして、前記座標X1〜X2間の画素個数は(X2−X1)/δ(=Nとする)であり、これが画素個数を単位とした長尺材画像長さ(Image Lengthの略号であるILと記す)であり、すなわち、IL=Nである。   The image processing means 8 continues to obtain the length of the long material (steel pipe 1) from the long material image. First, the X-axis of the pixels located at both ends of the long material image in the X-axis direction is used. The coordinates, that is, the tip end X coordinate X1 and the tail end X coordinate X2 are read. Assuming that the pixel size is δ, the number of pixels between the coordinates X1 to X2 is (X2−X1) / δ (= N), and this is the long material image length (Image Length) in units of the number of pixels. In other words, IL = N.

前記ILを長尺材の実長(Real Lengthの略号であるRLと記す)に変換するには、1画素当たりの実長(Real Length Per Pixelの略号であるRLPPと記す)が必要である。
カメラがレンズ歪み(収差)の無い理想レンズのカメラであれば、RLPPは画面内の画素位置には依存せず、レンズ倍率Mと画素サイズδで決まり、RLPP=M×δであり、
RL=RLPP×N=M×δ×N=M×(X2−X1) …(1)
となる。
In order to convert the IL into the actual length of a long material (referred to as RL, which is an abbreviation of Real Length), the actual length per pixel (referred to as RLPP, which is an abbreviation of Real Length Per Pixel) is required.
If the camera is an ideal lens camera without lens distortion (aberration), RLPP does not depend on the pixel position in the screen, is determined by the lens magnification M and the pixel size δ, and RLPP = M × δ.
RL = RLPP × N = M × δ × N = M × (X2−X1) (1)
It becomes.

然し、実際のカメラにはレンズ歪みがあるので、前記長尺材画像のX軸方向の中央部と端部とではRLPPは異なる。例えば、中央部では4mm/画素、両端部では3.7mm/画素などである。
一般にRLPPは中央部では理想レンズの場合とほぼ同じであるが、端部に向かうほど理想レンズの場合とのずれが大きくなる。よって、RLPPは、前記ずれを表す係数である長さ換算係数Kを加味する必要があるため、本実施形態では、長尺材画像と該長尺材画像中の長さ方向二以上の区域で相異なる長さ換算係数Kとから、熱間長尺材の長さを算出する。但し、RLPPは上述の様に中央部では理想レンズの場合とほぼ同じなので、K=1である。
However, since an actual camera has lens distortion, RLPP is different between the central portion and the end portion in the X-axis direction of the long material image. For example, 4 mm / pixel at the center and 3.7 mm / pixel at both ends.
In general, RLPP is almost the same as in the case of an ideal lens at the center, but the deviation from the ideal lens increases toward the end. Therefore, since it is necessary for the RLPP to take into account the length conversion coefficient K that is a coefficient representing the deviation, in the present embodiment, the RLPP is divided into a long material image and two or more areas in the length direction in the long material image. The length of the hot long material is calculated from the different length conversion factors K. However, since RLPP is almost the same as that of an ideal lens at the center as described above, K = 1.

上記の様に長尺材画像のX軸方向区域により異なるRLPPを求めて長尺材画像から長尺材長さRLを算出する為に、本発明では、予め前記カメラで冷間静止状態の光点目盛尺を撮像して得た光点撮像データを画像処理して、長さ方向の二以上の区域で相異なる長さ換算係数を導出しておき、これと長尺材画像とから長尺材の長さを算出する。前記長さ換算係数(以下、単に、係数とも云う)の導出方法を以下に述べる。   In order to calculate the long material length RL from the long material image by obtaining different RLPPs depending on the X-axis direction area of the long material image as described above, in the present invention, in the present invention, the light in the cold stationary state in advance by the camera is used. The light spot imaging data obtained by imaging the point scale is subjected to image processing, and different length conversion coefficients are derived in two or more areas in the length direction. Calculate the length of the material. A method for deriving the length conversion coefficient (hereinafter also simply referred to as coefficient) will be described below.

本発明の一実施形態における光点目盛尺撮像時を示す模式図である図3に示される様に、光点目盛尺14は、冷間且つ静止の状態で搬送路2の撮像視野SA横断部分の路上に載置する。光点目盛尺14は光点担体用長尺品(例えば塩ビ管)の外面長手方向に設けた光点配列直線18上に複数の光点15(例えばLEDであり、或いは豆電球でもよい)を配列してなり、この光点15が目盛を形成する。光点配列直線18は鋼管1を搬送するときの搬送方向と平行となるようにしてあり、すなわち、光点目盛尺14は長尺材の長さ方向に目盛が配列されている。前記目盛を光点15で形成したのは、前記目盛にカメラ5での撮像を可能ならしめる輝度を付与するためである。尚、ここでは、光点15の成す目盛は等間隔としたが、間隔が既知の値に設定してあれば必ずしも等間隔でなくてもよい。又、光点15の個数は全9個としたが、これに限定されない。   As shown in FIG. 3, which is a schematic diagram showing light spot scale imaging in one embodiment of the present invention, the light spot scale 14 is a cold and stationary state across the imaging field SA of the conveyance path 2. Placed on the road. The light spot scale 14 has a plurality of light spots 15 (for example, LEDs or bean bulbs) on a light spot array line 18 provided in the longitudinal direction of the outer surface of a long light spot carrier (for example, a polyvinyl chloride tube). These light spots 15 form a scale. The light spot alignment line 18 is parallel to the transport direction when the steel pipe 1 is transported. That is, the light spot scale 14 has scales arranged in the length direction of the long material. The reason why the scale is formed at the light spot 15 is to give the scale a luminance that enables imaging by the camera 5. Here, the graduations formed by the light spots 15 are equally spaced, but may not necessarily be equally spaced as long as the spacing is set to a known value. Further, although the total number of the light spots 15 is nine, it is not limited to this.

但し、光点目盛尺14の円周方向の位相は、前記光点配列直線18がカメラ視線6と直交する位相とし、このときのカメラ5から光点配列直線18までの距離L0は既知の値に設定してある(図3(b)参照)。
カメラ5への撮像トリガ信号19は例えば押釦スイッチ等の手動送信手段16で手動送信する。該送信を受けたカメラ5は直ちに撮像を実行し、得た光点撮像データ12を画像処理手段8に送信する。前記光点撮像データ12は、光点15の点列の輝度情報を含むものである。
However, the phase in the circumferential direction of the light spot scale 14 is a phase in which the light spot array line 18 is orthogonal to the camera line of sight 6, and the distance L0 from the camera 5 to the light spot array line 18 at this time is a known value. (See FIG. 3B).
The imaging trigger signal 19 to the camera 5 is manually transmitted by manual transmission means 16 such as a push button switch. Upon receiving the transmission, the camera 5 immediately executes imaging, and transmits the obtained light spot imaging data 12 to the image processing means 8. The light spot imaging data 12 includes luminance information of a point sequence of the light spot 15.

画像処理手段8では、図4に示す様に、まず、光点撮像データ12の輝度情報を可視化した光点目盛画像22を画面8Dに表示する。光点目盛画像22は、9個の光点像22AがX軸方向に並んだものである。そこで、図示しないマウス等の入力手段を操作して各光点像22Aの中心位置をクリック24する。すると、画像処理手段8は、左から右への各光点像22AのX軸座標X(i)(;i=1〜9)を記録し、区域j(;X(j)〜X(j+1);j=1〜8)の画素個数N(j)=(X(j+1)−X(j))/δを計算する。そして、この画素個数N(j)と、光点目盛尺撮像準備時に入力し記憶させておいた、区域jに対応する実光点目盛間隔L(j)とから、RLPP(j)=L(j)/N(j)を計算する。   As shown in FIG. 4, the image processing means 8 first displays the light spot scale image 22 in which the luminance information of the light spot imaging data 12 is visualized on the screen 8D. The light spot scale image 22 is an image in which nine light spot images 22A are arranged in the X-axis direction. Therefore, an input means such as a mouse (not shown) is operated to click 24 at the center position of each light spot image 22A. Then, the image processing means 8 records the X-axis coordinates X (i) (; i = 1 to 9) of each light spot image 22A from the left to the right, and the area j (; X (j) to X (j + 1). ); The number of pixels N (j) = (X (j + 1) −X (j)) / δ for j = 1 to 8) is calculated. Then, from this number of pixels N (j) and the actual light spot scale interval L (j) corresponding to the zone j, which was input and stored when preparing the light spot scale image, RLPP (j) = L ( j) / N (j) is calculated.

計算の結果、RLPP(1)≒RLPP(8)>RLPP(2)≒RLPP(7)>RLPP(3)≒RLPP(4)≒RLPP(5)≒RLPP(6)であった。
そこで、光点目盛画像22における区域3〜6を中央部Cとして、そこでの前記係数Kは、K(C)=1とし、又、区域2,7は第2端部E2として、そこでの前記係数Kは、K(E2)=Mean(RLPP(j)(;j=2,7))/Mean(RLPP(j)(;j=3〜6))とし、又、区域1,8は第1端部E1として、そこでの前記係数Kは、K(E1)=Mean(RLPP(j)(;j=1,8))/Mean(RLPP(j)(;j=3〜6))とし、夫々記憶する。
As a result of the calculation, RLPP (1) ≈RLPP (8)> RLPP (2) ≈RLPP (7)> RLPP (3) ≈RLPP (4) ≈RLPP (5) ≈RLPP (6).
Accordingly, the areas 3 to 6 in the light spot scale image 22 are set as the central part C, and the coefficient K is set to K (C) = 1, and the areas 2 and 7 are set as the second end part E2 and the above-described coefficient is set there. The coefficient K is K (E2) = Mean (RLPP (j) (; j = 2,7)) / Mean (RLPP (j) (; j = 3 to 6)), and the areas 1 and 8 are As the one end E1, the coefficient K is K (E1) = Mean (RLPP (j) (; j = 1,8)) / Mean (RLPP (j) (; j = 3 to 6)) Remember each one.

かくして記憶した中央部Cと第1、第2端部E1,E2に夫々対応する相異なる係数K(C)、K(E1),K(E2)を用い、図2に示した長尺材画像から、長尺材長さRLを算出する。
先ず、鋼管の測長時(熱間長尺材撮像時)における鋼管1とカメラ5との距離Lが、光点目盛尺撮像時におけるカメラ5と光点配列直線18との距離L0と等しい揚合について説明する。
Using the different coefficients K (C), K (E1), and K (E2) respectively corresponding to the central portion C thus stored and the first and second end portions E1 and E2, the long material image shown in FIG. From this, the long material length RL is calculated.
First, the distance L between the steel pipe 1 and the camera 5 at the time of measuring the length of the steel pipe (when imaging a long hot material) is equal to the distance L0 between the camera 5 and the light spot array line 18 at the time of imaging the light spot scale. The case will be described.

長尺材画像11から読み取ったX軸方向両端に位置する画素のX軸座標X1、X2が、中央部C、第1端部E1、第2端部E2のいずれの位置にあるかを判定する。図5に示す例では、長尺材画像のX軸方向先端に位置する画素のX軸座標X1、X軸方向尾端に位置する画素のX座標X2が、それぞれ第2端部E2、第1端部E1に存在する。したがって、画像中のX軸方向における長尺材の存在位置は、区域2におけるX1と光点座標X(3)の間、区域3〜区域7の全域(光点座標X(3)〜X(8)の間)、区域8における光点座標X(8)とX2との間となる。したがつて、長尺材長さRLは、各光点像のX軸座標X(i)、係数K(C)、K(E1)、K(E2)から、以下の式(2)で算出される。
RL(mm)=M×(X(3)−X1)×K(E2)
+M×(X(7)−X(3))×K(C)
+M×(X(8)−X(7))×K(E2)
+M×(X2−X(8))×K(E1) ・・・(2)
つまり、静止画像上のX軸方向各区域における長尺材の存在長さに各区域についての前記係数Kおよび倍率Mを乗じたものを合計することで、長尺材長さRLを算出する。
It is determined whether the X-axis coordinates X1 and X2 of the pixels located at both ends in the X-axis direction read from the long material image 11 are located at the center C, the first end E1, or the second end E2. . In the example shown in FIG. 5, the X-axis coordinate X1 of the pixel located at the tip of the long material image in the X-axis direction and the X-coordinate X2 of the pixel located at the tail end in the X-axis direction are respectively the second end E2 and the first. Present at end E1. Accordingly, the position of the long material in the X-axis direction in the image is between X1 in the area 2 and the light spot coordinate X (3), between the entire area 3 to the area 7 (light spot coordinates X (3) to X ( 8)), between the light spot coordinates X (8) and X2 in the area 8. Therefore, the long material length RL is calculated by the following equation (2) from the X-axis coordinates X (i) and the coefficients K (C), K (E1), and K (E2) of each light spot image. Is done.
RL (mm) = M × (X (3) −X1) × K (E2)
+ M × (X (7) −X (3)) × K (C)
+ M × (X (8) −X (7)) × K (E2)
+ M × (X2−X (8)) × K (E1) (2)
That is, the long material length RL is calculated by summing the length of the long material in each X-axis direction area on the still image multiplied by the coefficient K and the magnification M for each area.

鋼管の測長時(熱間長尺材撮像時)における鋼管1とカメラ5との距離L(図1(b)参照)が、光点目盛尺撮像時におけるカメラ5と光点15の配列線15aとの距離L0(図2(b)参照)と等しい揚合には、画面8Dに表示される際の倍率Mは、鋼管1の画像と光点目盛尺14の画像とでは同一となるから、上記式(2)により求めたRLがそのまま、鋼管1の測長結果として用いることができる。例えば、搬送路2で搬送される鋼管1の外径寸法が1種類のみである場合には、上記LとL0とを等しく設定しておけば、上記式(2)によるRLが鋼管1の測長結果となる。   The distance L (see FIG. 1B) between the steel pipe 1 and the camera 5 at the time of measuring the length of the steel pipe (at the time of imaging a hot long material) is an array line of the camera 5 and the light spot 15 at the time of imaging the light spot scale. For an assembly equal to the distance L0 (see FIG. 2B) with respect to 15a, the magnification M when displayed on the screen 8D is the same between the image of the steel pipe 1 and the image of the light spot scale 14. The RL obtained by the above equation (2) can be used as the measurement result of the steel pipe 1 as it is. For example, when the outer diameter of the steel pipe 1 conveyed by the conveyance path 2 is only one type, if the above L and L0 are set equal, the RL according to the above equation (2) is measured by the steel pipe 1. Long result.

しかしながら、搬送路2を搬送される鋼管1として、種々の外径寸法のものがある場合、外径寸法に応じて、鋼管の側長時(熱間長尺材撮像時)における鋼管1とカメラ5との距離Lは変化するため、画面8Dに表示される際の倍率Mも変化する。したがって、搬送される鋼管1に種々の外径寸法のものがある場合、上記式(2)で求めたRLに対し、外径寸法に応じて補正を行うようにする。   However, when there are various outer diameters as the steel pipe 1 conveyed through the conveyance path 2, the steel pipe 1 and the camera at the time of the side length of the steel pipe (at the time of hot long material imaging) according to the outer diameter dimension. Since the distance L to 5 changes, the magnification M when displayed on the screen 8D also changes. Therefore, when the steel pipe 1 to be conveyed has various outer diameters, the RL obtained by the above equation (2) is corrected according to the outer diameter.

具体的には、画像処理手段8には、搬送されている鋼管1に関する情報としての外径Dの値が上記計算機(図示せず)から入力されるようにしておき、画像処理手段8には、鋼管1の外径Dに応じたカメラ5と鋼管1との距離L(D)を予め登録しておく。カメラ5と鋼管1との距離がL0のときの倍率をMとしているので、カメラ5と鋼管1との距離がL(D)のときの倍率MはM×L(D)/L0となるから、この外径Dの値に応じて、上記式(2)で求めたRLの値を以下の式(3)で補正してRL’を得ることで真の測長結果が得られる。   Specifically, the image processing means 8 is inputted with the value of the outer diameter D as information relating to the steel pipe 1 being conveyed from the above computer (not shown), and the image processing means 8 The distance L (D) between the camera 5 and the steel pipe 1 corresponding to the outer diameter D of the steel pipe 1 is registered in advance. Since the magnification when the distance between the camera 5 and the steel pipe 1 is L0 is M, the magnification M when the distance between the camera 5 and the steel pipe 1 is L (D) is M × L (D) / L0. Depending on the value of the outer diameter D, the true length measurement result can be obtained by correcting the value of RL obtained by the above equation (2) with the following equation (3) to obtain RL ′.

RL’=RL×L(D)/L0 ・・・(3)
なお、鋼管1の外径に応じたLの値は、幾何学的に予め計算して画像処理手段5に登録しておけばよい。
RL ′ = RL × L (D) / L0 (3)
Note that the value of L corresponding to the outer diameter of the steel pipe 1 may be geometrically calculated in advance and registered in the image processing means 5.

継目無鋼管製造ラインにおいてピアサーミル出側で熱間搬送中の鋼管(ホロー)は、従来、搬送方向に5個以上配置したHMDによる熱観測データとHMD位置座標と管搬送速度とから、最上流側HMDの管尾端検出時点の管先端位置と一致する下流側HMD位置座標を補間計算することで測長されていたが、測長精度が十分とは云えず、測長結果を次材圧延の為の圧延機セットアップに利用する操業のなかでときどき圧延不具合が発生した。   In the seamless steel pipe production line, the steel pipes (hollows) that are hot transported on the piercer mill exit side are conventionally the most upstream side from the thermal observation data by HMD, HMD position coordinates and pipe transport speed arranged in the transport direction. The length was measured by interpolation calculation of the downstream HMD position coordinates that coincide with the pipe tip position at the time of HMD pipe tail end detection, but the length measurement accuracy is not sufficient, and the length measurement result is Sometimes rolling defects occurred in the operation used to set up the rolling mill.

前記ラインに図1の形態で本発明を実施した。カメラは東芝テリー製CSC12M25BMP19,レンズはニコン製Nikkor14mmを用いた。鋼管のカメラ撮像から長さ算出までは17msと極短時間である。本発明実施後は、前記圧延不具合は発生しなくなった。又、カメラとHMD各1個ずつの設置となったので、設備コスト削減、メンテナンス負荷軽減の効果も具現した。   The present invention was implemented in the form of FIG. The camera used was Toshiba Terry CSC12M25BMP19, and the lens used was Nikon Nikkor 14 mm. It takes an extremely short time of 17 ms from the camera imaging of the steel pipe to the length calculation. After implementation of the present invention, the rolling defect no longer occurred. In addition, since one camera and one HMD were installed, the effect of reducing equipment cost and maintenance load was also realized.

1 鋼管(熱間長尺材)
2 搬送路(搬送ローラ群)
3 搬送
4 熱センサ(HMD)
5 カメラ(撮像手段)
6 カメラ視線
7 熱観測視線
8 画像処理手段
8D 画面
9 撮像トリガ信号
10 1次撮像データ
11 輝度画像
11A 長尺材部
11B 長尺材部以外の部分
12 光点撮像データ
14 光点目盛尺
15 光点(LED或いは豆電球)
16 手動送信手段(押釦スイッチ)
18 光点配列直線
19 撮像トリガ信号
22 光点目盛画像
22A 光点像
30 シーケンス制御手段
PS 特定位置(熱観測地点)
SA 撮像視野
B 特定領域
1 Steel pipe (hot long material)
2 Conveying path (conveying roller group)
3 Transport 4 Thermal sensor (HMD)
5 Camera (imaging means)
6 Camera line of sight 7 Thermal observation line of sight 8 Image processing means 8D Screen 9 Imaging trigger signal 10 Primary imaging data 11 Luminance image 11A Long material part 11B Non-long material part 12 Light spot imaging data 14 Light spot scale 15 Light Point (LED or miniature bulb)
16 Manual transmission means (push button switch)
18 Light spot array line 19 Imaging trigger signal 22 Light spot scale image 22A Light spot image 30 Sequence control means PS Specific position (thermal observation point)
SA Imaging field of view B Specific area

Claims (2)

搬送路を搬送される、種々の外径寸法の熱間長尺材の測長方法であって、
前記熱間長尺材の全長が視野内に入る撮像視野を持ち、前記搬送路の特定領域を撮像する1個の撮像手段の視野内に、前記熱間長尺材が搬送されたことを検知し、
該検知した時点で、前記撮像手段により撮像された前記熱間長尺材の静止画像を取得し、
該静止画像における熱間長尺材の長さ方向存在位置と、前記特定領域内に前記熱間長尺材の長さ方向に目盛を配列した光点目盛尺を撮像してなる光点撮像データを画像処理して予め導出してある、前記熱間長尺材の外径寸法に応じた、画像中の長さ方向二以上の区域で相異なる長さ換算係数とから、
前記熱間長尺材の長さを算出することを特徴とする熱間長尺材の測長方法。
A method for measuring a hot long material of various outer diameters that is transported through a transport path,
It has an imaging field of view where the entire length of the hot long material falls within the field of view, and it is detected that the hot long material has been transported within the field of view of one imaging means that images a specific area of the transport path. And
At the time of the detection, obtain a still image of the hot long material imaged by the imaging means,
Light spot imaging data obtained by imaging the position in the length direction of the hot long material in the still image and the light spot scale in which the scale is arranged in the length direction of the hot long material in the specific region From the length conversion coefficient different in the two or more areas in the length direction in the image according to the outer diameter dimension of the hot long material , which is derived in advance by image processing,
A method for measuring a length of a hot long material, comprising calculating a length of the hot long material.
搬送路を搬送される、種々の外径寸法の熱間長尺材の測長装置であって、
前記熱間長尺材の全長が視野内に入る撮像視野を持ち、前記搬送路の特定領域を撮像する1個の撮像手段と、
前記搬送路の特定位置における熱間長尺材の有無を検出し、前記特定領域内に前記熱間長尺材の全長が搬送されたことを検知する検知手段と、
該検知手段の検知信号にもとづき、前記撮像手段により撮像された前記熱間長尺材の全長を含む静止画像を取得し、
前記取得した静止画像における熱間長尺材の長さ方向存在位置と、前記撮像視野内で、前記熱間長尺材の長さ方向に目盛を配列した光点目盛尺を撮像してなる光点撮像データを画像処理して予め導出してある、前記熱間長尺材の外径寸法に応じた、画像中の長さ方向二以上の区域で相異なる長さ換算係数とから、
前記熱間長尺材の長さを算出する画像処理手段と、
を有することを特徴とする熱間長尺材の測長装置。
It is a length measuring device for hot long materials of various outer diameters that are transported through a transport path,
An imaging field having an imaging field in which the entire length of the hot long material falls within the field of view;
Detecting means for detecting presence or absence of a hot long material at a specific position of the transport path, and detecting that the entire length of the hot long material is transported in the specific region;
Based on the detection signal of the detection means, obtain a still image including the entire length of the hot long material imaged by the imaging means,
Light obtained by imaging the position of the hot long material in the length direction of the acquired still image and the light spot scale in which the scale is arranged in the length direction of the hot long material within the imaging field of view. From the length conversion coefficient different in two or more areas in the length direction in the image according to the outer diameter size of the hot long material , which is derived in advance by image processing the point imaging data,
Image processing means for calculating the length of the hot long material;
A length measuring apparatus for hot long materials, comprising:
JP2012200379A 2012-09-12 2012-09-12 Hot length measuring method and apparatus Active JP6079072B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2012200379A JP6079072B2 (en) 2012-09-12 2012-09-12 Hot length measuring method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012200379A JP6079072B2 (en) 2012-09-12 2012-09-12 Hot length measuring method and apparatus

Publications (2)

Publication Number Publication Date
JP2014055833A JP2014055833A (en) 2014-03-27
JP6079072B2 true JP6079072B2 (en) 2017-02-15

Family

ID=50613279

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012200379A Active JP6079072B2 (en) 2012-09-12 2012-09-12 Hot length measuring method and apparatus

Country Status (1)

Country Link
JP (1) JP6079072B2 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104154887A (en) * 2014-08-27 2014-11-19 李书闯 Steel length measurement device
CN111798444B (en) * 2020-07-17 2023-06-27 太原理工大学 Unmanned workshop steel pipe length measurement method based on image distortion correction color separation processing
CN116124015A (en) * 2023-01-06 2023-05-16 合肥金星智控科技股份有限公司 A system and method for visual inspection of pipe length

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4490617A (en) * 1979-11-26 1984-12-25 European Electronic Systems Limited Optical width measuring system using two cameras
GB2064102B (en) * 1979-11-26 1983-11-30 Europ Electronic Syst Ltd Electro-optical dimension measurement
JPS5722507A (en) * 1980-07-16 1982-02-05 Shinko Electric Co Ltd Measuring device for length of travelling body
JP3369235B2 (en) * 1993-01-12 2003-01-20 三洋機工株式会社 Calibration method for measuring distortion in three-dimensional measurement
JP2673112B2 (en) * 1994-06-22 1997-11-05 コナミ株式会社 Mobile body remote control device
JPH0961121A (en) * 1995-08-25 1997-03-07 Sumitomo Electric Ind Ltd Dimension measuring device and measuring method
JP3573054B2 (en) * 2000-03-13 2004-10-06 Jfeスチール株式会社 On-line measurement accuracy inspection method for width and length meters
JP3736464B2 (en) * 2002-01-28 2006-01-18 松下電工株式会社 Reference mark position detection method
JP4837538B2 (en) * 2006-12-04 2011-12-14 昭和電工株式会社 End position measuring method and dimension measuring method
JP2013242184A (en) * 2012-05-18 2013-12-05 Nittetsu Hokkaido Control Systems Corp Bending quantity measuring apparatus of round bar material or cylindrical material

Also Published As

Publication number Publication date
JP2014055833A (en) 2014-03-27

Similar Documents

Publication Publication Date Title
JP5888035B2 (en) Method and apparatus for inspecting surface defects of cylindrical body or cylindrical body material
JP6497039B2 (en) Particle image flow velocity measuring method and particle image flow velocity measuring apparatus
JP2011134012A5 (en)
JP6079072B2 (en) Hot length measuring method and apparatus
JP5540767B2 (en) Method and apparatus for measuring length of hot long material
WO2016208622A1 (en) Surface defect detection apparatus and surface defect detection method
JP2014048226A (en) Shape inspection device of bar steel, and shape inspection method of bar steel
JP5853768B2 (en) Container appearance inspection device
JP2010025586A (en) Configuration determination method and configuration determination apparatus
JP2017219343A (en) Defect inspection device, defect inspection method, film manufacturing device, and film manufacturing method
JP5359038B2 (en) Line sensor elevation angle measuring device by image processing
JPH02194307A (en) Curvature shape measuring instrument for plate-like body
EP2957860B1 (en) Shape measuring device
JP3312564B2 (en) Measuring device for long objects
JP6398950B2 (en) Device for photographing the surface of a plate-like body
JP2016087652A (en) Thick steel plate warpage detection method and device
JP2012202957A (en) Defect position information generation device, defect confirmation system, and defect position information generation method
JP5889426B1 (en) Web inspection device, web inspection method, web inspection program
JP2013130415A (en) Radiation measuring device
JP5760462B2 (en) Tail-end crop detection device
JP5786631B2 (en) Surface defect inspection equipment
JP2011174884A (en) Method and apparatus for measuring length of hot long material
JP4023295B2 (en) Surface inspection method and surface inspection apparatus
JP2015059854A (en) Defect inspection method and defect inspection device
JP6339493B2 (en) Method for measuring plate width of continuum and method for producing steel plate

Legal Events

Date Code Title Description
RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20140328

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150717

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160525

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160531

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160722

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20161220

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170102

R150 Certificate of patent or registration of utility model

Ref document number: 6079072

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250