Deprecated: The each() function is deprecated. This message will be suppressed on further calls in /home/zhenxiangba/zhenxiangba.com/public_html/phproxy-improved-master/index.php on line 456
JP4239167B2 - Visual sensor - Google Patents
[go: Go Back, main page]

JP4239167B2 - Visual sensor - Google Patents

Visual sensor Download PDF

Info

Publication number
JP4239167B2
JP4239167B2 JP2003338936A JP2003338936A JP4239167B2 JP 4239167 B2 JP4239167 B2 JP 4239167B2 JP 2003338936 A JP2003338936 A JP 2003338936A JP 2003338936 A JP2003338936 A JP 2003338936A JP 4239167 B2 JP4239167 B2 JP 4239167B2
Authority
JP
Japan
Prior art keywords
image
optical member
incident light
incident
case body
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2003338936A
Other languages
Japanese (ja)
Other versions
JP2005109764A (en
Inventor
恵一 永野
祐一 高橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nippon Seiki Co Ltd
Original Assignee
Nippon Seiki Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Seiki Co Ltd filed Critical Nippon Seiki Co Ltd
Priority to JP2003338936A priority Critical patent/JP4239167B2/en
Publication of JP2005109764A publication Critical patent/JP2005109764A/en
Application granted granted Critical
Publication of JP4239167B2 publication Critical patent/JP4239167B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Studio Devices (AREA)

Description

本発明は、任意の視点位置における周辺画像を撮像する視覚センサに関する。   The present invention relates to a visual sensor that captures a peripheral image at an arbitrary viewpoint position.

従来、任意の視点位置における周辺画像を撮像する視覚センサとしては、例えば任意の視点位置における全方位画像を撮像する全方位視覚センサが知られており、図2に示すように、二葉双曲面のうちの一方の双曲面状の形状を有する反射ミラー11と、二葉双曲面の他方の双曲面状の形状を有し中心が他方の双曲面の焦点に配置されたレンズ12を備えるものが例えば特許文献1に開示されている。   Conventionally, as a visual sensor that captures a peripheral image at an arbitrary viewpoint position, for example, an omnidirectional visual sensor that captures an omnidirectional image at an arbitrary viewpoint position is known. As shown in FIG. For example, there is a patent that includes a reflecting mirror 11 having one hyperboloid shape and a lens 12 having the other hyperboloid shape of a two-leaf hyperboloid and having a center disposed at the focal point of the other hyperboloid. It is disclosed in Document 1.

かかる全方位視覚センサは、双曲面状の反射ミラー11によって、その焦点から全方位画像を撮像できるため、光学的に複雑な変換を受けていない歪の少ない画像を得ることが可能となるものであり、撮像した映像を容易に変換することができるものである。
特開平6−295333号公報
Such an omnidirectional visual sensor can pick up an omnidirectional image from its focal point by the hyperboloidal reflecting mirror 11, so that it is possible to obtain an image with less distortion that has not undergone optically complicated conversion. Yes, the captured image can be easily converted.
JP-A-6-295333

かかる全方位視覚センサは、反射ミラー11によって周囲からの入射光bを反射し、さらにレンズ12によってCCD(Charge-Coupled Device)等からなる撮像素子13に反射された入射光13を結像し、撮像素子13によって前記全方位画像を撮像するものである。そのため、撮像素子13によって歪みのない前記全方位画像を得るためには反射ミラー11の中心軸とレンズ12の光軸とを厳密に一致させる必要があり、反射ミラー11及びレンズ12を精度良く配設することが求められる。しかしながら、特に、小型化された全方位視覚センサにおいては、別体に形成される反射ミラー11及びレンズ12をそれぞれ精度良く配設することが困難であり、前記全方位画像が大きく歪んでしまう虞があるという問題点があった。   The omnidirectional visual sensor reflects incident light b from the surroundings by the reflecting mirror 11, and further forms an image of the incident light 13 reflected by the lens 12 on the image pickup device 13 such as a CCD (Charge-Coupled Device). The omnidirectional image is picked up by the image pickup device 13. Therefore, in order to obtain the omnidirectional image without distortion by the image sensor 13, it is necessary to strictly match the central axis of the reflecting mirror 11 and the optical axis of the lens 12, and the reflecting mirror 11 and the lens 12 are arranged with high accuracy. It is required to install. However, particularly in a miniaturized omnidirectional visual sensor, it is difficult to dispose the reflecting mirror 11 and the lens 12 separately formed with high accuracy, and the omnidirectional image may be greatly distorted. There was a problem that there was.

本発明は、前述の問題点に鑑みなされたものであり、撮像した任意の視点位置における周辺画像に歪みが生じることを抑制することが可能な視覚センサを提供することを目的とする。   The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a visual sensor capable of suppressing the occurrence of distortion in a peripheral image taken at an arbitrary viewpoint position.

本発明は、前述の課題を解決するために、周囲からの入射光を所定方向に導く光学部材と、前記光学部材によって導かれた前記入射光を受光して周辺画像を撮像する撮像素子と、前記撮像素子を収納するケース体と、を備え、前記光学部材は、前記光学部材の内部に前記入射光を導く入射部と、曲面形状からなり前記入射部からの前記入射光を前記撮像素子に向けて反射する反射部と、前記反射部によって反射された前記入射光を前記撮像素子に結像させる出射部と、前記入射部から延設され前記入射部及び前記出射部を支持する支持部と、前記支持部の端部に設けられ前記ケース体に配設されて前記ケース体内に収納される前記撮像素子に対して位置決めをするための取付部と、が一体的に形成されてなることを特徴とする。 In order to solve the above-described problems, the present invention provides an optical member that guides incident light from the surroundings in a predetermined direction, an imaging element that receives the incident light guided by the optical member and images a peripheral image, and A case body that houses the imaging element, and the optical member has an incident part that guides the incident light into the optical member, and has a curved shape, and the incident light from the incident part is incident on the imaging element. A reflecting portion that reflects toward the imaging device; an emitting portion that forms an image of the incident light reflected by the reflecting portion on the imaging device; and a support portion that extends from the incident portion and supports the incident portion and the emitting portion. A mounting portion provided at an end portion of the support portion and disposed in the case body for positioning with respect to the imaging element housed in the case body. Features.

また、前記光学部材は、中実構造からなることを特徴とする。   Further, the optical member has a solid structure.

また、前記出射部は、前記撮像素子に向かって突出する曲面形状からなることを特徴とする。   In addition, the emission part has a curved shape protruding toward the image sensor.

本発明は、任意の視点位置における周辺画像を撮像する視覚センサに関するものであり、撮像した前記画像に歪みが生じることを抑制することが可能となる。   The present invention relates to a visual sensor that captures a peripheral image at an arbitrary viewpoint position, and can prevent distortion of the captured image.

以下、本発明の実施の形態である視覚センサを添付図面に基づいて説明する。   Hereinafter, a visual sensor according to an embodiment of the present invention will be described with reference to the accompanying drawings.

図1に示すように、視覚センサは、光学部材1と、ケース体2と、撮像素子3とから主に構成されている。前記視覚センサは、例えば、車両のバンパーやサイドミラー等に固定して配設され、前記車両周辺における運転席に着座した運転手の死角部分を周辺画像として撮像するものである。   As shown in FIG. 1, the visual sensor mainly includes an optical member 1, a case body 2, and an image sensor 3. For example, the visual sensor is fixed to a vehicle bumper, a side mirror, or the like, and images a blind spot portion of a driver seated on a driver's seat around the vehicle as a peripheral image.

光学部材1は、例えば透光性の樹脂材料からなるものであり、光学部材1の周囲から光学部材1の内部に入射光を導く入射部1aと、双曲面形状からなり入射部1aからの前記入射光を撮像素子3に向けて反射する反射部1bと、光学部材1をケース体2に配設するための支持部1cと、反射部1bによって反射された前記入射光を撮像素子3に結像させる出射部1dと、が一体的に形成されてなるものである。また、光学部材1は、内部に空間のない中実構造からなるものであり、エッチング,切削あるいは成型等の適宜方法を用いて形成される。光学部材1を中実構造とすることによって、表面反射による減光を抑制することができ、撮像素子3によって撮像される任意の視点位置における周辺画像にコントラストがでない等の悪影響を与えることを抑制することが可能となっている。   The optical member 1 is made of, for example, a translucent resin material, and includes an incident portion 1a that guides incident light from the periphery of the optical member 1 to the inside of the optical member 1, and a front surface from the incident portion 1a that has a hyperboloid shape. The reflection part 1 b that reflects incident light toward the image sensor 3, the support part 1 c for disposing the optical member 1 on the case body 2, and the incident light reflected by the reflection part 1 b are coupled to the image sensor 3. The emitting part 1d to be imaged is formed integrally. The optical member 1 has a solid structure with no space inside, and is formed using an appropriate method such as etching, cutting or molding. By making the optical member 1 a solid structure, dimming due to surface reflection can be suppressed, and adverse effects such as lack of contrast on the peripheral image at an arbitrary viewpoint position imaged by the image sensor 3 can be suppressed. It is possible to do.

入射部1aは、双曲面形状である反射部1bの焦点Aを中心とする球面形状に形成され、周囲の前記入射光を反射部1bに向けて入射するものである。入射部1aを球面形状に形成することによって反射部1bの焦点に向けられる光が入射部の表面に対して垂直に入射されることとなるため、入射部1aから入射する際に前記入射光に屈折が生じて撮像素子3によって前記周辺画像を撮像する際に前記周辺画像が変形することを抑制でき、撮像素子3における画像処理において変形に対する修正のための複雑な演算を必要とせず、容易に画像処理を行うことが可能となっている。   The incident portion 1a is formed in a spherical shape centering on the focal point A of the reflecting portion 1b having a hyperboloid shape, and the surrounding incident light is incident on the reflecting portion 1b. By forming the incident portion 1a into a spherical shape, the light directed to the focal point of the reflecting portion 1b is incident perpendicularly to the surface of the incident portion, so that the incident light is incident on the incident portion 1a. It is possible to suppress the deformation of the peripheral image when the image sensor 3 captures the peripheral image due to refraction, and does not require a complicated calculation for correcting the deformation in the image processing in the image sensor 3, and can be easily performed. Image processing can be performed.

反射部1bは、二葉曲面の一方の双曲面形状に形成される凹部からなり、外側表面を鏡面とするために例えばアルミニウム(AL)等の金属材料からなる金属膜4が配設されてなるものである。また、反射部1bは、入射部1aから入射される前記入射光を反射し、特に、反射部1bの焦点に向けられた入射光aを撮像素子3に向けて反射する。   The reflecting portion 1b is formed by a concave portion formed in one hyperboloid shape of a two-leaf curved surface and is provided with a metal film 4 made of a metal material such as aluminum (AL) in order to make the outer surface a mirror surface. It is. The reflection unit 1b reflects the incident light incident from the incident unit 1a, and particularly reflects the incident light a directed toward the focal point of the reflection unit 1b toward the imaging element 3.

支持部1cは、入射部1aから延設される円柱形状に形成され、入射部1a及び反射部1bを支持するものである。また、支持部1cの端部には光学部材1を後述するケース体2の壁部に配設し、また、ケース体2内に収納される撮像素子3に対して位置決めをするための取付部1eが形成されている。光学部材1は後述するケース体2の開口部を覆うように配設され、例えば接着剤(図示しない)を介して取付部1eとケース体2の前記壁部とを接着して配設固定されている。   The support part 1c is formed in a cylindrical shape extending from the incident part 1a, and supports the incident part 1a and the reflecting part 1b. Further, the optical member 1 is disposed at the end of the support portion 1c on the wall portion of the case body 2 to be described later, and the mounting portion is used for positioning with respect to the image sensor 3 housed in the case body 2. 1e is formed. The optical member 1 is disposed so as to cover an opening of a case body 2 to be described later. For example, the mounting portion 1e and the wall portion of the case body 2 are bonded and fixed via an adhesive (not shown). ing.

出射部1dは、支持部1cの撮像素子3との対向面に形成され、撮像素子3に向けて突出する曲面形状からなり、反射部1bの焦点Aに向けて入射され反射部1bによって撮像素子3に向けて反射された入射光aを撮像素子3に結像させるものである。また、出射部1dは中心が反射部1bと一対となる二葉曲面の他方の双曲面の焦点Bに位置し、また、出射部1dの光軸と反射部1bの中心軸とが一致するように形成される。   The emitting portion 1d is formed on the surface of the support portion 1c facing the imaging device 3, has a curved shape protruding toward the imaging device 3, and is incident toward the focal point A of the reflecting portion 1b and is reflected by the reflecting portion 1b. The incident light “a” reflected toward the image 3 is imaged on the image sensor 3. In addition, the center of the emitting portion 1d is located at the focal point B of the other hyperboloid of the two-leaf curved surface paired with the reflecting portion 1b, and the optical axis of the emitting portion 1d and the central axis of the reflecting portion 1b coincide with each other. It is formed.

ケース体2は、例えば黒色等の暗色の樹脂材料からなり、後述する撮像素子3を収納するものである。ケース体2は、撮像素子3を配設する底面部2aと、底面部2aから延設し光学部材1の支持部1cが前記接着剤を介して配設される壁部2bと、底面部2aと対向し光学部材1によって覆われる開口部2cとを備える筒状形状からなる。   The case body 2 is made of, for example, a dark resin material such as black, and accommodates an image sensor 3 described later. The case body 2 includes a bottom surface portion 2a on which the image pickup device 3 is disposed, a wall portion 2b extending from the bottom surface portion 2a, and a support portion 1c of the optical member 1 disposed on the adhesive, and a bottom surface portion 2a. And a cylindrical shape provided with an opening 2c that is covered with the optical member 1.

撮像素子3は、例えばCCDあるいはCMOS等からなるものであり、光学部材1の反射部1b及び出射部1dと対向するようにケース体2の底面部2a上に配設され、出射部1dから受光した入射光aを所定の画像信号に変換して前記周辺画像を撮像するものである。前記画像信号は撮像素子3と電気的に接続される表示手段(図示しない)に出力され、前記画像信号に基づいて前記表示手段を制御することによって前記周辺画像が映像化して表示される。   The imaging device 3 is made of, for example, a CCD or a CMOS, and is disposed on the bottom surface portion 2a of the case body 2 so as to face the reflection portion 1b and the emission portion 1d of the optical member 1, and receives light from the emission portion 1d. The incident light a is converted into a predetermined image signal to capture the peripheral image. The image signal is output to display means (not shown) electrically connected to the image pickup device 3, and the peripheral image is visualized and displayed by controlling the display means based on the image signal.

かかる視覚センサは、周囲からの入射光を所定方向に導く光学部材1と、光学部材1によって導かれた前記入射光を受光して前記周辺画像を撮像する撮像素子3と、を備え、光学部材1は、光学部材1の内部に前記入射光を導く入射部1aと、双曲面形状からなり入射部1aからの前記入射光を撮像素子3に向けて反射する反射部と、反射部1bによって反射された前記入射光を撮像素子3に結像させる出射部1dと、が一体的に形成されてなるものである。また、出射部1dは、撮像素子3に向かって突出する曲面形状からなるものである。   The visual sensor includes an optical member 1 that guides incident light from the surroundings in a predetermined direction, and an imaging element 3 that receives the incident light guided by the optical member 1 and picks up the peripheral image. Reference numeral 1 denotes an incident part 1a that guides the incident light into the optical member 1, a reflection part that has a hyperboloid shape and reflects the incident light from the incident part 1a toward the image sensor 3, and is reflected by the reflection part 1b. The exit portion 1d that forms an image of the incident light on the image pickup device 3 is integrally formed. In addition, the emission portion 1 d has a curved shape that protrudes toward the image sensor 3.

以上の構成により、前記視覚センサは、入射部1a,反射部1b及び出射部1dを透光性の樹脂材料によって一体的に形成することによって、予め入射光を撮像素子3に向けて反射する反射部1bの中心軸と反射部1bによって反射された入射光を撮像素子3に結像させる出射部1dの光軸とが一致した状態で光学部材1をケース体2に配設することができる。したがって、光学部材1の実装の際に反射部1bの中心軸と出射部1dの光軸とが一致せずに撮像素子3によって撮像された前記周辺画像に歪みが生じることを抑制することが可能となる。   With the above configuration, the visual sensor is configured to integrally reflect the incident light toward the image sensor 3 by integrally forming the incident portion 1a, the reflection portion 1b, and the emission portion 1d with a translucent resin material. The optical member 1 can be disposed in the case body 2 in a state where the central axis of the part 1b and the optical axis of the emitting part 1d that forms the incident light reflected by the reflecting part 1b on the image pickup device 3 coincide with each other. Therefore, when the optical member 1 is mounted, it is possible to prevent the peripheral image captured by the image sensor 3 from being distorted when the central axis of the reflecting portion 1b does not coincide with the optical axis of the emitting portion 1d. It becomes.

また、前記視覚センサは、入射部1a,反射部1b及び出射部1dを透光性の樹脂材料によって一体的に形成することによって、従来のように光学部材1とは別体に入射光aを撮像素子3に結像させるための専用のレンズを配設する必要がないため、ケース体2に前記レンズを配設するためのスペースを削除することができることから、従来のように前記レンズを配設するものと比較して小型化することが可能となる。また、前記レンズが必要ないため部品点数を削減することができ、前記視覚センサの製造コストを安価にすることが可能となる。   In addition, the visual sensor integrally forms the incident portion 1a, the reflecting portion 1b, and the emitting portion 1d with a translucent resin material, so that the incident light a is separated from the optical member 1 as in the prior art. Since it is not necessary to dispose a dedicated lens for forming an image on the image pickup device 3, a space for disposing the lens in the case body 2 can be eliminated. It becomes possible to reduce the size as compared with the installation. Further, since the lens is not necessary, the number of parts can be reduced, and the manufacturing cost of the visual sensor can be reduced.

また、前記視覚センサは、光学部材1を中実構造にて形成するものであり、表面反射が生じる個所を削減することによって表面反射による減光を抑制することができ、撮像素子3によって撮像される前記周辺画像にコントラストがでない等の悪影響を与えることを抑制することが可能となる。   In addition, the optical sensor is formed by forming the optical member 1 with a solid structure, and can reduce the dimming due to the surface reflection by reducing the places where the surface reflection occurs. It is possible to suppress adverse effects such as lack of contrast on the peripheral image.

なお、本発明の実施の形態である前記視覚センサは、光学部材1を中実構造にて形成するものであったが、本発明の請求項1においては、光学部材を内部に空間を備える中空構造にて形成するものであってもよい。   In addition, although the said visual sensor which is embodiment of this invention formed the optical member 1 by the solid structure, in Claim 1 of this invention, the optical member is hollow provided with space inside. It may be formed by a structure.

また、本発明の実施の形態である前記視覚センサは、光学部材1の反射部1bが双曲面形状に形成されるものであったが、本発明は、光学部材の反射部は曲面形状であれば良く、例えば球面,楕円面または楕円放物面等の曲面形状からなるものであってもよい。   In the visual sensor according to the embodiment of the present invention, the reflecting portion 1b of the optical member 1 is formed in a hyperboloid shape. However, in the present invention, the reflecting portion of the optical member may be a curved surface shape. For example, it may be formed of a curved surface such as a spherical surface, an elliptical surface, or an elliptical paraboloid.

本発明の実施の形態である視覚センサを示す断面図。Sectional drawing which shows the visual sensor which is embodiment of this invention. 従来の全方位視覚センサを示す断面図。Sectional drawing which shows the conventional omnidirectional vision sensor.

符号の説明Explanation of symbols

1 光学部材
1a 入射部
1b 反射部
1c 支持部
1d 出射部
1e 支持部
2 ケース体
3 撮像素子
DESCRIPTION OF SYMBOLS 1 Optical member 1a Incident part 1b Reflective part 1c Support part 1d Output part 1e Support part 2 Case body 3 Imaging element

Claims (3)

周囲からの入射光を所定方向に導く光学部材と、前記光学部材によって導かれた前記入射光を受光して周辺画像を撮像する撮像素子と、前記撮像素子を収納するケース体と、を備え、
前記光学部材は、前記光学部材の内部に前記入射光を導く入射部と、曲面形状からなり前記入射部からの前記入射光を前記撮像素子に向けて反射する反射部と、前記反射部によって反射された前記入射光を前記撮像素子に結像させる出射部と、前記入射部から延設され前記入射部及び前記出射部を支持する支持部と、前記支持部の端部に設けられ前記ケース体に配設されて前記ケース体内に収納される前記撮像素子に対して位置決めをするための取付部と、が一体的に形成されてなることを特徴とする視覚センサ。
An optical member that guides incident light from the surroundings in a predetermined direction, an image pickup device that receives the incident light guided by the optical member and picks up a peripheral image, and a case body that houses the image pickup device ,
The optical member includes an incident part that guides the incident light into the optical member, a reflection part that has a curved shape and reflects the incident light from the incident part toward the imaging element, and is reflected by the reflection part. An exit portion that forms an image of the incident light on the image sensor; a support portion that extends from the entrance portion and supports the entrance portion and the exit portion; and a case body that is provided at an end of the support portion. And a mounting portion for positioning with respect to the imaging element housed in the case body and integrally formed.
前記光学部材は、中実構造からなることを特徴とする請求項1に記載の視覚センサ。 The visual sensor according to claim 1, wherein the optical member has a solid structure. 前記出射部は、前記撮像素子に向かって突出する曲面形状からなることを特徴とする請求項1に記載の視覚センサ。 The visual sensor according to claim 1, wherein the emitting portion has a curved shape protruding toward the imaging element.
JP2003338936A 2003-09-30 2003-09-30 Visual sensor Expired - Fee Related JP4239167B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003338936A JP4239167B2 (en) 2003-09-30 2003-09-30 Visual sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2003338936A JP4239167B2 (en) 2003-09-30 2003-09-30 Visual sensor

Publications (2)

Publication Number Publication Date
JP2005109764A JP2005109764A (en) 2005-04-21
JP4239167B2 true JP4239167B2 (en) 2009-03-18

Family

ID=34534250

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003338936A Expired - Fee Related JP4239167B2 (en) 2003-09-30 2003-09-30 Visual sensor

Country Status (1)

Country Link
JP (1) JP4239167B2 (en)

Also Published As

Publication number Publication date
JP2005109764A (en) 2005-04-21

Similar Documents

Publication Publication Date Title
CN102211549B (en) camera for vehicle
KR100548744B1 (en) Imaging Device and Manufacturing Method
US20110063498A1 (en) Camera module for vehicles
US20040165280A1 (en) Lens apparatus and image-taking apparatus
JP2011109634A (en) Vehicle-mounted camera
JP2001341580A (en) Camera device
JP2001154295A (en) Omnidirectional vision camera
JP2011221136A (en) Compound lens, lens unit, image pick-up device, and method of connecting and fixing compound lens
JP4239167B2 (en) Visual sensor
JP2006078854A (en) Camera head
JP2011244162A (en) Camera module and camera
JP5400511B2 (en) Raindrop detector
JP2005109806A (en) Imaging device
JP4433395B2 (en) Visual sensor
JP4239168B2 (en) Visual sensor
JP2005338218A (en) Imaging device
JP7244289B2 (en) Lens unit and camera module
JP2011237672A (en) Imaging apparatus
JP2006058778A (en) Optical unit
JP2005109785A (en) Visual sensor
JP2007147948A (en) Imaging apparatus
CN120972446A (en) Lens integration structure, panoramic camera, and image processing methods
JP4734873B2 (en) Wide-angle imaging device
JP2008135894A (en) Visual sensor device
JP4725723B2 (en) Imaging device

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060714

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20080911

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20080918

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20081016

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20081128

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20081211

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120109

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20150109

Year of fee payment: 6

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees