JP4190197B2 - Image display system, program, and recording medium - Google Patents

Description

【００３８】
とする。被写体が平面の場合、Ｐ１とＰ２との間には次の関係が成り立つ。
【００３９】
【式２】

【００４０】
ここで、
【００４１】
【式３】

【００４２】
により示される射影変換行列Ｈは、画像に撮影された二つの位置（Ｐ１とＰ２）が同じ場合は一定であるから、予め既知の点の組（ｕ１，ｖ１）と（ｕ２，ｖ２）からｈ１〜ｈ８を算出することができる。
したがって、第二画像の各点を第一画像の位置で撮影した場合の位置は、式（１）および式（２）を用いることにより算出することができる。
これにより、第一画像を基準とし、第一画像上に第二画像の画素をマッピングすることができる。
あおり歪を補正するためには、被写体の正対位置での正対画像を基準とし、正対画像と第一画像との間の射影変換行列Ｈを予め求め、それを用いて画像を再配置する。表示する際には、画像表示領域をシフトさせて全体画像が表示されるように調整する。
画像入力装置３０では、駆動部２０により、カメラ座標系の回転運動を規定して、撮像部１３を決められた位置に制御することができるので、撮影時に生じるあおり歪の補正を画像ごとに一意的に行うことができる。
【００４３】
また、画像整形手段３２４は、画像の属性情報に従って画像の表示方向を変える。
例えば、画像入力装置３０は、図１２に示すように、駆動部２０により撮像部１３を移動させ、被写体２２の設置面以外の被写体（図１２では、人物５０）を撮像することができるが、このように人物５０等を被写体とする場合には、低解像度（例えば、４８０×６４０の画素数）の要求の場合が多く、また、文書等を被写体２２として撮像する場合には、高解像度（例えば、１０２４×２０４８の画素数）が要求される場合が多い。
【００４４】
したがって、ユーザは被写体を撮像するときには、被写体の種類によって、駆動部２０の駆動状態や解像度を変えることから、画像の解像度から撮像部１３を駆動した際に生じる撮像の向きを判別することができる。
例えば、図１３（Ａ）に示したような画素数をもつ画像データは、その画素数の大きさによって、画像の向きを自動判別でき、その判断した向きに合わせて配置することができる。図１３において、画像ごとに表示されている三角マーク（▲）は、画像の向きを示すマーカである。
【００４５】
また、文書等の被写体を撮影する際には、画質を確保するために、圧縮率の低いＢＭＰデータを用いることが望ましく、一方、人物等を撮像する際には、圧縮率の高いＪＰＥＧデータを用いれば良いので、これらのファイル種別により撮像の向きを判別することもできる。
例えば、図１３（Ｂ）におけるように、ＢＭＰファイルは横向き方向に、ＪＰＥＧファイルは縦向き方向に画像の表示方向を変えるようにする。
このように、画素数やファイルの種類に応じて各画像の表示方向を可変にすることで、表示画像の向きが不自然になることを防ぐことができる。
【００４６】
＜画像表示装置の実施形態２＞
図１４は、図６に示した画像表示装置３２の他の機能構成を示すブロック図である。図１４において、画像表示装置３２は、インターフェース２７を介して、図１に示した画像入力装置の制御ユニット２６に設けられた記録媒体に記録された画像データを受信する画像受信手段３２１、受信した画像データを記録する記録手段３２２、記録手段３２２に記録された複数の画像データを選択する画像選択手段３２３、選択された画像を表示する画像表示手段３２５、この表示された画像から１画像以上を選択する第２画像選択手段３２６、第２画像選択手段３２６で選択された画像の属性情報に基づき処理する画像整形手段３２４、整形された画像を表示する第２画像表示手段３２７とから構成される。
上述の実施形態１の画像表示装置３２と同じ機能を持つ手段に対しては、図６と同じ符号を付し、ここでは相違する点についてのみ説明する。
【００４７】
画像表示装置３２は、転送されてきた画像データを画像受信手段３２１によって受信し、受信した画像データを一旦記録手段３２２に記録する。
ユーザは、この分割画像を利用したい場合に、記録手段３２２に記録された画像の中から画像選択手段３２３で複数の画像を選択する。
画像表示装置３２は、この選択された選択画像を画像表示手段３２５で表示させ、表示された複数の画像のうち少なくとも１画像以上を第２画像選択手段３２６でユーザに選択させる。
次に、画像表示装置３２は、選択された１以上の画像データを画像整形手段３２４であおり歪を補正し（前述の公知技術により補正する）、その補正した処理結果の画像を第２画像表示手段３２７で表示する。
【００４８】
この実施形態２の使用例につき図１５を用いて説明する。
まず、記録手段３２２の中から複数の画像が画像選択手段３２３によって選択され、画像表示手段３２５で図１５のウィンドウ１に示すように、あおり歪の補正が行われていない画像を各画像に対して選択表示枠を設けて表示する。
ユーザは、画像表示手段３２５で表示された複数の画像のうち、例えばＰＣのマウス等のポインティングデバイスによるクリックやダブルクリック等の操作により１つ以上の画像を選択（再選択）する。
第２画像選択手段３２６は、ウィンドウ１において、ユーザにより選択された画像の選択表示枠の色、選択画像自身の明るさや色合い、またはコントラスト等を変えることにより、視覚的に選択された画像が分かるように表示する。
次に、画像整形手段３２４によりここで選択された画像のあおり歪を補正し、第２画像表示手段３２７で補正結果を図１５のウィンドウ２のように表示する。
【００４９】
したがって、ユーザが第２画像選択手段３２６により指示した画像に対してのみ画像整形を行い、整形された画像のみを第２画像表示手段３２７へ表示するので、一覧表示を行う際の処理時間が短縮化され、より高速な表示ができ、分割撮像した各領域の領域画像の利便性が向上する。
また、第２画像選択手段３２６により選択した画像については、データ軽減処理を行わない画像を新たに受信し、記録手段３２２に記録することで、効率的な画像表示と画像の有効的な活用を促進できる。
【００５０】
また、第２画像表示手段３２７は、図１６に示すように、画像のあおり歪補正や複数の画像の画像合成を行った画像を表示するウィンドウ２にツールウィンドウ１を設けて、表示画像の明るさやコントラスト、画像の拡大／縮小等の表示パラメータを変えたり、カラーバランスや色相、彩度等のカラー画像の補正処理、２値化、デジタルフィルタによるノイズ低減処理等の一般的な画像処理を行ったり、文字が表示された領域について、汎用のＯＣＲ（Optical Character Recognition）処理を用いて文字認識を行うようにしてもよい。
【００５１】
さらに、第２画像表示手段３２７は、図１７に示すように、ウィンドウ２にツールウィンドウ２を設け、表示された画像の画像データを保存する等のファイル操作が行えるようにしてもよい。このファイル操作には、ファイルのオープンやクローズ、コピーや削除、移動、転送等が含まれる。
【００５２】
さらに、第２画像表示手段３２７は、図１８に示すように、ウィンドウ２にツールウィンドウ３〜５を設け、表示された画像の部分領域の指定（ツールウィンドウ３）、その指定された領域のコピー（ツールウィンドウ４）や貼り付け（ツールウィンドウ５）を行うようにしてもよい。
この指定された領域の貼り付けは、新たなウィンドウ３や文書作成や画像ファイルの編集等を行うアプリケーション（ワードプロセッサー等）上に貼り付ける。
【００５３】
また、上記のような機能は、ツールウィンドウではなく、ウィンドウ２の機能メニューとして設けるようにしてもよいし、マウスを用いたポップアップメニューや、ドラッグ、ドラッグアンドドロップ等を用いてもよい。
また、指定された指定領域の画像をコピーまたは貼り付けを行うだけでなく、指定された領域に対してツールウィンドウ１で汎用ＯＣＲ処理機能を指定したときには、その領域を文字認識してウィンドウ３またはアプリケーション上に貼り付けるようにしてもよい。
これにより、より容易な電子文書の作成が可能になる。
【００５４】
＜画像表示装置の実施形態１の変形例＞
上述した実施形態１は、選択した複数の画像データをそれぞれ画像整形してあおり歪補正した各画像を独立に表示していた。
本変形例では、このあおり歪補正した後、１枚の合成画像として表示するようにした。
図１９は、本変形例の画像表示装置の機能構成を示すブロック図である。図１９において、本変形例の画像表示装置３２は、インターフェース２７を介して、図１に示した画像入力装置の制御ユニット２６に設けられた記録媒体に記録された画像データを受信する画像受信手段３２１、受信した画像データを記録する記録手段３２２、記録手段３２２に記録された複数の画像データを選択する画像選択手段３２３、画像の属性情報に基づき処理する画像整形手段３２４、画像整形した結果を１枚の画像に合成する画像合成手段３２８、その合成結果を表示する第２画像表示手段３２７とから構成される。
上述の実施形態１または実施形態２の画像表示装置３２と同じ機能を持つ手段に対しては、図６および図１４と同じ符号を付している。
【００５５】
本変形例の画像表示装置３２は、次のように動作する。
まず、転送されてきた画像データを画像受信手段３２１によって受信し、受信した画像データを一旦記録手段３２２に記録する。
ユーザは、この分割画像を利用したい場合に、記録手段３２２に記録された画像の中から画像選択手段３２３で複数の画像を選択する。
画像表示装置３２は、この選択された選択画像に対して、画像整形手段３２４で画像の属性情報を参照して種々の整形処理を行った後、あおり歪補正を行う。
画像合成手段３２８で、あおり歪補正を行った画像を１枚の画像に合成し、第２画像表示手段３２７でこの合成された画像を表示する。
【００５６】
＜画像表示装置の実施形態２の変形例＞
上述した実施形態２は、選択した複数の画像データの中から、さらに選択した１つ以上の画像にあおり歪補正した画像を表示していた。
本変形例では、このあおり歪補正した後、１枚の合成画像として表示するようにした。
図２０は、実施形態２の変形例の画像表示装置の機能構成を示すブロック図である。図２０において、本変形例の画像表示装置３２は、インターフェース２７を介して、図１に示した画像入力装置の制御ユニット２６に設けられた記録媒体に記録された画像データを受信する画像受信手段３２１、受信した画像データを記録する記録手段３２２、記録手段３２２に記録された複数の画像データを選択する画像選択手段３２３、選択された画像を表示する画像表示手段３２５、この表示された画像から１画像以上を選択する第２画像選択手段３２６、第２画像選択手段３２６で選択された画像の属性情報に基づき処理する画像整形手段３２４、画像整形した結果を１枚の画像に合成する画像合成手段３２８、その合成結果を表示する第２画像表示手段３２７とから構成される。
上述の実施形態１または実施形態２の画像表示装置３２と同じ機能を持つ手段に対しては、図６および図１４と同じ符号を付している。
【００５７】
本変形例の画像表示装置３２は、次のように動作する。
まず、転送されてきた画像データを画像受信手段３２１によって受信し、受信した画像データを一旦記録手段３２２に記録する。
ユーザは、この分割画像を利用したい場合に、記録手段３２２に記録された画像の中から画像選択手段３２３で複数の画像を選択する。
画像表示装置３２は、この選択された選択画像を画像表示手段３２５で表示させ、表示された複数の画像のうち少なくとも１画像以上を第２画像選択手段３２６でユーザに選択させる。
次に、画像表示装置３２は、選択された１以上の画像データを画像整形手段３２４であおり歪を補正し（前述の公知技術により補正する）、画像合成手段３２８で、あおり歪補正を行った画像を１枚の画像に合成し、第２画像表示手段３２７でこの合成された画像を表示する。
【００５８】
画像選択手段３２３で選択された複数の画像は、図２１に示すようにウィンドウ１に分割撮像された画像のサムネイル画像として表示される。
第２画像選択手段３２６によって、このウィンドウ１に表示されたサムネイル画像の複数画像を選択する。
例えば、ウィンドウ１の選択画像上でＰＣのマウス等のポインティングデバイスによるクリックやダブルクリック等の操作により選択（再選択）する。図２１では、４画像を選択している。
【００５９】
この選択が終了すると、画像整形手段３２４でその選択された複数画像のあおり歪を補正し、画像合成手段３２８で一枚の画像に画像合成する。この合成画像を第２画像表示手段３２７でウィンドウ２に表示する（図２１）。
これにより、分割して撮影したより広い部分領域の画像を抽出できるようになり、画像の利用性がさらに向上する。
【００６０】
さらに、本発明は上記の実施形態のみに限定されたものではない。
図２２は、本発明をコンピュータで実現するときのハードウェアの構成を示すブロック図である。図２２において、中央演算処理装置（ＣＰＵ）６１と、キーボード、マウスまたはタッチパネル等の入力装置６２と、ディスプレイ等の表示装置６３と、メモリ６４と、ハードディスク等の記憶装置６５と、媒体読取装置６６とがデータバス６７によって接続されている。
上述した本発明の機能を実行するプログラムコードを記録媒体に記録し、その記録媒体に記録されたプログラムコードを媒体読取装置６６や記憶装置６５から読み取って、図２２に示したコンピュータへインストールし、そのプログラムをＣＰＵ６１で実行することにより容易に本発明を実施できる。
この場合、記録媒体から読出されたプログラムコード自体も上述した本発明の機能を実現することになり、そのプログラムコードおよびそのコードを記憶した記録媒体は本発明を構成することになる。
【００６１】
なお、記録媒体としては半導体媒体（例えば、ＲＯＭ、不揮発性メモリカード等）、光媒体（例えば、ＤＶＤ、ＭＯ、ＭＤ、ＣＤ−Ｒ等）、磁気媒体（例えば、磁気テープ、フレキシブルディスク等）等のいずれであってもよい。
【００６２】
また、ロードしたプログラムを実行することにより上述した本発明の機能が実現されるだけでなく、そのプログラムの指示に基づき、オペレーティングシステム等が実際の処理の一部または全部を行い、その処理によって上述した本発明の機能が実現される場合も含まれる。
【００６３】
【発明の効果】
以上説明したように本発明によれば、被写体を複数の分割画像領域に分割して撮像する画像入力装置を用いて撮像した画像を一覧表示する際に、画像の種類や仕様等の属性情報に応じて画像を整形して表示することにより画像の閲覧性、利便性が向上する。
【００６４】
また、被写体を複数の分割画像領域に分割して撮像する画像入力装置を用いて撮像した画像を一覧表示し、一覧表示上でさらに指示した画像の種類や仕様等の属性情報に応じて画像を整形して表示するため、表示にかかる時間を短縮するとともに、画像の閲覧性、利便性が向上する。
【００６５】
また、被写体の分割撮像により生じるあおり歪を補正して表示することにより、分割撮像した各画像の閲覧性、利便性が向上する。
【００６６】
また、撮影した画像の属性情報に応じて画像の表示方向を変えて表示するため、異なった被写体を撮影した際の表示方向を変更する煩雑さが低減し、画像表示の閲覧性、利便性が向上する。
【００６７】
また、ユーザに画像範囲をより柔軟に指定できるようにして、被写体に対して広い範囲を撮像して得た分割撮像から、所望の複数の画像を選択し、選択された画像を一枚の画像に合成することができるため、より広い範囲から得られた画像の閲覧性、利便性が向上する。
【００６８】
また、被写体を分割撮像した画像を、分割撮像の順番に基づいて、表示位置を調整するため、被写体の全体画像と同様なレイアウトで分割画像を並べて閲覧することが可能になり閲覧性、利便性が向上する。
【００６９】
また、被写体を分割撮像した一連の画像を分割撮像単位で分離して表示するようにしたので、複数の関連性の無い分割画像が混在して表示されることが無くなり閲覧性、利便性が向上する。
【図面の簡単な説明】
【図１】 本システムで扱う分割画像を入力するための画像入力装置の構成を示す模式図である。
【図２】 撮像部の構成を示す模式図である。
【図３】 本システムの構成を示す模式図である。
【図４】 本システムの他の構成を示す模式図である。
【図５】 コントローラの構成を示す模式図である。
【図６】 本システムで用いられる画像表示装置の機能構成を示すブロック図である。
【図７】 表示テンプレートを説明するための表示例である。
【図８】 表示テンプレートを説明するための他の表示例である。
【図９】 被写体となる文書の表示例である。
【図１０】 被写体の分割画像の表示例である。
【図１１】 分割画像のあおり歪を補正した画像の表示例である。
【図１２】 撮像対象によって画像属性が判定できることを説明するための図である。
【図１３】 画像属性によって画像の表示方向が判定できることを説明するための図である。
【図１４】 本システムで用いられる画像表示装置の他の機能構成を示すブロック図である。
【図１５】 他の構成の画像表示装置の使用例である。
【図１６】 第２画像表示手段における操作例である。
【図１７】 第２画像表示手段における他の操作例である。
【図１８】 第２画像表示手段における他の操作例である。
【図１９】 画像表示装置の実施形態１の変形例の機能構成を示すブロック図である。
【図２０】 画像表示装置の実施形態２の変形例の機能構成を示すブロック図である。
【図２１】 表示された画像から部分的に選択した画像をあおり歪補正して画像合成するときの表示例である。
【図２２】 本発明をコンピュータで実現するときのハードウェアの構成を示すブロック図である。
【符号の説明】
１…固定レンズ、２…ズームレンズ、３…絞り機構、４…シャッタ、５…フォーカスレンズ、６…撮像素子、７…ＣＤＳ回路、８…Ａ／Ｄ変換器、９…ＴＧ、１０…ＩＰＰ、１１…メモリ、１２…ＭＰＵ、１３…撮像部、２０…駆動部、２１ａ…支持柱、２１ｂ…支持ユニット、２２…被写体、２３…分割撮像領域、２６…制御ユニット、２７…インターフェース、３０…画像入力装置、３１…コントローラ、３１ａ…表示手段、３１ｂ,３１ｃ…メニュー選択スイッチ、３１ｄ…メニュー決定スイッチ、３１ｅ…ファイル転送・出力スイッチ、３２…画像表示装置、４０…ネットワーク、５０…人物、３２１…画像受信手段、３２２…記録手段、３２３…画像選択手段、３２４…画像整形手段、３２５…画像表示手段、３２６…第２画像選択手段、３２７…第２画像表示手段、３２８…画像合成手段、６１…ＣＰＵ、６２…入力装置、６３…表示装置、６４…メモリ、６５…記憶装置、６６…媒体読取装置、６７…データバス。[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image display system, a program, and a recording medium, and more particularly, to an image display system, a program, and a recording medium having an image display device used in combination with an image input device.
[0002]
[Prior art]
The “image composition device” disclosed in Japanese Patent Laid-Open No. 11-232477 requires fine adjustment to a group of thumbnail images (reduced display images), for example, panoramas of a plurality of captured still images in which a part of each is overlapped. When an image is created, processing such as movement, rotation, enlargement, and deformation can be performed in a batch in the process of image composition processing.
However, no consideration is given to a method for displaying a plurality of subjects with different shooting conditions, and correction cannot be performed when there is a different distortion in each image.
[0003]
Japanese Patent Laid-Open No. 8-251521 discloses an “image input device” which captures an image of a subject provided on a document table with an imaging unit, stores a plurality of images obtained by the imaging unit, and stores the stored multiple images. A predetermined number of images are displayed on the display device as an image group.
However, since division shooting is not considered, correction of tilt distortion due to this is not considered. Also, the image display has not been improved.
[0004]
[Problems to be solved by the invention]
In an image input device that captures an image by dividing a subject into a plurality of divided image areas, there are many cases where the image is distorted.
On the other hand, the list display is effective when using each of the divided images. As a list display method, display of thumbnail images for reducing images and the like can be considered.
However, when the divided images are displayed as thumbnail images, there is a problem that the viewability is deteriorated due to the presence of tilt distortion.
[0005]
In addition, in an image input apparatus that captures an image by dividing the subject into a plurality of divided image regions, it is possible to move the image pickup unit and pick up images of subjects on different installation surfaces. In this case, the direction of the image on the image pickup surface However, it may be different from the direction in which the subject is installed, and the image may be displayed upside down when displayed, thus degrading the viewability.
[0006]
The present invention has been made in view of the above-described circumstances, and eliminates a factor that hinders the viewability of divided images, thereby improving the convenience of the divided images. An object of the present invention is to provide a program and a recording medium.
[0007]
[Means for Solving the Problems]
In order to solve the above problems, an image display system according to claim 1 of the present invention includes an image input device that inputs a divided image of a subject placed on a predetermined installation surface, and an image display device that displays the divided image. In the image display system provided, the image input device supports an imaging unit, a moving unit that moves the imaging unit to sequentially shoot the subject by dividing the subject into a plurality of divided imaging regions, and the moving unit. A divided image captured by the supporting unit and the imaging unit; Sequentially Transmitting means for transmitting to the image display device, the image display device, In the order of the arrangement of the divided images in the template corresponding to the desired number of divisions Image receiving means for receiving an image captured by the image input device, recording means for recording the received image, image selecting means for selecting a plurality of images recorded in the recording means, and the image selecting means An image shaping unit for correcting tilt distortion of the plurality of images selected in step (b), and the image selection unit selected by the image selection unit. The template is specified using the number of divided images as the division number, and in the order of arrangement of the divided images of the identified template, A reduced image of the corrected image is used for the image that has been corrected for distortion, and a reduced image of the image that has not been corrected for the image that has not been corrected for distortion. Arrange and combine the divided images as one image It has the image display means to display, It is characterized by the above-mentioned.
According to a second aspect of the present invention, in the image display system according to the first aspect, the image shaping means is further based on a type of image data selected by the image selecting means and an image characteristic value. The direction of the image is changed, and the image display means displays a reduced image whose direction has been changed.
According to a third aspect of the present invention, in the image display system according to the first or second aspect, the image display means is a divided imaging region by the image input device. Every A series of divided images taken The number of divisions Each is separated and displayed in a separate window.
[0010]
Further, the claims of the present invention 4 The program comprises a computer. 3 A program for causing the image display apparatus to function as each unit of the image display system according to any one of the above.
Further, the claims of the present invention 5 The recording medium of claim 4 The computer-readable recording medium which recorded the program as described in 1 above.
[0011]
Therefore, with the above configuration, when displaying a list of images captured using an image input device that captures an image by dividing the subject into a plurality of divided image areas, according to attribute information such as image type and specifications. By viewing and shaping the image, the image browsing and convenience are improved.
[0012]
In addition, a list of images captured using an image input device that divides the subject into a plurality of divided image areas and captures the image according to attribute information such as the type and specification of the image further specified on the list display. Since it is shaped and displayed, the time required for display is shortened, and the viewability and convenience of the image are improved.
[0013]
In addition, by correcting and displaying the distortion caused by the divided imaging of the subject, the viewability and convenience of each of the divided images is improved.
[0014]
In addition, since the display direction of the image is changed according to the attribute information of the photographed image, the complexity of changing the display direction when photographing different subjects is reduced, and the viewability and convenience of image display are reduced. improves.
[0015]
In addition, the user can select an image range more flexibly, select a plurality of desired images from the divided image obtained by imaging a wide range with respect to the subject, and select the selected image as one image. Therefore, it is possible to improve the viewability and convenience of images obtained from a wider range.
[0016]
In addition, because the display position of an image obtained by dividing the subject is adjusted based on the order of the divided imaging, the divided images can be viewed side by side in the same layout as the entire image of the subject. Will improve.
[0017]
In addition, since a series of images obtained by dividing the subject is separated and displayed in divided imaging units, a plurality of unrelated divided images are not mixedly displayed, improving the viewability and convenience. To do.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of an image display system of the present invention (hereinafter referred to as the present system) will be described with reference to the drawings.
FIG. 1 is a schematic diagram showing a configuration of an image input apparatus for inputting divided images handled in the present system.
In FIG. 1, the image input apparatus communicates with an imaging unit 13, a support column 21 a for supporting the imaging unit 13, a support unit 21 b, a driving unit 20 for moving the imaging unit 13, and an external device. It comprises a control unit 26 having an interface 27 for this purpose.
[0019]
In this image input apparatus, the image pickup unit 13 is moved using the drive unit 20, and the subject 22 is divided into the divided image pickup regions 23 and photographed (regions A to H).
By inputting an image of a subject having a large area with this image input device and performing high-magnification shooting with the zoom lens of the imaging unit 13, it is possible to input a higher-resolution image.
[0020]
As a drive mechanism of the drive unit 20, two stepping motors whose rotation axes are orthogonal to each other and a gear having a predetermined attenuation ratio can be used to perform two-axis rotation driving with a predetermined rotation center as the rotation axis. To. Further, the drive mechanism is not limited to the rotational drive, and may be a drive mechanism that performs a translational motion.
The control unit 26 includes an MPU (Micro Processing Unit) and a recording medium such as a hard disk and a semiconductor memory. The control unit 26 controls the operation of the imaging unit 13 and performs image processing and editing of image data transferred from the built-in memory of the imaging unit 13. Recording and the like are performed, and the external device is connected via the interface 27 to communicate with the external device.
[0021]
The interface 27 uses a general-purpose interface for PC, for example, a serial interface such as RS-232C, USB (Universal Serial Bus), IEEE 1394, IrDA (Infrared Data Association), or a network interface of a network adapter.
[0022]
The imaging unit 13 is configured to be electrically connected by a connector (not shown) held by the drive unit 20 and to be connected to the control unit 26.
FIG. 2 is a schematic diagram illustrating the configuration of the imaging unit 13. The imaging unit 13 forms an object image on the imaging element 6 by controlling the exposure time by the shutter 4 through the fixed lens 1, the zoom lens 2, the diaphragm mechanism 3, and the focus lens 5.
[0023]
An image signal from the image sensor 6 is sampled by a CDS (Correlated Double Sampling) circuit 7 and then converted into a digital signal by an A / D converter 8. The timing at this time is generated by a TG (Timing Generator) 9.
The image signal converted into a digital signal is then stored in the memory 11 after being subjected to image processing such as aperture correction and compression by an IPP (Image Pre-Processor) 10.
The operations of these units are controlled by the MPU 12.
[0024]
The image display system of the present invention is configured as shown in FIGS. 3 and 4 using the image input device as described above and an image display device that displays the image.
The system in FIG. 3 includes the image input device 30 described above, an image display device 32 connected to the image input device 30, and a controller 31 that controls the entire system.
The controller 31 and the image display device 32 are connected to the image input device 30 via the interface 27.
[0025]
4 includes the above-described image input device 30, one or more image display devices 32, and a controller 31.
The controller 31 and the image display device 32 are connected to the image input device 30 via the interface 27. In particular, the image display device 32 may be connected not only directly to the image input device 30 but also using the network 40. The image display device 32 connected via the network 40 can communicate with the image input device 30 even from a remote location.
The network 40 may be a general-purpose communication means such as a LAN (Local Area Network), a public telephone line, a dedicated telephone line, an optical fiber network, a satellite communication means, or the like, and may use an infrastructure such as the Internet.
[0026]
Further, the operation of all the devices (image display devices) connected to the image input device 30 by the controller 31 and the mutual communication between the devices (the image input device 30 and the image display device 32) can be controlled. .
FIG. 5 is a schematic diagram showing the configuration of the controller 31. In FIG. 5, the controller 31 comprises display means 31a, menu selection switches (31b, 31c), menu determination switch 31d, and file transfer / output switch 31e.
When the controller 31 is used, a desired operation is performed by selecting an operation menu displayed on the display means 31a by the menu selection switch 31b or 31c and pressing the menu determination switch 31d.
[0027]
The controller 31 also has an operation menu for specifying the type of subject, specifying the capture resolution, a network address such as an IP (Internet Protocol) address of the image display device 32 to be connected, and a setting value for a network parameter of the image input device 30. The information is displayed on the display means 31a and an operation corresponding to the selected state is performed.
Further, the image data recorded in the image input device 30 is transferred to the designated image display device 32 by the file transfer / output switch 31e.
[0028]
<Embodiment 1 of Image Display Device>
FIG. 6 is a block diagram showing a functional configuration of the image display device 32 used in the present system. In FIG. 6, the image display device 32 receives an image receiving means 321 for receiving image data recorded on a recording medium provided in the control unit 26 of the image input device shown in FIG. Recording means 322 for recording image data, image selection means 323 for selecting a plurality of image data recorded in the recording means 322, image shaping means 324 for processing based on image attribute information, and image display means for displaying the processing result 325.
[0029]
The image display device 32 operates as follows.
First, the transferred image data is received by the image receiving unit 321, and the received image data is temporarily recorded in the recording unit 322.
Here, the image data transferred from the image input device 30 is processed at high speed by performing data amount reduction processing, for example, data thinning processing, data compression processing, and the like. For image transmission / reception, a memory capable of reading and writing data at a high speed such as a video random access memory (VRAM) is provided.
[0030]
When the user wants to use this divided image, the image selecting unit 323 selects a plurality of images from the images recorded in the recording unit 322.
The image display device 32 performs various shaping processes (for example, image placement, tilt distortion correction, etc.) on the selected selected image with reference to image attribute information by the image shaping means 324.
The attribute information of the image is recognizable such as the type of image data and the data capacity, and may include the characteristic value of the image. The types of image data include general-purpose formats such as BMP (BitMaP), JPEG (Joint Photographic Coding Experts Group), and TIFF (Tagged Image File Format), and an image shaping method is defined according to these formats.
The image characteristic values include resolution, gradation, color information, monochrome, binary image, and the like.
[0031]
Thumbnail images are displayed as a list display of the shaped images by the image display means 325.
The thumbnail images are displayed by preparing list display templates having different arrangements according to the number of thumbnail images, and displaying images that have been subjected to shaping processing such as distortion correction on the templates.
For example, the image display unit 325 arranges images based on the order of divided imaging of each image by divided imaging of the subject. As shown in FIG. 7, the orientation and arrangement of each image displayed on the window 1 are determined in accordance with the shooting order (here, nine shots).
That is, a display template is determined in advance according to the number and order of divided imaging, and the imaging order and the arrangement of images on the display template (for example, the direction and arrangement in which a document can be easily viewed) are also defined. If such rearrangement is not performed, the positional relationship of each image with respect to the entire document image becomes unclear, and the convenience of each image decreases.
[0032]
Further, the image display means 325 separates and displays an image for each series of divided imaging by subject imaging.
For example, if a plurality of images obtained by a series of divided imaging are displayed together, the display becomes complicated and the correspondence between the images becomes difficult to understand. Therefore, as shown in FIG. ) Four-division imaging (FIG. (B)) and batch imaging (FIG. (C)) display images on separate windows.
[0033]
Further, the image display means 325 may be used to display the image data stored in the recording means 322 when the image selection means 323 selects an image.
[0034]
The image shaping unit 324 performs image shaping on the plurality of images selected by the image selection unit 323 according to the attribute information, and displays the result on the image display unit 325.
As image shaping, tilt distortion correction, display direction adjustment, display image resolution adjustment, image characteristic value change, and the like are performed.
As a technique for correcting the tilt distortion, the document “Trail distortion correction technique for document image input (Proceedings of the 7th Image Sensing Symposium, G-23, pp. 385-390 (2001))” or There is a technique disclosed in “Image processing method and apparatus, digital camera, image processing system, and recording medium on which an image processing program is recorded” in Japanese Laid-Open Patent Publication No. 2001-134751.
[0035]
In the image input device 30, when the subject shown in FIG. 9 is divided and photographed, the image pickup unit 13 is moved. However, since the image pickup surface and the subject surface are not necessarily parallel, each image has a different distortion. As a result, the viewability of each image is deteriorated.
In the configuration shown in FIG. 1, if the movement of the imaging unit 13 is designed so that the rotational movement is larger than the translational movement, the drive region of the imaging unit 13 can be reduced, while the rotational movement becomes larger. Becomes larger, and if displayed as it is, the viewability becomes worse. That is, when the image pickup unit 13 is moved by the rotational motion, as shown in FIG. 10 (A), each image causes distortion (trapezoidal distortion).
When the distortion correction of this image is performed, the image becomes very easy to see as shown in FIG. 10B, and the convenience is improved.
[0036]
Referring to FIG. 11, in the case where the subject 22 is divided and captured into two images (first image and second image) and the two images are combined, the position facing the subject 22 (facing to the front) A method of correcting the tilt distortion using the position) as a reference image will be described.
Now, point P1 on the first image and point P2 on the second image
[0037]
[Formula 1]

[0038]
And When the subject is a plane, the following relationship is established between P1 and P2.
[0039]
[Formula 2]

[0040]
here,
[0041]
[Formula 3]

[0042]
Since the projective transformation matrix H indicated by is constant when the two positions (P1 and P2) photographed in the image are the same, h1 from a set of known points (u1, v1) and (u2, v2) in advance. ˜h8 can be calculated.
Therefore, the position when each point of the second image is captured at the position of the first image can be calculated by using Expression (1) and Expression (2).
Thereby, the pixel of a 2nd image can be mapped on the 1st image on the basis of a 1st image.
In order to correct the tilt distortion, a projection transformation matrix H between the facing image and the first image is obtained in advance with the facing image at the facing position of the subject as a reference, and the image is rearranged using the matrix. To do. When displaying, the image display area is shifted and adjusted so that the entire image is displayed.
In the image input device 30, the drive unit 20 can define the rotational movement of the camera coordinate system and control the imaging unit 13 to a predetermined position. Can be done automatically.
[0043]
The image shaping unit 324 changes the display direction of the image according to the attribute information of the image.
For example, as illustrated in FIG. 12, the image input device 30 can move the imaging unit 13 by the driving unit 20 and image a subject (a person 50 in FIG. 12) other than the installation surface of the subject 22. As described above, when the person 50 or the like is a subject, a low resolution (for example, the number of pixels of 480 × 640) is often required, and when a document or the like is imaged as the subject 22, a high resolution ( For example, the number of pixels of 1024 × 2048 is often required.
[0044]
Therefore, when the user captures an image of the subject, the driving state and resolution of the drive unit 20 are changed depending on the type of the subject, and thus the direction of imaging that occurs when the imaging unit 13 is driven can be determined from the resolution of the image. .
For example, image data having the number of pixels as shown in FIG. 13A can automatically determine the orientation of the image depending on the size of the number of pixels, and can be arranged according to the determined orientation. In FIG. 13, a triangular mark (マ ー ク) displayed for each image is a marker indicating the orientation of the image.
[0045]
Also, when photographing a subject such as a document, it is desirable to use BMP data with a low compression rate in order to ensure image quality. On the other hand, when shooting a person or the like, JPEG data with a high compression rate is used. Since it may be used, the direction of imaging can also be determined by these file types.
For example, as shown in FIG. 13B, the image display direction is changed in the horizontal direction for the BMP file and the vertical direction for the JPEG file.
Thus, by making the display direction of each image variable according to the number of pixels and the file type, it is possible to prevent the orientation of the display image from becoming unnatural.
[0046]
<Embodiment 2 of Image Display Device>
FIG. 14 is a block diagram showing another functional configuration of the image display device 32 shown in FIG. In FIG. 14, the image display device 32 receives an image receiving unit 321 for receiving image data recorded on a recording medium provided in the control unit 26 of the image input device shown in FIG. Recording means 322 for recording image data, image selection means 323 for selecting a plurality of image data recorded in the recording means 322, image display means 325 for displaying the selected image, and one or more images from the displayed images Second image selection means 326 to select, image shaping means 324 for processing based on attribute information of the image selected by the second image selection means 326, and second image display means 327 for displaying the shaped image. .
Means having the same functions as those of the image display device 32 of the first embodiment are denoted by the same reference numerals as those in FIG. 6, and only differences will be described here.
[0047]
The image display device 32 receives the transferred image data by the image receiving unit 321, and temporarily records the received image data in the recording unit 322.
When the user wants to use this divided image, the image selecting unit 323 selects a plurality of images from the images recorded in the recording unit 322.
The image display device 32 causes the selected display image to be displayed by the image display unit 325 and causes the user to select at least one or more of the displayed images using the second image selection unit 326.
Next, the image display device 32 uses the image shaping unit 324 to correct the distortion of the selected one or more image data (corrected by the above-described known technique), and displays the corrected processing result image as a second image. Displayed by means 327.
[0048]
A usage example of the second embodiment will be described with reference to FIG.
First, a plurality of images are selected from the recording means 322 by the image selection means 323, and as shown in the window 1 in FIG. Display a selection display frame.
The user selects (reselects) one or more images from among a plurality of images displayed by the image display means 325 by an operation such as clicking or double clicking with a pointing device such as a PC mouse.
The second image selection means 326 can recognize the visually selected image in the window 1 by changing the color of the selection display frame of the image selected by the user, the brightness or hue of the selected image itself, or the contrast. To display.
Next, the distortion of the image selected here is corrected by the image shaping means 324, and the correction result is displayed as shown in the window 2 of FIG. 15 by the second image display means 327.
[0049]
Therefore, the image shaping is performed only on the image instructed by the user using the second image selection unit 326, and only the shaped image is displayed on the second image display unit 327, so that the processing time for displaying the list is shortened. Can be displayed at a higher speed, and the convenience of the area image of each area obtained by divided imaging is improved.
For the image selected by the second image selection unit 326, an image that is not subjected to the data reduction process is newly received and recorded in the recording unit 322, so that efficient image display and effective use of the image can be achieved. Can promote.
[0050]
Further, as shown in FIG. 16, the second image display means 327 provides a tool window 1 in a window 2 that displays an image obtained by correcting image distortion and combining a plurality of images, so that the brightness of the display image is increased. Perform general image processing such as changing display parameters such as sheath, contrast, image enlargement / reduction, color image correction processing such as color balance, hue, saturation, binarization, noise reduction processing using digital filters, etc. Alternatively, character recognition may be performed using a general-purpose OCR (Optical Character Recognition) process for an area where characters are displayed.
[0051]
Further, as shown in FIG. 17, the second image display means 327 may be provided with a tool window 2 in the window 2 and perform file operations such as saving image data of the displayed image. This file operation includes file open / close, copy / delete, move, transfer, and the like.
[0052]
Further, as shown in FIG. 18, the second image display means 327 provides tool windows 3 to 5 in the window 2, specifies a partial area of the displayed image (tool window 3), and copies the specified area. (Tool window 4) or pasting (tool window 5) may be performed.
The designated area is pasted on a new window 3 or an application (such as a word processor) for creating a document or editing an image file.
[0053]
The above functions may be provided as a function menu of the window 2 instead of the tool window, or a pop-up menu using a mouse, drag, drag and drop, or the like may be used.
In addition to copying or pasting the image in the designated area, when the general-purpose OCR processing function is designated in the tool window 1 for the designated area, the area is recognized and the window 3 or You may make it paste on an application.
This makes it possible to create an electronic document more easily.
[0054]
<Modification of Embodiment 1 of Image Display Device>
In the first embodiment described above, each of a plurality of selected image data is subjected to image shaping, and each distortion corrected image is displayed independently.
In this modification, after correcting the tilt distortion, it is displayed as one composite image.
FIG. 19 is a block diagram illustrating a functional configuration of the image display apparatus according to the present modification. In FIG. 19, the image display device 32 of this modification is an image receiving means for receiving image data recorded on a recording medium provided in the control unit 26 of the image input device shown in FIG. 321, a recording unit 322 for recording received image data, an image selection unit 323 for selecting a plurality of image data recorded in the recording unit 322, an image shaping unit 324 for processing based on image attribute information, and a result of image shaping. The image synthesizing unit 328 for synthesizing the image into one image and the second image display unit 327 for displaying the synthesis result.
Means having the same functions as those of the image display device 32 of the first embodiment or the second embodiment are denoted by the same reference numerals as those in FIGS.
[0055]
The image display device 32 of the present modification operates as follows.
First, the transferred image data is received by the image receiving unit 321, and the received image data is temporarily recorded in the recording unit 322.
When the user wants to use this divided image, the image selecting unit 323 selects a plurality of images from the images recorded in the recording unit 322.
The image display device 32 performs tilting correction on the selected image after the image shaping unit 324 performs various shaping processes with reference to image attribute information.
The image composition means 328 composes the image subjected to tilt distortion correction into one image, and the second image display means 327 displays the synthesized image.
[0056]
<Modification of Embodiment 2 of Image Display Device>
In the second embodiment described above, a distortion-corrected image is displayed in one or more selected images from among a plurality of selected image data.
In this modification, after correcting the tilt distortion, it is displayed as one composite image.
FIG. 20 is a block diagram illustrating a functional configuration of an image display apparatus according to a modification of the second embodiment. 20, the image display device 32 according to this modification is configured to receive image data recorded on the recording medium provided in the control unit 26 of the image input device shown in FIG. 321, a recording unit 322 for recording received image data, an image selection unit 323 for selecting a plurality of image data recorded in the recording unit 322, an image display unit 325 for displaying the selected image, and the displayed image Second image selecting means 326 for selecting one or more images, image shaping means 324 for processing based on the attribute information of the image selected by the second image selecting means 326, and image composition for synthesizing the result of image shaping into one image. Means 328 and second image display means 327 for displaying the synthesis result.
Means having the same functions as those of the image display device 32 of the first embodiment or the second embodiment are denoted by the same reference numerals as those in FIGS.
[0057]
The image display device 32 of the present modification operates as follows.
First, the transferred image data is received by the image receiving unit 321, and the received image data is temporarily recorded in the recording unit 322.
When the user wants to use this divided image, the image selecting unit 323 selects a plurality of images from the images recorded in the recording unit 322.
The image display device 32 causes the selected display image to be displayed by the image display unit 325 and causes the user to select at least one or more of the displayed images using the second image selection unit 326.
Next, the image display device 32 corrects the distortion of the selected one or more pieces of image data by the image shaping unit 324 (correcting by the above-described known technique), and performs the distortion correction by the image composition unit 328. The images are combined into one image, and the combined image is displayed by the second image display means 327.
[0058]
The plurality of images selected by the image selection means 323 are displayed as thumbnail images of images divided and captured in the window 1 as shown in FIG.
The second image selection means 326 selects a plurality of thumbnail images displayed in the window 1.
For example, the selection (reselection) is performed on the selected image of the window 1 by an operation such as a click or a double click with a pointing device such as a PC mouse. In FIG. 21, four images are selected.
[0059]
When this selection is completed, the image shaping means 324 corrects the distortion of the selected plurality of images, and the image composition means 328 composes the image into a single image. This synthesized image is displayed on the window 2 by the second image display means 327 (FIG. 21).
As a result, it is possible to extract an image of a larger partial area taken by dividing, and the usability of the image is further improved.
[0060]
Furthermore, the present invention is not limited only to the above-described embodiment.
FIG. 22 is a block diagram showing a hardware configuration when the present invention is realized by a computer. In FIG. 22, a central processing unit (CPU) 61, an input device 62 such as a keyboard, a mouse or a touch panel, a display device 63 such as a display, a memory 64, a storage device 65 such as a hard disk, and a medium reading device 66. Are connected by a data bus 67.
The program code for executing the above-described function of the present invention is recorded on a recording medium, the program code recorded on the recording medium is read from the medium reading device 66 or the storage device 65, and installed in the computer shown in FIG. The present invention can be easily implemented by executing the program by the CPU 61.
In this case, the program code itself read from the recording medium also realizes the above-described functions of the present invention, and the program code and the recording medium storing the code constitute the present invention.
[0061]
As a recording medium, a semiconductor medium (for example, ROM, nonvolatile memory card, etc.), an optical medium (for example, DVD, MO, MD, CD-R, etc.), a magnetic medium (for example, magnetic tape, flexible disk, etc.), etc. Any of these may be used.
[0062]
Moreover, not only the functions of the present invention described above are realized by executing the loaded program, but the operating system or the like performs part or all of the actual processing based on the instructions of the program, and the processing described above The case where the functions of the present invention are realized is also included.
[0063]
【The invention's effect】
As described above, according to the present invention, when displaying a list of images captured using an image input device that captures an image by dividing a subject into a plurality of divided image regions, attribute information such as image type and specification is displayed. In response, the image is shaped and displayed, thereby improving the viewability and convenience of the image.
[0064]
In addition, a list of images captured using an image input device that divides the subject into a plurality of divided image areas and captures the image according to attribute information such as the type and specification of the image further specified on the list display. Since it is shaped and displayed, the time required for display is shortened, and the viewability and convenience of the image are improved.
[0065]
In addition, by correcting and displaying the distortion caused by the divided imaging of the subject, the viewability and convenience of each of the divided images is improved.
[0066]
In addition, since the display direction of the image is changed according to the attribute information of the photographed image, the complexity of changing the display direction when photographing different subjects is reduced, and the viewability and convenience of image display are reduced. improves.
[0067]
In addition, the user can select an image range more flexibly, select a plurality of desired images from the divided image obtained by imaging a wide range with respect to the subject, and select the selected image as one image. Therefore, it is possible to improve the viewability and convenience of images obtained from a wider range.
[0068]
In addition, because the display position of an image obtained by dividing the subject is adjusted based on the order of the divided imaging, the divided images can be viewed side by side in the same layout as the entire image of the subject. Will improve.
[0069]
In addition, since a series of images obtained by dividing the subject is separated and displayed in divided imaging units, a plurality of unrelated divided images are not mixedly displayed, improving the viewability and convenience. To do.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing a configuration of an image input apparatus for inputting divided images handled by the present system.
FIG. 2 is a schematic diagram illustrating a configuration of an imaging unit.
FIG. 3 is a schematic diagram showing a configuration of the present system.
FIG. 4 is a schematic diagram showing another configuration of the present system.
FIG. 5 is a schematic diagram showing a configuration of a controller.
FIG. 6 is a block diagram showing a functional configuration of an image display device used in the present system.
FIG. 7 is a display example for explaining a display template.
FIG. 8 is another display example for explaining a display template.
FIG. 9 is a display example of a document as a subject.
FIG. 10 is a display example of a divided image of a subject.
FIG. 11 is a display example of an image obtained by correcting tilt distortion of a divided image.
FIG. 12 is a diagram for explaining that an image attribute can be determined according to an imaging target.
FIG. 13 is a diagram for explaining that an image display direction can be determined based on an image attribute;
FIG. 14 is a block diagram showing another functional configuration of the image display device used in the present system.
FIG. 15 is a usage example of an image display device having another configuration.
FIG. 16 is an operation example in the second image display means.
FIG. 17 is another operation example in the second image display means.
FIG. 18 is another operation example in the second image display means.
FIG. 19 is a block diagram illustrating a functional configuration of a modification of the first embodiment of the image display device.
FIG. 20 is a block diagram illustrating a functional configuration of a modification of the second embodiment of the image display apparatus.
FIG. 21 is a display example when an image partially selected from displayed images is subjected to tilt correction to synthesize an image.
FIG. 22 is a block diagram showing a hardware configuration when the present invention is realized by a computer.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Fixed lens, 2 ... Zoom lens, 3 ... Diaphragm mechanism, 4 ... Shutter, 5 ... Focus lens, 6 ... Image sensor, 7 ... CDS circuit, 8 ... A / D converter, 9 ... TG, 10 ... IPP, DESCRIPTION OF SYMBOLS 11 ... Memory, 12 ... MPU, 13 ... Imaging part, 20 ... Drive part, 21a ... Supporting column, 21b ... Supporting unit, 22 ... Subject, 23 ... Divided imaging area, 26 ... Control unit, 27 ... Interface, 30 ... Image Input device 31 ... Controller 31a ... Display means 31b, 31c ... Menu selection switch 31d ... Menu determination switch 31e ... File transfer / output switch 32 ... Image display device 40 ... Network 50 ... Person 321 ... Image receiving means, 322 ... recording means, 323 ... image selecting means, 324 ... image shaping means, 325 ... image display means, 326 ... second image selection Means, 327 ... second image display means, 328 ... image composition means, 61 ... CPU, 62 ... input device, 63 ... display device, 64 ... memory, 65 ... storage device, 66 ... medium reader, 67 ... data bus.

Claims (5)

In an image input system including an image input device that inputs a divided image of a subject placed on a predetermined installation surface and an image display device that displays the divided image, the image input device includes:
Imaging means, moving means for moving the imaging means to sequentially shoot the subject into a plurality of divided imaging areas, and support means for supporting the moving means,
A transmission unit that sequentially transmits the divided images captured by the imaging unit to the image display device;
The image display device includes:
Image receiving means for receiving images captured by the image input device in the order of arrangement of the divided images in the template corresponding to the desired number of divisions, recording means for recording the received images, and recording on the recording means The image selection means for selecting a plurality of images, the image shaping means for correcting the tilt distortion of the plurality of images selected by the image selection means, and the number of images selected by the image selection means as the division number Identify the template, and in the order of layout of the divided images of the identified template, correct the reduced image for the image that has been corrected for distortion and the correction for the image that has not been corrected for distortion by arranging the image of the reduced image that has not been, image, characterized in that it comprises an image display means for synthesizing and displaying the divided image as a single image Display system.   2. The image display system according to claim 1, wherein the image shaping unit further changes the orientation of the image based on a type of image data selected by the image selection unit and a characteristic value of the image, and the image display unit. Is an image display system that displays a reduced image whose orientation has been changed. 3. The image display system according to claim 1, wherein the image display unit separates a series of divided imaging shot for each divided imaging area by the image input device for each division number , and displays the separated imaging in a separate window. An image display system characterized by the above. The program for functioning a computer as each means of the image display apparatus of the image display system of any one of Claims 1 thru | or 3 . The computer-readable recording medium which recorded the program of Claim 4 .

Images