JP7236355B2 - Projection device and method - Google Patents

Description

The present invention relates to projection apparatus and methods.

As a digital zoom function, a function of enlarging and projecting a part of an image is known. Japanese Patent Application Laid-Open No. 2002-200002 describes a technique of specifying an area to be enlarged using a remote controller during digital zoom. Further, Patent Literature 2 describes a technique for designating an area to be enlarged using a portable information terminal such as a tablet terminal.

JP 2012-203367 A JP 2007-241537 A

One embodiment according to the technology of the present disclosure provides a projection apparatus and method capable of enlarging a portion of a projected image with a simple operation.

(1) A projection unit that projects an image, a projection control unit that controls the projection of the image by the projection unit, an imaging unit that captures the image projected by the projection unit, and a projection image based on the image captured by the imaging unit. and an enlargement target area setting unit that detects a shadowless area in the projection image based on the detection result of the shadow detection unit and sets it as an enlargement target area, wherein the projection control A projection device that, when a shadow is detected by a shadow detection unit, enlarges an area to be enlarged and causes a projection unit to project the area.

(2) The projection device according to (1), wherein the projection unit includes an image display unit that displays an image to be projected.

(3) The projection device according to (1) or (2), wherein the shadow detection unit detects a shadow that continues for a certain period of time or more.

(4) A motion detection unit for detecting motion of the shadow based on the captured image is further provided, and the projection control unit causes the projection unit to enlarge and project the enlargement target area, and then the motion detection unit detects the motion of the shadow. The projection device according to any one of (1) to (3), wherein, if detected, the enlargement ratio is changed according to the motion of the shadow detected by the motion detector.

(5) The projection device according to (4), wherein the motion detection unit detects a motion that the shadow expands or contracts.

(6) A movement detection unit that detects movement of the shadow based on the image captured by the imaging unit, and the projection control unit causes the projection unit to enlarge and project the enlargement target area, and then the movement detection unit detects the movement of the shadow. The projection device according to any one of (1) to (5), wherein, when movement of the shadow is detected in (1), the image projected by the projection section is slid according to the movement of the shadow detected by the movement detection section.

(7) a projection unit that projects an image, a projection control unit that controls projection of the image by the projection unit, an imaging unit that captures an image projected by the projection unit, and a projection image based on the image captured by the imaging unit; A shadow detection unit that detects a shadow, a position detection unit that detects the position of the shadow in the projection image, and an enlargement target area that sets an enlargement target area of the projection image according to the position of the shadow detected by the position detection unit. and a setting unit, wherein the projection control unit enlarges the enlargement target area and causes the projection unit to project the area when the shadow detection unit detects a shadow.

(8) A storage unit is further provided for storing a table that defines an area for enlarging the projected image for each shadow position, and the enlargement target area setting unit stores shadow positions detected by the position detection unit based on the table. The projection device according to (7), which sets an enlargement target area of the projection image.

(9) The projection device according to (7) or (8), wherein the projection unit includes an image display unit that displays an image to be projected.

(10) The projection device according to any one of (7) to (9), wherein the shadow detection unit detects a shadow that continues for a certain period of time or more.

(11) Further comprising a motion detection unit for detecting motion of the shadow based on the image captured by the imaging unit, the projection control unit causes the projection unit to enlarge and project the enlargement target area, and then the motion detection unit 10. The projection device according to any one of (7) to (10), wherein, when movement of the shadow is detected in A, the enlargement ratio is changed according to the movement of the shadow detected by the movement detection unit.

(12) The projection device according to (11), wherein the motion detection unit detects a motion that the shadow expands or contracts.

(13) Further comprising a movement detection unit for detecting movement of the shadow based on the image captured by the imaging unit, the projection control unit enlarging and projecting the enlargement target area to the projection unit, and thereafter causing the movement detection unit to The projection device according to any one of (7) to (12), wherein, when movement of the shadow is detected in A, the image projected by the projection section is slid according to the movement of the shadow detected by the movement detection section.

(14) a projection unit that projects an image, a projection control unit that controls projection of the image by the projection unit, an imaging unit that captures the image projected by the projection unit, and a projection image based on the image captured by the imaging unit; a projection control unit comprising: a shadow detection unit that detects a shadow enclosing an area; is a projection device that, when a shadow is detected by a shadow detection unit, enlarges an area to be enlarged and causes a projection unit to project the image.

(15) The projection device of (14), wherein the projection unit includes an image display unit that displays an image to be projected.

(16) The projection device according to (14) or (15), wherein the shadow detection unit detects a shadow that continues for a certain period of time or more.

(17) Further comprising a motion detection unit for detecting motion of the shadow based on the image captured by the imaging unit, the projection control unit enlarging and projecting the enlargement target area to the projection unit, 16. The projection device according to any one of (14) to (16), wherein, when movement of the shadow is detected in A, the enlargement ratio is changed according to the movement of the shadow detected by the movement detection unit.

(18) The projection device according to (17), wherein the motion detection unit detects a motion that the shadow expands or contracts.

(19) a projection unit that projects an image, a projection control unit that controls projection of the image by the projection unit, an imaging unit that captures the image projected by the projection unit, and a projection image based on the image captured by the imaging unit; a shadow detection unit that detects a moving shadow; and an enlargement target area setting unit that detects an area through which the shadow does not pass in the projection image based on the detection result of the shadow detection unit and sets the area as an enlargement target area. and a projection device in which, when a shadow is detected by the shadow detection unit, the projection control unit enlarges the enlargement target area and causes the projection unit to project the image.

(20) The projection device of (19), wherein the projection unit includes an image display unit that displays an image to be projected.

(21) The projection device according to (20), wherein the shadow detection unit detects a shadow moving back and forth on the projection image.

(22) The projection device according to any one of (19) to (21), wherein the projection control unit causes the projection unit to project the movement trajectory of the shadow.

(23) a step of projecting an image; a step of capturing a projection image; a step of detecting a shadow occurring in the projection image based on the captured image; A projection method comprising the steps of: detecting a shadow area and setting it as an enlargement target area; and, when a shadow is detected, enlarging the enlargement target area and projecting an image.

(24) a step of projecting an image, a step of capturing the projected image, a step of detecting a shadow generated in the projected image based on the captured image, a step of detecting the position of the shadow in the projected image, and detection; A projection method, comprising: setting an enlargement target area of a projection image based on the position of the detected shadow; and projecting the image by enlarging the enlargement target area when the shadow is detected.

(25) a step of projecting an image; a step of capturing the projected image; a step of detecting a shadow surrounding a portion of the projected image based on the captured image; A projection method, comprising: setting an enclosed area as an enlargement target area; and, if a shadow is detected, enlarging the enlargement target area and projecting an image.

(26) a step of projecting an image; a step of capturing a projected image; a step of detecting a shadow moving on the projected image based on the captured image; A projection method comprising the steps of: detecting a non-passing area and setting it as an enlargement target area; and, when a shadow is detected, enlarging the enlargement target area and projecting an image.

FIG. 2 is a conceptual diagram of digital zoom operation by the projection device according to the first embodiment; 1 is a block diagram showing an example of a system configuration of a projection device according to a first embodiment; FIG. Block diagram showing a schematic configuration of the projection unit Block diagram showing a schematic configuration of an imaging unit Block diagram of functions possessed by the control unit Conceptual diagram of setting the enlargement target area FIG. 4 is a diagram showing an outline of the operation of the projection device according to the first embodiment; 3 is a flow chart showing the operation procedure of the projection device according to the first embodiment; Flowchart showing digital zoom processing procedure Conceptual diagram of the operation when scaling the shadow to change the enlargement ratio Block diagram of functions possessed by the control unit when scaling the shadow and changing the enlargement ratio Flowchart showing the procedure of digital zoom processing when scaling a shadow to change the enlargement ratio Conceptual diagram of image movement operation after zooming Block diagram of functions possessed by the control unit when realizing the function of moving the image after zooming Flowchart showing the procedure of digital zoom processing when moving an image after zooming FIG. 4 is a conceptual diagram of digital zoom operation by the projection device according to the second embodiment; FIG. 4 is a conceptual diagram of digital zoom operation by the projection device according to the second embodiment; FIG. 4 is a conceptual diagram of digital zoom operation by the projection device according to the second embodiment; FIG. 11 is a block diagram of functions of a control unit of the projection apparatus according to the second embodiment; FIG. 4 shows an example of a lookup table stored in a storage unit; Flowchart showing a procedure of zoom processing in the projection device according to the second embodiment The figure which shows another example of a zoom form The figure which shows another example of a zoom form The figure which shows another example of a zoom form The figure which shows another example of a zoom form FIG. 11 is a conceptual diagram of digital zoom operation by the projection device according to the third embodiment; FIG. 11 is a conceptual diagram of digital zoom operation by the projection device according to the fourth embodiment; Diagram showing projected image after zoom operation Flowchart showing the procedure of zoom processing in the projection device of the fourth embodiment A diagram showing how the projected image changes based on the zoom operation. A diagram showing an example of the display of the movement trajectory of a shadow The figure which shows another example of the means (obstacle) which produces a shadow on a projection image.

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[First embodiment]
[overview]
FIG. 1 is a conceptual diagram of a zoom (digital zoom) operation by the projection device of this embodiment.

2. Description of the Related Art Conventional projection apparatuses (projectors) use a digital zoom function to specify an area to be enlarged using a remote controller or the like when enlarging a portion of a projected image. In this case, there is a drawback that only some people can operate it. In addition, there is a drawback that there are many operating procedures and the intended area cannot be expanded quickly. In the projection device 1 of the present embodiment, shadows formed on the screen 2 are used to designate an area to be enlarged. Specifically, as shown in FIG. 1, the area to be enlarged is specified by hiding the area other than the area to be enlarged with the shadow Sh of the hand (obstacle) W on the image projected on the screen 2 . Note that FIG. 1 shows an example of enlarging the left half of the projection image PI (area R surrounded by a dashed line). In this case, the right half of the projection image PI is hidden by the shadow Sh of the obstacle ("hand" in the example of FIG. 1) W, as shown in FIG.

[composition]
FIG. 2 is a block diagram showing an example of the system configuration of the projection apparatus according to this embodiment.

As shown in the figure, the projection apparatus 1 of this embodiment is a front-type projection apparatus, and mainly includes an image input unit 12, a projection unit 14, an imaging unit 16, an operation unit 18, a control unit 20, and the like. . The front type is a projection device that projects an image onto the front screen 2 and sees the reflected light.

The image input unit 12 inputs an image signal of an image projected by the projection device 1 . The image input unit 12 has an image input interface. The image input unit 12 inputs an image signal from the external device 3 connected via the image input interface. The external device 3 is, for example, a personal computer (PC), a video deck, a DVD player (Digital Versatile Disc Player), a Blu-ray disc player, a video camera, or the like. Connections may be wired or wireless.

The projection unit 14 projects an image represented by the image signal input to the image input unit 12 onto the screen (projection surface) 2 .

FIG. 3 is a block diagram showing a schematic configuration of the projection section.

As shown in the figure, the projection section 14 mainly includes an illumination section 14A, an illumination optical system 14B, an image display section 14C, a projection optical system 14D, and the like.

The illumination unit 14A includes a light source, generates light of three colors of red (Red, R), green (Green, G), and blue (Blue, B) from light emitted from the light source, and emits the light in a time division manner. .

The illumination optical system 14B includes a rod lens or the like, homogenizes the light emitted from the illumination section 14A, and enters the image display section 14C.

The image display unit 14C displays an image projected by the projection unit 14. FIG. The image display unit 14C includes display elements such as a digital micromirror device (DMD) and a liquid crystal panel, receives light emitted from the illumination optical system 14B, and outputs an image signal input to the image input unit 12. Display the image represented by .

The projection optical system 14</b>D enlarges the image displayed on the image display section 14</b>C and projects it onto the screen 2 . The projection optical system 14D has a focus adjustment function, and the focus is adjusted by moving the entire or part of the lens group back and forth along the optical axis.

The imaging unit 16 is composed of a so-called digital camera, and electronically captures an image (projection image) projected on the screen 2 . The imaging unit 16 is configured to be capable of imaging at least the entire projection image.

FIG. 4 is a block diagram showing a schematic configuration of an imaging unit.

As shown in the figure, the imaging unit 16 mainly includes an imaging optical system 16A, an image sensor 16B, an analog signal processing unit 16C, a digital signal processing unit 16D, and the like.

The imaging optical system 16A forms an optical image of a subject (screen 2) on the light receiving surface of the image sensor 16B. The imaging optical system 16A has a focus adjustment function, and the focus is adjusted by moving the entire or part of the lens group back and forth along the optical axis.

The image sensor 16B receives light passing through the imaging optical system 16A to capture an image of the subject. The image sensor 16B is composed of a solid-state imaging device such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charged Coupled Device).

The analog signal processing unit 16C takes in the signal output from the image sensor 16B, performs predetermined signal processing (for example, correlated double sampling processing, amplification processing, etc.), converts it into a digital signal, and outputs it.

The digital signal processing unit 16D takes in the signal output from the analog signal processing unit 16C, and performs predetermined signal processing (eg, gradation conversion processing, white balance correction processing, gamma correction processing, synchronization processing, YC conversion processing, etc.). to generate an image signal of an image of the subject. Here, an image signal of an image (captured image) obtained by capturing an image (projected image) projected onto the screen 2, which is an object, is generated. The generated image signal is output to the control section 20 .

The operation unit 18 includes various operation members such as a power button and a menu button, and outputs signals to the control unit 20 according to the operation of each operation member.

The control unit 20 centrally controls the operation of the projection device 1 . The control unit 20 is configured by a computer. The computer implements the functions of the control unit 20 by having its processor (for example, CPU (Central Processing Unit)) execute a predetermined control program (projection control program). A ROM (Read Only Memory) provided in a computer stores programs executed by a processor and various data required for control. Also, a RAM (Random Access Memory) provided in the computer provides a working memory space for the processor.

FIG. 5 is a block diagram of functions of the control unit.

As shown in the figure, the control unit 20 has functions of a projection control unit 20A, a shadow detection unit 20B, and an enlargement target area setting unit 20C.

The projection control unit 20A controls image projection by the projection unit 14 . The projection control unit 20A controls projection based on an operation input to the operation unit 18. FIG. Further, when a shadow occurs on the projection image, the projection control section 20A controls zooming of the projection image based on the image (captured image) captured by the imaging section 16 . More specifically, the display of the image on the image display unit 14C is controlled to control the zoom of the image to be projected (so-called digital zoom). Control of this zoom (digital zoom) will be described later.

The shadow detector 20B detects shadows that appear on the projection image. This shadow occurs when an obstacle is interposed between the projection device 1 and the screen 2 . The shadow detection section 20B detects shadows produced in the projection image based on the image (captured image) captured by the imaging section 16 . Shadows appearing on the projected image are detected, for example, based on the brightness of the image. That is, an area with brightness equal to or lower than the threshold is detected as a shadow area in the captured image. For more accurate detection, the shadow is detected by comparing it with the image data of the projected image.

The enlargement target region setting unit 20C sets an image enlargement region (enlargement target region) within the projection image. The enlargement target area setting unit 20C sets the enlargement target area based on the detection result of the shadow detection unit 20B. Specifically, a shadowless area (area not hidden by a shadow) is detected in the projection image, and the detected area is set as an enlargement target area.

FIG. 6 is a conceptual diagram of setting the enlargement target area.

A shadowless area in the projected image is defined as a non-occluded area. That is, an area where the projected image is not blocked by an obstacle is defined as a non-blocked area. As shown in FIG. 6, the non-shielded area is detected by dividing the projected image PI into a plurality of areas. That is, the non-shielded area is detected by detecting the area where the shadow Sh does not exist from among the divided areas. In FIG. 6, the projected image PI is divided into six regions (first region P1, second region P2, third region P3, fourth region P4, fifth region P5, and sixth region P6). An example of detecting a shielded area is shown. In the example shown in FIG. 6, obstacle shadows Sh ("hand shadows" in FIG. 6) exist in the first area P1, the second area P2, and the third area P3. Therefore, the area composed of the remaining areas (the fourth area P4, the fifth area P5 and the sixth area P6) is detected as the non-shielded area.

The enlargement target area setting unit 20C detects a shadowless area (non-shielded area) in the projection image based on the detection result of the shadow detection unit 20B, and sets the detected area as an enlargement target area.

When the shadow detection unit 20B detects a shadow, the projection control unit 20A enlarges the area (enlargement target area) set by the enlargement target area setting unit 20C and causes the projection unit 14 to project the image (digital zoom). More specifically, with the center of the set enlargement target area as the reference (the center of the zoom), an image (so-called trimmed image) is generated by enlarging the projected image at a specified magnification, and the generated image is projected. Project on the part 14 .

[Action]
The operation of the projection apparatus 1 according to this embodiment will be described below.

FIG. 7 is a diagram showing an outline of the operation of the projection device of this embodiment. In the figure, (A) shows a normal projection image. On the other hand, (B) shows the projected image when the zoom operation is performed. As shown in the figure, when a shadow is created on the projection image, the shadowless area is enlarged and projected.

FIG. 8 is a flowchart showing the operation procedure (projection method) of the projection apparatus of this embodiment.

First, an input of an image signal of an image to be projected is received (step S11). When the image signal is input, normal projection is performed (step S12). That is, the image represented by the image signal is projected as it is on the screen 2 (see FIG. 7A). Further, when the image is projected onto the screen 2, the projection image PI is captured by the imaging unit 16 (step S13). A shadow Sh appearing on the projection image PI is detected based on the captured image (step S14), and the presence or absence of the shadow Sh is determined based on the detection result (step S15). That is, it is determined whether or not the shadow Sh appears on the projection image PI.

If it is determined in step S15 that the shadow Sh has not occurred (No in step S15), it is determined whether or not the projection has ended (step S17). If it is determined that the projection has ended (Yes in step S17), the process ends. On the other hand, if it is determined that the projection has not ended (No in step S17), the process returns to step S12 and normal projection is continued.

If it is determined in step S15 that the shadow Sh is present (Yes in step S15), zooming (digital zooming) is performed (step S16).

FIG. 9 is a flowchart showing the procedure of zoom processing.

First, a non-shielded area is detected based on the detection result of the shadow Sh (step S21). That is, an area without the shadow Sh (area not hidden by the shadow Sh) is detected in the projection image PI.

Next, the detected non-shielded area is set as the enlargement target area (step S22). That is, it is set to an area for enlarging the projection image PI.

Then, the set enlargement target area is enlarged and projected (step S23). In this case, first, an image for projection is generated. The generated image is then projected. An image for projection is generated by enlarging the image to be projected at a prescribed enlargement ratio with reference to the center of the set enlargement target area. As a result, the set enlargement target area is enlarged and projected onto the screen 2 (see FIG. 7B).

After that, it is determined whether or not the shadow Sh has disappeared from the projection image PI based on the detection result of the shadow Sh based on the captured image (step S24). If the shadow Sh has not disappeared (No in step S24), zooming continues. On the other hand, when the shadow Sh disappears (Yes in step S24), the zooming process ends.

As described above, in the projection device 1 of the present embodiment, when an obstacle is interposed between the projection device 1 and the screen 2 to create a shadow Sh on the projection image PI, the shadow Sh is generated based on the area of the shadow Sh. , an enlargement target area is set, and the projection image PI is enlarged. This makes it possible to easily enlarge a portion of the projection image PI. Moreover, since it only creates a shadow Sh, it is not limited to a specific operator, and can be operated by any person.

[Modification]
(1) Modification of Shadow Detection by Shadow Detection Unit The shadow detection unit 20B may be configured to detect a shadow Sh that continues to appear for a certain period of time or longer. This can prevent the projection image PI from fluctuating due to unintentional zooming. It is more preferable that the user can arbitrarily set the “fixed time” here. This allows setting according to the user's preference.

(2) Modified example of canceling zoom In the above embodiment, when the shadow Sh disappears, the zoom is immediately canceled (returns to normal projection), but the zoom may be canceled after a certain period of time. . Further, the user may arbitrarily set the “fixed time” here.

Also, the zoom may be continued even after the shadow Sh disappears. In this case, it is preferable that the zoom is canceled by a specific operation. For example, the zoom is canceled when the shadow Sh is detected again. Alternatively, zoom out when a shadow of a particular shape is detected. Alternatively, zooming is canceled when the entire projection image PI is covered with shadows.

Further, in the case where the zoom is continued even after the shadow Sh disappears, if the shadow Sh is detected again, the zoom processing may be performed again based on the detected shadow Sh. This allows you to zoom step by step.

(3) Method of changing the magnification rate In the above embodiment, when a shadow Sh is detected, the area without the shadow Sh is enlarged at a constant magnification rate. good. For example, a method of scaling the shadow Sh to change the magnification can be adopted.

10A and 10B are conceptual diagrams of operations for changing the enlargement ratio by enlarging or reducing a shadow. The figure shows an example in which the enlargement ratio is increased.

FIG. 10(A) shows the projected image at the beginning of zooming, and FIG. 10(B) shows the projected image PI after the magnification is lowered.

As shown in FIG. 10, when increasing the magnification of a zoomed image, the shadow Sh generated for zooming is reduced after zooming. Conversely, when the enlargement ratio is decreased, the shadow Sh is reduced. A shadow is enlarged or reduced by moving an obstacle, which is the source of the shadow, back and forth along the projection direction (the direction of the optical axis of the projection optical system 14D). Therefore, the enlargement ratio can be changed by the operation of moving the obstacle back and forth along the projection direction.

FIG. 11 is a block diagram of functions possessed by the control unit when realizing this function.

As shown in the figure, the control section 20 further has the function of a motion detection section 20D. The motion detection unit 20D detects the motion of the shadow Sh based on the image captured by the imaging unit 16. FIG. Here, the movement of scaling (enlarging, shrinking) of the shadow Sh is detected.

After zooming, when the motion detection unit 20D detects a motion that expands or contracts the shadow Sh, the projection control unit 20A changes the enlargement ratio of the projection image PI according to the detected motion. That is, when the motion of enlarging the shadow Sh is detected, the enlargement ratio of the projection image is increased according to the motion (the enlargement ratio is increased according to the change in the enlargement ratio of the shadow). Also, when a movement of the shadow Sh to shrink is detected, the enlargement ratio of the projection image PI is reduced according to the movement (the enlargement ratio is increased according to a change in the shadow reduction ratio).

FIG. 12 is a flowchart showing the procedure of zoom (digital zoom) processing in this example.

First, a non-shielded area is detected based on the detection result of the shadow Sh (step S31). Next, the detected non-shielded area is set as the enlargement target area (step S32). Then, the set enlargement target area is enlarged and projected (step S33) (see FIG. 10A).

After that, it is determined whether or not the movement of the shadow Sh has been detected (step S34). Here, if it is determined that the movement of the shadow Sh has not been detected (No in step S34), it is determined whether or not the shadow Sh has disappeared (step S38). Then, when it is determined that the shadow Sh has disappeared, the zooming process ends.

On the other hand, if it is determined in step S34 that the movement of the shadow Sh has been detected, it is determined whether or not the shadow Sh is expanding (step S35).

If the shadow Sh expands (Yes in step S34), the enlargement ratio of the projection image PI is increased according to the movement of the shadow Sh (step S36) (see FIG. 10B).

On the other hand, when the shadow Sh shrinks (No in step S34), the enlargement ratio of the projection image PI is lowered according to the motion of the shadow Sh (step S37).

After that, it is determined whether or not the shadow Sh has disappeared from the projection image PI (step S38). If the shadow Sh has not disappeared (No in step S38), the process returns to step S34 to determine whether or not the movement of the shadow Sh has been detected. On the other hand, when the shadow Sh disappears (Yes in step S38), the zooming process ends.

Thus, according to this example, the zoom magnification can be changed by the operation of enlarging or reducing the shadow Sh. Thereby, convenience can be improved more.

In this example, the shadow Sh is scaled to change the zoom magnification, but it is also possible to change the zoom magnification by other movements. For example, it is also possible to adopt a configuration in which the enlargement ratio is changed according to the movement of moving the shadow Sh up and down. In this case, for example, when the shadow Sh is moved upward, the enlargement ratio is increased, and when the shadow Sh is moved downward, the enlargement ratio is decreased.

(4) Movement of image after zooming A configuration may be adopted in which an image can be moved after zooming. In this case, for example, a method of moving the shadow Sh generated for zooming after zooming and sliding the image in the moving direction of the shadow Sh can be adopted.

FIG. 13 is a conceptual diagram of an image moving operation after zooming.

In the figure, (A) shows the projected image PI immediately after the shadow Sh is generated and zoomed (see FIG. 7A for the projected image before zooming).

(B) of the same figure shows the projection image PI when the shadow Sh is moved upward from the state of (A) of the same figure. In this case, the projection image PI slides upward.

(C) of the same figure shows the projection image PI when the shadow Sh is moved rightward from the state of (A) of the same figure. In this case, the projection image PI slides rightward.

(D) of the same figure shows the projection image PI when the shadow Sh is moved downward from the state of (A) of the same figure. In this case, the projection image PI slides downward.

(E) of the same figure shows the projection image PI when the shadow Sh is moved leftward from the state of (A) of the same figure. In this case, the projection image PI slides leftward.

In this way, when moving the image after zooming, the shadow Sh is moved in the direction in which the image is desired to be moved. In the example shown in FIG. 13, the movement is in four directions (up, down, left, and right), but the direction of movement is arbitrary. That is, movement in all directions is possible.

FIG. 14 is a block diagram of functions possessed by the control unit when realizing this function.

As shown in the figure, the control section 20 further has the function of a movement detection section 20E. The movement detection unit 20E detects movement of the shadow Sh based on the image captured by the imaging unit 16. FIG.

After zooming, when the movement detection unit 20E detects the movement of the shadow Sh, the projection control unit 20A slides the image projected by the projection unit 14 in the movement direction of the shadow Sh. When a rightward movement of the shadow Sh is detected, the projected image is slid to the right, and when a leftward movement of the shadow Sh is detected, the projected image is slid to the left.

FIG. 15 is a flowchart showing the procedure of zoom (digital zoom) processing in this example.

First, a non-shielded area is detected based on the shadow detection result (step S41). Next, the detected non-shielded area is set as the enlargement target area (step S42). Then, the set enlargement target area is enlarged and projected (step S43) (see FIG. 13A).

After that, it is determined whether or not the movement of the shadow Sh has been detected (step S44). Here, if it is determined that the movement of the shadow Sh has not been detected (No in step S44), it is determined whether or not the shadow Sh has disappeared (step S46). Then, when it is determined that the shadow Sh has disappeared, the zooming process ends.

On the other hand, when it is determined in step S44 that the movement of the shadow Sh has been detected, the image to be projected is moved. That is, the projected image is slid in the direction in which the movement of the shadow Sh is detected (step S45). (See FIGS. 13B to 13E)
After that, it is determined whether or not the shadow Sh has disappeared from the projection image PI (step S46). If the shadow Sh has not disappeared (No in step S46), the process returns to step S34 to determine whether or not the movement of the shadow Sh has been detected. On the other hand, when the shadow Sh disappears (Yes in step S38), the zooming process ends.

Thus, according to this example, the projection image PI can be moved by the operation of moving the shadow Sh. Thereby, convenience can be improved more.

Note that this function can also be used in combination with a function for enlarging or reducing the projected image PI after zooming. In this case, the movement of the shadow Sh that scales the projection image PI is set separately from the movement (movement) of the shadow Sh that moves the projection image.

[Second embodiment]
[overview]
In the projection apparatus of this embodiment, when a shadow is generated on the projection image, the area corresponding to the position of the shadow is enlarged.

16 to 18 are conceptual diagrams of a zoom (digital zoom) operation by the projection apparatus of this embodiment.

As shown in FIG. 16, in the projection device of this embodiment, the projected image PI is divided into a plurality of areas. By detecting in which region the shadow Sh exists, the position where the shadow Sh exists is detected. FIG. 16 shows an example of division into six regions (first region P1, second region P2, third region P3, fourth region P4, fifth region P5, and sixth region P6). . The area in which the shadow Sh exists is detected by the following method. First, the shadow Sh generated on the projection image PI is detected. Next, the ratio of the shadow Sh to each region (shadow occupation ratio) is obtained. The occupancy rate of the shadow Sh is obtained as a ratio of the area of the shadow Sh to the area of each region. The region with the highest occupancy ratio is detected as the position (region) where the shadow Sh exists.

When the position (region) where the shadow Sh exists is detected, a predetermined region corresponding to the position (region) is enlarged. In the example shown in FIG. 16, for example, the area to be enlarged is determined as follows. The first area P1 is defined as an area to be expanded by the fourth area P4. The second area P2 is defined as an area to be enlarged by the fifth area P5. The third area P3 is defined as an area to be enlarged by the sixth area P6. A fourth area P4 is defined as an area to be enlarged by the first area P1. A fifth area P5 is defined as an area to be expanded by the second area P2. A sixth area P6 is defined as an area to be enlarged by the third area P3. That is, the laterally adjacent area is determined as the enlargement target area.

FIG. 17 shows an example of the projection image PI when the shadow Sh is detected in the fifth area P5 (when the fifth area P5 has the highest occupancy rate of the shadow Sh). As shown in the figure, in this case, the second region P2 is enlarged.

Also, FIG. 18 shows an example of the projection image PI when the shadow Sh is detected in the sixth area P6 (when the sixth area P6 is the area where the shadow Sh has the highest occupancy rate). As shown in the figure, in this case, the third region P3 is enlarged.

As described above, in the projection apparatus of the present embodiment, when the shadow Sh is generated on the projection image PI, the area corresponding to the position of the shadow Sh is enlarged.

[composition]
The only difference between the projection apparatus of this embodiment and the projection apparatus of the first embodiment is the digital zoom function. Therefore, only the digital zoom function installed in the projection apparatus of this embodiment will be described here.

FIG. 19 is a functional block diagram of the control unit of the projection apparatus according to this embodiment.

As shown in the figure, the control unit 20 has functions of a projection control unit 20A, a shadow detection unit 20B, an enlargement target area setting unit 20C, and a position detection unit 20F.

The shadow detector 20B detects a shadow Sh that appears on the projection image PI. The position detection unit 20F detects the position where the shadow Sh exists based on the detection result of the shadow Sh by the shadow detection unit 20B. As for the position where the shadow Sh exists, the occupancy rate of the shadow Sh in each area is obtained as described above, and the area with the highest occupancy rate is detected as the position (area) where the shadow Sh exists.

The enlargement target area setting unit 20C sets an image enlargement area (enlargement target area) within the projection image PI based on the position of the shadow Sh detected by the position detection unit 20F. The enlargement target area setting unit 20C sets an enlargement target area by referring to a look-up table (LUT) stored in the storage unit 20G.

20 is a diagram illustrating an example of a lookup table stored in a storage unit; FIG.

As shown in the figure, the lookup table defines an area to be enlarged for each position (area) where a shadow exists. The storage unit 20G that stores the lookup tables is composed of, for example, a ROM of a computer.

When the shadow detection unit 20B detects the shadow Sh, the projection control unit 20A enlarges the area set by the enlargement target area setting unit 20C and causes the projection unit 14 to project the image. Here, in the projection apparatus of this embodiment, as shown in FIGS. 17 and 18, the target area is vertically enlarged to enlarge the image displayed in the area.

[Action]
When a shadow is detected on the projected image, digital zooming is performed according to the following procedure.

FIG. 21 is a flow chart showing the procedure of zoom processing in the projection apparatus of this embodiment.

First, the position of the shadow Sh is detected (step S51). That is, the area where the shadow Sh exists is detected. Next, an enlargement target area is set based on the detected position (area) of the shadow Sh (step S52). The enlargement target area is set by referring to the lookup table based on the position of the detected shadow Sh. When the enlargement target area is set, the set enlargement target area is enlarged and projected (step S53) (see FIGS. 17 and 18).

After that, it is determined whether or not the shadow Sh has disappeared from the projection image PI (step S54). If the shadow Sh has not disappeared (No in step S54), zooming continues. On the other hand, when the shadow Sh disappears (Yes in step S54), the zooming process ends.

As described above, according to the projection apparatus of the present embodiment, when the shadow Sh is generated on the projection image PI, the area corresponding to the position of the shadow Sh is enlarged. This makes it possible to easily enlarge the desired area. Moreover, since it only creates a shadow Sh, it is not limited to a specific operator and can be operated by any person.

[Modification]
(1) Modified example of zoom mode In the above embodiment, when zooming, the target area is enlarged in the vertical direction, and the image displayed in that area is enlarged (see FIGS. 17 and 18). However, the form of zooming is not limited to this.

FIG. 22 is a diagram showing another example of the form of zoom. The figure shows an example in which the second area P2 is set as the enlargement target area.

As shown in the figure, the image to be projected may be zoomed (digitally zoomed) with the center of the area set as the enlargement target area as the center of zooming.

FIG. 23 is a diagram showing another example of the form of zoom. The figure shows an example in which the second area P2 is set as the enlargement target area.

As shown in the figure, the zooming may be performed so that the entire area set as the enlargement target area is projected on the entire screen.

24 and 25 are diagrams showing another example of the form of zoom. 24 shows an example in which the second area P2 is set as the enlargement target area, and FIG. 25 shows an example in which the third area P3 is set as the enlargement target area.

The zooming method shown in FIGS. 24 and 25 is the same as the zooming method of the above embodiment in that the target area is vertically enlarged to enlarge the image displayed in that area. However, the difference is that the areas above and below the object are displayed in a reduced size. The upper and lower areas are reduced according to the enlargement of the target area, and the image displayed in that area is also reduced at the same time. Note that in the examples shown in FIGS. 24 and 25, the images of the areas arranged above and below the target are reduced (compressed) in the vertical direction. By reducing and displaying the upper and lower regions in this way, it is possible to leave the display of the regions other than the enlarged region.

(2) Other Modified Examples The modified example of shadow detection, the modified example of canceling the zoom, the change of the enlargement ratio, the movement of the image after zooming, etc. described in the first embodiment are described in the present embodiment. can also be applied to the projection device of

[Third embodiment]
[overview]
The projection apparatus of this embodiment enlarges the shaded area. That is, the shadow acts like a magnifying glass for zooming.

FIG. 26 is a conceptual diagram of a zoom (digital zoom) operation by the projection device of this embodiment. (A) of the figure shows the projected image before the zoom operation, and (B) of the same figure shows the projected image after the zoom operation.

As shown in FIG. 26, when a frame-shaped shadow Sh is generated on the projection image PI, the area surrounded by the frame-shaped shadow Sh is enlarged.

[composition]
The only difference between the projection apparatus of this embodiment and the projection apparatus of the first embodiment is the digital zoom function. Therefore, only the digital zoom function installed in the projection apparatus of this embodiment will be described here.

The point that the control unit 20 has the functions of a projection control unit 20A, a shadow detection unit 20B, and an enlargement target area setting unit 20C is the same as the projection apparatus 1 of the first embodiment (see FIG. 5).

The shadow detection unit 20B of the present embodiment detects a shadow (frame-shaped shadow) Sh surrounding a portion of the projection image. The shadow Sh is detected based on the image captured by the imaging unit 16 .

The enlargement target area setting unit 20C sets an image enlargement area (enlargement target area) within the projection image PI based on the detection result of the shadow detection unit 20B. Specifically, the area surrounded by the frame-shaped shadow PI is set as the enlargement target area.

When the shadow detection unit 20B detects the shadow Sh, the projection control unit 20A enlarges the area set by the enlargement target area setting unit 20C and causes the projection unit 14 to project the image. Specifically, as shown in FIG. 26B, the image within the area surrounded by the shadow Sh is enlarged at a prescribed enlargement ratio and projected. At this time, with the center of the area surrounded by the shadow Sh as the center of zooming, the image of the area is enlarged and displayed within the area surrounded by the shadow Sh.

[Action]
When a shadow Sh surrounding part of the projection image PI is detected during normal projection (see FIG. 26A), digital zooming is performed. When the shadow Sh surrounding part of the projection image PI is detected, the area surrounded by the shadow Sh is set as the enlargement target area. Then, the set enlargement target area is enlarged, and the projection target image is projected (see FIG. 26B). When the shadow Sh is moved, the area to be enlarged is changed in conjunction with the movement of the shadow Sh.

As described above, according to the projection apparatus of the present embodiment, by enclosing part of the projection image PI with the frame-shaped shadow Sh, the enclosed area can be enlarged. This makes it possible to easily enlarge the desired area. Also, since it only creates a shadow, it is not limited to a specific operator, and can be operated by any person.

[Modification]
The modified example of shadow detection, the modified example of canceling the zoom, the change of the enlargement ratio, etc. described in the first embodiment can also be applied to the projection apparatus of the present embodiment.

Also, a plurality of shadows may be generated. In this case, the zoom is done shadow by shadow.

[Fourth Embodiment]
[overview]
In the projection apparatus of this embodiment, the enlargement target area is specified using the movement of the shadow. Specifically, the shadow is continuously moved on the projection image, and the area other than the area through which the shadow passes is designated as the enlargement target area.

FIG. 27 is a conceptual diagram of a zoom (digital zoom) operation by the projection device of this embodiment.

As shown in the figure, the projected image PI is divided into a plurality of regions P(x, y) (x=1, 2, 3, . . . y=1, 2, 3, . Specify the area that is not covered as the enlargement target area. FIG. 27 shows an example in which the projection image PI is divided into grids.

The example shown in FIG. 27 shows an example in which the shadow Sh is moved along the lower side and right side of the projection image PI. In addition, in FIG. 27, in order to clarify the area through which the shadow Sh passes, the area through which the shadow Sh passes is indicated by oblique lines. In the case of the example shown in FIG. 27, the area displayed as "ABCEFG" is designated as the enlargement target area.

FIG. 28 is a diagram showing a projection image after zooming.

As shown in the figure, after the zoom operation, the area specified as the enlargement target area is enlarged and projected on the entire screen. That is, the image is enlarged and projected on the entire screen with the center of the area designated as the enlargement target area as the zoom center (so-called trimming zoom). Therefore, in FIG. 27, the area labeled "ABCEFG" is enlarged and projected on the entire screen.

[composition]
The only difference between the projection apparatus of this embodiment and the projection apparatus of the first embodiment is the digital zoom function. Therefore, only the digital zoom installed in the projection apparatus of this embodiment will be described here.

The point that the control unit 20 has the functions of a projection control unit 20A, a shadow detection unit 20B, and an enlargement target area setting unit 20C is the same as the projection apparatus 1 of the first embodiment (see FIG. 5).

The shadow detection unit 20B of this embodiment detects the shadow Sh moving on the projection image PI. More specifically, the area P(x, y) where the shadow Sh has moved is detected on the projection image PI, and the movement locus thereof is detected. Movement of the shadow Sh is detected based on an image captured by the imaging unit 16 . In addition, since the movement of the shadow Sh is detected, the shadow detection unit 20B detects the movement of the shadow based on the continuously captured images (so-called moving images).

The shadow detection unit 20B also detects a shadow Sh covering the entire surface of the projection image PI. Here, the shadow Sh covering the entire surface of the projected image PI is a condition for ending zooming in the projection apparatus of the present embodiment. That is, when the entire surface of the projected image PI is covered with the shadow Sh after digital zooming, the digital zooming ends and normal projection is resumed.

The enlargement target area setting unit 20C detects an area through which the shadow Sh does not pass within the projection image PI based on the detection result of the shadow detection unit 20B, and sets the detected area as the enlargement target area (see FIG. 27). ).

When the shadow detection unit 20B detects the shadow Sh, the projection control unit 20A enlarges the area set by the enlargement target area setting unit 20C and causes the projection unit 14 to project the image. Specifically, with the center of the area set by the enlargement target area setting unit 20C as the center of zooming, the image of the area is enlarged and projected on the entire screen (the center of projection and the center of the image are aligned, (See FIG. 28).

Further, when the shadow detection unit 20B detects the shadow Sh covering the entire surface of the projection image PI after the digital zoom, the projection control unit 20A ends the digital zoom and returns to normal projection.

[Action]
When a moving shadow is detected on the projection image, digital zooming is performed according to the following procedure.

FIG. 29 is a flowchart showing the procedure of zooming (digital zooming) processing in the projection apparatus of this embodiment. Also, FIG. 30 is a diagram showing how the projected image changes based on the zoom operation.

First, the locus of movement of the shadow Sh is detected based on the captured image (step S61). More specifically, as shown in FIG. 30(A), a region where the shadow Sh has moved is detected on the projection image PI. Note that in FIG. 30A, the area where the shadow Sh has moved is indicated by oblique lines.

After that, it is determined whether or not the shadow Sh has disappeared from the projection image PI (step S62). That is, it is determined whether or not the specification of the enlargement target area has been completed.

When it is determined that the shadow Sh has disappeared from the projection image PI, an enlargement target area is set from the movement trajectory of the shadow Sh (step S63). That is, an area through which the shadow Sh does not pass is detected, and that area is set as the enlargement target area.

When setting of the enlargement target area is completed, as shown in FIG. 30B, the set enlargement target area is enlarged and projected on the entire screen (step S64).

After that, it is determined whether or not an operation for ending the zoom has been performed (step S65). That is, as shown in FIG. 30C, it is determined whether or not the shadow Sh covering the entire screen has been detected. When the shadow Sh covering the entire screen is detected, the zooming process ends. When the zoom is finished, normal projection is restored as shown in FIG. 30(D).

As described above, according to the projection device of the present embodiment, the desired area can be easily enlarged by the operation of moving the shadow Sh. Also, since it only creates a shadow, it is not limited to a specific operator, and can be operated by any person.

[Modification]
(1) Modified Example of Shadow Detection by Shadow Detection Section The shadow detection section 20B may be configured to detect a shadow that reciprocates more than a predetermined number of times. As a result, it is possible to prevent the projection image from being changed due to unintentional zooming. It is more preferable that the user can arbitrarily set the “fixed number of times” here. This allows setting according to the user's preference.

(2) Display of Shadow Movement Trajectory When a moving shadow Sh is detected, the movement trajectory of the detected shadow Sh may be displayed in the projection image.

FIG. 31 is a diagram illustrating an example of display of a shadow movement trajectory.

In the example shown in the figure, the movement locus of the shadow Sh is displayed on the projection image PI by changing the brightness of the area through which the shadow Sh passes and projecting it (projecting it by darkening it). In addition, in the example shown in the figure, the area through which the shadow Sh passes is indicated by oblique lines.

The projection control unit 20A causes the projection unit 14 to project the movement trajectory of the shadow Sh based on the detection result of the shadow detection unit 20B.

The display form of the movement track is not particularly limited as long as it can be distinguished from other areas. As described above, in addition to changing the brightness, the background color may be changed, or the display may be turned off (so-called black filling).

[Other embodiments]
(1) Means for Generating Shadows In the above-described embodiment, shadows Sh are generated by human hands during zooming, but the means (obstacles) for generating shadows on the projected image is not particularly limited. .

FIG. 32 is a diagram showing another example of means (obstacle) for generating a shadow on the projection image.

This figure shows an example of zooming an area surrounded by shadows, and shows an example of generating a frame-shaped shadow Sh using a circular frame F. FIG.

In addition, when specifying an enlargement target area by covering a part of the projected image with a shadow, a paper or the like can be used to generate a shadow.

(2) Imaging Unit The imaging unit 16 may be integrally incorporated into the main body of the projection apparatus, or may be separated.

(3) Controller The controller can be implemented using various processors. Various processors include, for example, a CPU, which is a general-purpose processor that executes software (programs) to implement various functions. Further, the above-mentioned various processors include GPUs (Graphics Processing Units) which are processors specialized for image processing, FPGAs (Field Programmable Gate Arrays), etc. Programmable logic devices which are processors whose circuit configuration can be changed after manufacturing. Logic Devices (PLDs) are also included. Further, the above-mentioned various processors also include dedicated electric circuits, such as ASICs (Application Specific Integrated Circuits), which are processors having circuit configurations specially designed to execute specific processing.

The control unit may be realized by one processor, or may be realized by a plurality of processors of the same type or different types (for example, a plurality of FPGAs, a combination of CPU and FPGA, or a combination of CPU and GPU). Also, a plurality of functions may be realized by one processor. As an example of configuring a plurality of functions in one processor, first, as represented by a computer such as a server, one processor is configured by a combination of one or more CPUs and software, and this processor has a plurality of functions. There is a form that is realized as a function of Secondly, as typified by System On Chip (SoC), there is a form of using a processor that implements the functions of the entire system with a single IC (Integrated Circuit) chip. In this way, various functions are configured using one or more of the above various processors as a hardware structure. Further, the hardware structure of these various processors is, more specifically, an electric circuit combining circuit elements such as semiconductor elements. These electrical circuits may be electrical circuits that implement the above functions using logical sums, logical products, logical negations, exclusive logical sums, and logical operations combining these.

When the above processor or electric circuit executes software (program), the processor (computer) readable code of the software to be executed is stored in a non-temporary recording medium such as ROM, and the processor refers to the software. do. The software stored in the non-temporary recording medium includes programs for executing image input, analysis, display control, and the like. Codes may be recorded in non-temporary recording media such as magneto-optical recording devices and semiconductor memories instead of ROMs. During processing using software, for example, a RAM is used as a temporary storage area, and data stored in, for example, an EEPROM (Electronically Erasable and Programmable Read Only Memory) (not shown) can also be referred to.

1 projection device 2 screen 3 external device 12 image input unit 14 projection unit 14A illumination unit 14B illumination optical system 14C image display unit 14D projection optical system 16 imaging unit 16A imaging optical system 16B image sensor 16C analog signal processing unit 16D digital signal processing unit 18 Operation unit 20 Control unit 20A Projection control unit 20B Shadow detection unit 20C Enlargement target area setting unit 20D Motion detection unit 20E Movement detection unit 20F Position detection unit 20G Storage unit F Frame (obstacle)
P(x, y) Divided area P1 First area P2 Second area P3 Third area P4 Fourth area P5 Fifth area P6 Sixth area PI Projected image Sh Shadow R Enlargement target area W Hand (obstacle)
S11 to S17 Projector operation procedures S21 to S24 Digital zoom processing procedures S31 to S38 Digital zoom processing procedures S41 to S46 Digital zoom processing procedures S51 to S54 Digital zoom processing procedures S61 to S65 Digital zoom processing procedures

Claims (7)

A projection device that projects an image onto a projection plane and visually recognizes the reflected light,
a projection unit that projects the image onto the projection plane ;
a projection control unit that controls projection of an image by the projection unit;
an imaging unit that captures an image projected by the projection unit;
a shadow detection unit that detects a shadow appearing in the projected image based on the image captured by the imaging unit;
an enlargement target area setting unit that detects the shadowless area in the projection image based on the detection result of the shadow detection unit and sets the area as an enlargement target area;
with
When the shadow is detected by the shadow detection unit, the projection control unit enlarges the enlargement target area and causes the projection unit to project it.
projection device. The projection unit includes an image display unit that displays an image to be projected,
A projection device according to claim 1 . The shadow detection unit detects the shadow that continues for a certain period of time or longer.
3. Projection device according to claim 1 or 2. further comprising a motion detection unit that detects motion of the shadow based on the captured image;
When the movement detection unit detects the movement of the shadow after causing the projection unit to enlarge and project the enlargement target area, the projection control unit controls the movement of the shadow detected by the movement detection unit. change the magnification according to
4. A projection device according to any one of claims 1-3. The motion detection unit detects a motion that the shadow expands or contracts.
5. A projection device according to claim 4. further comprising a movement detection unit that detects movement of the shadow based on the image captured by the imaging unit;
When the movement detection unit detects movement of the shadow after causing the projection unit to enlarge and project the enlargement target area, the projection control unit controls the movement of the shadow detected by the movement detection unit. sliding the image projected by the projection unit according to
6. Projection apparatus according to any one of claims 1-5. A projection method using a projection device that projects an image onto a projection plane and visually recognizes the reflected light,
projecting the image onto the projection plane;
capturing a projection image;
a step of detecting shadows occurring in the projected image based on the captured image;
a step of detecting the shadowless area in the projection image based on the shadow detection result and setting it as an enlargement target area;
enlarging the area to be enlarged and projecting the image when the shadow is detected;
projection method, including

Images