JP6900115B2 - Projector system and program for projector system - Google Patents

Description

The present invention relates to a projector system and a program for a projector system in which the screen is moved to project contents.

In recent years, projectors have been used to display lecture manuscripts on desks and recipes on countertops in cooking classes. FIG. 1 shows a recipe projected from the projector systems 103A and 103B provided on the ceiling 102 onto the countertops 101A and 101B of the cooking class.

In the above situations, it is preferable that the recipe is displayed at a position that follows the movement of the cook. In particular, when the cook moves from one side of the countertops 101A and 101B to the opposite side, the characters are turned upside down and become difficult to read. Further, when the cook of the counter 101A can read only Japanese and the cook of the counter 101B can read only English, it is convenient to display recipes in different languages.

On the other hand, Patent Document 1 discloses that when a positioning mark and a keyword are drawn on a board, the positioning mark and the keyword are read and the content corresponding to the keyword is displayed at the position indicated by the positioning mark.

Further, in Patent Document 2, when a medium provided with a position marker is held over a display unit on which the content to be copied is displayed, a state such as the position and angle of the medium is detected from the position of the position marker and a region to be copied is determined. A system capable of copying is disclosed.

Japanese Unexamined Patent Publication No. 2013-89987 Japanese Unexamined Patent Publication No. 2005-31448

The above-mentioned Patent Document 1 is assumed to be used for teaching or the like using a whiteboard, and it is not assumed that the image is displayed upside down or slanted on the whiteboard.

In the system of Patent Document 2, the image in the position marker tilted from the object to be copied can be obtained by tilting the medium provided with the position marker. However, when the screen to be projected by the projector is tilted, the image is not properly displayed on the screen.

The present invention has been made in response to the current state of the projector system and the demand for the projector system as described above, and an object of the present invention is to be able to appropriately project an image on the screen surface after moving according to the movement of the screen surface. To provide a projector system. Another object is to provide a projector system capable of designating content by characters on the screen surface.

The projector system according to the present invention includes a projector that projects an image, a camera unit that captures an image of a screen surface on which characters are written at a predetermined position and an image projected by the projector to obtain image information, and the camera unit. and orientation detection means for performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by detecting the vertical and horizontal directions of the characters, to detect the orientation information of the screen to be projected on the screen surface by the orientation It is characterized by comprising a video signal generating means for generating a video signal by adjusting the inclination of the video to be transmitted to the projector based on the orientation information detected by the detecting means.

The projector system according to the present invention, the range of a screen for projection in the screen surface with obtaining the position and arrangement of the characters by performing character recognition of the predetermined position on the screen surface on the basis of image information obtained by the camera unit A range detecting means for detecting is provided, and the video signal generating means adjusts the screen range of the image to be transmitted to the projector based on the range information of the screen detected by the range detecting means to generate a video signal. It is a feature.

In the projector system according to the present invention, the range detecting means obtains a rectangle in which two characters having a predetermined positional relationship in the character recognized character are diagonally aligned, and the range of this rectangle is set on the screen surface. It is characterized in that it is detected as the range of the screen to be projected.

In a projector system according to the present invention, a content storage unit which content is stored in correspondence with the character of the image to be projected from the projector, the character of the predetermined position in the screen surface on the basis of image information obtained by the camera unit It is characterized by including a character recognition means for recognizing a character and a content extraction means for extracting the content corresponding to the character related to the character recognition result from the content storage unit and transmitting the content as a video signal to the projector by the video signal generation means. And.

The projector system according to the present invention is characterized in that the characters written on the screen surface are alphabets in which the vertical direction can be determined.

The program for a projector system according to the present invention includes a projector that projects an image, a camera unit that captures an image of a screen surface on which characters are written at a predetermined position and an image projected by the projector, and obtains image information. said computer configured projector system and a control unit comprising a computer for controlling the projector, the upper and lower character performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by the camera unit An orientation detecting means that detects the left-right direction and detects the orientation information of the screen to be projected on the screen surface, and adjusts the inclination of the image to be transmitted to the projector based on the orientation information detected by the orientation detecting means to obtain an image signal. It is characterized in that it functions as a means for generating a video signal to be generated.

The projector system program according to the present invention, further the computer, the screen surface with obtaining the position and arrangement of characters performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by the camera unit It functions as a range detecting means for detecting the range of the screen to be projected, and the video signal generating means adjusts the screen range of the image to be transmitted to the projector based on the range information of the screen detected by the range detecting means. It is characterized in that it functions so as to generate a video signal.

In the projector system program according to the present invention, the range detecting means obtains a rectangle having a diagonal line between two characters having a predetermined positional relationship in the character recognized character, and the range of the rectangle is set to the screen. It is characterized in that it is detected as the range of the screen to be projected on the surface.

In the projector system program according to the present invention, the projector system includes a content storage unit in which the content of an image projected from the projector is stored corresponding to characters, and the computer is further obtained by the camera unit. character recognition means for performing character recognition of the predetermined position in the screen surface on the basis of the image information, the projector contents corresponding to the character according to the character recognition result as a video signal by the video signal generating means is taken out from the content storage unit It is characterized in that it functions as a means for extracting contents to be transmitted.

The program for a projector system according to the present invention is characterized in that the characters written on the screen surface are alphabets in which the vertical direction can be determined.

According to the present invention, based on image information obtained by imaging a screen surface on which an image projected by a projector is projected, character recognition at a predetermined position on the screen surface is performed to detect the vertical and horizontal directions of the characters, and the screen surface is detected. The orientation information of the screen to be projected is detected, and the inclination of the image to be transmitted to the projector is adjusted based on the detected orientation information to generate an image signal. Therefore, the image is appropriately moved following the movement of the screen surface. It can be projected on the screen surface later.

Further, according to the present invention, character recognition at a predetermined position on the screen surface is performed based on the image information obtained by the camera unit, and the content corresponding to the character related to the character recognition result is taken out from the content storage unit to generate the video signal. Since it is transmitted to the projector as a video signal by means, it is possible to specify the content by the characters on the screen surface.

The perspective view which shows the example of the kitchen using the embodiment of the projector system which concerns on this invention. The block diagram of the 1st Embodiment of the projector system which concerns on this invention. The plan view which shows an example of the screen used in embodiment of the projector system which concerns on this invention. The flowchart for demonstrating the operation of the 1st Embodiment of the projector system which concerns on this invention. The plan view which shows the posture of the screen and the projected image for demonstrating the operation by 1st Embodiment of the projector system which concerns on this invention. The plan view for demonstrating the screen range adjustment operation by 1st Embodiment of the projector system which concerns on this invention. The block diagram of the 2nd Embodiment of the projector system which concerns on this invention. The flowchart for demonstrating the operation of the 2nd Embodiment of the projector system which concerns on this invention. The plan view which shows the screen and the projected content image for demonstrating the operation by 2nd Embodiment of the projector system which concerns on this invention. The plan view which shows the screen and the projected content image for demonstrating the operation by 2nd Embodiment of the projector system which concerns on this invention.

Hereinafter, embodiments of the projector system and its program according to the present invention will be described with reference to the accompanying drawings. In each figure, the same components are designated by the same reference numerals, and duplicate description will be omitted. As shown in FIG. 1, the projector systems 103A and 103B according to the present embodiment are provided on the ceiling 102. FIG. 1 is only an example, and the installation location and the number of projector systems 103A and 103B are not limited to this. The configurations of the projector systems 103A and 103B are the same, as shown in FIG.

The projector system projects an image according to the posture of the screen. The projector 10 is provided with a video receiving unit 11 to receive a video signal sent from the control unit 30.

The projector 10 is provided with a video output unit 12 and a control unit 13. The control unit 13 receives the video signal received by the video receiving unit 11 and sends it to the video output unit 12. The video output unit 12 receives the signal related to the video information, visualizes it, and outputs it to the screens 104A and 104B of FIG.

The screens 104A and 104B are made of paper, an acrylic plate, cloth, or the like, and there are no restrictions on the material, thickness, size, or the like as long as they can project an image. Further, the planar shape can be rectangular as shown in FIG. Of course, the planar shape of the screens 104A and 104B may be any shape. On the screens 104A and 104B, characters indicating the projection range 9 of the image are written (printed or the like). Since the projection range 9 of the image is usually a rectangle, a total of four characters are described at the positions of the four corners of the rectangle. If the projection range is a rectangle whose diagonal line is between two characters in a predetermined positional relationship (for example, the relationship between the start point and the end point of the diagonal line of the rectangle), two characters may be used, but in consideration of the case where they are hidden by a hand or the like. Can be 4 characters.

In addition, characters may be written at positions other than the above four characters along the boundary line of the projection range 9, but it is expected that they will interfere with the visual observation when the image is projected, so the four characters Can be. In addition, the characters are basically not limited as long as they can determine the vertical direction, but the vertical direction in the alphabet is determined from the viewpoint that it is preferable that the accuracy and efficiency of character recognition are better. It can be a possible alphabet. The nine letters "H", "I", "M", "N", "O", "S", "W", "X", and "Z" are alphabets whose vertical direction cannot be determined. Not used.

The camera unit 20 obtains image information by capturing an image of a screen surface on which an image projected by the projector 10 is projected. Based on the image information obtained by the camera unit 20, the control unit 30 adjusts and transmits the video information before transmitting it to the projector 10.

The control unit 30 includes an arithmetic processing unit 31 composed of a CPU, a content storage unit 32 in which video information of a plurality of contents is stored, an input unit 33 for inputting commands and data, and a video signal projector. A video transmission unit 34 for transmitting to the video reception unit 11 of 10 is provided. The input unit 33 can be configured by a keyboard, a touch panel, a mouse, or the like.

The arithmetic processing unit 31 is provided with orientation detecting means 311, video signal generating means 312, range detecting means 313, and content extracting means 314. The orientation detecting means 311, the video signal generating means 312, the range detecting means 313, and the content extracting means 314 are realized by a program.

The orientation detecting means 311 recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit 20, detects the vertical and horizontal directions of the characters, and detects the orientation information of the screen to be projected on the screen surface. Is what you do. For character recognition, a known configuration can be adopted in this portion and other than this portion. The video signal generation means 312 generates a video signal by adjusting the inclination of the video to be transmitted to the projector 10 based on the orientation information detected by the orientation detection means 311.

The range detecting means 313 performs character recognition at a predetermined position on the screen surface based on the image information obtained by the camera unit 20 to obtain the position and arrangement of the characters and detects the range of the screen to be projected on the screen surface. It is a thing. Specifically, the range detecting means 313 obtains a rectangle in which two characters having a predetermined positional relationship are diagonally aligned, and detects the range of this rectangle as the range of the screen to be projected on the screen surface. The video signal generation means 312 generates a video signal by adjusting the screen range of the video to be transmitted to the projector 10 based on the screen range information detected by the range detection means 313.

The input unit 33 is used to input an instruction to read the content in the content storage unit 32. The content extraction means 314 takes out the content instructed to be read by the input unit 33 from the content storage unit and passes it to the video signal generation means 312.

Since the projector system according to the first embodiment configured as described above operates by the program corresponding to the flowchart shown in FIG. 4, this will be described. When the power is turned on, the start is started, the content instructed to be read by the input unit 33 is taken out from the content storage unit 32 and sent to the video signal generation means 312 (S11), and the direction and range of the video are adjusted by the video signal generation means 312. Move to processing.

That is, the camera unit 20 captures the screen surface on which the image projected by the projector 10 is projected to obtain image information (S12). Next, character recognition is performed based on the obtained image information to detect the vertical and horizontal directions of the characters, and the orientation information of the screen to be projected on the screen surface is detected (S13). Next, the orientation of the screen is controlled based on the orientation information of the screen with respect to the image of the content extracted in the above, and an image matching the inclination of the screen surface is generated (S14).

For example, as shown in FIG. 5A, if the vertical and horizontal directions of the character postures shown on the screens 104A and 104B are normal, the content strawberry picture 50 is in the normal direction (when the bottom is on the upper side). The video information is adjusted so that it faces (normal). Further, as shown in FIG. 5B, if the character postures described on the screens 104A and 104B are upside down, the video information is adjusted so that the strawberry picture 50, which is the content, faces the upside down direction. To. Further, if the character postures described on the screens 104A and 104B are tilted upward as shown in FIG. 5C, the video information is adjusted so that the strawberry picture 50, which is the content, is also tilted upward to the right. Will be done.

Further, character recognition is performed based on the image information obtained in step S12 to obtain the position and arrangement of the characters, and the range of the screen to be projected on the screen surface is detected (S15). Here, the projection range is a rectangle whose diagonal line is between two characters in a predetermined positional relationship (for example, the relationship between the start point and the end point of the diagonal line of the rectangle). Based on the obtained screen range information, the screen range is adjusted with respect to the video of the content whose orientation is adjusted in the above (S16).

According to the present embodiment, when the range of the screen on which the image of the content is projected by the initial value is, for example, the frame 200 as shown in FIG. 6, the projection range of the screens 104A and 104B is defined by the frame 210. The range of the image of the strawberry picture, which is the content, is reduced from the range of the frame 200 in the initial state to the range of the frame 210. Even when the character postures described on the screens 104A and 104B are upside down as shown in FIG. 5B, the orientation has already been adjusted in step S16, so that the range of the image is in the range of the image. Is adjusted in the same manner as above. Further, even when the character postures described on the screens 104A and 104B are tilted upward to the right as shown in FIG. 5C, the orientation adjustment has already been performed in step S16, so that the image of the image is displayed. The range adjustment is performed in the same manner as described above.

As described above, the video whose direction and range of the video have been adjusted by the video signal generation means 312 is regarded as a video signal, sent from the video transmission unit 34 to the projector 10, and projected onto the screens 104A and 104B. (S17). After that, the process is repeated by this program. The order of adjusting the orientation and adjusting the image range may be the reverse of this embodiment.

FIG. 7 shows the configuration of the projector system according to the second embodiment. In the present embodiment, the arithmetic processing unit 31A is provided with the character recognition means 315, and the content extraction means 314A has a new function. That is, the character recognition means 315 recognizes characters at a predetermined position on the screen surface based on the image information obtained by the camera unit 20.

One content is assigned to the content storage unit 32 corresponding to one character of the alphabet, and a plurality of contents are stored so that the corresponding content can be read by one character of the alphabet. The content extraction means 314A takes out the content corresponding to the character related to the character recognition result from the content storage unit 32 and sends it to the projector 10 as a video signal by the video signal generation means 312.

Except for the above configuration, the configuration of the present embodiment is the same as the configuration of the first embodiment. In the projector system according to the second embodiment configured as described above, the operation is performed by the program corresponding to the flowchart shown in FIG. 8, and this will be described. The operation of steps S12 to S15 is the same as the configuration of the first embodiment. In the present embodiment, first, the camera unit 20 captures the screen surface on which the image projected by the projector 10 is projected to obtain image information (S12). Following step S12, character recognition at a predetermined position on the screen surface is performed based on the image information obtained by the camera unit 20 (S21). Based on the character information as a result of character recognition, the corresponding content is read out from the content storage unit 32 and sent to the video signal generation means 312 (S22), and the video signal generation means 312 moves to the adjustment process of the direction and range of the video. (S13 to S17) Transition. Since the operations of steps S12 to S17 have already been described in detail in the description of the first embodiment, the description thereof will be omitted here. After the process of step S17, the process by this program is repeated.

According to the projector system according to the second embodiment as described above, the following can be achieved. It is assumed that the content storage unit 32 stores, for example, the "strawberry content" associated with the character A and the "melon content" associated with the character B.

Therefore, as shown in FIG. 9A, when the screen 201 in which the characters A are described in the four corners is used, the characters A in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character A, and the "strawberry content" associated with the character A is read out from the content storage unit 32, and as shown in FIG. 9A, the screen 201 projection range is covered with "strawberry content". The image of "Strawberry content" is projected.

Further, as shown in FIG. 9B, when the screen 202 in which the characters B are described in the four corners is used, the characters B in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character B, and the "melon content" associated with the character B is read from the content storage unit 32, and as shown in FIG. 9 (b), the "melon content" is displayed in the screen 201 projection range. The image of "Melon contents" is projected.

As another example, the content storage unit 32 stores, for example, "content in Japanese" associated with the character J and "content in English" associated with the character E. To do.

Therefore, as shown in FIG. 10A, when the screen 203 in which the characters J are described in the four corners is used, the characters J in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character J, and "Japan (content in Japanese)" associated with the character J is read from the content storage unit 32, and as shown in FIG. 10A, the screen 201 is read. The image of "Japan (content in Japanese)" is projected in the projection range of.

Further, as shown in FIG. 10B, when the screen 204 in which the characters E are described in the four corners is used, the characters E in the four corners are read by the camera unit 20 and used as image data to perform character recognition. Therefore, the character is recognized as the character E, and the "Japan (content in English)" associated with the character E is read out from the content storage unit 32, and as shown in FIG. 10B, the screen 201 is projected. An image of "Japan (content in English)" is projected on the range.

In the above example, in FIG. 1, when the cook of the countertop 101A can read only Japanese and the cooker of the countertop 101B can read only English, it is convenient because recipes in different languages can be displayed for each countertop. Is.

In the above embodiment, the predetermined positions for character recognition at the predetermined positions on the screen surface are the four corners, but they can be appropriately changed depending on the frame shape of the projected image and the shape of the screen surface. For example, in addition to the four corners, a character may be written at a position between the two characters, and this may also be recognized. Further, the screen may be oval, and characters may be written at some positions on the arc so that the characters can be recognized.

10 Projector 11 Video receiving unit 12 Video output unit 13 Control unit 20 Camera unit 30 Control unit 31 Arithmetic processing unit 31A Arithmetic processing unit 32 Content storage unit 33 Input unit 34 Video transmission unit 101A, 101B Cooking table 102 Ceiling 103A, 103B Projector system 104A, 103B, 2011-204 Screen 311 Orientation detection means 312 Video signal generation means 313 Range detection means 314, 314A Content extraction means 315 Character recognition means

Claims (10)

A projector that projects images and
A camera unit that obtains image information by capturing an image of a screen surface on which characters are written at predetermined positions and an image projected by the projector is projected.
The performing character recognition of the predetermined position detects the vertical and horizontal directions of the character in the screen surface on the basis of image information obtained by the camera unit, and the direction detecting means for detecting the orientation information of the screen to be projected on the screen surface ,
A projector system comprising: a video signal generating means for generating a video signal by adjusting the inclination of a video to be transmitted to the projector based on the orientation information detected by the orientation detecting means. Comprising a range detection means for detecting a range of a screen for projection in the screen surface with obtaining the position and arrangement of characters performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by the camera unit ,
The first aspect of the present invention, wherein the video signal generating means adjusts the screen range of the video to be transmitted to the projector based on the range information of the screen detected by the range detecting means to generate a video signal. Projector system. The range detecting means obtains a rectangle having a diagonal line between two characters having a predetermined positional relationship in the character recognized, and detects the range of the rectangle as the range of the screen to be projected on the screen surface. The projector system according to claim 2. A content storage unit in which the content of the image projected from the projector is stored corresponding to characters, and
And character recognition means for performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by the camera unit,
A third aspect of the present invention, wherein the content corresponding to the character related to the character recognition result is taken out from the content storage unit and transmitted to the projector as a video signal by the video signal generating means. The projector system according to any one item. The projector system according to any one of claims 1 to 4, wherein the characters described on the screen surface are alphabets in which the vertical direction can be determined. A projector that projects an image, a camera unit that captures an image of a screen surface on which characters are written at a predetermined position and the image projected by the projector is projected to obtain image information, and a control unit that includes a computer that controls the projector. The computer of the projector system configured to include
Orientation detecting means for detecting the orientation information of the screen the performing character recognition of the predetermined position on the screen surface on the basis of image information obtained by the camera unit to detect the vertical and horizontal directions of the character, is projected on the screen surface,
A program for a projector system, characterized in that it functions as a video signal generation means for generating a video signal by adjusting the inclination of a video to be transmitted to the projector based on the orientation information detected by the orientation detecting means. Further, the computer
To function as range detecting means for detecting a range of a screen for projection in the screen surface with obtaining the position and arrangement of characters performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by the camera unit ,
The video signal generating means adjusts the screen range of the video to be transmitted to the projector based on the range information of the screen detected by the range detecting means to generate the video signal.
The program for a projector system according to claim 6, wherein the program is made to function. The range detecting means obtains a rectangle having a diagonal line between two characters having a predetermined positional relationship in the character recognized, and detects the range of the rectangle as the range of the screen to be projected on the screen surface. 7. The program for a projector system according to claim 7. The projector system includes a content storage unit in which the content of an image projected from the projector is stored corresponding to characters.
Further, the computer
Character recognition means for performing character recognition of the predetermined position in the screen surface on the basis of image information obtained by the camera unit,
Any of claims 6 to 8, wherein the content corresponding to the character related to the character recognition result is taken out from the content storage unit and functioned as a content taking-out means to be transmitted to the projector as a video signal by the video signal generation means. The program for the projector system described in item 1. The program for a projector system according to any one of claims 6 to 9, wherein the characters described on the screen surface are alphabets in which the vertical direction can be determined.

Images