JP7587776B2 - Image Projection Method - Google Patents

Description

This invention relates to an image projection method for projecting an image, an image projection device for implementing the image projection method, an unmanned aerial vehicle, and an image projection program.

In recent years, the opportunities to view images on information terminal devices such as smartphones have become more diverse. A related technology in the past, specifically, was a technology for an image display system that is equipped with a projection unit on an autonomous robot and projects an image onto a projection surface while detecting the state of the projection surface around the robot, thereby displaying an image that is easily visible to unspecified people (see, for example, Patent Document 1 below).

JP 2018-125816 A

However, if you do not have a display device such as an information terminal device, or if a display device such as a monitor is not installed, you cannot view image information. Also, projectors can only project images onto a predetermined screen.

In addition, the conventional technology described in Patent Document 1 above had the problem that it was not suitable for viewing image information addressed to an individual.

In order to solve the problems associated with the conventional technology described above, the object of this invention is to provide an image projection method that allows a user to view image information even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby, as well as an image projection device, an unmanned aerial vehicle, and an image projection program that realize the image projection method.

To solve the above-mentioned problems and achieve the objective, the image projection method of the present invention is characterized by identifying the position of a user and any part of the user's body, and projecting an image transmitted or distributed to the user onto the identified any part as a screen.

The image projection method according to the present invention is characterized in that, in the above invention, an image projection device that projects the image is moved to a position where the image can be projected onto the arbitrary part.

The image projection method according to the present invention is characterized in that, in the above invention, the image projection device is moved using an unmanned aerial vehicle.

The image projection method according to the present invention is characterized in that, in the above invention, the image projection device is moved using indoor facilities.

The image projection method according to the present invention is characterized in that, in the above invention, the indoor facility is at least one of an indoor wall, ceiling, and floor, and the image projection device is moved along the indoor facility.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is set according to the user's specification.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is selected based on the content of the image.

The image projection method according to the present invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on the state of the arbitrary part of the user that becomes the screen.

The image projection method according to the present invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on the surrounding situation of the arbitrary part of the user that serves as the screen.

The image projection method according to the present invention is characterized in that, in the above invention, the surrounding condition of the arbitrary part is the brightness of the surroundings.

The image projection method according to the present invention is characterized in that, in the above invention, the image projected onto the screen is recognized, and the projection method is changed based on the recognized image condition.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is a part of the user's body that is visible to the user.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is the user's hand or arm.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is the user's leg or foot.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is the nail of a finger or a toe of the user.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is a part of the user's body that can be seen by the user using a mirror.

The image projection method according to the present invention is characterized in that, in the above invention, when the image is projected onto a part that is visible to the user using a mirror, the image is inverted left and right.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is the face, head, or neck of the user.

The image projection method according to the present invention is characterized in that, in the above invention, the arbitrary part of the user that becomes the screen is the trunk or buttocks of the user.

The image projection method of the present invention is characterized in that it identifies the position of the user and any part of the user's body, and projects an image transmitted or distributed to the user using the clothing worn at the identified part as a screen.

The image projection method according to the present invention is characterized in that, in the above invention, the clothing includes at least one of clothes, gloves, shoes, socks, a hat, and a mask.

The image projection method according to the present invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on the type or state of clothing worn on the arbitrary part of the user that serves as the screen.

The image projection method according to the present invention is characterized in that, in the above invention, the projection method for projecting the image is changed based on at least one of the color and material of the clothing worn on the arbitrary part of the user that serves as the screen.

To solve the above-mentioned problems and achieve the objective, the image projection device of the present invention is characterized by having a control unit that identifies the position of a user and any part of the user's body, and projects an image transmitted or distributed to the user using the identified any part as a screen.

The image projection device of the present invention is also characterized by having a control unit that identifies the position of the user and any part of the user's body, and projects an image transmitted or distributed to the user using the clothing worn at the identified part as a screen.

The image projection device according to the present invention is characterized in that in the above invention, the control unit moves the image projection device that projects the image to a position where the image can be projected onto the arbitrary part.

To solve the above problems and achieve the objectives, the unmanned aerial vehicle of the present invention is characterized by identifying the position of a user and any part of the user's body, and projecting an image transmitted or distributed to the user onto the identified any part as a screen.

The unmanned aerial vehicle of the present invention is also characterized by identifying the position of the user and any part of the user's body, and projecting an image transmitted or distributed to the user using the clothing worn on the identified part as a screen.

The unmanned aerial vehicle of this invention is also characterized in that, in the above invention, it moves to a position where the image can be projected onto the arbitrary part and projects the image.

To solve the above problems and achieve the objective, the image projection program of the present invention is characterized in that it causes an image projection device to execute a process of identifying the position of a user and any part of the user's body, and projecting an image transmitted or distributed to the user using the identified any part as a screen.

The image projection program of the present invention is characterized in that it causes an image projection device to execute a process of identifying the position of a user and any part of the user's body, and projecting an image transmitted or distributed to the user using the clothing worn at the identified part as a screen.

The image projection program according to the present invention is characterized in that, in the above invention, the image projection device executes a process of moving the image projection device that projects the image to a position where the image can be projected onto the arbitrary part.

The image projection method, image projection device, unmanned aerial vehicle, and image projection program of the present invention have the effect of allowing a user to view image information even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby.

FIG. 1 is an explanatory diagram (part 1) showing an overview of an image projection method ("palmtop screen"). This is an explanatory diagram (part 2) showing an overview of the image projection method ("drone projector"). This is an explanatory diagram (part 3) showing an overview of the image projection method ("palmtop screen"). This is an explanatory diagram (part 4) showing an overview of the image projection method ("Arm Top Screen"). This is an explanatory diagram (part 5) showing an overview of the image projection method ("wrist-top screen"). FIG. 1 is an explanatory diagram showing an example of the appearance of an image projection device (drone projector). FIG. 2 is an explanatory diagram illustrating an example of a hardware configuration of an image projection device. FIG. 2 is a block diagram showing an example of a functional configuration of the image projection device. 11 is a flowchart showing an example of a processing procedure of the image projection device. FIG. 11 is an explanatory diagram showing an example of an image projection device (a movable projector) according to another embodiment of the present invention and an example of a moving environment of the image projection device.

Below, with reference to the attached drawings, a detailed description will be given of preferred embodiments of the image projection method, the image projection device for implementing the image projection method, the unmanned aerial vehicle, and the image projection program of the present invention.

(Overview of image projection method)
1 to 5 are explanatory diagrams showing an outline of an image projection method. In FIG. 1, image information 110 related to a video call is projected onto the right hand 101 of a user. Image information 120 related to a chat screen is projected onto the left hand 102. In addition, image information desired by the user can be projected onto the right hand 101 and the left hand 102. For example, image information 110 related to a video call with a different person may be projected onto both the right hand 101 and the left hand 102. In this way, an image is projected onto the palm of at least one of the user's hands. The inventor named the use of the palm as a screen "PALM TOP SCREEN".

Sound accompanying image information, such as the sound from the other party in a video call when projecting an image related to a video call, can be output from earphones worn by the user or a speaker installed in the vicinity of the user. The speaker may be mounted on the image projection device 200 shown in FIG. 2 (speaker 707 shown in FIG. 7 described later). The user's voice can be input (collected) from earphones worn by the user or a microphone installed in the vicinity of the user. The microphone may be mounted on the image projection device 200 (microphone 706 shown in FIG. 7 described later).

FIG. 2 shows an image projection device 200 projecting image information 110 related to a video call onto the palm of a user 201. As shown in FIG. 2, the image projection device 200 projects image information 110 onto the palm of the user 201, which is an arbitrary part of the user's body, so that the palm of the user's body can be used as a screen. The image projection device 200 is a drone (unmanned aerial vehicle) equipped with a projector, which flies and stops in a predetermined space, and projects an image from the drone onto the palm of the user's body. The inventor has named this image projection device 200 a "drone projector (abbreviated as "DRONE PROJECTOR")".

By using the palm of your hand as a screen, there is no need for a dedicated display device to view image information. By turning your palm in the right direction, you can prevent other people nearby from peeking at the image information. Also, by turning your palm in the right direction, you can share the image information with people next to you or across from you.

As shown in FIG. 1, by using both hands, the user can simultaneously view at least two different screens. In order to display two different pieces of image information, a single drone may be equipped with two or more projectors, or multiple drone projectors may be used to project from each of them. Also, as shown in FIG. 2, by bringing both hands close together or touching each other, a single image can be enlarged and displayed across both hands.

As can be seen from Figures 1 and 2, these pieces of image information 110, 120 are projected images projected from the image projection device 200 onto the outstretched palms of the hands. In order to project the image information 110, 120 onto the palms of the user 201 in this way, the image projection device 200 first identifies the user 201 to whom the image information is to be projected. It then identifies the position of the palm of the identified user 201, and projects the image transmitted to the user 201 using the identified palm as a screen. This allows the user 201 to view the image information 110, 120 projected onto their palms.

As shown in FIG. 3, the orientation of the image information 110 may be determined from the relationship between the user's line of sight (the position of both eyes) and the position of the palm 101. Therefore, regardless of the direction of the fingertips, the angle at which the user can easily see may be inferred from the positions of the left and right eyes of the user 201, and the orientation of the image information may be determined. In FIG. 3, it can be seen that the orientation at which the image 110 is projected on the palm is different from that in FIG. 1. The orientation of the image 110 is changed depending on the direction in which the user 201 spreads his or her right hand 101. Therefore, even if the user 201 changes the angle of his or her hand, the orientation at which the image is projected is always constant with respect to the line of sight of the user 201, thereby improving the visibility of the image information 110.

The direction in which the image information is projected may also be changed (for example, by flipping the image information upside down) by instructions from the user 201 using voice (for example, "Make it visible to the person opposite") or gestures. This allows the image information to be easily visible not only to the user 201, but also to other people next to or opposite the user.

If the angle of the palm is changed or the position of the palm moves, the image projection device 200 recognizes the change and follows the change in the angle and position of the palm so that it can continue to project image information onto the palm. Therefore, until an instruction to end the projection is given by the user 201, image information can be continuously projected onto the palm in the same way as it is displayed on a display device, for example.

The dimensions of the image information may be determined based on the size, shape, etc. of the palm of the user 201. The dimensions of the image information when projected onto the palm may be determined in advance for each user 201. This ensures that image information of the same dimensions is always displayed on the palm, reducing the sense of discomfort that the user 201 feels each time he or she views the image information.

The dimensions of the image information may be changed by instructions from the user 201. The instructions from the user 201 to change the dimensions may be voice (e.g., saying "make it bigger" or "make it smaller") or gestures (e.g., pointing to the desired size with a finger). The voice may be collected by a microphone 706 mounted on the image projection device 200 or the like, and the instructions from the user 201 may be determined by voice recognition or the like. The gestures may be captured by a camera mounted on the image projection device 200 or the like (camera 603 shown in Figures 6 and 7 described later), and the instructions from the user 201 may be determined by image recognition or the like.

The notification of image reception may be made by a chime, an alarm, or a voice ("You have received a message from Mr./Ms. XX"). The voice may be output to a speaker 707 shown in FIG. 7 described later or to the user's earphones. The notification of image reception may also be made by emitting light or vibrating belongings. Furthermore, the notification may be made by the drone projector 200 flying in front of the user 201.

When notified of image reception, user 201 issues a command to start projection. The command to start projection can be specifically given, for example, by speaking ("display it") or by a specific gesture. Next, user 201 issues a command for the projection position. The command to start projection can be specifically given, for example, by speaking ("back of left hand") or by a gesture (opening the palm of the hand with the palm facing up. Making a gesture as if looking at a watch. Pointing to the desired position with a finger). The command to start projection and the command for the projection position may be a series of actions. (For example, speaking "display it on the thigh of the left leg." Also, pointing to the left arm with the index finger of the right hand.) In this way, the intention of user 201 can be confirmed.

Figure 4 shows an example of projection onto a body part of the user 201 other than the palm. As shown in Figure 4, depending on the display form of the image information to be displayed, for example, the image information may be displayed continuously from near the wrist of the left hand along the arm to the shoulder. The inventor has named this use of the arm as a screen "arm top screen". In Figure 4, the arm top screen 400 displays map information as an example of image information. In this way, a relatively large image can be displayed by utilizing the length of the arm, and a navigation function that is easier to understand can be realized. In addition to map information, the arm top screen 400 can project a long vertical image, such as a chat screen (with more chats) by raising the arm.

(Examples of body parts onto which image information is projected)
The body part onto which the image information is projected may be any body part that is visible to the user 201. The body part onto which the image information is projected may be the hand or arm of the user 201. However, the hand is not limited to the palm. It may be, specifically, for example, the back of the hand (not shown). The inventor has named the use of the back of the hand, other than the palm, as a screen as a "HAND TOP SCREEN."

The body part onto which the image information is projected may be, for example, a finger. The inventor has named the use of the finger as a screen "Finger Top Screen." The part of the finger onto which the image information is projected may be the palm side, the back side of the hand, or both, or it may be the part between the palm side and the back side of the hand. Also, text information such as a message of, for example, one to three lines, may be displayed on the finger along the length of the finger. Separate text information may be displayed on each finger, or continuous text information may be displayed on each finger.

An example of a "finger top screen" may include a "nail top screen" in which the nail of a finger is used as the screen. In this way, by using the nail, which is harder and shinier than skin, as the screen, the image can be projected more clearly. By determining in advance which finger's nail the image will be projected onto depending on the destination of the image information, the destination of the image information can be instantly and intuitively understood (e.g., the nail on the thumb of the right hand is for Person A, and the nail on the middle finger of the left hand is for Person B). Also, it may be determined in advance which finger's nail the image will be projected onto based on the content of the image information. For example, an emergency message could be projected onto the nail of the thumb of the right hand.

As another example of the user's hand or arm, which is a body part onto which image information is projected, the wrist as shown in FIG. 5 may be used. The inventor has named the use of the wrist as a screen "LIST TOP SCREEN." As shown in FIG. 5, the wrist top screen 500 projects image information at approximately the same position as the display position of a wristwatch. Therefore, the user can view the wrist top screen 500 with a sensation similar to that of viewing the display of a wristwatch. The wrist top screen 500 may be the wrist on the back side of the hand as shown in FIG. 5, or the wrist on the palm side of the opposite hand, or the wrist part between the back side and the palm side.

The body part onto which the image information is projected may be the legs or feet of the user 201. For example, when the user 201 is sitting, the projected image can be easily viewed by using the legs or feet as a screen. Specifically, it may be a "lap top screen" (the knees, or the legs between the knees and the hip joints when sitting on a chair, etc.), a "leg top screen" (the entire legs, such as the calves when legs are crossed), or a "foot top screen" (the instep, sole, toes, etc.). The ankle is included in either the "leg top screen" or the "foot top screen".

The legs or feet have a relatively large screen area compared to the hands or arms, allowing images to be projected onto them at a larger size. Also, by using the legs or feet as a screen together with the hands or arms, more image information can be seen.

In addition, similar to fingernails, an example of a "foot top screen" may include a "nail top screen" in which the toenail is used as a screen.

The body part onto which the image information is projected may be a body part that is normally difficult to see but can be seen by using a mirror or the like (for example, the user's own face ("FACE TOP SCREEN"), particularly the cheek, head ("HEAD TOP SCREEN"), particularly the forehead or part of the head where hair grows, neck ("NECK TOP SCREEN"), or shoulder ("SHOULDER TOP SCREEN"). All of these names were given by the inventor.

The body parts onto which image information is projected may be the trunk, such as the back ("BACK TOP SCREEN") or abdomen ("ABD TOP SCREEN"), or the buttocks ("HIP TOP SCREEN"). These names were also given by the inventor. When a mirror or the like is used, image information that has been mirror-inverted (the image is reversed left and right) can be projected. The nose and ears are included in the "face top screen".

In particular, by using a mirror to project an image onto the user's 201 own face ("face-top screen"), neck ("neck-top screen"), shoulders ("shoulder-top screen"), or head ("head-top screen"), the image information can be checked, for example, while applying makeup, or while washing or cutting hair.

In addition, if the area is the trunk or buttocks, the user 201 can check the image information while looking at their entire body in a mirror.

As applications of these, the image information can be images of makeup, clothing, accessories (such as glasses), accessories (such as necklaces), and tattoos. These image information can be projected directly onto parts of the user's 201 body, allowing them to enjoy virtual makeup and trying on clothes. It can also be used during surgery, for example, to display the location of an affected area at the corresponding position on a body part. In addition, ideal body lines can be projected directly onto the body to set a goal for dieting.

In this way, by using each part of the user's body as a screen, a dedicated device such as a screen is not required to view the images. In addition, the user does not need to carry an information terminal device with a display screen (the user can be "empty-handed").

The part of the body onto which the image information is projected is selected by the user's instructions. The user's instructions may be voice (e.g., saying "display it on the back of my right hand" or "my left wrist") or gestures (e.g., pointing at the desired location for projection). The part of the body onto which the image information is projected may also be selected depending on the type of image information. For example, highly confidential information may be displayed on the palm of the hand, and the image contents can be prevented from being seen by those nearby by adjusting the orientation and angle of the palm or the distance from the face.

The part of the body that is selected may also be determined by the user's posture. When sitting on a chair, the image can be projected onto the knees or legs. When holding an object in one hand or performing a task, the image can be projected onto the other hand or another body part.

Image information may be projected directly onto the skin of a body part of the user, or, if the user is wearing clothing, onto the clothing. The projection method (color, luminosity, etc.) can be changed depending on whether the image is projected onto the skin or onto clothing. It can also be changed depending on the type of clothing (material, color, etc.). These differences can be determined by analyzing images captured by a camera mounted on the image projection device.

(An example of the appearance of the image projection device 200)
Next, an example of the appearance of the image projection device according to the embodiment of the present invention will be described. Fig. 6 is an explanatory diagram showing an example of the appearance of the image projection device. As shown in Fig. 6, the image projection device (drone projector) 200 includes a projector (projection unit) 601, a drone (unmanned aerial vehicle) 602, a camera 603, and a human presence sensor 604. That is, the projector 601, the camera 603, and the human presence sensor 604 are mounted on the drone 602.

The projector 601 includes a projector light source, an optical system, a projection lens, and the like (all of which are not shown in the figures). The projector 601 guides the light emitted from the projector light source along a predetermined path using the optical system, and irradiates the light outside the projector 601 through the projection lens 601a, thereby projecting an image at the location where the light is irradiated. The optical system is composed of an integrator lens that increases the uniformity of the illuminance of the light emitted from the projector light source, a polarization conversion element that converts (polarizes) the light emitted from the non-polarized light source into a predetermined polarization direction, a dichroic mirror that separates the light from the projector light into the three primary colors of R, G, and B, a liquid crystal panel that displays an image corresponding to each color of light of R, G, and B, and a dichroic prism that combines the images of each color displayed by each liquid crystal panel (all of which are not shown in the figures).

As the projector 601, for example, a laser-type projector that uses a laser as the projector light source can be used. By using a laser-type projector, the projector 601 can be made smaller. Specifically, a laser-type projector can suppress heat generation to a lower level than a mercury lamp-type projector that uses a mercury lamp as the projector light source, and therefore it is possible to achieve a smaller size and lighter weight by eliminating mechanisms such as a cooling fan.

In addition, by using a laser projector, it is possible to start up quickly and begin projecting images. In addition, by using a laser projector, it is possible to achieve higher brightness of the projected image while reducing power consumption compared to a mercury lamp projector.

Mercury lamp projectors are recommended to be used with the projection (optical axis) direction horizontal, limiting the freedom of projection direction, whereas laser projectors can be used with the optical axis tilted from the horizontal. This allows laser projectors to have a high degree of freedom in the projection direction, and they can project images not only onto walls but also onto the ground and floor.

The drone 602 moves the projector 601. By moving the projector 601 using the drone 602, which is also called an unmanned aerial vehicle, the location where the image is projected by the projector 601 can be moved. Specifically, the drone 602 can be a quadcopter equipped with four propellers 605. The drone 602 is not limited to a quadcopter, and various types of multicopters can be used, such as a hexacopter equipped with six propellers and an octocopter equipped with eight propellers.

The projector 601 is fixed to the drone 602, and moves with the movement (flight) of the drone 102. The projector 601 may be connected to the drone 602 in a state in which its attitude can be adjusted. Specifically, for example, the projector 601 can be connected to the bottom of the drone 602 via a universal joint such as a ball joint. By connecting the projector 601 to the drone 602 via a universal joint such as a ball joint, a high degree of freedom in adjusting the attitude of the projector 601 can be ensured.

In this case, the image projection device 200 may be provided with a drive mechanism that changes the attitude of the projector 601 relative to the drone 602 in order to adjust the attitude of the projector 601 relative to the drone 602 without human intervention. The drive mechanism can be configured, for example, with a motor or a gear train. By making it possible to adjust the attitude of the projector 601 relative to the drone 602, it is possible to project an image at an optimal angle depending on the location where the image is to be projected.

The camera 603 captures an image of the user 201 shown in FIG. 2 and also captures an image projected by the projector 601. Specifically, the camera 603 can be realized by, for example, a general-purpose digital camera. The camera 603 is fixed to the drone 602 with, for example, the lens 603a facing in the same direction as the projection direction of the image by the projector 601.

The camera 603 may be connected to the drone 602 in a state in which the direction in which the lens is pointed is adjustable relative to the projection direction of the image by the projector 601. In FIG. 6, the camera 603 can be rotated around an axis that connects the camera 603 to the drone 602. The camera 603 may be connected to the bottom of the drone 602 via a universal joint such as a ball joint. By connecting the camera 603 to the drone 602 via a universal joint such as a ball joint, a high degree of freedom in adjusting the attitude of the camera 603 can be ensured.

In this case, the image projection device 200 may be equipped with a drive mechanism that changes the attitude of the camera 603 relative to the drone 602 in order to adjust the direction in which the lens 603a is pointed without human intervention. The drive mechanism can be configured, for example, with a motor or a gear train. By making it possible to adjust the direction in which the lens 603a is pointed relative to the projection direction of the image by the projector 601, it is possible to use a single camera 603 to capture an image projected by the projector 601 and to capture an image of the surroundings of the image projection device 200.

In the image projection device 200, the drive mechanism that adjusts the attitude of the projector 601 relative to the drone 602 and the drive mechanism that adjusts the attitude of the camera 603 relative to the drone 602 may operate independently. This makes it possible to project an image using the projector 601 while capturing the projected image using the camera 603, or to adjust the attitude of the camera 603 to capture a direction different from the direction in which the image is projected.

The camera 603 is not limited to a general-purpose digital camera, and may be realized, for example, by a night vision camera that captures images in dark places by amplifying its sensitivity to light, or an infrared camera that is sensitive to infrared light. By installing such a camera 603, it is possible to clearly capture images of the user and any part of the user, as well as images projected by the projector 601, even at night, without using a light source for auxiliary imaging. This makes it possible to suppress increases in the weight and power consumption of the image projection device 600.

The human presence sensor 604 detects a user present within a predetermined range from the image projection device 200. The user is the object on which the image projected by the image projection device 200 is made visible. Specifically, the human presence sensor 604 can be realized, for example, by an infrared sensor. The infrared sensor detects the temperature rise (temperature change) caused by the light receiving element absorbing the infrared rays emitted by a detected object such as a user using a temperature sensor, and outputs a predetermined electrical signal. By using the infrared sensor, it is possible to detect the presence or absence of a viewer and the movement of the viewer.

The range of detection of a user by the human presence sensor 604 realized by an infrared sensor can be adjusted, for example, by adjusting the sensitivity of the infrared sensor, the number and arrangement of the sensor elements (pixels), the amplification rate of the current sensed by the sensor elements (pixels), etc. The human presence sensor 604 is not limited to being realized by an infrared sensor, and may be one that detects the user 201 using, for example, ultrasound or visible light, or one that detects the user 201 using a method that combines infrared rays and ultrasound.

In this way, the image projection device 200 is a drone projector that can move in space by flying indoors and outdoors. This drone projector may be a drone projector for personal use, or a public drone projector shared by multiple users.

(Hardware Configuration of Image Projection Device 200)
Next, the hardware configuration of the image projection device 200 will be described. Fig. 7 is an explanatory diagram showing the hardware configuration of the image projection device 200. As shown in Fig. 7, the hardware of the image projection device 200 is composed of a battery 701, a control circuit 702, a communication I/F 703, a GPS receiver 704, a motor 705, a projector 601, a camera 603, a human presence sensor 604, a microphone 706, a speaker 707, etc. The respective units 601, 603, 604, 701 to 707 included in the image projection device 200 are connected by a bus 700.

The battery 701 supplies the power required for the operation of each part of the image projection device 200. The battery 701 can be realized, for example, by a secondary battery (rechargeable battery, storage battery) such as a lithium battery. The battery 701 realized by a secondary battery may be detachable from the drone 602.

The image projection device 200 may also include a charging contact for charging the battery 701. The charging contact may have, for example, an exposed terminal shape or a connector shape. Alternatively, the image projection device 200 may include a receiving coil for wireless power transmission (wireless power transfer, contactless power transmission) instead of or in addition to the charging contact for charging the battery 701.

Wireless power supply is a technology that receives power from the battery 701 without going through a charging contact, and is also called non-contact power supply or wireless power supply. The receiving coil is provided inside the exterior surface of the drone 602. This makes it possible to avoid deterioration or failure of the image projection device 200 due to water droplets from rain or dew. The battery 701 may be realized by a primary battery that only discharges DC power.

The control circuit 702 is composed of a CPU, memory, etc., and drives and controls each part of the image projection device 200. The CPU controls the entire image projection device 200 by executing a program stored in the memory. The memory stores the program executed by the CPU. The memory also stores various information including, for example, image information related to the image to be projected.

Specifically, the memory can be realized by, for example, an IC memory or an SSD (Solid State Drive). The memory may also be a memory card that is detachable from the image projection device 200 via a card slot provided in the image projection device 200. The memory card can realize its function by, for example, an IC card such as an SD (Secure Digital) memory card. The memory may also realize its function by, for example, an external hard disk or USB memory.

Specifically, the control circuit 702 includes, for example, a flight controller and an ESC (Electronic Speed Controller). The control circuit 702 may further include a BEC (Battery Elimination Circuit) and a UBEC (Universal BEC). In addition, when the battery 701 is realized by a secondary battery, the control circuit 702 may include a charging circuit that charges (stores) the battery 701.

The flight controller performs calculations related to the rotation control of the motor 705 and outputs a control signal. The ESC controls the rotation of the motor 705 based on the control signal output from the flight controller. While the image projection device 200 is flying, the flight controller detects the inclination of the image projection device 200, performs repeated calculations, and recursively outputs a control signal for the motor 705.

The flight controller outputs a control signal to the ESC to control the direction and speed of rotation of the propellers (propeller motors 705). Specifically, for example, the rotation of the image projection device 200 is prevented by outputting a control signal to control adjacent propellers to rotate in opposite directions. Also, for example, the image projection device 200 is moved forward by controlling the propeller at the front in the direction of travel to rotate slower than the propeller at the rear in the direction of travel. Also, for example, the image projection device 200 is turned to the right by controlling the propeller at the right in the direction of travel to rotate slower than the propeller at the left in the direction of travel.

More specifically, the control circuit 702 includes, for example, a GPU (Graphics Processing Unit) that is specialized for image processing related to the image projected by the projector 601. By including a GPU, it is possible to project fast-moving videos and the like with high image quality.

The communication I/F 703 is an interface that connects the image projection device 200 and the network N through a communication line, and is responsible for the interface between the network N and the inside of the image projection device 200, and controls the input of data from and the output of data to an external device connected via the network N. The network N is realized, for example, by the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), etc.

The communication I/F 703 is, for example, a wireless interface based on Wi-Fi (registered trademark). The communication I/F 703 may also be an interface for wireless communication such as a mobile phone line (for example, LTE (Long Term Evolution) or PHS (Personal Handy-phone System).

The control circuit 702 can acquire various information including image information related to the image to be projected from the external device by communicating with the external device via the communication I/F 703. In addition, each time the control circuit 702 acquires various information from the external device, it may store the acquired information in memory or update the contents of the memory based on the acquired information.

The GPS receiver 704 identifies the current position of the image projection device 200. Specifically, the GPS receiver 704 includes, for example, a GPS antenna, an RF (Radio Frequency) unit, and a baseband unit. The GPS antenna receives radio waves broadcast by GPS satellites. The RF unit demodulates the pre-modulation signal received by the GPS antenna into a baseband signal. The baseband unit calculates the current position of the image projection device 200 based on the baseband signal demodulated by the RF unit. The GPS receiver 704 may further include a filter that removes unnecessary components, and an amplifier such as an LNA (Low Noise Amplifier) or a PA (Power Amplifier).

The current position of the image projection device 200 can be determined by positioning based on radio waves transmitted from multiple GPS satellites. The baseband unit calculates the distances to each of the four GPS satellites and performs positioning by calculating the position where the distances intersect. Instead of GPS, which determines the geometric position of the GPS satellite and the image projection device 200 based on radio waves received from the GPS satellite, the current position of the image projection device 200 may be determined using a satellite positioning system such as Michibiki, GLONASS, or Galileo.

The motor 705 is controlled by the control circuit 702, and rotates the propeller 605 by rotating. Specifically, the motor 705 may be, for example, a brushless motor in which the rotor is a permanent magnet and the stator is composed of a coil. The same number of motors 705 as the number of propellers 605 may be provided. This allows each propeller 605 to rotate independently, and allows the image projection device 200 to move forward, backward, and turn left and right.

If the projector 601 and the camera 603 are provided with a driving mechanism for adjusting their attitudes, the control circuit 702 also controls the operation of the motors 705 that the driving mechanisms each have. This allows the image projection device 200 to adjust the attitudes of the projector 601 and the camera 603 independently (individually) while moving.

As described above, the projector 601 guides the light emitted from the projector light source along a predetermined path by the optical system and irradiates the light to the outside of the projector 601 via the projection lens 601a, thereby projecting an image at the location where the light is irradiated. The projector 601 may adjust the image quality of the projected image by adjusting the intensity of the light emitted from the projector light source according to the distance from the position where the image is projected. The distance between the projector 601 and the position where the image is projected can be determined, for example, by using a distance sensor. The distance sensor can be, for example, any of various known sensors such as a laser distance sensor, an ultrasonic sensor, or an infrared sensor.

The camera 603 is equipped with an image sensor, and generates image information (photographed data) by converting light received by the image sensor through a photographing lens into an electrical signal. The generated image information is output to the control circuit 702. The camera 603 may be one that captures still images or one that captures moving images. Moving images include those that continuously play back still images captured at a predetermined time interval. The image information may be compressed using a predetermined standard for video/audio data compression (e.g., MPEG (Moving Picture Experts Group)).

The human sensor 604 outputs an electrical signal corresponding to the temperature change caused by the light receiving element absorbing infrared rays to the control circuit 702. Specifically, the human sensor 604 converts the current signal corresponding to the temperature change into a voltage signal and amplifies it, and outputs a predetermined electrical signal to the control circuit 702 when the amplified voltage signal exceeds a predetermined threshold. The control circuit 702 detects the user 201 when it receives an input of the predetermined electrical signal output from the human sensor 604.

The microphone 706 collects sound around the image projection device 200. The microphone 706 converts sound input as analog data into an electrical signal. Specifically, the microphone 706 performs analog/digital conversion on the analog audio signal input as analog data, and generates audio data in digital format.

The speaker 707 generates sound by vibrating a diaphragm with an electrical signal, which is an audio signal. The speaker 707 may also be an output terminal that outputs an audio signal, and an external speaker may be connected to the output terminal to generate sound.

The image projection device 200 may also include input/output devices such as LED lamps that indicate the state of the image projection device 200, and keys or buttons that input instructions to the image projection device 200, although these are not shown in the figure. The input/output devices may be realized by connection terminals to which other information processing devices can be connected.

The image projection device 200 may also include a memory card I/F, which is an interface that is connected to the image projection device 200 via a card slot. The memory card I/F manages the internal interface with the memory card, and controls the input of data from the memory card and the output of data to the memory card. This allows the image to be projected by the image projection device 200 to be stored in the memory card, and the image to be projected by the image projection device 200 to be switched simply by replacing the memory card.

(An example of a functional configuration of the image projection device 200)
Next, an example of the functional configuration of the image projection device 200 will be described. FIG. 8 is a block diagram showing an example of the functional configuration of the image projection device 200. As shown in FIG. 8, the functions of the image projection device 200 according to the embodiment of the present invention are realized by a user instruction receiving unit 801, a projection target user identifying unit 802, a body part information acquiring unit 803, a projection image information acquiring unit 804, a body part identifying unit 805, a projection position and projection dimension determining unit 806, a warning output unit 807, a movement position and projection angle determining unit 808, a movement and projection angle control unit 809, an image information projection unit 810, a projection image capturing unit 811, and an instruction output unit 812. Therefore, the functions of the control unit of the image projection device 200 can be realized by these components 801 to 812.

The user instruction accepting unit 801 accepts an instruction to project image information for the user 201. Then, the accepted projection instruction is output to the projection target user identification unit 802. Specifically, the user instruction accepting unit 801 can realize its functions using, for example, the camera 603 and microphone 706 shown in Figures 6 and 7, the control circuit 702 and communication I/F 703 shown in Figure 7, etc. The user instruction accepting unit 801 can accept an instruction to end projection. The accepted instruction to end projection is output to the image information projection unit 810.

The user instruction receiving unit 801 can also receive various operation instructions for the projected image information. The received instructions can be output (transmitted) to the outside from the instruction output unit 812. Note that all or part of the various instructions from the user may be transmitted directly to the outside without going through the image projection device 200.

The projection target user identification unit 802 identifies a projection target user who has received a projection instruction from the user instruction receiving unit 801. Specifically, the projection target user identification unit 802 can realize its functions using, for example, the camera 603, microphone 706, control circuit 702, and communication I/F 703 shown in FIG. 7. The projection target user identification unit 802 identifies the projection target user as follows.

In the case of a user-dedicated image projection device 200, user information (ID information transmitted by the user or information identified from the user's physical characteristics) is stored in advance, and the user's current location is identified based on that information. The user's location is grasped at regular time intervals. Then, if the user moves, their location is captured.

In the case of a shared image projection device, user information is received and a search is made for the corresponding user 201 based on that information. The search for the user 201 may be made based on location information of the user 201 calculated based on a user ID signal transmitted by the user 201, for example. The search for the user 201 may also be made by identifying the corresponding user 201 by analyzing an image captured by the camera 603 based on information related to the morphological characteristics of the user 201. If the current location of the user 201 can be found, the current location of the user 201 is identified and grasped at regular time intervals. Then, if the user 201 moves, the location is captured.

The projection target user identification unit 802 outputs information about the identified projection target user 201, specifically, the user's position information, etc., to the body part identification unit 805.

The body part information acquisition unit 803 acquires information about the body part that will become the screen on which the image information is projected. Specifically, the body part information acquisition unit 803 can realize its functions using, for example, the camera 603, microphone 706, and communication I/F 703 shown in FIG. 7. When a body part is specified by the user 201, the body part information acquisition unit 803 acquires the specified information using the camera 603, microphone 706, communication I/F 703, etc. The body part information acquisition unit 803 outputs the acquired body part information to the body part identification unit 805.

The projection image information acquisition unit 804 acquires image information to be projected. Specifically, the projection image information acquisition unit 804 can realize its functions by, for example, the communication I/F 703 shown in FIG. 7. The projection image information may be a still image or a video. The acquired image information also includes information on the content (profile) of the image. Specifically, the type of image (e.g., chat or video call), the resolution of the image, the amount of data, etc. The projection image information acquisition unit 804 outputs the acquired image information to the image information projection unit 810. In addition, information on the content of the image from the acquired image information is output to the body part identification unit 805 and the projection position and projection dimension determination unit 806.

The body part identification unit 805 identifies the information on the projection target user identified by the projection target user identification unit 802, the information on the body part acquired by the body part information acquisition unit 803, and the body part that will be the screen on which the image information is projected. Furthermore, the body part may be identified based on information on the content of the image acquired by the projection image information acquisition unit 804. For example, if the image is relatively large, even if the user 201 specifies the palm, it can be changed to the arm. In that case, the user can also be notified (projected) that the specified body part will be changed. Specifically, the body part identification unit 805 can realize its function using, for example, the camera 603, the human sensor 604, and the control circuit 702 shown in FIG. 7, as shown in FIG. 6 and FIG. 7.

Specifically, the body part identification unit 805 identifies the body part as follows. If the body part is the palm, first, when an instruction to project image information is given, the location of the user's palm, whose position is known, is identified. The location is identified by analyzing an image captured by the camera 603 mounted on the image projection device 200. The location may also be identified using a human presence sensor 604 such as an infrared sensor as an alternative to or supplement to the camera. Specifically, the direction and posture of the user are identified from the positions of each part of the user's body, such as the head, shoulders, and arms, and the position of the user's palm is inferred.

Then, the position of the palm is determined based on the shape of the palm. Furthermore, the palm's physical characteristics (such as finger length, fingerprints, palm lines, veins, etc.) may be used to authenticate that it is the palm of the user.

In this way, the body part identification unit 805 identifies the body part (palm). Each of the other body parts can be identified based on its respective characteristics. The body part identification unit 805 outputs information about the identified body part to the projection position and projection dimension determination unit 806.

The projection position and projection dimension determination unit 806 determines the projection position at which the image information is projected and the dimensions of the projected image based on the body part identified by the body part identification unit 805. In addition, the projection position and projection dimension determination unit 806 may refer to the contents of the image information acquired by the projection image information acquisition unit 804 and determine the projection position at which the image information is projected and the dimensions of the projected image based on the contents. Specifically, the function of the projection position and projection dimension determination unit 806 can be realized by, for example, the control circuit 702 shown in FIG. 7.

Specifically, the projection position/projection dimension determination unit 806 may determine the projection position and projection direction from the direction of the fingers, the angle of the wrist, and the like, based on information about the position of the palm of the user 201 that is placed on the body part identified by the body part identification unit 805. In addition, the projection position/projection dimension determination unit 806 may determine the size of the palm from information about the palm of the user 201 that is placed on the body part identified by the body part identification unit 805, and determine the dimensions of the image information to be projected so that the image fits on the palm.

The projection position and projection dimension determination unit 806 may also change the projection method for projecting the image based on the state of the body part identified by the body part identification unit 805. Specifically, the state of the body part may be, for example, wearing gloves. The projection position and projection dimension determination unit 806 outputs information related to the determined projection position, projection dimensions, etc. to the movement position and projection angle determination unit.

In addition, if the projection position/projection dimension determination unit 806 determines that projection onto the palm is not possible based on the direction of the fingers, the angle of the wrist, etc., it outputs to the warning output unit 807 information indicating that projection is not possible and also information urging the user to change the position of the palm.

When the projection position and projection dimension determination unit 806 determines the projection position and projection dimensions, if projection is not possible on the body part identified by the body part identification unit 805, the warning output unit 807 outputs a warning to that effect and to encourage the user to move the position of the user or the position of the body part. Specifically, the function of the warning output unit 807 can be realized by, for example, the communication I/F 703 and speaker 707 shown in FIG. 7.

The movement position and projection angle determination unit 808 determines at least one of the movement position of the image projection device 200 and the projection angle of the image projection device 200 based on the projection position and projection dimensions determined by the projection position and projection dimension determination unit 806. Specifically, the movement position and projection angle determination unit 808 can realize its function by, for example, the control circuit 702 shown in FIG. 7. Specifically, the movement position and projection angle determination unit 808 calculates the latitude and longitude information of the position to which the image projection device 601 is moved and the projection angle of the projector 601, and outputs the calculation result to the movement and projection angle control unit 809.

The movement and projection angle control unit 809 controls the motor 705 to move the image projection device 200 based on the movement position of the image projection device 200 determined by the movement position and projection angle determination unit 808. Also, based on the movement position of the image projection device 200 determined by the movement position and projection angle determination unit 808, it adjusts the projection angle of the image projection device 200. Specifically, the movement and projection angle control unit 809 can realize its functions using, for example, the control circuit 702, GPS receiver 704, motor 705, and the like shown in FIG. 7.

The image information projection unit 810 projects the image information acquired by the projection image information acquisition unit 804 onto the identified body part as a screen. The projection of the image information may be stopped in response to an instruction to end the projection received by the user instruction reception unit 801. Specifically, the image information projection unit 810 can be realized by, for example, the projector 601 shown in FIG. 6 and FIG. 7, the control circuit 702 shown in FIG. 7, etc.

The projection image capturing unit 811 captures an image projected using any body part as a screen, or captures or acquires the surroundings of the image. Specifically, the projection image capturing unit 811 can realize its function using, for example, the camera 603 or the motion sensor 604 shown in Figures 6 and 7. The projection image capturing unit 811 outputs information about the surroundings of the captured image or the acquired image to the projection position and projection dimension determination unit 806.

The projection position and projection dimension determination unit 806 may change the projection method for projecting the image based on the acquired surrounding conditions of the arbitrary part, and output information related to the changed projection method to the image information projection unit 810. The surrounding conditions of the arbitrary part may specifically be the brightness of the surroundings. If the surroundings are relatively bright, the illuminance of the projected image may be increased. On the other hand, if the surroundings are relatively dark, such as at night, the illuminance of the projected image may be decreased.

The projection position and projection dimension determination unit 806 may recognize (analyze) the image captured by the projection image capture unit 811, and change the projection method based on the recognized image condition. Specifically, if the image quality of the projected image has deteriorated or the user 201 has difficulty viewing the image, the projection position, projection dimensions, etc. may be changed to improve visibility. Then, information related to the changed projection method may be output to the image information projection unit 810.

The instruction output unit 812 outputs information related to the instructions of the user 201 with respect to the projected image information, which are received by the user instruction receiving unit 801. Specifically, the instruction output unit 812 can realize its function by, for example, the communication I/F 703 shown in FIG. 7. Also, the information related to the instructions may be transmitted to each component via the bus 700.

(Example of Processing Procedure of Image Projection Device 200)
Next, a description will be given of an example of a processing procedure of the image projection device 200. Fig. 9 is a flowchart showing an example of a processing procedure of the image projection device 200. In the flowchart of Fig. 9, the image projection device 200 first identifies a current position of a projection target user onto which image information is to be projected (step S901).

Next, information regarding the body part onto which image information is to be projected is acquired from among the identified body parts of the projection target user (step S902). Then, based on the acquired information regarding the body part, the current position and orientation of the body part onto which image information is to be projected is identified (step S903). Then, based on the identified position and orientation of the body part, it is determined whether or not it is possible to project image information onto the body part at that position and orientation (step S904).

If it is determined in step S904 that projection is not possible (step S904: No), a warning to that effect is issued to the projection target user (step S905). This prompts the projection target user to move or change the position or orientation of a body part. Then, the process returns to step S901, and the processes of steps S901 to S905 are repeated.

If it is determined in step S904 that projection is possible (step S904: Yes), the projection position and projection dimensions of the image information to be projected are determined (step S906). Then, based on the determined projection position and projection dimensions of the image information, the projection position of the image projection device 200 is determined (step S907).

Next, the image projection device (own device) 200 is moved to the determined projection position and the projection angle is adjusted (step S908). After the movement and adjustment are completed, the image information is projected using the (identified) body part as a screen (step S909).

It is then determined whether the position and orientation of the body part to be projected has changed (step S910). Whether the position and orientation of the body part to be projected has changed can be determined, for example, by performing identification by the body part information identification unit 803 shown in FIG. 8 every predetermined time (e.g., 0.5 seconds) and basing the determination on the difference with the information on the position of the body part identified the previous time (e.g., 0.5 seconds ago). If it is determined that the position and orientation of the body part to be projected has changed (step S910: Yes), the process returns to step S903, and the position and orientation of the body part to be projected are identified again (step S903), and thereafter, the process from step S904 onwards is performed.

If it is determined in step S910 that the position/orientation of the body part to be projected has not changed (step S910: No), then it is determined whether the body part to be projected has changed (step S911). Whether the body part to be projected has changed can be determined, for example, based on the information acquired by the body part information acquisition unit 803 shown in FIG. 8. Here, if the body part to be projected has changed (step S911: Yes), the process returns to step S902, and again acquires information about the body part onto which image information is to be projected (step S902), and thereafter performs the processes from step S903 onward.

If the body part to be projected has not changed in step S911 (step S911: No), it is then determined whether the projection target user has moved (step S912). Whether the projection target user has moved can be determined, for example, by performing identification by the projection target user identification unit 802 shown in FIG. 8 every predetermined time (e.g., 0.5 seconds) and basing the determination on the difference with the information regarding the position of the projection target user identified the previous time (e.g., 0.5 seconds ago). Here, if the projection target user to be projected has moved (step S912: Yes), the process returns to step S901, and the current position of the projection target user is identified again (step S901), and thereafter, the process from step S902 onwards is performed.

If it is determined in step S912 that the projection target user has not moved (step S912: No), it is then determined whether or not an instruction to end projection has been given (step S913). Whether or not an instruction to end projection has been given can be determined, for example, by whether or not an instruction to end projection has been given from the user instruction receiving unit 801. Here, if there is no instruction to end projection (step S913: No), the process proceeds to step S910, and thereafter, each of the processes of steps S910 to S913 is repeated. On the other hand, if there is an instruction to end projection (step S913: Yes), the projection of image information is stopped (step S914), and the series of processes is terminated.

In this way, the image projection device 200 can project an image onto any part of the body of the user 201. Furthermore, even if the position or orientation of the body part changes, if the body part to be projected changes, or if the user 201 moves, the image projection can continue.

<Another embodiment>
Although the drone projector 200 has been described as an image projection device, the image projection device is not limited to this. For example, it may be an image projection device that is movably installed on an indoor wall or ceiling. The inventor named this image projection device "movable projector (abbreviated as Movable Projector)". The movable projector has a variable projection direction and the projector itself can move on the wall or ceiling.

Fig. 10 is an explanatory diagram showing an example of an image projection device (movable projector) 1000 according to another embodiment of the present invention and an example of a moving environment of the image projection device 1000. In Fig. 10, the same parts as those of the image projection device 200 according to the above-mentioned embodiment are indicated by the same reference numerals. As shown in Fig. 10, the image projection device (movable projector) 1000 includes a moving body 1001. The moving body 1001 includes a main body 1002, a rolling body 1003, a magnet 1004, and a slide shoe 1005.

The main body 1002 is generally box-shaped and houses a control circuit 702, an antenna, a motor, a battery, etc. inside. The control circuit 702 is composed of a CPU, memory, etc., and drives and controls each part of the image projection device 1000. Specifically, for example, the control circuit 702 drives and controls a motor 705 connected to the rolling element 1003 to rotate the rolling element 1003 and move the image projection device 1000.

The rolling body 1003 is connected to the main body 1002 so as to be rotatable (rollable). The rolling body 1003 protrudes from the end face of the main body 1002 toward the ceiling 1006 or wall 1007. It is preferable that three or more rolling bodies 1003 are provided. This allows the image projection device 1000 to move stably and smoothly.

The rolling body 1003 can be realized, specifically, by rollers, balls, or rollers, for example. By realizing the rolling body 1003 by balls or rollers, the turning radius of the moving body 1001 can be reduced, so that it can maneuver with a small radius and a high degree of freedom in movement can be ensured. When the rolling body 1003 is realized by rollers, the toe angle and caster angle are adjusted appropriately.

The magnet 1004 is provided on the same side of the main body 1002 as the rolling body 1003. The magnet 1004 uses magnetic force to attract the image projection device 600 to the ceiling 1006 or the wall 1007. The slide shoe 1005 has a sheet or plate shape. The slide shoe 1005 is made of a material that does not impair the magnetic force of the magnet 1004 that attracts the image projection device 1000 to the ceiling 1006 or the wall 1007, and does not provide resistance when the image projection device 600 moves. Specifically, the slide shoe 1005 can be made of hard silicone rubber, for example.

The slide shoe 1005 is arranged so that the end face opposite the main body is located at the same position as the tip of the rolling body 1003 (the contact position of the rolling body 1003 with the ceiling 1006 or wall 1007) or slightly closer to the main body. This allows the rolling body 1003 to be reliably contacted with the ceiling 1006 or wall 1007, allowing the image projection device 600 to be moved smoothly.

The slide shoe 1005 may be provided so as to be capable of coming into contact with or being separated from the magnet 1004 or the main body 1002. Specifically, for example, the slide shoe 1005 may be connected to the magnet 1004 or the main body 1002 via an elastic member such as a spring. This allows the rolling body 1003 to be reliably brought into contact with the ceiling 1006 or the wall 1007, allowing the image projection device 600 to be moved smoothly.

Such an image projection device 1000 may determine its current location using the GPS receiver 704 as described above, but is not limited to this. The image projection device 1000 may determine its current location using the principle of triangulation used in, for example, a PHS (Personal Handy-phone System). Specifically, for example, a plurality of PHS base stations (not shown) are provided on the ceiling 1006 or wall 1007, and the location of the device is determined by receiving radio waves output from these base stations via an antenna.

As a result, even in an environment where radio waves from GPS satellites are difficult to receive due to the presence of a ceiling 1006 or a wall 1007, the position of the image projection device 1000 can be identified and controlled with high accuracy. This makes it possible to project an image 502 at any position within a building. Because the image projection device 1000 moves along the ceiling 1006 or the wall 1007, it is possible to reliably prevent the user 201 from colliding with it, ensuring the safety of the user 201.

In this way, the image projection device 1000 can be moved using indoor facilities. The indoor facilities can be at least one of the indoor walls, ceiling, and even floor, and the image projection device 1000 can be moved along the indoor facilities. This allows the image projection device 1000 to be moved to a desired position indoors, and an image can be reliably projected onto the desired part of the user 201.

In yet another embodiment, the image projection device may be a projector attached to the body of the user 201, although this is not shown in the drawings. For example, a rechargeable projector may be built into or attached to glasses or a hat worn by the user 201.

Alternatively, the projector may be a portable information terminal device (such as a smartphone) that is held and operated in one hand. In that case, the portable information terminal device may be owned by the user, or may be owned by someone other than the user.

As described above, the image projection method according to the embodiment of the present invention is characterized by identifying the position of the user 201 and any part of the user's 201 body (e.g., reference numerals 101, 102, etc.), and projecting an image transmitted or distributed to the user 201 onto the identified any part as a screen 110, 120, 400, 500. As a result, the body can be used as a screen, so that the image can be viewed even if the user does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby.

The image projection method according to the embodiment of the present invention is further characterized in that the image projection device 200, 1000 that projects the image is moved to a position where the image can be projected onto any part of the user 201. This makes it possible to reliably project the image onto the desired part of the user 201.

The image projection method according to the embodiment of the present invention is characterized in that the image projection device 200 is moved using an unmanned aerial vehicle 602. This allows the image projection device 200 to fly freely in three-dimensional space and be moved to a desired position.

The image projection method according to the embodiment of the present invention is characterized in that the image projection device 1000 is moved using indoor facilities. Furthermore, the indoor facilities may be at least one of an indoor wall, ceiling, and floor, and the image projection device 1000 may be moved along the indoor facilities. This allows the image projection device 1000 to be moved to a desired position indoors, and an image can be reliably projected onto the desired part of the user 201.

The image projection method according to the embodiment of the present invention is further characterized in that any part of the user 201 that becomes the screen can be set by the user 201's designation. This allows the user 201 to project an image at a position of his or her own choosing and view the image.

The image projection method according to the embodiment of the present invention is further characterized in that an arbitrary part of the user 201 to be the screen is selected based on the content of the image. This allows the screen to be selected from among any part of the user 201 that is optimal for the image, thereby improving the visibility of the image.

The image projection method according to the embodiment of the present invention is further characterized in that the projection method for projecting an image is changed based on the state of any part of the user 201 that serves as the screen. This makes it possible to recognize the state of any part, specifically, for example, the palm of the hand, whether it is a bare hand or a gloved hand, and change the projection method according to that difference, thereby achieving more optimal projection and improving the visibility of the image.

The image projection method according to the embodiment of the present invention is further characterized in that the projection method for projecting an image is changed based on the surrounding conditions of an arbitrary part of the user 201 that serves as the screen. This makes it possible to recognize the surrounding conditions of an arbitrary part, specifically, differences in the surrounding brightness and the density of people, for example, and change the projection method according to those differences, thereby realizing a more optimal projection and improving the visibility of the image.

The image projection method according to the embodiment of the present invention is characterized in that, in the above invention, the image projected onto the screen is recognized, and the projection method is changed based on the recognized state of the image. This makes it possible to photograph the projected image, analyze the photographed image, and change the projection method so as to correct the projected image based on the analysis results, thereby achieving more optimal projection and improving the visibility of the image.

The image projection method according to the embodiment of the present invention is characterized in that, in the above invention, the arbitrary part of the user 201 that becomes the screen is a part of the body of the user 201 that is visible to the user 201. For example, the arbitrary part of the user 201 that becomes the screen is the hand or arm of the user 201. This makes it possible to easily use the hand or arm as a screen by simply moving it, and to project the image more quickly.

In addition, the arbitrary part of the user 201 that becomes the screen is, for example, the leg or foot of the user 201. This allows the user 201 to easily view the projected image, for example, when the user 201 is sitting. In addition, since the area on the legs or feet that can become a screen is relatively large compared to the hands or arms, the image can be projected in a large size.

In addition, for example, the arbitrary part of the user 201 that serves as the screen is the nail of the user's 201 finger or toe. In this way, by using the nail, which is harder and shinier than skin, as the screen, the image can be projected more clearly.

The image projection method according to the embodiment of the present invention is further characterized in that the arbitrary part of the user 201 that becomes the screen is a part of the user 201's body that can be seen by the user 201 using a mirror. This allows the user 201's own body reflected in the mirror to be used as the screen, and the user 201 can see the contents of the image while looking in the mirror.

The image projection method according to the embodiment of the present invention is further characterized in that when the user 201 projects an image onto a part of the body that can be seen by using a mirror, the image is inverted from left to right. This makes it possible to prevent the image information from being inverted and difficult to read, even when the image information is text information.

The image projection method according to the embodiment of the present invention is further characterized in that the arbitrary part of the user 201 that becomes the screen is the face, head, or neck of the user 201. This allows the user 201 to check the content of the image while looking at his or her own face in a mirror.

The image projection method according to the embodiment of the present invention is further characterized in that the arbitrary part of the user 201 that becomes the screen is the trunk or buttocks of the user 201. This allows the user 201 to check the content of the image while looking at his or her whole body in the mirror.

The image projection method according to the embodiment of the present invention is characterized in that it identifies the position of the user 201 and any part of the user's 201 body, and projects an image transmitted or distributed to the user 201 using the clothing of the identified any part as a screen. For example, the clothing may include at least one of clothes, gloves, shoes, socks, a hat, and a mask. As a result, the user 201 can use the clothing as a screen, and can view the image even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby.

The image projection method according to the embodiment of the present invention is further characterized in that the projection method for projecting an image is changed based on the type or state of clothing worn on any part of the user 201 that serves as the screen. For example, the projection method for projecting an image is changed based on at least one of the color and material of clothing worn on any part of the user 201 that serves as the screen. This makes it possible to recognize differences in the color and material of clothing and change the projection method according to these differences, thereby achieving more optimal projection and improving the visibility of the image.

The image projection devices 200 and 1000 according to the embodiments of the present invention are characterized by including a control unit (control circuit 702) that identifies the position of the user 201 and any part of the user's 201 body, and projects an image transmitted or distributed to the user 201 using the identified any part as a screen. This allows the user 201 to use his or her body as a screen, so that the user 201 can view an image even if he or she does not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby.

The image projection devices 200 and 1000 according to the embodiments of the present invention are characterized by having a control unit (control circuit 702) that identifies the position of the user 201 and any part of the body of the user 201, and projects an image transmitted or distributed to the user 201 using the clothes ("clothes") of the identified part as a screen. This allows the user 201 to use the clothes as a screen, so that the user 201 can view the image even if he or she does not carry a display device such as a mobile terminal device or even if there is no display device such as a display or screen nearby.

The image projection device 200, 1000 according to the embodiment of the present invention is further characterized in that the control unit (control circuit 702) moves the image projection device 200, 1000 that projects the image to a position where the image can be projected onto any part of the user 201. This makes it possible to reliably project the image onto the desired part of the user 201.

The unmanned aerial vehicle 602 of the embodiment of the present invention is characterized in that it identifies the position of the user 201 and any part of the body of the user 201, and projects an image transmitted or distributed to the user 201 using the identified any part as a screen. The unmanned aerial vehicle 602 of the embodiment of the present invention is characterized in that it includes a control unit (control circuit 702) that identifies the position of the user 201 and any part of the body of the user 201, and projects an image transmitted or distributed to the user 201 using clothing worn on the identified any part as a screen. The unmanned aerial vehicle 602 of the embodiment of the present invention is characterized in that it moves to a position where an image can be projected onto any part, and projects the image.

This allows it to fly freely in three-dimensional space, move to a desired location, and project images. Because the user 201 can use their body or clothing as a screen, they can view images even if they do not carry a display device such as a mobile terminal device, or even if there is no display device such as a display or screen nearby.

The image projection program according to the embodiment of the present invention is characterized in that it causes the image projection device to execute a process of identifying the position of the user 201 and any part of the body of the user 201, and projecting an image transmitted or distributed to the user 201 using the identified any part as a screen. The image projection program according to the embodiment of the present invention is characterized in that it causes the image projection device to execute a process of identifying the position of the user 201 and any part of the body of the user 201, and projecting an image transmitted or distributed to the user 201 using clothing worn on the identified any part as a screen. The image projection program according to the embodiment of the present invention is characterized in that it causes the image projection device 200, 1000 to execute a process of moving the image projection device that projects the image to a position where the image can be projected onto the any part.

This allows the image projection device 200, 1000 to be moved to a desired position and images to be projected. The user 201 can use their body or clothing as a screen, so they can view images even if they do not carry a display device such as a mobile terminal device or even if there is no display device such as a display or screen nearby.

The image projection method described in this embodiment can be realized by executing a prepared program on a computer such as a personal computer or a workstation. This program is recorded on a computer-readable recording medium such as a hard disk, CD-ROM, MO, DVD, USB memory, or SSD, and is executed by being read from the recording medium by the computer. This program may also be a transmission medium that can be distributed via a network such as the Internet.

As described above, the image projection method, image projection device, unmanned aerial vehicle, and image projection program of the present invention are useful for image projection methods, image projection devices, unmanned aerial vehicle, and image projection programs that project images, and are particularly suitable for image projection methods, image projection devices, unmanned aerial vehicle, and image projection programs that project images using the body as a screen.

110, 120 Palmtop screen 200 Image projection device (drone projector)
201 User 400 Arm-top screen 500 Wrist-top screen 601 Projector 602 Drone 603 Camera 604 Human presence sensor 801 User instruction reception unit 802 Projection target user identification unit 803 Body part information acquisition unit 804 Projection image information acquisition unit 805 Body part identification unit 806 Projection position/projection dimension determination unit 807 Warning output unit 808 Movement position/projection angle determination unit 809 Movement/projection angle control unit 810 Image information projection unit 811 Projection image capture unit 812 Instruction output unit 1000 Image projection device (movable projector)

Claims (3)

1. An image projection method for projecting an image transmitted or distributed to a user using an image projection device, comprising:
The image projection device,
After the user is notified of the reception of the image, an instruction to start projecting the image is received from the user;
When the instruction to start the projection is received, a current position of the user is identified, and a position and orientation of a body part to be projected or clothing in the body part to be projected is identified based on an instruction to select a projection part by the user ;
If it is determined that projection is possible based on the specified position and orientation , moving the image to a position where the image can be projected onto the body part to be projected or onto clothing of the body part to be projected, and adjusting the projection angle;
An image projection method, comprising: projecting the image onto the body part to be projected or onto clothing of the body part to be projected , as a screen. The image projection method according to claim 1, characterized in that the image projection device is movably installed on a wall or ceiling inside a room where the user is present. The image projection method according to claim 1, characterized in that the image projection device moves by flying an unmanned aerial vehicle, and notifies the user of receipt of the image by flying around the user.

Images