JP6288948B2 - Image sharing system - Google Patents

Description

  The present invention relates to an image sharing system for sharing an effect composite image of a user created by a camera function of a mobile terminal and an AR application with other users.

  In recent years, various services using AR (Augmented Reality) have been proposed. For example, when a two-dimensional image (also referred to as “AR trigger”) registered in advance is photographed with a digital camera using an image recognition routine, content linked to the image is synthesized and displayed in real time with the camera video. Is provided. Conventionally, the AR trigger is attached to a card or the like. (For example, refer to Patent Document 1).

JP 2012-058968 A

  However, there is room for further development of a service using AR, and it has been desired to provide a new service that has never been seen before.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide an image sharing system that can provide a new service using AR.

  The image sharing system of the present invention provides a program providing server that provides an AR application to a mobile terminal having a camera function, and a user function composite image created by the camera function of the mobile terminal and the AR application from the mobile terminal. A service providing server for receiving, and an image sharing database for storing the effect composite image received by the service providing server, wherein the effect composite image is an image of the user obtained by a camera function of the mobile terminal, It is an image to which an effect image obtained based on the AR trigger attached to the accessory worn by the user is added, and is distributed in response to a request from another user's terminal device.

  As a result, the AR application is provided from the program providing server to the mobile terminal, and when the AR application is activated, the AR application is attached to the user's accessory by the AR application. The generated AR trigger is automatically recognized, and an effect composite image is created and displayed in real time from the user's image (image in which the user and the accessory are photographed together), and the effect composite image can be taken by terminal operation. Then, the effect composite image is transmitted from the portable terminal to the service providing server, stored in the image sharing database, and distributed in response to a request from another user's terminal device. In this case, the effect composite image is an image obtained by adding the effect image obtained based on the AR trigger attached to the accessory worn by the user to the user image obtained by the camera function of the mobile terminal. According to the present invention, such an effect composite image can be shared with other users and enjoyed.

  In the image sharing system of the present invention, the accessory may be clothes.

  In this case, the effect composite image is an image in which an effect image obtained based on an AR trigger attached to a user's clothes (such as a T-shirt) is added to the user's image obtained by the camera function of the mobile terminal. . Such an effect composite image can be shared with other users and enjoyed.

  Further, in the image sharing system of the present invention, the effect composite image is added to the AR trigger on the face portion of the user extracted by face recognition processing from the user image obtained by the camera function of the mobile terminal. An image to which an effect image obtained based on the image is added may be used.

  In this case, the effect composite image is an image obtained by adding the effect image to the user's face portion in the user image obtained by the camera function of the mobile terminal. Such an effect composite image can be shared with other users and enjoyed.

  In the image sharing system of the present invention, the effect composite image is used as the AR trigger on the user's arm portion extracted by arm recognition processing from the user image obtained by the camera function of the mobile terminal. An image to which an effect image obtained based on the image is added may be used.

  In this case, the effect composite image is an image obtained by adding the effect image to the user's arm portion in the user image obtained by the camera function of the mobile terminal. Such an effect composite image can be shared with other users and enjoyed.

  According to the present invention, a new service using AR can be provided.

Explanatory drawing of the image sharing system in embodiment of this invention Sequence diagram for explaining the operation of the image sharing system in the embodiment of the present invention

  Hereinafter, an image sharing system according to an embodiment of the present invention will be described with reference to the drawings. In this embodiment, the case of an image sharing system used for a social network service (SNS) or the like is illustrated.

  A configuration of an image sharing system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is an explanatory diagram showing a configuration of an image sharing system 1 according to the present embodiment. As shown in FIG. 1, the image sharing system 1 includes a mobile terminal 2 (for example, a smartphone) possessed by a user, a program providing server 3 that provides an AR application to the mobile terminal 2 of the user, and an effect composite image (described later). A service providing server 4 that receives the image data of the image providing database, and an image sharing database 5 that stores the effect composite image received by the service providing server 4.

  The mobile terminal 2 has a camera function, and the effect composite image is created by the AR application from the user image obtained by the camera function of the mobile terminal 2. In this case, when photographing the accessory 6 worn by the user together with the user (photographing operation) on the portable terminal 2 (the portable terminal 2 in which the AR application is activated), the AR trigger attached to the user's accessory 6 is automatically set. And the effect composite image is displayed on the screen of the portable terminal 2. In this mobile terminal 2 (the mobile terminal 2 in which the AR application is activated), a game using the effect composite image is performed by tapping the screen, shaking the mobile terminal 2, or rotating it (play operation). You can play.

  The effect composite image is based on an AR trigger 7 attached to the user's jewelry 6 in the user's image obtained by the camera function of the mobile terminal 2 (an image in which the user's jewelry 6 is reflected together with the user). It is an image to which the obtained effect image is added. The accessory 6 is clothes such as a T-shirt, but may be anything worn by the user, such as a hat or a wristband.

  Further, the effect by the effect image can be an effect in accordance with the current position of the mobile terminal 2, the weather, and the date and time (date, time). For example, the current position information can be acquired by the position information API of the mobile terminal 2. Weather information can be acquired from an external weather information providing server. The date information can be acquired by the calendar API of the mobile terminal 2, and the time information can be acquired by the time acquisition API of the mobile terminal 2.

  Furthermore, the effect produced by the effect image can be produced according to user data (friend list, birthday, hobby, check-in history, event participation, etc.) acquired from an external SNS (social network service).

  Further, the mobile terminal 2 (or the AR application) may have a function of recognizing a face by image processing. In this case, the effect composite image is an image obtained by adding the effect image obtained based on the AR trigger 7 to the user's face portion extracted by the face recognition process among the user images obtained by the camera function of the mobile terminal 2. But you can. Further, the effect produced by the effect image can be produced in accordance with the movement of the user's face part extracted by the face recognition process.

  Or the portable terminal 2 (or AR application) may be provided with the function to recognize an arm and a leg by image processing. In this case, the effect composite image is displayed on the user's arm part extracted by the arm recognition process or the user's foot part extracted by the foot recognition process among the user images obtained by the camera function of the mobile terminal 2. An image to which an effect image obtained based on the trigger 7 is added may be used. Further, the effect by the effect image can be an effect that matches the movement of the user's arm part extracted by the arm recognition process or the movement of the user's foot part extracted by the foot recognition process.

  The mobile terminal 2 (the mobile terminal 2 that activated the AR application) can save (temporarily save) the effect composite image displayed on the screen by tapping the screen (shot operation) or the like. The mobile terminal 2 (the mobile terminal 2 that has activated the AR application) has a function of transmitting (uploading) the saved (temporarily stored) effect composite image to the service providing server 4 (share operation). The effect composite image transmitted (uploaded) to the service providing server 4 is stored in the image sharing database 5.

  When the effect composite image stored in the image sharing database 5 has an access request from another user's terminal device 8 (for example, a smartphone or a personal computer), the other user's terminal device 8 responds to the access request. Delivered to. In this way, the effect composite image can be viewed on the terminal device 8 of another user.

  The operation of the image sharing system 1 of the present embodiment configured as described above will be described with reference to the sequence diagram of FIG.

  When sharing an image using the image sharing system 1 of the present embodiment, first, the AR application is downloaded from the program providing server 3 to the portable terminal 2 (S1), and the downloaded AR application is installed in the portable terminal 2. (S2).

  When the AR application is activated on the mobile terminal 2 (S3) and the user wears an accessory 6 (S4), the AR trigger attached to the user's accessory 6 is automatically recognized (S5). ), The effect composite image is displayed on the screen of the portable terminal 2. The user plays a game using the effect composite image by performing a play operation (tapping the screen, shaking the mobile terminal 2, rotating, etc.) (S <b> 6). Furthermore, the user saves (temporarily saves) the effect composite image that is being played (displayed on the screen) by performing a shot operation (such as tapping the screen) (S7).

  Thereafter, the user performs a sharing operation (such as tapping the screen) (S8), and transmits (uploads) the saved (temporarily saved) effect composite image to the service providing server 4 (S9). The service providing server 4 registers (image registration) the effect composite image uploaded from the mobile terminal 2 in the image sharing database 5 (S10).

  When another user sends an access request to the service providing server 4 from the terminal device 8 (smart phone or personal computer) (S11), the service providing server 4 reads the effect composite image from the image sharing database 5 (S12), The read effect composite image is distributed to the terminal device 8 of another user (S13). The effect composite image distributed from the service providing server 4 is displayed on the terminal device 8 of the other user (S14).

  According to such an image sharing system 1 of the present embodiment, a new service using AR can be provided.

  That is, in the present embodiment, the AR application is provided from the program providing server 3 to the mobile terminal 2, and when the mobile terminal 2 is held over the user (and the user's accessory 6 together) with the AR application activated, The AR trigger attached to the user's accessory 6 is automatically recognized by the application, and an effect composite image is created and displayed in real time from the user's image (an image showing the user and the accessory 6 together). The effect composite image can be taken. Then, the effect composite image is transmitted from the portable terminal 2 to the service providing server 4, stored in the image sharing database 5, and distributed in response to a request from the terminal device 8 of another user. In this case, the effect composite image is an image obtained by adding the effect image obtained based on the AR trigger 7 attached to the user's accessory 6 to the user image obtained by the camera function of the mobile terminal 2. According to the present invention, such an effect composite image can be shared with other users and enjoyed.

  In the present embodiment, the effect composite image is an effect image obtained based on an AR trigger 7 attached to a user's clothes (such as a T-shirt) on the user's image obtained by the camera function of the mobile terminal 2. Is an image with. Such an effect composite image can be shared with other users and enjoyed.

  In this case, the effect composite image is an image obtained by adding the effect image to the user's face portion in the user image obtained by the camera function of the mobile terminal 2. Alternatively, the effect composite image is an image obtained by adding the effect image to the user's arm portion in the user's image obtained by the camera function of the mobile terminal 2. Such an effect composite image can be shared with other users and enjoyed.

  The embodiments of the present invention have been described above by way of example, but the scope of the present invention is not limited to these embodiments, and can be changed or modified according to the purpose within the scope of the claims. is there.

  As described above, the image sharing system according to the present invention has an effect that it can provide a new service using AR, and is useful for a social network service (SNS).

DESCRIPTION OF SYMBOLS 1 Image sharing system 2 Portable terminal 3 Program provision server 4 Service provision server 5 Image sharing database 6 Trinket 7 AR trigger 8 Terminal device

Claims (3)

A program providing server for providing an AR application to a mobile terminal having a camera function;
A service providing server for receiving, from the mobile terminal, a user effect composite image created by the camera function of the mobile terminal and the AR application;
An image sharing database for storing the effect composite image received by the service providing server;
With
The effect composite image is an image in which an effect image obtained based on an AR trigger attached to an accessory worn by the user is added to the image of the user obtained by the camera function of the mobile terminal, Delivered in response to requests from other users' terminal devices,
The effect by the effect composite image is an effect according to the current position, weather, or date and time of the mobile terminal. A program providing server for providing an AR application to a mobile terminal having a camera function;
A service providing server for receiving, from the mobile terminal, a user effect composite image created by the camera function of the mobile terminal and the AR application;
An image sharing database for storing the effect composite image received by the service providing server;
With
The effect composite image is an image in which an effect image obtained based on an AR trigger attached to an accessory worn by the user is added to the image of the user obtained by the camera function of the mobile terminal, Delivered in response to requests from other users' terminal devices,
The effect by the effect composite image is an effect in accordance with user data of the portable terminal acquired from an external network. The image sharing system according to claim 1, wherein the accessory is clothing.

Images