JP7651027B2 - Photographing system, photographing method, photographing program, and stuffed toy - Google Patents

Description

The present invention relates to a photography system, photography method, photography program, and stuffed toy. In particular, the present invention relates to a photography system, photography method, photography program, and stuffed toy that are suitable for taking pictures of stuffed toys.

A communication device that performs a communication action toward a user is known, which includes a structure that is composed of a plurality of components and has a face with at least one component corresponding to a component that constitutes a face, a control means that controls the operation of the components to make the structure perform a gesture that expresses a communication action by controlling the operation of the components, and a detection means that detects the relative position of an object around the structure with respect to the structure, the detection means detecting the position of the user's face, and the control means controlling the operation of the components to make the structure perform a different gesture depending on the angle between the direction in which the face is facing and the direction of the user's face as viewed from the face (see, for example, Patent Document 1). The communication device described in Patent Document 1 allows for natural communication action that takes into account the orientation of the user with respect to the face of the structure.

JP 2018-051701 A

In recent years, the "nui-dori" culture has become widespread, whereby images are taken in various locations, such as indoors, outdoors, or while traveling, with toys such as stuffed animals and dolls (hereinafter, these will be simply referred to as "stuffed animals"). In "nui-dori," images taken with stuffed animals as the main characters are uploaded to social networking services (SNS), etc., and enjoyed by many people. Here, in "nui-dori," the situation, such as the location where the stuffed animal is located, is properly understood, and an image is taken that suits that situation.

In addition, when taking "nui-dori" photos, it is preferred to adjust the state of the stuffed animal to match the surrounding environment, but with a stuffed animal that does not have a moving part or the like, it is difficult to make the stuffed animal pose to match the surrounding environment. Furthermore, the communication device described in Patent Document 1 cannot take into account the surrounding environment of the stuffed animal, which is important in "nui-dori" photos. In other words, although the communication device described in Patent Document 1 focuses on natural communication behavior between the user and the communication device, it cannot take into account the environment in which the stuffed animal is placed. Furthermore, the communication device described in Patent Document 1 cannot make the stuffed animal more lovable by adapting it to "nui-dori" photos, or change the pose of the stuffed animal so that the user feels attached to it, and take an image that includes the stuffed animal.

Therefore, the object of the present invention is to provide a photography system, photography method, photography program, and stuffed animal photography system that are suitable for stuffed animal photography and can capture images with high added value.

To achieve the above object, the present invention provides a photography system that includes an information terminal and a stuffed animal that can operate based on specific information supplied from the information terminal, in which the information terminal has an imaging unit that images an imaging area that includes the stuffed animal, and an imaging area information acquisition unit that acquires imaging area information that is information related to the imaging area, and the stuffed animal has at least one component, a drive unit that operates the component, and a drive control unit that controls the operation of the drive unit based on the imaging area information.

The photography system, photography method, photography program, and stuffed animal of the present invention can provide a photography system, photography method, photography program, and stuffed animal that are suitable for stuffed animal photography and can capture images with high added value.

FIG. 1 is a schematic diagram of an imaging system according to an embodiment of the present invention. FIG. 2 is a functional configuration block diagram of an information terminal according to the embodiment. FIG. 2 is a functional block diagram of a stuffed animal according to the present embodiment. FIG. 1 is a schematic diagram of a stuffed animal according to an embodiment of the present invention. 3A and 3B are diagrams illustrating data configurations of each storage unit according to the embodiment. FIG. 4 is a flow diagram of processing in the imaging system according to the present embodiment. 5A to 5C are diagrams illustrating image processing by an image processing unit according to the embodiment. 11 is a modified example of a flow chart of processing in the imaging system according to the present embodiment. 11A and 11B are diagrams illustrating an example of creating additional information according to the embodiment. FIG. 11 is a flow diagram of a process of an imaging system according to another embodiment.

[Embodiment]
<Overview of Imaging System 5>
The photography system 5 according to the present embodiment includes an information terminal having a camera, and a toy such as a stuffed animal or a doll having a drive unit driven by a battery (hereinafter, in the present embodiment, referred to as a "stuffed animal"), and the drive unit operates in cooperation with the information terminal. That is, the drive unit of the stuffed animal operates based on information about the imaging area of the camera, and the information terminal can capture an image in which the stuffed animal in the imaging area behaves as if it were the main character. That is, in the photography system 5, the information terminal grasps the situation of the imaging area including the stuffed animal, and the drive unit of the stuffed animal operates based on the situation grasped by the information terminal. Then, an image including this stuffed animal (the stuffed animal in motion or after a predetermined motion) is captured by the information terminal. As a result, the photography system 5 can capture an image with high added value suitable for stuffed animal photography, and can provide a stuffed animal that is highly lovable.

Figure 1 shows an overview of a photography system according to an embodiment of the present invention.

Specifically, the photography system 5 includes an information terminal 10 and a stuffed toy 20 having a drive unit that can operate based on predetermined information supplied from the information terminal 10. The information terminal 10 has a camera (imaging unit), which captures an image of the imaging area. The predetermined information is information about the imaging area, such as the object 1 (e.g., a person), scenery/background, stuffed toy 20, other stuffed toys, imaging location, and/or imaging date and time included in the imaging area (hereinafter referred to as "imaging area information"). As an example, the information terminal 10 is in a state where it can accept an imaging instruction to instruct the camera to capture an image, and acquires imaging area information of the imaging area in a photography preparation state in which it waits for the imaging instruction.

For example, as shown in FIG. 1(a), a case will be described in which an object 1 (person) and a stuffed toy 20 are included in the imaging area of the information terminal 10. In this case, the information terminal 10 acquires, as imaging area information, information indicating that the person, who is object 1, is included in the imaging area together with the stuffed toy 20, and information indicating the movement of the person, by image analysis of the imaging area. The information terminal 10 can acquire imaging area information in real time and/or continuously. The information terminal 10 then supplies the acquired imaging area information to the stuffed toy 20 via wireless communication.

The stuffed toy 20 is configured with at least one component. As an example, the stuffed toy 20 has components such as a head, a torso, four limbs, and ears, and is configured with a drive unit in a connection area between one component and another component adjacent to the first component, such as a connection area between the head and the torso. The stuffed toy 20 also has a drive control unit that controls the operation of the drive unit based on the imaging area information.

When the drive control unit of the stuffed toy 20 acquires the imaging area information from the information terminal 10, it operates the drive unit based on the imaging area information to operate the components. For example, the drive control unit operates each drive unit of the stuffed toy 20 to follow the movement of the person included in the imaging area, and operates each component that makes up the stuffed toy 20. In the example of FIG. 1(b), the imaging area information includes information indicating a state in which the person, who is the object 1, is raising his/her right arm. Therefore, based on the imaging area information received from the information terminal 10, the drive control unit operates a drive unit that can raise the right arm of the stuffed toy 20, and brings the right arm of the stuffed toy 20 into a raised state. In this state, the information terminal 10 can capture an image of the stuffed toy 20.

As a result, the photography system 5 can capture images in which the stuffed animal 20 included in the imaging area appears to be expressing emotions of its own volition together with the person (object 1) in the image, or to be acting independently.

The information terminal 10 is an information terminal with an imaging function, such as a mobile phone or smartphone with a camera function, a notebook computer with a camera function or to which a web camera can be connected, a tablet PC, a PC with a camera function or to which a web camera can be connected, a portable game console with a camera function or to which a web camera can be connected, and/or a home game console with a camera function or to which a web camera can be connected. The details of the imaging system 5 according to this embodiment will be described below, but it should be noted that the names and numbers in the above and following descriptions are merely examples and are not limited to these names and numbers.

<Details of the Imaging System 5>
Fig. 2 shows an example of the functional configuration of an information terminal according to this embodiment, Fig. 3 shows an example of the functional configuration of a stuffed animal according to this embodiment, Fig. 4 shows an overview of an example of a stuffed animal according to this embodiment, and Fig. 5 shows an example of the data configuration of each storage unit according to this embodiment.

[Overview of the configuration of the imaging system 5]
The photographing system 5 according to the present embodiment includes an information terminal 10 and a stuffed animal 20 that operates based on imaging area information acquired by the information terminal 10. As shown in Fig. 2, the information terminal 10 includes an imaging unit 100, an imaging control unit 102 that controls the operation of the imaging unit 100, an imaging area information acquisition unit 104 that acquires information on the imaging area, an image analysis unit 106 that analyzes the image of the imaging area, an imaging area information storage unit 108 that stores the imaging area information, an information terminal side transmitting/receiving unit 110 that transmits and receives predetermined information, an instruction receiving unit 112 that receives instructions from the outside, an image storage unit 114 that stores an image, an image processing unit 118 that executes image processing, an additional information generating unit 120 that generates additional information, a supply unit 122 that supplies a predetermined image and/or additional information to a predetermined server, a stuffed animal information storage unit 124 that stores information about the stuffed animal, a stuffed animal information update unit 126 that updates information about the stuffed animal, a friend information storage unit 128 that stores information about friends of the stuffed animal, and a display unit 130 that displays an image of the imaging area, etc.

As shown in FIG. 3, the stuffed toy 20 has one or more components 200 that make up the stuffed toy 20, a stuffed toy side transceiver 202 that transmits and receives predetermined information, an operation information storage unit 204 that stores the operation scenario of the stuffed toy 20, one or more drive units 208 that operate the components 200, a drive control unit 206 that controls the operation of the drive units 208, a sensor 210 that measures acceleration, etc., a microphone 212, a speaker 214, a battery 220, a battery remaining amount confirmation unit 222 that confirms the remaining amount of the battery 220, and a charge/discharge control unit 224 that controls the charging and discharging of the battery.

All or part of the functions of each component of the information terminal 10 may be possessed by other components, or may be configured separately and independently. Also, some of the components of the information terminal 10 or some of the functions of each component may be possessed by the stuffed toy 20. Furthermore, some of the components of the stuffed toy 20 or some of the functions of each component may be possessed by the information terminal 10. For example, the information terminal 10 may have some of the functions of the operation information storage unit 204 and the drive control unit 206.

In a modified example of this embodiment, a server may have some of the functions of the information terminal 10 (e.g., the image analysis unit 106), and the information acquired by the information terminal 10 (e.g., image information of the imaging area) may be image-analyzed in the server, and the drive control unit 206 of the stuffed toy 20 may operate the drive unit 208 based on the image analysis results in the server. However, the following describes a form in which there is no server.

[Details of the configuration of the imaging system 5: configuration of the information terminal 10]
(Imaging unit 100, imaging control unit 102)
The imaging unit 100 captures an image of the imaging area. The imaging control unit 102 controls the operation of the imaging unit 100. For example, the imaging unit 100 is controlled by the imaging control unit 102 to capture an image (captured image) of the imaging area including the stuffed toy 20. Here, the imaging control unit 102 can cause the imaging unit 100 to capture an image of a state in which imaging can be performed according to an imaging instruction from a user and in which the imaging instruction is awaited before the imaging instruction is accepted (i.e., a shooting preparation state). The imaging control unit 102 can also cause the imaging unit 100 to capture images in the shooting preparation state in real time and/or continuously. The imaging unit 100 can supply the image captured during the shooting preparation state to the imaging area information acquisition unit 104, the image analysis unit 106, and/or the display unit 130, and can also supply the image to the image storage unit 114 and/or temporarily store the image in a predetermined memory. Then, when the imaging control unit 102 receives an imaging instruction from a user, for example, it causes the imaging unit 100 to capture an image, and stores the captured image of the imaging area at the time of the imaging instruction and/or a predetermined period before and after that time in the image storage unit 114 and/or displays it on the display unit 130.

(Imaging area information acquisition unit 104)
The imaging area information acquisition unit 104 acquires imaging area information, which is information related to the imaging area. The imaging area information acquisition unit 104 can acquire imaging area information in a shooting preparation state. The imaging area information acquisition unit 104 may also acquire imaging area information in real time, at predetermined time points along a time series, or at predetermined time intervals, of images continuously captured by the imaging unit 100 in a shooting preparation state. The imaging area information acquisition unit 104 supplies the acquired imaging area information to the imaging area information storage unit 108.

The imaging area information here is at least one piece of information selected from the group consisting of information about objects included in the imaging area, information about the background of the imaging area, position information of the imaging area (position information of the imaging position), shooting preparation state of the imaging area, date and time information at the time of imaging, temperature and humidity information, and weather information. Examples of objects include people, stuffed animals 20, stuffed animals other than the stuffed animal 20 that is the subject of the captured image, various items included in the imaging area, etc. Examples of information about objects include the type of object (if the object is a stuffed animal, the type of stuffed animal, etc.), the state of the object (the movement of the object, and if the object is a person, information about the person's actions, posture, facial expression, etc.), etc.

The imaging area information acquisition unit 104 may acquire, as imaging area information, information indicating whether or not there is another stuffed animal in the vicinity of the information terminal 10 (for example, within a predetermined distance from the information terminal 10. The predetermined distance is, for example, a distance at which wireless communication is possible with the information terminal side transmitting/receiving unit 110) even though the other stuffed animal is not included in the imaging area that includes the stuffed animal 20. For example, the imaging area information acquisition unit 104 determines whether or not communication is possible between the information terminal 10 and the other stuffed animal, and acquires, as imaging area information, information indicating that the other stuffed animal is present in the vicinity of the information terminal 10 if it is determined that communication is possible.

Alternatively, each of the multiple stuffed animals may be assigned a unique stuffed animal ID in advance, or the imaging area information acquisition unit 104 may assign a stuffed animal ID different from that of the stuffed animal 20 to a stuffed animal that is in the vicinity of the information terminal 10 and can communicate with the information terminal 10 each time the imaging preparation state is reached (if there are multiple stuffed animals, each of the multiple stuffed animals may be assigned a different ID). Then, the imaging area information acquisition unit 104 supplies commands to the drive control units 206 of the stuffed animals corresponding to each stuffed animal ID, for performing different operations. Next, the imaging area information acquisition unit 104 identifies the stuffed animals included in the imaging area and the stuffed animals that are not included in the imaging area and are present in the vicinity of the information terminal 10, based on the operation of the stuffed animal included in the imaging area and the stuffed animal ID of the stuffed animal that was supplied with the command corresponding to the operation. The imaging area information acquisition unit 104 may acquire this identification result as imaging area information.

The imaging area information acquisition unit 104 acquires the location information, date and time information, weather information, etc. of the imaging area using the GPS function, clock function, and function for acquiring information from an external server that the information terminal 10 has. In addition, the imaging area information acquisition unit 104 acquires information about objects included in the imaging area and information about the background of the imaging area, etc., by image analysis of the captured image received from the imaging unit 100.

(Image analysis unit 106)
That is, the information terminal 10 has an image analysis unit 106 that performs image analysis. The image analysis unit 106 analyzes an image of the imaging area in a shooting preparation state acquired by the imaging unit 100 and/or an image of the imaging area acquired by the imaging unit 100 in response to an imaging instruction, and generates the analysis result as imaging area information. The imaging area information acquisition unit 104 acquires the generated imaging area information. The image analysis unit 106 can perform image analysis using conventionally known image processing, pattern matching methods, etc.

The image analysis unit 106 can also read captured images of objects and backgrounds to be captured from the image storage unit 114 or an external server and learn from them. In this case, the image analysis unit 106 can compare the learning results with the feature amounts of the image of the captured area to identify what objects and backgrounds are included in the captured area. Furthermore, the image analysis unit 106 can also analyze the behavior and/or state of objects included in the captured area in real time. As an example, the image analysis unit 106 can compare a predetermined model of a specific object with the feature amounts of an object included in the captured area to analyze what behavior the object is performing and/or what state it is in. Note that the image analysis unit 106 may recognize objects included in an image using, for example, Regional Convolutional Neural Network (R-CNN), high-speed RCNN, semantic segmentation, instance segmentation, etc.

For example, the image analysis unit 106 can analyze the image of the imaging area, determine whether or not an object included in the imaging area is a person, and if it is determined that the object is a person, determine the actions and/or facial expressions of the person. The image analysis unit 106 can also determine whether or not an object included in the imaging area is a stuffed animal, and if it is determined that the object is a stuffed animal, determine the characteristics of the stuffed animal (e.g., type, attributes, etc.). Furthermore, if the object included in the imaging area is an item other than a person (e.g., food and drink, merchandise, personal belongings, vehicles such as cars, etc.), the image analysis unit 106 can determine what the item is (e.g., product name, etc.). Furthermore, the image analysis unit 106 can also determine what the background or scenery of the imaging area is.

(Imaging area information storage unit 108)
The imaging area information storage unit 108 stores the imaging area information. The imaging area information storage unit 108 stores the imaging area information acquired by the imaging area information acquisition unit 104 in association with an imaging area ID that identifies the imaging area information. The imaging area information storage unit 108 can also store the imaging area information in association with the date and time when the imaging area information was acquired (acquisition date and time). In other words, the imaging area information storage unit 108 can also store past imaging area information.

In this case, the image analysis unit 106 can analyze the image of the imaging area at the time when the imaging unit 100 captures an image of the imaging area in a shooting preparation state, and/or the image of the imaging area at a time prior to that time. This allows the image analysis unit 106 to generate, for example, imaging area information indicating what is in the imaging area at a time prior to the imaging unit 100 acquiring an image in response to an imaging instruction (for example, information on the scenery or background and changes thereto, information on the actions or facial expressions of the person included in the imaging area and changes thereto, and/or information on the type of stuffed animal other than the stuffed animal 20 that is the subject included in the imaging area). The imaging area information storage unit 108 supplies the stored information to a specified component in response to a request from another component of the information terminal 10.

(Information terminal side transmitting/receiving unit 110)
The information terminal side transmitting/receiving unit 110 supplies the stuffed toy 20 with predetermined information from a predetermined component of the information terminal 10. The information terminal side transmitting/receiving unit 110 also receives predetermined information from a predetermined component of the stuffed toy 20. Furthermore, the information terminal side transmitting/receiving unit 110 can supply predetermined information from a predetermined component of the information terminal 10 to an external server or the like, and can also receive predetermined information from an external server or the like. The communication format is not particularly limited as long as it is wireless communication. For example, the information terminal side transmitting/receiving unit 110 can use short-range wireless communication such as Bluetooth (registered trademark). The same applies to the stuffed toy side transmitting/receiving unit 202. This allows the information terminal 10 and the stuffed toy 20 to wirelessly communicate with each other.

(Instruction Receiving Unit 112)
The instruction receiving unit 112 receives various instructions from a user. For example, various instructions include an instruction to capture an image of an imaging area in an imaging preparation state. In response to the received instruction, the instruction receiving unit 112 supplies the instruction to a component of the information terminal 10 that executes the instruction, and the component that receives the instruction executes an operation according to the instruction.

(Image storage unit 114)
The image storage unit 114 stores image information in association with an image ID that identifies an image. The image information includes an image of the imaging area in a shooting preparation state, a captured image captured by the imaging unit 100 in response to an imaging instruction, and/or a compositing image (including an image member used for compositing images) to be composited with the stuffed toy 20 included in the captured image. In this embodiment, the terms "image", "captured image", and "compositing image" include both still images and moving images. In addition, the still images and moving images may include accompanying audio information. The image storage unit 114 supplies the stored image information to a specified component in response to a request from another component of the information terminal 10.

(Plush Toy Information Storage Unit 124)
The stuffed toy information storage unit 124 stores stuffed toy information, which is information about a stuffed toy, in association with a stuffed toy ID that identifies the stuffed toy. The stuffed toy information is information about the type, name, sex, attributes, personality, etc. of the stuffed toy. The stuffed toy information storage unit 124 can store stuffed toy information about stuffed toy 20 owned by the user and/or stuffed toy information about stuffed toy 20 not owned by the user. The stuffed toy information storage unit 124 supplies specified information to specified components in response to requests from other components of the information terminal 10.

(Plush Toy Information Update Unit 126)
The stuffed toy information update unit 126 updates the stuffed toy information stored in the stuffed toy information storage unit 124. For example, when the instruction receiving unit 112 receives a predetermined instruction from the user, the stuffed toy information update unit 126 can update the stuffed toy information.

(Friend information storage unit 128)
The friend information storage unit 128 stores friend-related information, which is a friend stuffed animal ID that identifies another stuffed animal (second stuffed animal) as a friend of the stuffed animal (first stuffed animal) identified by the stuffed animal ID in association with the stuffed animal ID, and information indicating the relationship between the first stuffed animal and the second stuffed animal (for example, information indicating the number of times that they have appeared together in the same captured image, and information on the degree of intimacy calculated based on the information indicating the number of times, etc.). The friend information storage unit 128 supplies the friend-related information to a predetermined component in response to an action from another component of the information terminal 10.

(Image processing control unit 116, image processing unit 118)
The image processing control unit 116 controls the operation of the image processing unit 118. The image processing control unit 116 judges whether or not to composite a predetermined image at the display position of the stuffed animal 20 displayed on the display unit 130 based on the imaging area information and/or information such as the remaining battery level of the stuffed animal 20. Then, when the image processing control unit 116 judges that images should be composited, it causes the image processing unit 118 to execute image composition. Note that the image processing unit 118 can also execute processes such as image conversion and deformation of the captured image and extraction of information such as feature amounts from the captured image in addition to the image composition process.

The image processing unit 118 is controlled by the image processing control unit 116 and generates a composite image by synthesizing a predetermined image at the display position of the display unit 130 of the stuffed toy 20 included in the imaging area. The image processing unit 118 then causes the composite image to be displayed on the display unit 130. The image processing unit 118 can also store the composite image in the image storage unit 114 in association with a composite image ID that identifies the composite image. The image processing unit 118 can generate a composite image by using an image for synthesis stored in the image storage unit 114.

(Additional Information Generator 120)
The additional information generating unit 120 generates additional information corresponding to the captured image captured by the imaging unit 100, i.e., additional information indicating what action the object and/or stuffed toy 20 included in the captured image is taking or what state it is in, based on the imaging area information. The additional information generating unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquiring unit 104, the imaging area information stored in the imaging area information storage unit 108, and/or the imaging area information stored in the image storage unit 114 at the time the captured image was captured. The additional information is text information, graphic information, etc. indicating what action or movement the object and/or stuffed toy 20 included in the imaging area is taking or what state it is in. For example, the additional information is text information such as lines, explanations, etc. generated based on the relationship between the object and stuffed toy 20 included in the imaging area, the combination of the object and stuffed toy 20, etc.

The additional information generating unit 120 may have, for example, a text information storage unit that stores text information such as a description or a line predetermined for each type of object or stuffed animal in association with the imaging area information, and/or a text information acquiring unit that acquires text information from an external server. Based on the imaging area information, the additional information generating unit 120 may acquire text information corresponding to the type and action of the object included in the imaging area, the type of stuffed animal 20, and/or the type of stuffed animal other than the stuffed animal 20 included in the imaging area from the text information storage unit or from an external server, and use the acquired text information, or generate additional information using processed text information obtained by processing the acquired text information based on the imaging area information.

The additional information generating unit 120 may generate the additional information by using a Conditional Variational Auto-encoder (CVAE). Furthermore, the additional information generating unit 120 may generate text information as the additional information by using neural image annotating that combines a Convolutional Neural Network (CNN) that performs image recognition and a recurrent neural network.

The additional information may be information indicating the position of the imaging area included in the imaging area information, that is, text information suitable for the region or place where the image was captured. Furthermore, the additional information may be text information suitable for the object or background (such as a person, another stuffed animal that can communicate with the information terminal 10, a stuffed animal that cannot communicate with the information terminal 10, a product, etc.) that appears together with the stuffed animal 20, depending on the object or background (such as scenery of a tourist spot or scenic spot, a movie screen, etc.). For example, if the imaging area information includes information indicating the position where the image was captured, the additional information may be text information indicating that the user has arrived at the position (such as text information such as "I came to XX!" (where XX is the name of a place or a landmark)), and if the imaging area information includes information indicating the name of a specific product in the imaging area, the additional information may be text information related to the product (such as text information such as "I got XX!" (where XX is the product name)).

The additional information may be text information corresponding to the weather, temperature, and/or humidity of the imaging area. The additional information may be text information (first text information) corresponding to the number of times the stuffed animal 20 included in the imaging area has visited the imaging area, the number of times it has been captured in the imaging area with other objects, and/or the number of times it has been captured with other stuffed animals. For example, as the number of times the stuffed animal 20 has visited a certain imaging area increases, the additional information generating unit 120 may generate text information with a special expression (i.e., the stuffed animal 20 is perceived as personified). As the number of times other stuffed animals are captured together with the stuffed animal 20 increases, the additional information generating unit 120 may generate text information with a special expression (second text information) based on the past imaging area information stored in the imaging area information storage unit 108 and/or the past captured images stored in the image storage unit 114.

In addition, when the imaging area information indicates that the imaging area includes multiple stuffed toys, the additional information generating unit 120 can generate text information according to the combination of stuffed toys. In this case, the imaging area information acquiring unit 104 identifies the types of multiple stuffed toys included in the imaging area based on the image analysis results of the image analyzing unit 106 and the stuffed toy information stored in the stuffed toy information storage unit 124, and identifies the combination of stuffed toys. The additional information generating unit 120 then generates text information based on the identified combination of stuffed toys. In addition, when the imaging area includes a stuffed toy 20, while the imaging area information includes information indicating that there is another stuffed toy in the vicinity of the information terminal 10 but not included in the imaging area, the additional information generating unit 120 can also generate special text information (for example, text information such as "I want to be photographed with this other stuffed toy next time").

Furthermore, the stuffed animal 20 and the other stuffed animals may each be associated with unique characteristics (such as gender and personality) (these unique characteristics are stored as stuffed animal information in the stuffed animal information storage unit 124). The additional information generating unit 120 may obtain information indicating the unique characteristics of the stuffed animal 20 contained in the imaging area information from the stuffed animal information storage unit 124, and generate text information based on the obtained information. For example, the additional information generating unit 120 may generate text information in which the ending of the generated text is changed when the personality of the stuffed animal 20 is "quiet" or "mischievous". In addition, when multiple stuffed animals are included in the imaging area and/or when stuffed animals are included in both the imaging area and the information terminal 10, the additional information generating unit 120 may generate text information according to the intimacy between the stuffed animals. The intimacy between the stuffed animals is stored, for example, as friend-related information in the friend information storage unit 128.

The additional information generating unit 120 can also generate a plurality of pieces of text information based on information indicating the unique characteristics of the stuffed toy 20 included in the imaging area. When the instruction receiving unit 112 receives a selection instruction from the user, the additional information generating unit 120 determines the text information selected by the user as the additional information. In this case, the additional information generating unit 120 may act on the stuffed toy information updating unit 126 to update the stuffed toy information stored in the stuffed toy information storage unit 124 so that the characteristics corresponding to the text information selected by the user are associated with the stuffed toy 20 as new characteristics. For example, the additional information generating unit 120 generates one or more pieces of text information corresponding to other characteristics in addition to the text information corresponding to the characteristics based on information indicating the unique characteristics of the stuffed toy 20 included in the imaging area. When the text information selected by the user from the plurality of pieces of text information is text information corresponding to other characteristics different from the text information corresponding to the characteristics, the additional information generating unit 120 causes the stuffed toy information updating unit 126 to update the characteristics of the stuffed toy included in the stuffed toy information stored in the stuffed toy information storage unit 124 to the other characteristics. This allows the characteristics of the stuffed toy 20 to be changed to the characteristics preferred by the user.

(Supply unit 122)
The supply unit 122 supplies the captured image and the additional information corresponding to the captured image to a predetermined server (for example, a server of a social network service (SNS)). When the instruction receiving unit 112 receives an instruction to post to the SNS from a user, the supply unit 122 supplies the captured image captured by the imaging unit 100 and the additional information to the predetermined server. As a result, the captured image in which the stuffed animal 20 is the main character is uploaded to the predetermined server together with the additional information.

[Details of the configuration of the photography system 5: Configuration of the stuffed toy 20]
(Component 200)
The stuffed toy 20 is configured with at least one component 200. As an example, as shown in FIG. 4, the stuffed toy 20 is configured with a head component 200a, a body component 200b connected to the head, ear components 200c and 200d provided on the head, arm components 200e and 200f provided on the body, and leg components 200g and 200h provided near the side of the body opposite to the side connected to the head. Each component of the stuffed toy 20 may have one or more driving units inside. For example, a plurality of driving units and connecting members connecting each driving unit may be provided at predetermined intervals along the longitudinal direction of the component corresponding to the arm or ear of the stuffed toy 20 configured with a predetermined length, so that the arm or ear can be bent. The shape of the stuffed toy 20 and the components constituting the stuffed toy 20 are not limited to the example of FIG. 4. The shape of the stuffed toy 20 can be various animal shapes, various character shapes, etc. The shape and number of components constituting the stuffed toy 20 can also be determined appropriately depending on the overall shape and/or function of the stuffed toy 20. However, the stuffed toy 20 is configured without having an imaging unit such as a camera.

A component and another component adjacent to the component can be connected via a drive unit. For example, in the example of FIG. 4, the component 200a and the component 200b are connected via the drive unit 208a, and the head component 200a is configured to move relative to the torso component 200b. Also, the component 200b and the right arm component 200e are connected via the drive unit 208b, the component 200b and the left arm component 200f are connected via the drive unit 208c, the component 200a and the right ear component 200c are connected via the drive unit 208d, the component 200a and the left ear component 200d are connected via the drive unit 208e, the component 200b and the right leg component 200g are connected via the drive unit 208i, and the component 200b and the left leg component 200h are connected via the drive unit 208j. The limbs and ears of the stuffed animal 20 are configured to move in the same way as the head relative to the torso.

In addition, a driving unit 208f is connected to one eye of the stuffed animal 20, and a driving unit 208g is connected to the other eye. Driving unit 208f and/or driving unit 208g are configured to perform the actions of opening and closing the eyes and blinking. Furthermore, driving unit 208h provided in the mouth of the stuffed animal 20 is configured to perform the action of changing the shape of the mouth.

(Plush toy side transmitting/receiving unit 202)
The stuffed toy side transmitting/receiving unit 202 receives predetermined information such as imaging area information from the information terminal 10, and supplies the received predetermined information to predetermined components of the stuffed toy 20. The stuffed toy side transmitting/receiving unit 202 also supplies predetermined information from predetermined components of the stuffed toy 20, such as information on the remaining battery level, to predetermined components of the information terminal 10.

(Operation information storage unit 204)
The operation information storage unit 204 stores the remaining amount information of the battery 220, the imaging area information, and/or the operation information. The operation information storage unit 204 may store these pieces of information in association with a stuffed toy ID for identifying the stuffed toy 20. The operation information is information that specifies the operation of one or more drive units 208 and/or components such as the speaker 214 of the stuffed toy 20, and is information such as scenario information and audio information of the operation. The operation information storage unit 204 supplies predetermined operation information to the drive control unit 206 in response to an action of the drive control unit 206. Note that the information terminal 10 may have the operation information storage unit 204. In this case, the information terminal 10 supplies the operation information to the drive control unit 206. Alternatively, the information terminal 10 may have an operation information generation unit that generates operation information based on the imaging area information. The operation information generation unit supplies the generated operation information to the operation information storage unit 204 (in this case, the operation information storage unit 204 is included in the information terminal 10 or the stuffed toy 20).

(Drive control unit 206, drive unit 208)
The driving unit 208 operates the components. The driving unit 208 is composed of, for example, an RC servo motor, a DC motor, and/or a potentiometer. The driving control unit 206 controls the operation of the driving unit 208 based on the imaging area information. For example, the driving control unit 206 operates the driving unit 208 using the operation information stored in the operation information storage unit 204 in association with the imaging area information received from the information terminal 10. The driving control unit 206 may add a predetermined change to the operation information according to the position of the imaging area included in the imaging area information, objects and other stuffed animals included in the imaging area together with the stuffed animal 20, the background of the imaging area, the weather and humidity at the time of imaging the imaging area, the relationship between the stuffed animal 20 and the other stuffed animals captured in the imaging area together with the stuffed animal 20 (for example, intimacy, etc.), and the like.

(Sensor 210, microphone 212, speaker 214)
The sensor 210 detects the touch of the user to the stuffed toy 20, the operation of the stuffed toy 20, etc. For example, the sensor 210 is an acceleration sensor, a capacitance touch sensor, etc. The microphone 212 acquires sounds around the stuffed toy 20. Furthermore, the speaker 214 outputs various sounds from the stuffed toy 20. For example, the drive control unit 206 may control the operation of the drive unit 208 based on information indicating the touch of the user to the stuffed toy 20 detected by the sensor 210, etc., and/or information such as sound detected by the microphone 212. In this case, the operation information storage unit 204 may store the operation information in association with the information indicating the touch and the information such as sound, and the drive control unit 206 may operate the drive unit 208 based on the operation information corresponding to the information indicating the touch and the information of sound.

(Battery 220, battery remaining capacity confirmation unit 222, charge/discharge control unit 224)
The battery 220 supplies at least power to the drive unit 208 to operate the drive unit 208. The battery 220 supplies power to components that require power among the components that make up the stuffed animal 20. The battery remaining amount confirmation unit 222 monitors the battery 220 and confirms the remaining amount of the battery 220. The battery remaining amount confirmation unit 222 supplies information indicating the remaining amount of the battery to the information terminal 10 and/or the drive control unit 206. The charge/discharge control unit 224 controls charging and discharging of the battery 220.

When the drive control unit 206 receives information regarding the remaining battery level from the battery level confirmation unit 222, it controls the operation of the drive unit 208 based on the remaining battery level. For example, when the remaining battery level is equal to or lower than a specified value and exceeds a predetermined threshold, the drive control unit 206 controls the drive unit 208 so that the stuffed animal 20 behaves as if it is sleepy or hungry. For example, the drive control unit 206 can operate the drive unit for the eyes of the stuffed animal 20 to realize a state in which the eyes of the stuffed animal 20 are closed, or operate the drive unit for the ears to perform an action in which the ears gradually lower according to the remaining battery level.

In addition, the drive control unit 206 receives information on the remaining battery level from the battery remaining level confirmation unit 222, and when the remaining battery level is equal to or lower than a predetermined threshold level, the drive control unit 208 is set to a predetermined state and the drive unit 208 is stopped in that state. That is, when the remaining battery level is not sufficient to operate the drive unit 208, the posture and expression of the stuffed animal 20 may not be suitable for sewing photography. Therefore, when the remaining battery level is equal to or lower than a predetermined threshold level, the drive control unit 206 controls the operation of the drive unit 208, and stops the operation of the stuffed animal 20 (i.e., the operation of the drive unit 208) after changing the posture and expression of the stuffed animal 20 to a posture and expression suitable for sewing photography so that an image that is not inappropriate for sewing photography can be captured. As a result, even if the remaining battery level is too low to operate the drive unit 208, the posture and expression of the stuffed animal 20 suitable for sewing photography can be maintained. Note that when the battery 220 is recharged and the remaining battery level exceeds a predetermined threshold level or a predetermined value, the drive control unit 206 can resume the operation of the drive unit 208.

[Processing flow of the imaging system 5]
FIG. 6 shows an example of a processing flow in the imaging system according to this embodiment.

First, when the stuffed toy 20 is in the imaging area of the imaging unit 100, the imaging control unit 102 puts the imaging unit 100 into a shooting preparation state automatically or in response to an instruction from the user received by the instruction receiving unit 112 (step 10. Hereinafter, step is represented as "S"). Then, the imaging area information acquisition unit 104 acquires imaging area information of the imaging area based on the image being captured by the imaging unit 100 or the captured image (S12). The imaging area information acquisition unit 104 acquires information such as the presence or absence of an object in the imaging area, the type of the object (e.g., type indicating whether it is a person or an object, etc.) if an object is included, the operation or state of the object, the background of the imaging area, the location of the imaging area, the date and time when the shooting preparation state started, and/or the temperature and weather of the imaging area, as imaging area information by utilizing a GPS function, a clock function, etc., image recognition of the imaging area, and/or image analysis.

Then, the information terminal side transmitting/receiving unit 110 transmits the imaging area information acquired by the imaging area information acquiring unit 104 to the stuffed toy side transmitting/receiving unit 202 (S14). The information terminal side transmitting/receiving unit 110 may transmit past imaging area information. When the stuffed toy side transmitting/receiving unit 202 receives the imaging area information, it supplies the imaging area information to the drive control unit 206 and causes the battery remaining amount checking unit 222 to check the remaining amount of the battery 220. Then, the battery remaining amount checking unit 222 checks the remaining amount of the battery 220 (S16). When the battery remaining amount checking unit 222 confirms that the remaining amount of the battery 220 exceeds a predetermined value ("Exceeds predetermined value" in S16), the drive control unit 206 controls the operation of a predetermined drive unit 208 based on the imaging area information (S18). Specifically, the drive control unit 206 acquires the operation information stored in the operation information storage unit 204 in association with the imaging area information, and operates the drive unit 208 based on the acquired operation information.

For example, the motion information storage unit 204 can store motion information indicating that the imaging area includes a person and that the person has performed a predetermined motion, in association with imaging area information indicating that the person is to make the stuffed animal 20 follow the predetermined motion. As an example, when the received imaging area information includes information indicating that a person is included in the imaging area together with the stuffed animal 20 and that the person is making the motion of raising his right hand, the drive control unit 206 operates the drive unit 208 connecting the body and right hand of the stuffed animal 20 based on the motion information stored in the motion information storage unit 204 in association with the imaging area information, and causes the stuffed animal 20 to perform the motion of raising its right hand.

The information terminal 10 may have an operation information storage unit 204 or an operation information generation unit that generates operation information based on imaging area information. In this case, operation information is supplied from the information terminal 10 to the drive control unit 206 of the stuffed animal 20, and the drive control unit 206 can operate the drive unit 208 according to the received operation information. However, in this embodiment, an example will be described in which the stuffed animal 20 has the operation information storage unit 204.

In addition, when the battery remaining amount confirmation unit 222 confirms that the battery remaining amount exceeds a predetermined threshold and is equal to or less than the predetermined value ("above threshold and equal to or less than the predetermined value" in S16), the drive control unit 206 causes the drive unit 208 to execute a predetermined operation (S20). That is, the drive control unit 206 causes the stuffed animal 20 to execute an operation that allows the user to know that the battery remaining amount is decreasing. For example, when the battery remaining amount exceeds a predetermined threshold, the battery remaining amount confirmation unit 222 divides the area between the threshold and the predetermined value into a plurality of zones (predetermined value > threshold) and confirms which zone the battery remaining amount belongs to. Then, the drive control unit 206 causes a predetermined drive unit 208 to execute a predetermined operation each time the battery remaining amount decreases and moves from a zone with a large battery remaining amount to a zone with a small battery remaining amount. As an example, the drive control unit 206 operates the drive unit 208d and drive unit 208e of the component 200c and component 200d of the ear connected to the head of the stuffed animal 20, and executes an operation in which the ears lower each time the battery remaining amount moves from a zone with a large battery remaining amount to a zone with a small battery remaining amount. The drive control unit 206 may also operate the drive units 208f and 208g for the eyes of the stuffed animal 20 to gradually close the eyes each time the battery level changes from a high to a low level zone. In this case, the drive control unit 206 may operate the drive unit 208a provided between the head and the torso, for example, to make the stuffed animal 20 perform a motion as if it were sleeping (for example, a motion like rowing a boat).

The drive control unit 206 may also change the operating speed of the drive unit 208 depending on the remaining battery charge. For example, the drive control unit 206 may increase the operating speed of the drive unit 208 the more the remaining battery charge is (proportional to the remaining battery charge). Alternatively, the drive control unit 206 may increase the operating speed of the drive unit 208 the less the remaining battery charge is (inversely proportional to the remaining battery charge). This allows the behavior of the stuffed animal 20 to be changed depending on the remaining battery charge.

Furthermore, when the battery remaining amount confirmation unit 222 confirms that the battery remaining amount is equal to or less than a predetermined threshold amount ("Below threshold amount" in S16), the drive control unit 206 stops the operation of the drive unit 208 after putting the drive unit 208 in a specific state (S22). That is, the drive control unit 206 stops the operation of the drive unit 208 after putting the posture and expression of the stuffed animal 20 into a predetermined posture and expression before the battery remaining amount is no longer sufficient to operate the drive unit 208, thereby maintaining this posture and expression. If the remaining amount of the battery is equal to or less than a predetermined threshold amount even if there is remaining battery amount, the drive control unit 206 stops the operation of the drive unit 208 until the battery remaining amount is restored by charging. This makes it possible to make the stuffed animal 20 assume a posture or show an expression that it would only do when the battery is dead. That is, by executing the above process when the remaining battery charge is insufficient for the operation of the drive unit 208, the posture and expression of the stuffed animal 20 that the user finds cute can be maintained even when taking a picture of the stuffed animal (that is, the operation of the drive unit can be stopped before the remaining battery charge reaches a level at which the drive unit cannot be driven, so that the operation of the stuffed animal 20 does not stop with a posture or expression that is unsuitable for imaging.) The above threshold value of the remaining battery charge is determined from the viewpoint of leaving in the battery 220 a level of power that allows communication between the information terminal 10 and the stuffed animal 20, and from the viewpoint of leaving a level of power that allows the drive unit 208 to operate in order to put the posture and expression of the stuffed animal 20 into a predetermined posture and expression.

Next, when the instruction receiving unit 112 receives an image capture instruction from the user, the image capture control unit 102 causes the image capture unit 100 to capture an image (S24). The captured image captured by the image capture unit 100 is supplied to the image storage unit 114 and/or the display unit 130.

Then, the image processing control unit 116 judges whether or not to apply image processing to the captured image captured by the imaging unit 100 based on the imaging area information and/or information indicating the remaining battery level (S26). Specifically, the image processing control unit 116 refers to the imaging area information and judges to apply image processing to the image (Yes in S26) in cases where no action information is stored in the action information storage unit 204 in association with the imaging area information, or where the action information is stored but the stuffed animal 20 cannot complete the action depending on the action information (for example, when the imaging area information includes information indicating the action or posture of a person included in the imaging area, but the stuffed animal 20 cannot follow the action or posture), etc.

When the image processing control unit 116 determines that image processing is to be performed on the image, the image processing unit 118 performs image processing on the captured image captured by the imaging unit 100 (S28). For example, when the imaging area information includes information indicating the posture of a person included in the imaging area and the operation information is a content that instructs the drive unit to follow the posture, if the plush toy 20 cannot be made to take the posture due to its structure (for example, when the person is sitting upright and the plush toy 20 cannot take the posture of sitting upright), the image processing unit 118 synthesizes an image of the plush toy sitting upright at the position where the plush toy 20 is displayed in the captured image captured by the imaging unit 100 (i.e., the position of the plush toy 20 displayed on the display unit 130). In this case, the image of the plush toy 20 sitting upright (image for synthesis) is stored in the image storage unit 114, and the image processing unit 118 performs image processing (for example, image synthesis processing) using the image in the image storage unit 114. Then, the captured image to which the image processing has been performed is displayed on the display unit 130. In addition, the captured image that has undergone image processing can also be stored in the image storage unit 114.

The image processing control unit 116 may also refer to the imaging area information and determine whether or not to perform image processing depending on the status of the imaging area. The status of the imaging area is, for example, the date, time, location, weather, etc. of the imaging area. As an example, if the location of the imaging area is a specified location (for example, a tourist spot, a recreational spot, a scenic spot, etc.), the image processing control unit 116 may decide to perform image processing on some or all of the captured image.

Figure 7 shows an example of image processing by the image processing unit according to this embodiment.

For example, a case where the stuffed animal 20 is captured with a five-story pagoda in an ancient capital of Japan as a background will be described. In this case, the imaging area information acquisition unit 104 acquires information as imaging area information that the location of the imaging area is a specific location in Japan and that a traditional Japanese building is included in the background. Then, the image processing control unit 116 determines to execute image processing on a part of the captured image based on this information. For example, the image processing control unit 116 causes the image processing unit 118 to synthesize an image suitable for the location of the imaging area at the display position on the display unit 130 of the stuffed animal 20 included in the imaging area. As an example, an image of the stuffed animal 20 wearing a kimono and sitting upright is synthesized. As a result, as shown in FIG. 7, a composite image 22 showing the stuffed animal 20 wearing a kimono and sitting upright with a five-story pagoda or the like in the background is displayed on the display unit 130. In this way, the image processing by the image processing unit 118 makes it possible to display on the display unit 130 a composite image in which the posture of the stuffed animal 20 is changed according to the location of the imaging area, or a composite image of the stuffed animal 20 that has been changed.

The image processing unit 118 may display the captured image of the stuffed toy 20 at the display position on the display unit 130 of the stuffed toy 20, and may composite an image onto a portion of the captured image. For example, the captured image may be displayed for the head of the stuffed toy 20, and a composite image may be composited onto the other portion excluding the head. This allows the composite image to be composited onto the captured image, even if the captured image area information includes information indicating a posture or movement that the stuffed toy 20 cannot follow (i.e., even if the captured image area information includes information indicating a posture or movement that cannot be achieved even if each drive unit of the stuffed toy 20 is operated), and the composite image showing the posture or movement can be composited onto the captured image.

The image processing unit 118 may make predetermined changes to the image to be synthesized depending on the position of the imaging area included in the imaging area information, objects or other stuffed animals included in the imaging area together with the stuffed animal 20, the background of the imaging area, the weather, temperature, and humidity at the time of imaging the imaging area, the relationship between the stuffed animal 20 and other stuffed animals that appear in the imaging area together with the stuffed animal 20 (for example, the degree of intimacy), etc.

The image processing control unit 116 can also refer to the confirmation result of the battery remaining amount confirmation unit 222 and determine that image processing should be applied to the image if the remaining battery amount is equal to or less than a predetermined threshold amount (Yes in S26). For example, if the remaining battery amount is equal to or less than a predetermined threshold amount, the image processing control unit 116 causes the image processing unit 118 to synthesize an image of the stuffed animal 20 sleeping at the display position of the stuffed animal 20 on the display unit 130 included in the imaging area, an image of the stuffed animal 20 with its eyes rolling at the display position of the eyes, an image displaying a predetermined figure or symbol around the stuffed animal 20 (for example, an image displaying a figure such as an exclamation mark around the face of the stuffed animal 20), or an image of the stuffed animal 20 hiding behind a predetermined object, etc.

In this way, when capturing an image using the information terminal 10, a composite image indicating that the battery level of the stuffed toy 20 is low or the stuffed toy 20 can be made to perform a specified action can be displayed, making it possible to make the user aware of the remaining battery level of the stuffed toy 20 when capturing an image. This makes it possible to prevent a situation in which an appropriate image cannot be captured due to the stuffed toy 20 having no remaining battery level when actually capturing an image of an image capturing area including the stuffed toy 20.

The compositing image used by the image processing unit 118 to composite images may be stored in the image storage unit 114, or may be an image obtained from an external server. The compositing image may be an image obtainable from a predetermined server that stores compositing images specific to the location where the image is captured.

On the other hand, if the image processing control unit 116 determines not to execute image processing (No in S26), the captured image is displayed on the display unit 130. The captured image can also be stored in the image storage unit 114.

[Modification of the processing flow of the imaging system 5]
Fig. 8 shows an example of a modified processing flow in the imaging system according to the present embodiment. Fig. 9 shows an example of creating additional information according to the present embodiment. In the example of Fig. 8, substantially the same processing as in the example of Fig. 6 is performed, except that the step of S32 is performed between S24 and S30. Therefore, detailed description will be omitted except for the differences.

In the example of FIG. 8, additional information is generated for the captured image (S32). That is, first, the stuffed animal 20, objects, background, etc. included in the captured image are identified based on the captured area information (including information indicating the results of the image analysis unit 106 analyzing the captured image) acquired by the captured area information acquisition unit 104. Then, the additional information generation unit 120 generates additional information suitable for the captured image based on the identification results.

As an example, a case will be described in which the imaging unit 100 captures an image of the imaging area as shown in FIG. 9. Note that the image may be either an image captured by the imaging unit 100 in response to an imaging instruction, or an image captured by the imaging unit 100 in a state of preparation for imaging. In this case, the additional information generating unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquiring unit 104 for the image of the imaging area. For example, in FIG. 9, imaging area information is generated indicating that the imaging area includes a stuffed animal 20 and another stuffed animal 24 (a stuffed bird), ice cream is included in front of the stuffed animal 20 and the stuffed animal 24, and the size of the ice cream is larger than the mouths of the stuffed animal 20 and the stuffed animal 24.

In this case, the additional information generating unit 120 generates text information according to the situation in the captured image. In the example of FIG. 9, the additional information generating unit 120 generates text information 26 as additional information such as "The ice cream looks delicious!" and "Is it too big for us?!". The additional information generating unit 120 may generate audio information, symbol information, or the like according to the situation in the captured image as additional information. The additional information generating unit 120 then associates the generated additional information with the captured image. In this case, the image storage unit 114 may also store the additional information generated by the additional information generating unit 120 in association with the stored captured image.

The additional information generating unit 120 then displays the generated additional information on the display unit 130 together with the captured image (S30). In this case, the instruction receiving unit 112 can also receive an instruction from the user to post the captured image and additional information to a specified SNS. When the instruction receiving unit 112 receives the instruction, the supply unit 122 posts the captured image and additional information to a specified server (posting process: S34). Note that the instruction receiving unit 112 may display a "post button" at a specified position on the display unit 130, and execute the posting process when the user taps this post button. This allows the user to easily and quickly post the captured image to the SNS together with additional information according to the imaging situation when capturing an image including the stuffed animal 20.

[Effects of the embodiment]
The photography system 5 according to the present embodiment can capture images with high added value because it can change the pose and facial expression of the stuffed toy 20 according to the photography situation. That is, because it is possible to change the pose and facial expression of the stuffed toy 20 according to the situation around the stuffed toy 20, it is possible to enhance the lovability of the stuffed toy 20 and/or to take a composition in which the stuffed toy 20 that the user or the like feels attached to is the main character.

When capturing an image, the photography system 5 obtains imaging area information of the imaging area in a state ready for photography, and operates each drive unit of the stuffed animal 20 based on this imaging area information, thereby obtaining a captured image of the stuffed animal 20 operating according to the situation at the time of capturing the image. This makes it possible to provide captured images for stuffed animal photography with higher added value than before, and to provide a stuffed animal 20 that is highly lovable. Furthermore, the photography system 5 can cause the stuffed animal 20 to perform a specified operation and/or stop further operation after a specified operation in response to changes in the remaining battery level of the stuffed animal 20 that is taken with the user when going out, thereby making it possible to capture an image appropriate for the remaining battery level.

In addition, even if the added value of the captured image itself is not high, the photography system 5 can associate additional information with the captured image, so that the added value of the captured image and the additional information can be improved when sharing the captured image on a social networking site, for example. In addition, since the additional information can be linked to the captured image, both pieces of information can be uploaded to a social networking site easily and conveniently.

[Other embodiments]
Fig. 10 shows an example of a process flow of an imaging system according to another embodiment. Note that steps S40, S42, S44, and S46 in Fig. 10 are substantially the same as steps S10, S12, S24, and S32 in Fig. 6, respectively, and therefore detailed description thereof will be omitted except for the differences.

First, when the stuffed toy 20 is in the imaging area of the imaging unit 100, the imaging control unit 102 sets the imaging unit 100 to a shooting preparation state (S40). Then, the imaging area information acquisition unit 104 acquires imaging area information of the imaging area (S42). Next, when the instruction acceptance unit 112 accepts an imaging instruction from the user, the imaging control unit 102 causes the imaging unit 100 to perform imaging (S44). Furthermore, the additional information generation unit 120 generates additional information based on the imaging area information acquired by the imaging area information acquisition unit 104 (S46). The additional information generation unit 120 stores the captured image and the additional information corresponding to the captured image in the image storage unit 114. Next, when the instruction acceptance unit 112 accepts an instruction from the user to post the captured image and the additional information to a specified server, the supply unit 122 transmits the captured image and the additional information corresponding to the captured image to the specified server (S48). The specified server is, for example, a server for a social networking service, and the supply unit 122 transmits the captured image and the additional information to the server, whereby the captured image and the additional information are posted to the social networking service. After step S46, the display unit 130 can display the additional information together with the captured image.

[Filming program]
Each of the components of the imaging system 5 according to the present embodiment shown in Figures 1 to 10 can be realized by executing a program (i.e., an imaging program) in an arithmetic processing device such as a central processing unit (CPU), that is, by software processing. Also, it can be realized by writing a program in advance into hardware as an electronic component such as an integrated circuit (IC). Note that software and hardware can be used in combination.

The imaging program according to this embodiment can be incorporated in advance, for example, in an IC or ROM. The imaging program can also be provided as a computer program by recording it in an installable or executable file format on a computer-readable recording medium such as a magnetic recording medium, optical recording medium, or semiconductor recording medium. The recording medium storing the program may be a non-transient recording medium such as a CD-ROM or DVD. Furthermore, the imaging program can be stored in advance on a computer connected to a communication network such as the Internet, and provided by downloading via the communication network.

The photography program according to this embodiment works on the CPU and the like to make the photography program function as the imaging unit 100, imaging control unit 102, imaging area information acquisition unit 104, image analysis unit 106, imaging area information storage unit 108, information terminal side transmission/reception unit 110, instruction reception unit 112, image storage unit 114, image processing control unit 116, image processing unit 118, additional information generation unit 120, supply unit 122, stuffed toy information storage unit 124, stuffed toy information update unit 126, friend information storage unit 128, display unit 130, stuffed toy side transmission/reception unit 202, operation information storage unit 204, drive control unit 206, battery remaining amount confirmation unit 222, and charge/discharge control unit 224, all of which are described in FIG. 1 to FIG. 10.

Although the embodiments of the present invention have been described above, the invention according to the claims is not limited to the above-described embodiments. It should be noted that not all of the combinations of features described in the embodiments are necessarily essential to the means for solving the problems of the invention. Furthermore, the technical elements of the above-described embodiments may be applied alone, or may be divided into multiple parts, such as program parts and hardware parts, and then applied.

The imaging system according to this embodiment may also be referred to in the following appended claims, which should not be confused with the claims.
(Additional Note 1)
A photography system including an information terminal and a stuffed toy that can operate based on predetermined information supplied from the information terminal,
The information terminal,
An imaging unit that captures an imaging area including the stuffed toy;
an imaging area information acquisition unit that acquires imaging area information that is information about the imaging area;
an additional information generating section that generates additional information corresponding to the captured image captured by the imaging section based on the imaging area information;

REFERENCE SIGNS LIST 1 object 5 photography system 10 information terminal 20, 24 stuffed toy 22 composite image 26 text information 100 imaging unit 102 imaging control unit 104 imaging area information acquisition unit 106 image analysis unit 108 imaging area information storage unit 110 information terminal side transmission/reception unit 112 instruction reception unit 114 image storage unit 116 image processing control unit 118 image processing unit 120 additional information generation unit 122 supply unit 124 stuffed toy information storage unit 126 stuffed toy information update unit 128 friend information storage unit 130 display unit 200 constituent members 200a, 200b, 200c, 200d, 200e, 200f, 200g, 200h constituent members 202 stuffed toy side transmission/reception unit 204 operation information storage unit 206 drive control unit 208 Driving unit 208a, 208b, 208c, 208d, 208e, 208f, 208g, 208h, 208i, 208j Driving unit 210 Sensor 212 Microphone 214 Speaker 220 Battery 222 Battery remaining amount confirmation unit 224 Charging and discharging control unit

Claims (10)

An imaging system including an information terminal having a storage unit,
The information terminal,
a display unit that displays an image capture area captured by the image capture unit, the image capture area including an object having a shape of a character to which an ID is assigned;
an imaging area information acquisition unit that acquires, by wireless communication, information about the imaging area including the ID, which is information about the object, and information indicating a position of the imaging area, and that is stored in the storage unit ;
an additional information generating section that generates text information as additional information corresponding to the captured image captured by the imaging section based on the imaging area information. The imaging system according to claim 1, wherein the additional information generating unit generates the text information based on the status of the imaging area. The photography system according to claim 1, wherein the additional information generating unit generates the text information based on the imaging area information including the state of the object. The imaging system according to claim 1, wherein the additional information generating unit generates the text information and audio information according to the status of the imaging area. The photographing system according to claim 1 , wherein the additional information generating section generates the text information indicating that the object is expressing joy, anger, sadness or happiness based on a state of the imaging area. An imaging system including an information terminal having a storage unit,
The information terminal,
a display unit that displays an image capture area captured by the image capture unit, the image capture area including an object having a shape of a character to which an ID is assigned;
an imaging area information acquisition unit that acquires, by wireless communication, imaging area information stored in the storage unit, the imaging area information including the ID that is information about the object;
an additional information generating unit that generates text information as additional information corresponding to the captured image captured by the imaging unit based on the imaging area information;
Equipped with
A photography system in which, when the imaging area includes another object having the shape of another character, the additional information generation unit generates the text information according to a combination of the object and the other object . A method for photographing an object having a shape of a character by an information terminal having a storage unit, comprising:
an imaging area information acquisition step of acquiring, via wireless communication, imaging area information related to an imaging area of a captured image including an object having a shape of a character to which an ID is assigned , the imaging area information including the ID which is information related to the object and information indicating a position of the imaging area , the imaging area information being stored in the storage unit ;
and generating additional information based on the imaging area information, the additional information corresponding to the captured image. An imaging program for an imaging system including an information terminal having a storage unit,
On the computer,
an imaging area information acquisition function that acquires, via wireless communication, imaging area information related to an imaging area of a captured image including an object having the shape of a character to which an ID is assigned, the ID being information related to the object and information indicating a position of the imaging area , the imaging area information being stored in the storage unit ;
and an additional information generating function of generating text information as additional information corresponding to the captured image based on the imaging area information. A method for photographing an object having a character shape by an information terminal having a storage unit, comprising:
an imaging area information acquisition step of acquiring, via wireless communication, imaging area information related to an imaging area of a captured image including an object having a shape of a character to which an ID is assigned, the imaging area information including the ID that is information regarding the object, the imaging area information being stored in the storage unit;
and an additional information generating step of generating text information as additional information corresponding to the captured image based on the imaging area information ,
A photographing method in which, in the additional information generation step, when the imaging area includes another object having the shape of another character, the text information is generated according to a combination of the object and the other object. An imaging program for an imaging system including an information terminal having a storage unit,
On the computer,
an imaging area information acquisition function that acquires, via wireless communication, imaging area information related to an imaging area of a captured image including an object having a shape of a character to which an ID is assigned, the imaging area information including the ID that is information related to the object, and that is stored in the storage unit;
an additional information generating function for generating text information as additional information corresponding to the captured image based on the imaging area information;
Realize this,
A photography program in which, when the imaging area includes another object having the shape of another character, the additional information generation function generates the text information according to a combination of the object and the other object.

Images