JP7353057B2 - Recording systems and programs - Google Patents

Description

The present invention relates to a recording system and a program.

The images may be edited and put into an album by sorting the captured images and arranging them, for example, in chronological order.

The electronic album editing device described in Patent Document 1 includes: an image/audio data I/F unit that imports image data and audio data corresponding to the image data; a recording unit that manages and stores the image data and the audio data; A voice data conversion means for converting data into text data, a search/sort means for searching and sorting image data based on the text data, and creating an album by arranging images based on the sorting results. An album creation means is provided.

Further, the album creation device described in Patent Document 2 is capable of analyzing, from a plurality of accumulated image data, a range of dates and times when image data was created, a range of places where image data was taken, and a person whose image is included in the image data. or a person making a speaking voice included in the audio accompanying the image data, or a combination thereof as a search condition to extract one or more image data; and a display means to display the extracted image data. It is also described that the system includes means for automatically generating these search conditions and means for interacting with the user to input search conditions.

JP2003-111009 JP2005-107867

For example, a user may select appropriate images from among the captured images and arrange them in order to create an album of images and audio. However, such work generally requires a lot of time and effort, and tends to place an excessive burden on the user.
An object of the present invention is to provide a recording system and the like that can reduce the burden on the user when creating an album of captured images and acquired audio.

Thus, according to the present invention, there is provided a storage means for acquiring and storing an image in which a person is photographed and audio related to the image, and a storage means for receiving and storing an image in which a person is photographed, and receiving an input of a photographing scene from a user, and responding in advance to the received photographing scene. a selection means for selecting a word registered as a tagged word; a discriminating means for discriminating the selected word from audio stored in a storage means; and a discrimination means for selecting an image corresponding to the selected word. , an output means for outputting the selected images, and the output means selects images of a predetermined period including images when the identified words were uttered, and outputs images of the person who uttered the identified words. A recording system is provided, which is characterized in that it identifies a person and selects, as a period, images during a period in which the specified person is photographed.

Here , the output means can arrange the selected images and the sounds corresponding to the selected images in chronological order and create an album. In this case, images and sounds that are more closely related can be combined into one.

Furthermore, according to the present invention, the computer has a memory function for acquiring and storing an image in which a person is photographed and audio related to the image, and a memory function for receiving and storing an input of a photographed scene from a user, and a selection function for selecting a word registered in advance in association with a scene; a discrimination function for discriminating the selected word from audio stored in a memory function; The output function selects images and outputs the selected images, and the output function selects images of a predetermined period including images when the identified words are uttered, A program is provided for identifying the person who uttered the message and selecting images from the period during which the identified person was photographed.

According to the present invention, it is possible to provide a recording system and the like that can reduce the burden on the user when creating an album of captured images and acquired audio.

1 is a diagram showing a configuration example of a recording system in this embodiment. FIG. 2 is a diagram illustrating an example of a schematic operation of the recording system. 1 is a block diagram showing an example of a functional configuration of a recording system in a first embodiment. FIG. It is a flowchart explaining the operation of the recording system in the first embodiment. FIG. 2 is a diagram illustrating an example of a screen on which a user registers words on a mobile terminal. (a) to (b) are diagrams showing periods during which a selection unit selects images. It is a flow chart explaining operation of a recording system in a 2nd embodiment. (a) to (b) are diagrams showing the data structure of data saved in the storage unit in step 205 of FIG. 7. FIG. 7 is a block diagram showing an example of a functional configuration of a recording system in a third embodiment. It is a flow chart explaining operation of a recording system in a 3rd embodiment. FIG. 3 is a diagram illustrating an example of a screen for registering a shooting scene on a mobile terminal. 11 is a diagram showing the data structure of data saved in the storage unit in step 306 of FIG. 10. FIG. It is a figure shown about the robot used in a 3rd embodiment. FIG. 2 is a block diagram showing an example of a functional configuration of a recording system when a robot is used. It is a flow chart explaining operation of a recording system in a 4th embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<Description of the entire recording system 1>
FIG. 1 is a diagram showing a configuration example of a recording system 1 in this embodiment.
As shown in the figure, the recording system 1 of this embodiment is configured by connecting a camera 10, mobile terminals 20a and 20b, and a management server 40 via a network 70, a network 80, and an access point 90. ing. Note that although only one camera 10 is shown in FIG. 1, any number may be used. Further, hereinafter, when the mobile terminal 20a and the mobile terminal 20b are not distinguished, they may be simply referred to as "mobile terminal 20."

The camera 10 is a photographing device and photographs moving images or still images. The camera 10 includes an optical system that converges light from an object and an image sensor that detects the light converged by the optical system. An optical system is composed of a single lens or a combination of multiple lenses. For example, a twin lens is used in which two hemispherical lenses are combined with their spherical surfaces facing each other. The image sensor is configured by arranging CCDs (Charge Coupled Devices), CMOSs (Complementary Metal Oxide Semiconductors), and the like.
Further, the camera 10 not only takes pictures but also acquires sounds around the camera 10. Therefore, the camera 10 includes, for example, a microphone, and converts sound acquired by the microphone into an electrical signal (audio signal). Further, at this time, the electric signal (audio signal) may be amplified. Various existing types of microphones can be used, such as dynamic type and condenser type. Note that from the viewpoint of capturing all sounds around the camera 10, it is preferable to use an omnidirectional MEMS (Micro Electro Mechanical Systems) type microphone.
Furthermore, the camera 10 is a network camera that connects to an access point 90 via wireless communication, and manages information on captured images and acquired sound information via the access point 90, the network 70, and the network 80. It can be transmitted to the server 40. Note that it is also possible to connect to the network 70 using a wired communication line.

The mobile terminal 20 is, for example, a mobile terminal such as a mobile computer, a mobile phone, a smartphone, or a tablet. Mobile terminals 20a and 20b connect to access point 90 for wireless communication. The mobile terminals 20a and 20b then connect to the network 70 via the access point 90.

The management server 40 is a server computer that manages the entire recording system 1. As will be described in detail later, the management server 40 identifies a predetermined word based on the image taken by the camera 10 and the sound obtained, and creates an album of images and sounds corresponding to this word.

The mobile terminal 20 and the management server 40 include a CPU (Central Processing Unit) as a calculation means, a main memory as a storage means, and a storage such as an HDD (Hard Disk Drive). Here, the CPU executes various software such as an OS (basic software) and application programs (application software). Further, the main memory is a storage area that stores various software and data used for executing the software, and the storage is a storage area that stores input data for various software, output data from the various software, and the like.
Furthermore, the mobile terminal 20 and the management server 40 include a communication interface (hereinafter referred to as "communication I/F") for communicating with the outside, a display mechanism consisting of a video memory, a display, etc., input buttons, It is equipped with input mechanisms such as a touch panel and a keyboard.

The network 70 is a communication means used for information communication between the camera 10, the mobile terminal 20, and the management server 40, and is, for example, the Internet.
Like the network 70, the network 80 is also a communication means used for information communication between the camera 10, the mobile terminal 20, and the management server 40, and is, for example, a LAN (Local Area Network).

The access point 90 is a device that performs wireless communication using a wireless communication line. The access point 90 mediates the transmission and reception of information between the camera 10, the mobile terminal 20, and the management server 40 with the network 70 and the network 80.
The types of wireless communication lines that can be used include mobile phone lines, PHS (Personal Handy-phone System) lines, Wi-Fi (Wireless Fidelity), Bluetooth (registered trademark), ZigBee, and UWB (Ultra Wideband). It is.

<Schematic explanation of the operation of recording system 1>
FIG. 2 is a diagram showing an example of a schematic operation of the recording system 1. As shown in FIG.
First, user A registers predetermined words using the mobile terminal 20a. This is done by user A inputting verbal information and sending it from the mobile terminal 20a to the management server 40 via the access point 90, network 70, and network 80 (1A).
Furthermore, the management server 40 stores this word in a storage such as an HDD, and the registration is completed (1B).

Next, the camera 10 photographs an image and acquires sound, and transmits the photographed image and the acquired sound to the management server 40 as transmission information (1C). The transmission information is sent to the management server 40 via the access point 90, network 70, and network 80.
The management server 40 stores the photographed images and the acquired sounds in a storage such as an HDD (1D).

The management server 40 then reads the registered words from the storage (1E). The acquired sound is then analyzed to determine whether the registered words are included as audio (1F).
Further, if the registered word is included as audio, the management server 40 selects an image corresponding to this word and creates an album together with the audio (1G). This album is a compilation of images containing specific words, along with audio. The order of images and sounds included in an album is not particularly limited, and can take various forms such as chronological order and time length order.
The albumed images and sounds are stored in a storage such as an HDD (1H).
The albumed images and sounds are read from the storage by user B operating the mobile terminal 20b (1I) and sent from the management server 40 to the mobile terminal 20b (1J). As a result, user B can view this album.
Note that the user A and the user B have, for example, a predetermined friendship relationship, such as a parent-child relationship, or a relationship between friends. Note that user A and user B may be the same person. In other words, it is conceivable that a person who has registered a word may view the album.

<Detailed explanation of recording system 1>
[First embodiment]
Next, the detailed functional configuration and operation of the recording system 1 of this embodiment will be explained.
Here, first, a first embodiment of the recording system 1 will be described. In the first embodiment, a user registers one word in the management server 40, and the management server 40 creates an album based on this word.

FIG. 3 is a block diagram showing an example of the functional configuration of the recording system 1 in the first embodiment.
Here, out of the various functions that the recording system 1 has, those related to this embodiment are selected and illustrated.
The camera 10 includes a photographing section 11 that photographs a person, a sound acquisition section 12 that acquires sound, and a transmitting section 13 that transmits information about the photographed image.
The photographing unit 11 is a functional unit that photographs a person, and is composed of the above-mentioned optical system and an image sensor.
The sound acquisition unit 12 is a functional unit that acquires sounds surrounding the camera 10 including the voice of a person, and corresponds to the above-mentioned microphone.
The transmitter 13 transmits information about the captured image and the acquired sound to the management server 40 as transmission information. The transmitter 13 is, for example, a communication I/F, and transmits transmission information to the management server 40 via the access point 90, the network 70, and the network 80.

In the recording system 1 of this embodiment, the mobile terminal 20a and the mobile terminal 20b have the same functional configuration, and include a transmitting/receiving section 21 that transmits and receives transmission information, a display section 22 that displays images, and a The apparatus includes an input section 23 for inputting the utterance, and a voice acquisition section 24 for acquiring the uttered voice.

The transmitting/receiving unit 21 transmits and receives information corresponding to image information and words when registering them. The transmitting/receiving unit 21 is, for example, a communication I/F, and transmits and receives information to and from the management server 40 via the access point 90, the network 70, and the network 80.

The display unit 22 displays images. The display unit 22 is, for example, a touch panel. In this case, the display unit 22 includes a display on which various information is displayed, and a position detection sheet that detects a position touched by a finger, a stylus pen, or the like. What types of methods are used to detect the touched position, such as a resistive film method that detects based on the pressure caused by contact, or a capacitance method that detects based on the static electricity of the object in contact. Good too.

The input unit 23 is an input mechanism for the user of the mobile terminal 20 to perform predetermined operations.
For example, it is the touch panel mentioned above. In this case, the touch panel has the functions of both the display section 22 and the input section 23. That is, by displaying a predetermined image and touching the displayed screen, it is possible to start/stop an application running on the mobile terminal 20 and perform operations on the application. Note that the input unit 23 is not limited to this, and may be configured with a keyboard, a mouse, or the like.

The audio acquisition unit 24 acquires the user's uttered audio. The audio acquisition unit 24 is, for example, a microphone. The microphone used as the audio acquisition section 24 is not particularly limited, and various existing microphones can be used.

The management server 40 includes a transmitting/receiving section 41 that communicates with the outside, a storage section 42 that stores image and sound information, a discrimination section 43 that discriminates registered words from sounds, and a sorting section that sorts images. 44.

The transmitting/receiving unit 41 communicates with the camera 10 and the mobile terminal 20 and exchanges predetermined information. The transmitting/receiving unit 41 receives information about images captured by the camera 10 and acquired sounds. The transmitting/receiving unit 41 also accepts registration of words from the mobile terminal 20a, and outputs album information to the mobile terminal 20b.
The storage unit 42 is an example of a storage unit, and acquires and stores an image of a person as an image taken by the camera 10 and audio related to the image. It also stores words registered by the user and album information, which will be described later.

The determining unit 43 is an example of a determining unit, and determines predetermined words from the sounds stored in the storage unit 42. As will be described in detail later, the determining unit 43 determines, for example, whether or not a word registered in advance by the user exists in the sound.

The sorting unit 44 is an example of an output means, and sorts out images corresponding to predetermined words, and outputs the sorted images. The output images are stored in the storage unit 42 as an album. Then, it can be viewed on the mobile terminal 20 by the user's operation.

The transmitter/receiver 41 is, for example, a communication I/F. Further, the storage unit 42 is, for example, a storage. Further, each function of the determining section 43 and the sorting section 44 can be realized by, for example, a CPU.

Next, the operation of the recording system 1 in the first embodiment will be explained in more detail.
FIG. 4 is a flowchart explaining the operation of the recording system 1 in the first embodiment.
First, a user who owns the mobile terminal 20a registers a word as a keyword for creating an album. In this case, the user starts, for example, a dedicated application, and uses the input unit 23 to input words while looking at the display unit 22 of the mobile terminal 20a (step 101). Note that the voice acquisition unit 24 may be used to perform voice input. In the case shown in FIG. 2, this user is user A who owns the mobile terminal 20a.
The input word information is transmitted to the management server 40 from the transmitting/receiving section 21 of the mobile terminal 20a. Then, the transmitting/receiving unit 41 of the management server 40 receives the word information and stores it in the storage unit 42 (step 102).

FIG. 5 is a diagram showing an example of a screen on which a user registers words on the mobile terminal 20a.
In this case, above the display section 22, a message 221 is displayed that reads, "Please enter the keywords necessary to create an electronic album." This is a message asking the user to input a keyword as a word.

A keyword input field 222 is displayed below this message 221, and an album name input field 223 is further displayed below that. The keyword input field 222 is a field for inputting words for creating an album. In this case, "congratulations" is entered in the keyword input field 222. Further, the album name input field 223 is a field for inputting the name of the album to be created. In other words, it is possible to input the name of an album created using the words "Congratulations." In this case, “Birthday Party” is input in the album name input field 223.
Then, when the OK button 224 displayed at the bottom of the display section 22 is pressed from this screen, the entered contents are transmitted to the management server 40. Furthermore, when the cancel button 225 is pressed, the screen returns to the screen that was displayed before this screen, for example.

Returning to FIG. 4, the photographing section 11 of the camera 10 photographs an image in a predetermined photographing range, and the sound acquisition section 12 acquires sounds around the camera 10 (step 103). Then, the transmitter 13 transmits the photographed image and the acquired sound to the management server 40 as transmission information (step 104). This transmission information may include information on the time when images and sounds were acquired, user A's user ID, and the like.
The transmitting/receiving unit 41 of the management server 40 receives the transmitted information and stores it in the storage unit 42 (step 105).
Next, the determining unit 43 analyzes the sound information in the acquired transmission information and determines whether the sound corresponding to the word registered in step 102 is included (step 106).
As a result, if it is not included (No in step 106), the process returns to step 103.
On the other hand, if the word is included (Yes in step 106), the selection unit 44 extracts the image along with the sound corresponding to the word (step 107). Then, the extracted images are arranged, made into an album, and output to the storage unit 42 (step 108). Note that this voice may be the voice of any person. Furthermore, the voice is not limited to a person, and may be a robot's voice or a pet's voice.
The storage unit 42 stores the images and sounds that have been output and made into an album (step 109).

At this time, the selection unit 44 selects images of a predetermined period including images when the identified words are uttered.
FIGS. 6(a) to 6(b) are diagrams showing periods during which the selection unit 44 selects images.
Of these, FIG. 6A is a diagram showing a first example of a period during which the selection unit 44 sorts out images.
Here, the selection unit 44 identifies the person who uttered the identified words, and selects, as the period, images during a period in which the identified person is photographed. That is, the selection unit 44 identifies the person who uttered the sound from the image, and extracts images and sounds during the period in which this person is photographed. In FIG. 6A, the time when the voice was uttered is expressed as time t0, and the selection unit 44 has determined the period ta as this period with time t0 in between.
Further, FIG. 6(b) is a diagram showing a second example of the period during which the sorting unit 44 sorts out images.
Here, the selection unit 44 selects images within a predetermined time range based on the time when the image when the identified word was uttered is taken as the period. In other words, the selection unit 44 has determined the period tb as the period between which the time t0 is defined as the time when the voice was uttered. The period tb consists of a period t1 before the time t0 and a period t2 after the time t0. These periods t1 and t2 are predetermined. Note that the periods t1 and t2 may be determined on the management server 40 side, or may be determined by being input by a user who owns the mobile terminal 20a and transmitted to the management server 40.
In the case of FIGS. 6(a) and 6(b), the sorting unit 44 determines the period with time t0 in between, but it does not include time t0 and sets a period whose starting point or end point is time t0. It's okay.

Furthermore, the extracted images and audio are combined with images and audio extracted during other periods to form one album. This can be done by the sorting section 44. In this case, the sorting unit 44 arranges the selected images and the sounds corresponding to the selected images, for example, in chronological order, and creates an album. This allows images and sounds that are more closely related to each other to be combined into one. However, this does not preclude making it a separate album. For example, if the transmission information was acquired on different dates, it is considered that the relevance is lower, so the information may be placed in a separate album.

Returning to FIG. 4 again, next, the transmitter/receiver 41 determines whether or not there is a request from the user to view the album (step 110). In the case shown in FIG. 2, this user is user B who owns the mobile terminal 20b. In this case, user B starts a dedicated application on the mobile terminal 20b, for example. Then, using the dedicated application, the user uses the input unit 23 while looking at the display unit 22 of the mobile terminal 20b to request viewing of the album.
As a result, if there is no request to view the album (No in step 110), the process returns to step 103.
On the other hand, if there is a request to view an album (Yes at step 110), the transmitting/receiving section 41 reads out the information of the corresponding album from the storage section 42 and transmits it to the mobile terminal 20b (step 111).

The album information is received by the transmitting/receiving section 21 of the mobile terminal 20b, and the contents of the album are displayed on the display section 22 (step 112). Thereby, user B can view the album.

[Second embodiment]
Next, a second embodiment of the recording system 1 will be described. In the second embodiment, a user registers a plurality of words as words in the management server 40, and the management server 40 creates an album based on the plurality of words.

The functional configuration example of the recording system 1 in the second embodiment is the same as that in the first embodiment shown in FIG. 3. Therefore, the operation of the recording system 1 in the second embodiment will be explained using the functional configuration example shown in FIG. 3.
FIG. 7 is a flowchart explaining the operation of the recording system 1 in the second embodiment.
Steps 201 to 205 are similar to steps 101 to 105 shown in FIG. However, in the second embodiment, the user registers words multiple times from the screen illustrated in FIG.

FIGS. 8(a) to 8(b) are diagrams showing the data structure of data stored in the storage unit 42 in step 205 of FIG. 7.
As illustrated in FIG. 8(a), this data structure includes each data of "word", "album name", and "group". Among these, "word" and "album name" are the keyword and album name input by the user in the example of FIG. In this embodiment, since the user registers multiple words, there are multiple words and album names. Here, "Congratulations", "Birthday", "●●-chan", "Happy New Year", and "New Year" are registered as "words", and "Birthday party" and "New Year's party" are registered for each word. This shows cases in which the respective album names correspond. Note that "●●-chan" is, for example, a child's name.

Furthermore, "group" is set for the album name. In the example of FIG. 8A, one group is set for each album name. Here, "1" is set as a group in the album name of "Birthday Party." Further, "2" is set as a group in the album name of "New Year Party". A group is a name given when a plurality of words are grouped together, and if the groups are the same, they are the same group even if the words are different. The result is the same album even though the words are different. In the example shown in FIG. 8A, two types of albums are created: one for group 1 and one for group 2.

In the example of FIG. 8(a), one group is set for each album name, but the invention is not limited to this. In the example of FIG. 8(b), "1" or "2" is set as a group in the album name "Birthday Party". Further, "3" is set as a group in the album name of "New Year Party". In this case, the group corresponding to the words "congratulations" and "birthday" is "1", and the albums created based on these words are the same. However, the group corresponding to the word "●●-chan" is "2", and the album created based on this word is different. The group corresponding to the words "New Year" and "New Year" is "3", and the album created based on these words is yet another. In the example of FIG. 8(b), three types of albums are created for each of groups 1, 2, and 3.
Groups can be set by having the user input them along with keywords and album names on the input screen as shown in FIG.

Returning to FIG. 7, the discrimination unit 43 discriminates a plurality of types of words as predetermined words. That is, it is determined whether or not a voice corresponding to any one of the registered plural types of words is included (step 206).
As a result, if no words are included (No in step 206), the process returns to step 203.
On the other hand, if any of a plurality of types of words is included (Yes in step 206), the selection unit 44 extracts the image along with the audio corresponding to the word (step 207).
Further, the selection unit 44 refers to the storage unit 42 and obtains a group corresponding to the included word (step 208).
Then, an album is created for each group and output to the storage unit 42 (step 209). That is, in the second embodiment, the sorting unit 44 sorts and outputs images for each group set for a plurality of types of words.
Subsequent steps 210 to 213 are the same as steps 109 to 112 in FIG. 4.

[Third embodiment]
Next, a third embodiment of the recording system 1 will be described. In the third embodiment, the management server 40 rather than the user selects a word and creates an album based on this word.

FIG. 9 is a block diagram showing an example of the functional configuration of the recording system 1 in the third embodiment.
The illustrated functional configuration example of the recording system 1 is different from the functional configuration example of the recording system 1 illustrated in FIG. 3 in that a selection unit 45 is added to the management server 40, and the other points are the same. Therefore, the following description will focus on the differences from the first embodiment.

The selection unit 45 is an example of a selection means, and selects predetermined words depending on the state of the object to be photographed. The state of the object to be photographed refers to the state of the photographic scene to be photographed by the camera 10. For example, shooting scenes include parties such as birthday parties, New Year's parties, Christmas parties, and weddings, and events such as meetings and gatherings. Then, words corresponding to this shooting scene are registered in advance in the storage unit 42 of the management server 40, and the selection unit 45 reads out the words stored in the storage unit 42 according to the shooting scene. This is a word that can be used for discrimination.

Next, the operation of the recording system 1 in the third embodiment will be explained.
FIG. 10 is a flowchart explaining the operation of the recording system 1 in the third embodiment.
First, a user who owns the mobile terminal 20a inputs a shooting scene for creating an album (step 301). In this case, the user inputs the shooting scene by using a dedicated application, for example.
The input shooting scene information is transmitted as transmission information from the transmission/reception unit 21 of the mobile terminal 20a to the management server 40. Then, the transmitting/receiving unit 41 of the management server 40 receives the transmitted information, and the selecting unit 45 selects words corresponding to the photographed scene (step 302). Furthermore, the storage unit 42 stores information on the selected word (step 303).

FIG. 11 is a diagram showing an example of a screen for registering a shooting scene on the mobile terminal 20a.
In this case, a message 221 is displayed on the upper side of the display section 22 that reads, "Please select a shooting scene when creating an electronic album." This is a message requesting the user to input a shooting scene.

A shooting scene input field 226 is displayed below this message 221, and an album name input field 223 is further displayed below this. The photographic scene input field 226 is, for example, a pull-down menu, and allows selection from among various displayed photographic scenes. In this case, the shooting scene input field 226 indicates that "party" has been selected. Further, the album name input field 223 is a field for inputting the name of the album to be created. In this case, “Birthday Party” is input in the album name input field 223.
Then, when the OK button 224 displayed at the bottom of the display section 22 is pressed from this screen, the entered contents are transmitted to the management server 40. Furthermore, when the cancel button 225 is pressed, the screen returns to the screen that was displayed before this screen, for example.

Returning to FIG. 10, steps 304 to 313 are similar to steps 103 to 112 shown in FIG.

FIG. 12 is a diagram showing the data structure of the data stored in the storage unit 42 in step 306 of FIG. 10.
As shown in FIG. 12, this data structure includes each data of "shooting scene", "album name", "word", and "group". Among these, "photographing scene" and "album name" are the photographing scene and album name input by the user in FIG. 11. In this embodiment, the words selected by the selection unit 45 according to the shooting scene are registered. Here, when the shooting scene is "party", "congratulations", "birthday", and "marriage" are registered as "words". Further, when the shooting scene is a "New Year's party", "Happy New Year" and "New Year" are registered as "words".

Furthermore, the "group" is the same as in the second embodiment. In this example, one group is set for each album name. Here, "1" is set as a group in the album name of "Birthday Party." Further, "2" is set as a group in the album name of "New Year Party".

In the above example, the selection unit 45 performed the process of selecting words according to the shooting scene selected by the user, but the selection unit 45 recognizes the surrounding situation of its own device and selects words according to the recognized situation. Processing may be performed to select words accordingly. That is, the state of the object to be photographed is inferred from the image photographed by the camera 10 and the sound obtained, and the situation, such as a party or a meeting, is recognized. Then, choose a word that suits the situation and create an album based on this word.

[Fourth embodiment]
Next, a fourth embodiment of the recording system 1 will be described. In the fourth embodiment, the functions of both the camera 10 and the management server 40 are performed by using a robot placed in a residence or the like.

FIG. 13 is a diagram showing a robot 100 used in the third embodiment. Further, FIG. 14 is a block diagram showing an example of the functional configuration of the recording system 1 when the robot 100 is used.
The robot 100 shown in FIG. 13 may be a mobile type that has the function of moving by walking or the like, or may be a non-mobile type that does not move.
The robot 100 has the same functions as the camera 10 shown in FIG. 3. That is, it includes a photographing section 110 corresponding to the photographing section 11 and a microphone 120 corresponding to the sound acquisition section 12. Note that the transmitter 13 is integrated with the transmitter/receiver 41.
Further, the robot 100 includes a communication antenna 130 corresponding to the transmitting/receiving section 41 and a control section 140 corresponding to the storage section 42, the determining section 43, and the sorting section 44.
This robot 100 can do the same things as in the first embodiment.

FIG. 15 is a flowchart explaining the operation of the recording system 1 in the fourth embodiment.
Steps 401 to 403 are similar to steps 101 to 103 in FIG.
Thereafter, in the fourth embodiment, since there is no need to transmit image and sound information to the management server 40, the image and sound acquired in step 403 are stored in the storage unit 42 (step 404).
Steps 405 to 411 are the same as steps 106 to 112 in FIG.

According to the embodiment described in detail above, a pre-registered word is identified from among the sounds acquired by the camera 10, images and sounds when the word is present are extracted, and an album is created. Therefore, it is possible to automatically create an album based on the images and sounds acquired by the camera 10. Therefore, it is possible to create an album of images taken by the camera 10 and sounds acquired, without requiring much time and effort on the part of the user, and with a reduced burden on the user.

Further, in the first to third embodiments described in detail above, the recording system 1 includes the camera 10, the mobile terminals 20a and 20b, and the management server 40, the network 70, the network 80, and the access point 90. However, the management server 40 alone can be treated as a recording system.
Further, in the fourth embodiment, the recording system 1 is configured by connecting the robot 100 and the mobile terminals 20a and 20b via the network 70, the network 80, and the access point 90. 100 alone can be treated as a recording system.

Furthermore, in the example detailed above, when a plurality of cameras 10 are used, it may be determined which camera 10's image or audio is to be selected. Possible selection methods include, for example, selecting an image in which the face of the person who made the sound is photographed, or selecting an image in which the loudest sound is captured.
Further, in the example detailed above, the images to be put into an album are moving images, but they may be still images. Note that in the case of still images, it is not necessary to include audio in the album.

<Program description>
Here, the processes performed by the management server 40 and the robot 100 in this embodiment described above are prepared, for example, as a program such as application software. This processing is realized by cooperation between software and hardware resources. That is, a CPU (not shown) inside a computer provided in the management server 40 or the robot 100 executes a program for realizing each of the above-described functions, thereby realizing each of these functions.

Therefore, in this embodiment, the processing performed by the management server 40 and the robot 100 includes a memory function for acquiring and storing an image of a person and a sound related to the image in the computer; It can be viewed as a program that realizes a discrimination function that identifies predetermined words from sounds stored in the computer, and an output function that selects images that correspond to predetermined words and outputs the selected images. You can also do that.

It should be noted that the program for implementing the present embodiment can of course be provided by communication means, and can also be provided by being stored in a recording medium such as a CD-ROM.

Although the present embodiment has been described above, the technical scope of the present invention is not limited to the scope described in the above embodiment. It is clear from the claims that various changes or improvements made to the above embodiments are also included within the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 1... Recording system, 10... Camera, 20, 20a, 20b... Mobile terminal, 40... Management server, 41... Transmission/reception part, 42... Storage part, 43... Discrimination part, 44... Selection part, 45... Selection part

Claims (3)

a storage means for acquiring and storing an image in which a person is photographed and audio related to the image;
a selection means that receives input of a photographic scene from a user and selects words that are registered in advance and associated with the accepted photographic scene;
Discrimination means for discriminating the selected word from the audio stored in the storage means;
output means for selecting images corresponding to the selected word and outputting the selected images;
has
The output means selects images of a predetermined period including images when the identified words are uttered, identifies the person who uttered the identified words, and determines when the identified person is photographed during the period. A recording system characterized by selecting images from a period of time. 2. The recording system according to claim 1, wherein the output means arranges the selected images and the audio corresponding to the selected images in chronological order and creates an album. to the computer,
a memory function that acquires and stores an image of a person and audio related to the image;
a selection function that accepts input of a shooting scene from a user and selects words that are registered in advance and associated with the accepted shooting scene;
a discrimination function that discriminates the selected word from the audio stored in the memory function;
an output function that selects images corresponding to the selected word and outputs the selected images;
Realize,
The output function selects images from a predetermined period including images when the identified words were uttered, identifies the person who uttered the identified words, and identifies the person who uttered the identified words during the relevant period. A program for sorting images from a given period.