JP6861562B2 - Image sharing system, image sharing server and image sharing method - Google Patents

Description

The present invention relates to an image sharing system, an image sharing server and an image sharing method, and in particular, an image sharing system and an image capable of sharing a still image or a moving image associated with a route from one point to another. Regarding a sharing server and an image sharing method.

Conventionally, the image information is stored in the storage unit together with the imaged position (imaging position) and the imaging time, the locus of the imaging position is displayed on the map, and when the user points out one point on the map, the image closest to that point is captured. A playback device that reads video information having a position from a storage unit and reproduces the read video information is known (see Patent Document 1).

In the playback device of Patent Document 1, when a plurality of video information is searched from the storage unit, the vicinity of the point pointed out by the user on the map is enlarged and displayed to give the user an opportunity to select the video information to be played back. There is.

Japanese Unexamined Patent Publication No. 2009-147542

However, in the technique of Patent Document 1, when a large amount of video information is searched, the user has to select a video to be reproduced from the large amount of video information, which may cause annoyance to the user. there were.

Therefore, an object of the present invention is to provide an image sharing system, an image sharing server, and an image sharing method that can reduce or eliminate the annoyance of viewers when sharing still images or moving images associated with a route. To do.

The image sharing system of the present invention
A holding unit that holds a still image or a moving image posted by each contributor and a first route as a route associated with the still image or the moving image.
A route designation reception unit that accepts the designation of arbitrary routes,
An image display unit that displays an image and
A route search unit for searching said first path with overlap over a predetermined length or more in the second path is a path that is specified through the routing acceptance unit from said holding portion,
Displaying a first path display of a portion or all of the route search unit according to the first path for each first path found by the search, and map information, a still image or a moving associated with said first path It is characterized by including a display control unit for displaying a reproduction instruction display, which is a display for receiving an image display or a reproduction instruction of a moving image associated with the first path, on the image display unit.

According to the image sharing system having this configuration, the route search unit searches the holding unit for a moving image having a first route that overlaps with the second route over a predetermined length.

Here, when the first route overlaps with the second route over a predetermined length, the number of still images or moving images searched is narrowed down from the moving images corresponding to the designated one point.

In addition, the display control unit displays the first route display and map information on the image display unit. As a result, the viewer can easily grasp the position on the map of the first route related to the still image or the moving image. Further, the display control unit displays an image display for displaying the still image or moving image associated with the first path, or a reproduction instruction interface which is an interface for reproducing the moving image on the image display unit. The viewer can easily view the still image or the moving image, or give an instruction to play the moving image.

As described above, according to the image sharing system of the present invention, the viewer can easily grasp the map of the first route related to the moving image while narrowing down the moving images to be searched, and the viewer can easily grasp the map. , Still images or moving images can be viewed, or moving images can be instructed to play. Therefore, according to the image sharing system of the present invention, it is possible to reduce or eliminate the annoyance of the viewer when sharing the still image or the moving image associated with the route.

In the image sharing system of the present invention
The holding unit holds the moving image and the path associated with the moving image as the first path, and holds the moving image.
The first route display includes a display showing a local route which is a part of the first route.
It is preferable that the image display displays a local moving image that is a partial moving image of the moving image, or the playback instruction interface includes an interface for receiving a reproduction instruction of the local moving image.

According to the image sharing system having this configuration, a display indicating a local route and an image display for displaying a local moving image or an interface for receiving a reproduction instruction of the local moving image are displayed on the image display unit. This makes it possible to give the viewer an option for viewing the local moving image or playing the local moving image while recognizing the local route.

Here, if it takes a long time to play the moving image, the viewer may feel annoyed. However, according to the image sharing system having the configuration, the local moving image is a part of the moving image, so that the playing time should be shortened. It is possible to reduce or eliminate the annoyance of the viewer.

In the image sharing system of the present invention
The moving image is a moving image captured during the movement of the first path, and is a moving image.
The first path is given a direction of movement in the moving image.
The route designation reception unit receives the direction designation together with the route,
It is preferable that the route search unit is configured to search the first route to which the same movement direction as the designated direction of the second route is given.

When viewing a moving image captured during movement, the direction of movement is important. However, according to the image sharing system having the configuration, the first path is given the same direction of movement as the designated direction of the second path. Is searched. As a result, a route in the same direction of movement as the direction specified by the viewer of the moving image is searched for. The direction of movement in the moving image associated with the route is the same as the direction specified by the viewer of the moving image. As a result, the moving image is shared in consideration of the direction desired by the viewer of the moving image.

In the image sharing system of the present invention
Equipped with a posting reception section that accepts video postings
The local moving image is preferably a part of the moving image designated by the poster of the moving image.

According to the image sharing system having the configuration, the display of the route corresponding to the part of the video specified by the poster of the video is output, and the local video or the interface for receiving the playback instruction of the local video is output. To. As a result, the viewer can easily watch the video (local video) of the part specified by the video poster while recognizing the route corresponding to the video part specified by the video poster. Become.

Since it is presumed that the part of the video specified by the video contributor is the part of the video that you want to share in particular, it is possible to facilitate the sharing of the video in a manner that is in line with the intention of the video contributor. Since the playback time can be shortened, it is possible to reduce or eliminate the annoyance of the viewer.

Overall configuration diagram of the first embodiment. The figure which shows the structure of the mobile body and 1st terminal in 1st Embodiment. The figure which shows the structure of the 2nd terminal in 1st Embodiment. The figure which shows the structure of the image sharing server in 1st Embodiment. The flowchart of the moving image posting process in 1st Embodiment. The flowchart of the posted information recognition processing in 1st Embodiment. The figure which shows an example of the posting screen in 1st Embodiment. The figure which shows the example of the posting screen which accepts the input of the posting information in 1st Embodiment. The flowchart of the posted moving image viewing process in 1st Embodiment. The figure which shows the search screen in 1st Embodiment. The figure which shows the search result screen in 1st Embodiment. The flowchart of the route search process in 1st Embodiment. The flowchart of the local moving image recognition processing in 2nd Embodiment. The figure which shows an example of the imaged road in 2nd Embodiment. The figure which shows the structure of the mobile body and 1st terminal in 3rd Embodiment. The flowchart of the local moving image recognition processing in 3rd Embodiment. The figure which shows the structure of the image sharing server in 4th Embodiment. The flowchart of recommendation list screen output processing in 4th Embodiment. The figure which shows the 1st recommendation list screen in 4th Embodiment. The figure which shows the 2nd recommendation list screen in 4th Embodiment.

(First Embodiment)
The first embodiment of the present invention will be described with reference to FIGS. 1 to 12.

In the first embodiment, the image sharing system includes a first terminal 21, a second terminal 22, and an image sharing server 3 mounted on the mobile body 1. The first terminal 21, the second terminal 22, and the image sharing server 3 are connected to each other so as to be able to communicate with each other via a network such as a wireless communication network.

(Composition of mobile body)
The moving body 1 has an operating unit of each part (not shown), an operating unit (actuator or operating mechanism) thereof, and a detecting unit that detects and detects the state of each unit or the operating unit thereof.

That is, the moving body 1 is equipped with a sensor unit 10 that outputs a signal indicating each state of the moving body 1 and a first terminal 21 connected to the sensor unit.

Further, the vehicle as the moving body 1 has a power source (not shown), and has an ignition switch or a start button which is a part of a switch mechanism for starting and stopping the power source.

An internal combustion engine or an electric motor is used as a power source. Further, natural energy generated by a fuel cell or solar power generation may be used.

Further, the vehicle as the moving body 1 has an accelerator, a braking device, and a steering device (not shown), and starts, accelerates, steers, decelerates, and stops.

The sensor unit 10 includes a GPS sensor 11 that acquires the current position of the moving body 1 by receiving a signal from a GPS (Global Positioning System) satellite, and a vehicle speed sensor 12 that acquires the moving speed of the moving body 1, here the vehicle. The gyro sensor 13 for acquiring the angular velocity of the moving body 1 and the ignition switch sensor 14 for acquiring the on / off state of the ignition switch of the moving body 1 are provided. The sensor unit 10 is configured to acquire operation instructions such as accelerator, brake, or steering for the moving body 1 and other device information mounted on the moving body 1 by a sensor (not shown). The sensor unit 10 is configured to output the acquired information to the first terminal 21. The GPS sensor 11 corresponds to the "position recognition unit" of the present invention.

(Configuration of first terminal)
The first terminal 21 is an information terminal whose size, shape, and weight are designed so that it can be carried by a user, such as a tablet terminal or a smartphone as a mobile station. The first terminal 21 is installed on the moving body 1 so that the periphery (for example, the front of the moving body 1) or the inside of the moving body 1 can be imaged. For example, when the moving body 1 is a four-wheeled vehicle, the first terminal 21 may be installed on the dashboard of the moving body 1 so that the front of the moving body 1 can be imaged.

The information that the first terminal 21 is designed to be mounted on the mobile body 1 on which the first user U1 (the occupant of the mobile body) of the first terminal 21 is boarded, for example, a standardized 1-2 DIN or the like. It may be configured by a terminal. The first user U1 corresponds to an example of "poster of video".

The first terminal 21 includes a first terminal control unit 211, a first terminal storage unit 212, a first terminal output unit 213, a first terminal input unit 214, a first terminal communication unit 215, and a first terminal timekeeping unit 216. There is. The first terminal 21 not only has a component inside the device, but also has a component outside the device like the GPS sensor 11 described above, and recognizes necessary data via wired communication or wireless communication. It may be configured as follows.

Note that one device "recognizes" information means that one device receives the information from another device, and one device receives information stored in a storage medium such as the first terminal storage unit 212. Reading, one device acquiring information based on a signal output from a sensor such as GPS sensor 11, one device is stored in the received information or a storage medium such as the first terminal storage unit 212. Derivation of the information by executing a predetermined arithmetic process (calculation process, search process, etc.) based on the information or information acquired from a sensor such as the GPS sensor 11, one device performs arithmetic processing by another device. All arithmetic processing to acquire the information, such as receiving the resulting information from the other device, one device reading the information from the internal storage device or the external storage device according to the received signal, etc. Means to be executed.

The first terminal control unit 211 is composed of a processor such as a CPU. An image sharing program is installed in the first terminal 21. When the image sharing program is activated, the first terminal control unit 211 is configured to read software and data from the first terminal storage unit 212 as necessary and then execute arithmetic processing described later. .. A part or all of the first terminal control unit 211 may be configured by an external server or the like capable of communicating via the first terminal communication unit 215. The first terminal control unit 211 corresponds to an example of the "post reception unit" of the present invention.

The first terminal control unit 211 transmits / receives information to / from the sensor unit 10, the first terminal storage unit 212, the first terminal output unit 213, the first terminal input unit 214, the first terminal communication unit 215, and the first terminal timekeeping unit 216. It is configured to be possible.

The first terminal storage unit 212 is composed of a storage device such as a RAM, a ROM, or an HDD, and is configured to record various information. The first terminal storage unit 212 is configured to be able to store and read data used in arithmetic processing by the first terminal control unit 211. A part or all of the first terminal storage unit 212 may be configured by an external storage server or the like capable of communicating via the first terminal communication unit 215.

The first terminal storage unit 212 stores map information 2121 and moving image information 2122.

The map information 2121 is information including position information such as latitude and longitude of roads and facilities, and POI (Point Of Interest). The map information 2121 includes a column of coordinate values ((latitude, longitude) or (latitude, longitude, altitude)) representing the positions, shapes, attitudes, etc. of each of a plurality of roads and road sections constituting the road network. , Road identification information for identifying each section and data representing attributes are included. Each section is connected to another road section at one end or both ends. Map information 2121 may include road features (sharp curves, steep slopes, poor visibility, frequent accidents, etc.).

In addition, in this specification, the term "road" is used to mean the road displayed on the map or each road that actually exists. Further, in the present specification, the term "road section" means a road having a certain length, such as a road from one intersection to an adjacent intersection. Each section is defined so that it does not overlap with other sections.

Further, in the present specification, the term "route" refers to a road for traveling from one point to another, that is, a road that encourages (guides) the user to pass, a road that the user is passing through, or a user. Is used to mean the road that has passed in the past. In addition, each route is represented by a set of coordinate values of each road included in the map information. Further, each route may be represented by a set of coordinate values of each section included in the map information.

The moving image information 2122 includes a moving image captured by the first terminal imaging unit 2141 of the first terminal input unit 214, an imaging date that is the imaging date, an imaging time that is the imaging time, and an imaging that is the position at the time of imaging. Information including the position. The imaging date and imaging time are the dates and times acquired from the first terminal timekeeping unit 216. The imaging position may be position information represented in two dimensions of latitude and longitude acquired from the GPS sensor 11, or may be three-dimensional information to which height is added.

The first terminal output unit 213 includes a first terminal image display unit 2131 and a first terminal audio output unit 2132.

The first terminal image display unit 2131 is composed of, for example, a liquid crystal panel. The first terminal image display unit 2131 is configured to display an image in response to a signal input from the first terminal control unit 211.

The first terminal audio output unit 2132 is composed of, for example, a speaker. The first terminal audio output unit 2132 is configured to output audio in response to a signal input from the first terminal control unit 211.

In addition to these, the first terminal output unit 213 may include a device that outputs information that can be recognized through the five senses of the user, such as an odor generator and a vibration generator.

The first terminal input unit 214 includes a first terminal imaging unit 2141, a first terminal operation detection unit 2142, and a first terminal voice recognition unit 2143.

The first terminal imaging unit 2141 is composed of, for example, a camera arranged at a predetermined position of the first terminal 21. The first terminal imaging unit 2141 is configured to image a moving image and output a signal corresponding to the captured moving image to the first terminal control unit 211.

The first terminal operation detection unit 2142 is composed of, for example, a touch pad, a button, a keyboard, a mouse, or the like. The first terminal operation detection unit 2142 is configured to detect the user's operation and output a signal corresponding to the touch operation to the first terminal control unit 211. A touch pad as the first terminal operation detection unit 2142 and a liquid crystal panel as the first terminal image display unit 2131 may be combined to form a touch panel.

The voice recognition unit 2143 of the first terminal is composed of, for example, a microphone. The first terminal voice recognition unit 2143 is configured to recognize the voice emitted by the user and output a signal corresponding to the voice to the first terminal control unit 211.

The first terminal communication unit 215 includes a first terminal short-range wireless communication unit 2151 and a first terminal wireless communication network communication unit 2152.

The first terminal short-range wireless communication unit 2151 is a device mounted on the mobile body 1 or the mobile body 1 via a wireless LAN or the like in the mobile body 1 according to a communication standard suitable for wired or short-range wireless communication. For example, it is configured to communicate with the sensor unit 10).

The first terminal wireless communication network communication unit 2152 is configured to communicate with an external terminal such as an image sharing server 3 according to a communication standard suitable for long-distance wireless communication such as WiFi (registered trademark).

The first terminal timekeeping unit 216 is configured to recognize the current time by communicating with, for example, an NTP (Network Time Protocol) server. The first terminal timekeeping unit 216 may recognize the current time by the signal received from the GPS sensor 11.

(Configuration of second terminal)
The second terminal 22 is an information terminal whose size, shape, and weight are designed so that it can be carried by a user, such as a tablet terminal or a smartphone as a mobile station.

Information in which the size of the second terminal 22 is designed so that it can be mounted on the mobile body 1 on which the second user U2 (the occupant of the mobile body) of the second terminal 22 is boarded, for example, a standardized 1-2 DIN or the like. It may be configured by a terminal. Further, the second terminal 22 may be configured as a fixed station by, for example, a desktop computer.

The second user U2 corresponds to an example of a “video viewer”.

The second terminal 22 includes a second terminal control unit 221, a second terminal storage unit 222, a second terminal output unit 223, a second terminal input unit 224, a second terminal communication unit 225, and a second terminal timekeeping unit 226. There is. The second terminal 22 may be configured not only to have a component inside the device but also to have a component outside the device so as to recognize necessary data via wired communication or wireless communication.

The second terminal control unit 221 is composed of a processor such as a CPU. An image sharing program is installed in the second terminal 22. When the image sharing program is activated, the second terminal control unit 221 is configured to read data from the second terminal storage unit 222 and then execute the arithmetic processing described later. A part or all of the second terminal control unit 221 may be configured by an external server or the like capable of communicating via the second terminal communication unit 225.

The second terminal control unit 221 corresponds to an example of the "route designation reception unit" and "display control unit" of the present invention.

The second terminal control unit 221 can transmit and receive information to and from the second terminal storage unit 222, the second terminal output unit 223, the second terminal input unit 224, the second terminal communication unit 225, and the second terminal timekeeping unit 226. It is configured.

The second terminal storage unit 222 is composed of a storage device such as a RAM, a ROM, or an HDD, and is configured to record various information. The second terminal storage unit 222 is configured to be able to store and read data used in arithmetic processing by the second terminal control unit 221. A part or all of the second terminal storage unit 222 may be configured by an external storage server or the like capable of communicating via the second terminal communication unit 225.

The second terminal storage unit 222 stores the map information 2221 and the reference moving image information 2222.

The map information 2221 is information including position information such as latitude and longitude of roads and facilities, and POI (Point Of Interest). The map information 2221 includes a column of coordinate values ((latitude, longitude) or (latitude, longitude, altitude)) representing the positions, shapes, attitudes, etc. of each of a plurality of roads and road sections constituting the road network. , Road identification information for identifying each section and data representing attributes are included. Each section is connected to another road section at one end or both ends. The map information 2221 may include road features (sharp curves, steep slopes, poor visibility, frequent accidents, etc.).

The reference moving image information 2222 is information on the moving image registered by the second user, and is mainly information on the moving image to be played together with the guidance of the route.

The second terminal output unit 223 includes a second terminal image display unit 2231 and a second terminal audio output unit 2232.

The second terminal image display unit 2231 is composed of, for example, a liquid crystal panel. The second terminal image display unit 2231 is configured to display an image in response to a signal input from the second terminal control unit 221. The second terminal image display unit 2231 corresponds to an example of the "image display unit" of the present invention.

The second terminal audio output unit 2232 is composed of, for example, a speaker. The second terminal audio output unit 2232 is configured to output audio in response to a signal input from the second terminal control unit 221.

In addition to these, the second terminal output unit 223 may include a device that outputs information that can be recognized through the five senses of the user, such as an odor generator and a vibration generator.

The second terminal input unit 224 includes a second terminal imaging unit 2241, a second terminal operation detection unit 2242, and a second terminal voice recognition unit 2243.

The second terminal imaging unit 2241 is composed of, for example, a camera arranged at a predetermined position of the second terminal 22. The second terminal imaging unit 2241 is configured to capture a moving image and output the signal corresponding to the captured moving image to the second terminal control unit 221.

The second terminal operation detection unit 2242 is composed of, for example, a touch pad, a button, a keyboard, a mouse, or the like. The second terminal operation detection unit 2242 is configured to detect the user's operation and output a signal corresponding to the touch operation to the second terminal control unit 221. A touch pad as the second terminal operation detection unit 2242 and a liquid crystal panel as the second terminal image display unit 2231 may be combined to form a touch panel.

The second terminal voice recognition unit 2243 is composed of, for example, a microphone. The second terminal voice recognition unit 2243 is configured to recognize the voice emitted by the user and output a signal corresponding to the voice to the second terminal control unit 221.

The second terminal communication unit 225 includes a second terminal short-range wireless communication unit 2251 and a second terminal wireless communication network communication unit 2252.

The second terminal short-range wireless communication unit 2251 is a device mounted on the mobile body 1 or the mobile body 1 via a wireless LAN or the like in the mobile body 1 according to a communication standard suitable for wired or short-range wireless communication. For example, it is configured to communicate with the sensor unit 10).

The second terminal wireless communication network communication unit 2252 is configured to communicate with an external terminal such as an image sharing server 3 in accordance with a communication standard suitable for long-distance wireless communication such as WiFi (registered trademark).

The second terminal timekeeping unit 226 is configured to recognize the current time by communicating with, for example, an NTP (Network Time Protocol) server. The second terminal timekeeping unit 226 may recognize the current time by the signal received from the GPS sensor 11.

(Image sharing server configuration)
The image sharing server 3 is composed of a computer as a fixed station, and includes a server control unit 31, a server holding unit 32, and a server communication unit 35. The image sharing server 3 may be configured by a portable terminal device such as a smartphone or tablet as a mobile station.

An image sharing program is installed on the image sharing server 3.

The server control unit 31 is composed of an arithmetic processing unit (CPU) that reads data from the server holding unit 32 as necessary and then executes arithmetic processing according to an image sharing program for the data. The details of the arithmetic processing will be described later. The server control unit 31 corresponds to an example of the "route search unit" of the present invention.

The server holding unit 32 is composed of a storage device such as a RAM, a ROM, or an HDD, and is configured to store and hold arithmetic processing results such as received information and calculation results by each of the server control units 31. The server holding unit 32 holds the moving image information 321 and the map information 322. The server holding unit 32 corresponds to the "holding unit" of the present invention.

The moving image information 321 is information about a moving image captured by a camera or the like mounted on the moving body. The server holding unit 32 holds moving image information 321 for each of the plurality of moving images.

In the present embodiment, each moving image is a moving image captured by a camera mounted on a moving body that actually travels on a certain route. Alternatively or additionally, each moving image may be a moving image simulating the running of a certain route, or may be a moving image of a virtual character traveling on a certain route such as a movie or an animation. It is preferable that each moving image is a moving image corresponding to a practical route.

In the present embodiment, each moving image is a moving image posted by a plurality of users including the first user U1 of the first terminal 21. Alternatively or additionally, the moving image may be a moving image prepared by the owner or administrator of the image sharing server 3.

The moving image information 321 includes moving image image 3211, imaging position log 3212, local moving image information 3213, local route information 3214, tag information 3215, title information 3216, imaging seasonal information 3217, imaging time zone information 3218, comment 3219, and reliability evaluation. Values 3220 are associated with each other for each video. For example, for one moving image, the moving image data of the one moving image, the imaging position log of the one moving image, the local moving image information of the one moving image, the local route information of the one moving image, the tag information of the one moving image, The title information of the one moving image, the imaging season information of the one moving image, the imaging time zone information of the one moving image, and the reliability evaluation value of the one moving image are associated with each other. The moving image information 321 may include audio accompanying the moving image.

The moving image 3211 includes a plurality of still image images constituting one moving image (hereinafter, referred to as “target moving image”). The moving image information 321 may include link information (URL (Uniform Resource Locator)) for playing back the target moving image instead of the moving image image 3211.

The imaging position log 3212 is a log of the time-series position (coordinate value) of the moving body in which the target moving image is captured. In addition to or in place of the imaging position log 3212, the combination of each link and each node included in the map information 322 may be stored. In the following, the time-series position of the moving body in which the target moving image is captured is referred to as a “target path”. The target route includes information on the moving direction, which is the direction in which the moving body moves.

The local moving image information 3213 includes information for playing a part of the moving image of the target moving image (hereinafter, referred to as “target local moving image”) designated by the poster of the target moving image. An example of information for playing the target local video is to specify one or both of the start time and the end time of the target local video in the video, such as 2 minutes 5 seconds to 2 minutes 55 seconds after 3 minutes. Information.

The local route information 3214 is information indicating a route corresponding to the target local moving image (hereinafter, referred to as “target local route”). The example of the local route information 3214 is information including one or both of the start position and the end position of the target local route in the target route.

The tag information 3215 is a set of one or a plurality of character strings attached to represent the target local moving image. For example, character strings such as "autumn leaves", "gentle curve", and "rain" may be attached to the target local moving image as tag information 3215. The tag information 3215 may be attached by the poster of the target moving image or by the viewer of the target moving image as described later.

The title information 3216 is a character string representing the title of the target local moving image. For example, a character string such as "drive a gentle curve surrounded by autumn leaves in the rain" may be attached to the target local moving image as title information 3216. The title information 3216 may be attached by the poster of the target moving image or by the viewer of the target moving image as described later.

The imaging season information 3217 is information regarding the season in which the target moving image recognized from the imaging date of the target moving image is captured, and is, for example, "spring", "early summer", "late autumn", and "midwinter".

The imaging time zone information 3218 is information related to the time zone in which the target moving image is imaged, which is recognized from the imaging time of the target moving image, and is, for example, "7:00 to 8:00", "early morning", "daytime", and "night". is there.

The comment 3219 is a comment on the target moving image or the target local moving image input by the user.

The reliability evaluation value 3220 is an evaluation value of reliability as to whether or not the target moving image and the target local moving image correspond to the target route and the target local route. The method of calculating the reliability evaluation value will be described later.

The map information 322 includes position information such as latitude and longitude of roads and facilities, and POI (Point Of Interest). The map information 322 includes a column of coordinate values ((latitude, longitude) or (latitude, longitude, altitude)) representing the positions, shapes, attitudes, etc. of each of a plurality of roads and road sections constituting the road network. , Road identification information for identifying each section and data representing attributes are included. Each section is connected to another road section at one end or both ends. The map information 322 may include road features (sharp curves, steep slopes, poor visibility, frequent accidents, etc.).

As another aspect, a part or all of the moving image information 321, a part or all of the map information 322, or each of them may be managed by an independent server and operated to be provided to the user. In this case, the server holding unit 32 can hold link information such as the URL of each server for accessing each moving image and map. Then, the image sharing server 3 acquires a moving image or a map as needed and provides it to the terminal of the user who wants to browse. This makes it possible to reduce the processing load and management load of the image sharing server 3.

In this way, holding link information for accessing information such as moving images, still images, and route information stored in a server separate from the image sharing server 3 also corresponds to "holding" of the present invention.

(Video posting process)
The outline of the moving image posting process executed by the first terminal 21 and the image sharing server 3 will be described with reference to FIG. This process can be executed, for example, in a scene in which the first user U1 of the first terminal 21 drives into the moving body 1, captures a moving object, stops the moving body 1, and then posts the captured moving object.

The first terminal control unit 211 of the first terminal 21 is referred to as a moving image while moving by the moving body 1 imaged by the first terminal imaging unit 2141 (hereinafter, referred to as “posted moving image” in the present process and the posted information recognition process. ) Is stored in the moving image information 2122 (FIG. 5 / STEP002). The first terminal control unit 211 is acquired by the GPS sensor 11 and at least the date and time at the time when the imaging is started and the time when the imaging is started, which is measured by the first terminal timekeeping unit 216 during the imaging of the posted moving image. The moving image information 2122 stores the time-series positions from the time when the imaging is started to the time when the imaging is started.

Examples of the time when the imaging of the posted video is started are the time when the imaging function of the first terminal imaging unit 2141 is started, and the first terminal control unit 211 is from the GPS sensor 11, the vehicle speed sensor 12, the gyro sensor 13, and the like. When it is determined that the moving body 1 has started moving based on the output of, and when it is determined that the power source of the moving body 1 has started based on the output from the ignition switch sensor 14, the door switch sensor (not shown) The time when it is determined that the door is opened or closed based on the output can be mentioned.

Examples of the time when the imaging of the posted video is completed include the time when the imaging function of the first terminal imaging unit 2141 is stopped, and the first terminal control unit 211 from the GPS sensor 11, the vehicle speed sensor 12, the gyro sensor 13, and the like. Door switch sensor (not shown) when it is determined that the moving body 1 has stopped for a predetermined time or longer based on the output of the moving body 1 and when it is determined that the power source of the moving body 1 has stopped based on the output from the ignition switch sensor 14. Based on the output of, the time when it is determined that the door has been opened or closed can be mentioned.

The first terminal control unit 211 executes the posting information recognition process (FIG. 5 / STEP004). The first terminal control unit 211 recognizes the information to be transmitted to the image sharing server 3 (hereinafter, referred to as “posted information”) by the posted information recognition process.

The posted information includes a user ID for identifying the first user U1 of the first terminal 21, an image constituting the posted video, a file showing the time-series transition of the imaging position, and a posted local video that is a part of the posted video. Includes information indicating, information on the posted local route indicating the route corresponding to the posted local video, tag information and title information attached to the posted local video, imaging date, imaging time, comment on the posted video or posted local video. There is. When the posted video is uploaded to an image sharing server different from the image sharing server, the first terminal control unit 211 includes the URL for playing the posted video in the posted information instead of the images constituting the posted video. You may.

The "posted local moving image" of the first embodiment corresponds to an example of the "part of the moving image designated by the poster of the moving image" of the present invention.

The first terminal control unit 211 may be configured to execute the process of FIG. 5 / STEP004 at the time when the imaging of the posted moving image is completed, for example.

The first terminal control unit 211 transmits the posted information to the image sharing server 3 (FIG. 5 / STEP006).

The server control unit 31 of the image sharing server 3 determines whether or not the posted information has been received (FIG. 5 / STEP052).

When the server control unit 31 receives the posted information (FIG. 5 / STEP052 ... YES), the server control unit 31 uses a table showing the correspondence between the date and the season and the correspondence between the time and the time zone from the imaging date and the imaging time included in the posting information. The season and time zone in which the image was taken are recognized with reference to the table showing (Fig. 5 / STEP054).

The server control unit 31 calculates the evaluation value of the reliability of the posted information (FIG. 5 / STEP056). The server control unit 31 highly evaluates the reliability when the posting route is specified together with the posted video. Further, the server control unit 31 may use the average value of the reliability of the past posted moving images posted by the first user U1 of the first terminal 21 as the reliability evaluation value.

The server control unit 31 causes the server holding unit 32 to hold each information included in the posted information, the season in which the image was taken, the time zone, and the evaluation value of reliability (FIG. 5 / STEP058).

By the video posting process described above, the posted video and its related information are stored in the image sharing server 3.

(Posted information recognition processing)
The posted information recognition process executed by the first terminal 21 will be described with reference to FIGS. 6 to 8.

This process is a process in which execution is started when the imaging of the posted video is completed, and even if the first user U1 of the first terminal 21 does not perform any special operation, the first terminal control unit 211 can perform the posted video. I am aware of.

The first terminal control unit 211 of the first terminal 21 outputs the posting screen P1 shown in FIG. 7 to the first terminal image display unit 2131 (FIG. 6 / STEP102).

The posting screen P1 includes a posting screen map P11, a route addition button P111, and a spot addition button P112.

The posting screen map P11 is a map created from the map information 2121. In addition to or instead of this, the posting screen map P11 may be a map downloaded by the first terminal control unit 211 from an external map server or the like via the first terminal communication unit 215.

The first terminal control unit 211 detects the pressing operation of the route addition button P111 via the first terminal operation detection unit 2142 to execute the processes of FIGS. 6 / STEP106 to STEP112, which will be described later.

Further, although not shown, the first terminal control unit 211 detects a pressing operation of the spot addition button P112 via the first terminal operation detection unit 2142 to specify a point on the map by the first user U1. , Accepts comments. These points and comments are included in the posted information and transmitted to the image sharing server 3.

When the first terminal control unit 211 detects the pressing operation of the route addition button P111 via the first terminal operation detection unit 2142 (FIG. 6 / STEP104 ... YES), the imaging start point, which is the point at which the imaging of the posted video is started. And a screen for inputting the imaging end point, which is the imaging end point of the posted video, is displayed (FIG. 6 / STEP106).

When the first terminal control unit 211 recognizes the input of the imaging start point and the imaging end point via the first terminal operation detection unit 2142 (FIG. 6 / STEP108 ... YES), the first terminal control unit 211 refers to the map information 2121 and two of them. By searching for a route connecting the points, the posting route, which is a route related to the posted video, is recognized (Fig. 6 / STEP110). When a plurality of routes are searched, the first terminal control unit 211 may request the user to input to select the route. The first terminal control unit 211 may omit the processing of FIGS. 6 / STEP106 to 6 / STEP108 and recognize the posting route based on the imaging position. Further, the "posting route" corresponds to an example of the "first route" of the present invention.

As shown in FIG. 8, the first terminal control unit 211 outputs the posting screen P1 to which the posting route display P121 and the input boxes P122 to P125 for receiving the input of various information are added to the first terminal image display unit 2131. (Fig. 6 / STEP112). The posting route display P121 is a display indicating the posting route. In the input box, a title input box P122 for inputting a title, an imaging date / time input box P123 for inputting an imaging date and an imaging time, a tag information input box P124 for inputting tag information, and an imaging position log file. A log file input box P125 for specifying is included. The first terminal control unit 211 may display the image pickup date and time input box P123 in a state of being input based on the image pickup date and the image pickup time included in the moving image information 2122.

When the first terminal control unit 211 detects a pressing operation on two of the posting route display P121 via the first terminal operation detection unit 2142 (FIG. 6 / STEP114 ... YES), the route between the two locations. Is recognized as a posting local route that is a part of the posting route (Fig. 6 / STEP116).

The first terminal control unit 211 recognizes the posted local moving image, which is a part of the posted moving image corresponding to the posted local path, from the imaging position at each imaging time (FIG. 6 / STEP118).

The first terminal control unit 211 outputs the post screen P1 to which the post local route display P126 indicating the post local route and the comment input box P127 for inputting a comment are added to the first terminal image display unit 2131 (FIG. 6). / STEP120).

The first terminal control unit 211 recognizes the information input to the input boxes P122 to P125 and P127 (FIG. 6 / STEP122).

When the image of the posted video is not included in the posted information, the first terminal control unit 211 sets the URL input box P128 for designating the URL of the video uploaded to another video server or the like in the first terminal image display unit. It may be output to 2131.

By the posted information recognition process described above, the posted information transmitted to the image sharing server 3 is recognized.

(Posted video viewing process)
Next, the posted video viewing process executed by the second terminal 22 and the image sharing server 3 will be described with reference to FIGS. 9 to 11.

In the posted video viewing process, for example, when the second user U2 of the second terminal 22 departs for a trip or the like, after determining the departure place and the destination, what kind of route is taken while viewing the video. This is a useful process when you want to consider whether or not you want to check the route you are going to take in advance.

The second terminal control unit 221 of the second terminal 22 outputs the search screen P2 shown in FIG. 10 to the second terminal image display unit 2231 (FIG. 9 / STEP202). On the search screen P2, the map P21, the scheduled travel date input box P22 for inputting the scheduled travel date, the travel time zone input box P23 for inputting the approximate time zone for travel, And a search tag information input box P24 for inputting tag information for search is included.

The second terminal control unit 221 of the second terminal 22 determines whether or not the input of the first search information is detected via the second terminal operation detection unit 2242 (FIG. 9 / STEP204).

The first search information includes a search route that is a route that is a basis of the search, and information input to each of the input boxes P22 to P24. The search route can be recognized as a route connecting the two points by designating the two points on the map P21. When there are a plurality of routes connecting the two points, the second terminal control unit 221 may cause the second user U2 to select one or a plurality of routes, or all the routes may be used as search routes. Good. Further, as shown in FIG. 10, the second terminal control unit 221 may add the display P25 indicating the recognized search route to the search screen P2 and output it to the second terminal image display unit 2231. The second terminal control unit 221 may include the moving direction in the search route in the first search information by setting the first designated point as the starting point and the second designated point as the destination. The second terminal control unit 221 may include the moving direction in the search route in the first search information according to the direction specified separately.

The search route corresponds to an example of the "second route" of the present invention.

When the determination result of FIG. 9 / STEP204 is affirmative (FIG. 9 / STEP204 ... YES), the second terminal control unit 221 transmits the first search information to the image sharing server 3 via the second terminal communication unit 225. (Fig. 9 / STEP206).

When the server control unit 31 of the image sharing server 3 receives the first search information (FIG. 9 / STEP252 ... YES), the server control unit 31 executes the route search process (FIG. 9 / STEP254). The details of the route search process will be described later, but the image sharing server 3 refers to the video information 321 of the server holding unit 32, and is a route associated with the posted video and the posted video, which are already posted videos. Recognize the posted video route, the posted local video that is a part of the posted video, the posted local route that is the route corresponding to the posted local video, and the comment for the posted local video as the search result. The search result may include an evaluation value of the reliability of the posted video.

The server control unit 31 transmits the search result to the second terminal 22 (FIG. 9 / STEP256).

When the second terminal control unit 221 of the second terminal 22 receives the search result (FIG. 9 / STEP208 ... YES), the second terminal control unit 221 outputs the search result screen P3 to the second terminal image display unit 2231 as shown in FIG. (Fig. 9 / STEP210).

On the search result screen P3, a map P31 configured based on the map information 2221, a search route display P321 indicating the search route, and a recommended route display P322 indicating a recommended route different from the search route are searched. The posted local route display P331 to P333 indicating each posted local route, the buttons P341 to P343 for instructing the playback of the posted local video, and the comment interface P351 to P353 for accepting comments on the posted local video. And include. The search result screen P3 may include a display indicating an evaluation value of reliability of the posted video. Each of the posted local route display P331 to P333 corresponds to an example of the "first route display" and "display indicating the local route" of the present invention. Each of the buttons P341 to P343 for instructing the reproduction of the posted local moving image corresponds to an example of the "interface for receiving the playing instruction of the local moving image" of the present invention.

When the second terminal control unit 221 detects the pressing operation of the buttons P341 to P343 for instructing the reproduction of the posted local video via the second terminal operation detection unit 2242, the second terminal control unit 221 displays the posted local video as the second terminal image. By outputting to unit 2231, the posted local video is reproduced (FIG. 9 / STEP212). On the playback screen of each posted local video, a setting button for setting each posted local video as a video for guiding the route is displayed. The second terminal control unit 221 may reproduce the entire posted moving image according to the operation or setting of the user.

By viewing each posted video while referring to the comment, the second user U2 can consider which route to take while grasping a concrete image.

The second terminal control unit 221 determines whether or not a pressing operation of the setting button for making a reference video (reference video) when guiding the route via the second terminal operation detection unit 2242 is detected ( FIG. 9 / STEP214).

When the determination result is affirmative (FIG. 9 / STEP214 ... YES), the second terminal control unit 221 refers to the posted local video by adding the corresponding posted local video to the reference video information 2222. Set as a moving image (Fig. 9 / STEP216). This reference moving image is also reproduced when the second terminal 22 guides the search route.

If the determination result is negative (FIG. 9 / STEP214 ... NO) or after the processing of FIG. 9 / STEP216, the second terminal control unit 221 ends the posted video viewing process.

(Route search processing)
Next, the route search process executed by the image sharing server 3 will be described with reference to FIG.

The server control unit 31 of the image sharing server 3 recognizes the search route included in the first search information (FIG. 12 / STEP352).

The server control unit 31 searches for a posted video route that overlaps the search route by a predetermined distance or more (FIG. 12 / STEP354).

Further, when one route A and another route B overlap by a predetermined distance or more, a set of coordinate values indicating a portion of the route A equal to or more than a predetermined distance among the set of coordinate values indicating each route A means that the set of coordinate values indicates a portion of the route A equal to or more than a predetermined distance. In addition to the case where it is completely the same as the set of coordinate values included in the route B, the set of coordinate values indicating the portion of the route A over a predetermined distance is the set of the coordinate values representing the whole or a part of the route B. It also includes the fact that they are close enough to be considered to exist on the same road.

When the first search information includes a plurality of search routes, the server control unit 31 searches for a posted video route that overlaps with any one of the plurality of search routes by a predetermined distance or more. ..

Further, when the first search information includes the moving direction in the search route, the server control unit 31 overlaps by a predetermined distance or more, and the direction of the search route and the moving direction of the posted video route are the same. You may search on the condition that

Further, the predetermined distance may be a predetermined distance or a distance determined corresponding to the distance of the search route (for example, a distance of 50% or more of the distance of the search route).

Alternatively or additionally, the server control unit 31 may search for a posted local route that overlaps with the search route by a predetermined first distance or more. In place of or in addition to these, the server control unit 31 may search for posted local routes included in the search route. In place of or in addition to these, in the server control unit 31, the search route and the posted video route overlap by a predetermined second distance or more, while the search route and the posted local route do not overlap or the search route and the posted video route are posted. You may search for a route whose overlap with the local route is less than or equal to a predetermined third distance.

When the search route and the posted local route do not overlap, the server control unit 31 may search for a route in which the distance between the search route and the posted local route is a predetermined fourth distance or less. Instead of or in addition to this, when the search route and the posted local route do not overlap, the server control unit 31 has a predetermined number or less of sections for connecting the search route and the posted local route. You may search for a route that is.

These searches result in, for example, another route to the same destination (eg, a so-called detour), or a road that is not a route to the same destination but is close to the road on which it is going (eg, a search route). Crossing roads) can be searched. As a result, the user can watch videos related to the road near the route in addition to the videos on the originally planned search route.

In addition to these, the server control unit 31 refers to the date, time zone, and tag information included in the first search information, and posts having the season, time zone, and tag information that match the date, time zone, and tag information. The completed video route may be extracted.

The server control unit 31 determines whether or not there is a searched posted video route (FIG. 12 / STEP356).

When the determination result is affirmative (FIG. 12 / STEP356 ... YES), the server control unit 31 refers to the video information 321 and uses each information associated with the searched posted video route as the search result. Recognize (Fig. 12 / STEP358). The server control unit 31 is at least a route corresponding to the posted video, the posted video route which is a route associated with the posted video, the posted local video which is a part of the posted video, and the posted local video. Recognize comments on posted local routes and posted local videos.

If the determination result is negative (FIG. 12 / STEP356 ... NO) or after the processing of FIG. 12 / STEP358, the server control unit 31 ends the route search process.

By this process, the posted video route that overlaps the search route by a predetermined distance or more is searched.

In addition to these, the latest list of moving images may be displayed on the initial screen or in response to a user's instruction detected by the input unit 224 of the second terminal 22 without searching for a route. In this case, a predetermined location is determined from the current location recognized by the position recognition unit such as the GPS sensor provided in the second terminal 22, the base such as the home where the second terminal 22 stays for a relatively long time, or the point designated by the user. A list of videos related to routes within a distance may be displayed.

By doing so, the user can browse the posted information even if the user does not have a destination or a route. In addition, even when the user roughly thinks about the travel destination, by designating a point such as an airport of the travel destination, a route near the designated point is searched and related to the route. The video can be played.

Even in this case, if the video to be played is a local video, the playback time is shortened, so that a large amount of information can be easily browsed.

(Second Embodiment)
A second embodiment of the present invention will be described with reference to FIGS. 13 to 14. In the first embodiment, the local route and the local moving image are recognized by having the first user U1 specify two places on the target route display (FIGS. 6 / STEP114 to 6 / STEP118), but the second embodiment. Then, in place of or in addition to FIGS. 6 / STEP114 to 6 / STEP118, the first terminal 21, not the first user U1, recognizes the local route and the local moving image, which is different from the first embodiment. The configurations common to the first embodiment and the second embodiment are designated by the same reference numerals and the description thereof will be omitted. Further, in the second embodiment, as in the first embodiment, the video to be processed is called a posted video, the local video of the posted video is called a posted local video, and the route corresponding to the posted local video is called the posted local video. Called a route.

(Local video recognition processing)
The first terminal control unit 211 recognizes the shape of the road with reference to the moving image information 2122 based on each image constituting the posted moving image (FIG. 13 / STEP402). The first terminal control unit 211 recognizes the shape of the road by extracting, for example, a white line image which is an image of the white line of the road from the images in the direction below the horizontal line of each image.

For example, in the road image P4 as shown in FIG. 14, a plurality of white line images P41 to P46 are included. The first terminal control unit 211 can extract an image of a white line surrounded by an edge after performing grayscale processing and then extracting an edge and removing noise and the like by a known method.

The first terminal control unit 211 can extract the continuity of the extracted white line image by a known method. For example, the first terminal control unit 211 can recognize that the white line images P41 to P43 on the left side are continuous white lines by connecting the lines passing through the center of the white line image as smoothly as possible, and can recognize that the white line images P41 to P43 on the right side are continuous white lines. It can be recognized that the white line images P44 to P46 are continuous white lines.

The first terminal control unit 211 can recognize the shape of the road based on the continuity of the images of the white lines extracted by a known method. For example, in the road image P4 as shown in FIG. 14, the first terminal control unit 211 is based on the continuity of the white line images P41 to P43 on the left side and the continuity of the white line images P44 to P46 on the right side. It is possible to qualitatively recognize the shape of the road, such as a curve to the left. Further, the first terminal control unit 211 may quantitatively recognize the shape of the road such as the radius of curvature of the road.

The first terminal control unit 211 determines whether or not the captured road includes a road having a predetermined shape based on each image constituting the posted moving image (FIG. 13 / STEP404).

"Roads of a predetermined shape" are, for example, "curves", "intersections", "intersections having a radius of curvature equal to or greater than a predetermined radius of curvature", "intersections including roads having a radius of curvature equal to or greater than a predetermined radius of curvature", and "after a curve". A combination of qualitative characteristics of road shape and quantitative characteristics of road shape, such as "intersections", "three or more consecutive curves", and "curves with a regeneration time of 5 minutes or more", and these and road shapes It can be expressed as a combination of one or both of the number and the reproduction time.

When any of the images constituting the posted video includes a road having a predetermined shape, the first terminal control unit 211 determines that the determination result is positive, and determines all the images constituting the video. If the road having the shape of is not included, the determination result is determined to be negative.

When the determination result is negative (FIG. 13 / STEP404 ... NO), the first terminal control unit 211 recognizes the road surrounding environment, which is the environment around the road, based on each image constituting the posted video. (Fig. 13 / STEP406). The first terminal control unit 211 recognizes the environment around the road by, for example, classifying each image by machine learning. The first terminal control unit 211 may qualitatively recognize the road surrounding environment such as "sea" and "building". In addition, the environment around the road may be quantitatively recognized, such as "more than XX lux".

The first terminal control unit 211 determines whether or not the captured road peripheral environment includes a predetermined road peripheral environment based on each image constituting the posted moving image (FIG. 13 / STEP408).

"Predetermined road surrounding environment" includes "sea", "building", "○○ lux or more", "○○ lux or more sea", "3 or more buildings", "regeneration time 5 minutes or more sea", etc. It can be expressed by a combination of the qualitative characteristics of the road and the quantitative characteristics of the environment around the road, and one or both of these and the number of road shapes and the regeneration time.

If the result of either FIG. 13 / STEP404 or FIG. 13 / STEP408 is positive (FIG. 13 / STEP404 ... YES or FIG. 13 / STEP408 ... YES), the first terminal control unit 211 is on a predetermined road. The first terminal recognizes the part of the posted video that reflects the shape or the environment around the predetermined road as the posted local video, and displays the information indicating the posted local video and the information indicating the posted local route that is the route corresponding to the posted local video. It is stored in the storage unit 212 (FIG. 13 / STEP410). The first terminal control unit 211 may recognize the posting local route based on the position where the posted local video is captured, or posts based on the shape of the road recognized from the posted local video or the environment around the road. The local route may be recognized.

After the processing of FIG. 13 / STEP410, or when the result of FIG. 13 / STEP408 is negative (FIG. 13 / STEP408 ... NO), the first terminal control unit 211 ends this processing.

In FIG. 13, the first terminal control unit 211 recognized the posted local video and the posted local route when the predetermined road shape or the predetermined road surrounding environment was discovered, and completed the process. Even if the first terminal control unit 211 executes the processes of FIGS. 13 / STEP402 to 13 / STEP410 until all or a predetermined number or more of the predetermined road shape or the predetermined road surrounding environment included in the moving image are extracted. Good.

(Third Embodiment)
A third embodiment of the present invention will be described with reference to FIGS. 15 to 16. In the second embodiment, the first terminal 21 recognizes the local route and the local moving image based on the shape of the road included in the moving image or the environment around the road, but in the third embodiment, FIGS. 13 / STEP402 to 13 / In addition to or in place of the processing of STEP 410, the first terminal 21 is different from the second embodiment in that it recognizes the local route and the local moving image based on the reaction of the first user U1. The configurations common to the first to third embodiments are designated by the same reference numerals and the description thereof will be omitted. Further, in the third embodiment, similarly to the first embodiment and the second embodiment, the video to be processed is referred to as a posted video, the local video of the posted video is referred to as a posted local video, and the posted local video is supported. The route to do is called the post local route.

(Structure of Third Embodiment)
As shown in FIG. 15, the first terminal 21 of the third embodiment is configured to be able to communicate with the biosensor 4 mounted on the first user U1. The biosensor 4 is composed of an electroencephalogram sensor, a wristband, and the like, and is configured to acquire biometric information of the first user U1 and transmit it to the first terminal 21. Biological information is expressed by quantitative characteristics such as brain waves, heart rate, and blood pressure.

Alternatively or additionally, the first terminal 21 communicates with a voice recognition device that collects the voice of the first user U1 or the passenger or an imaging device that captures the behavior of the first user U1 or the passenger. The voice or behavior of the first user U1 or the passenger may be recognized, and the local moving image recognition process may be executed based on these. The voice or behavior may be expressed by quantitative characteristics such as voice volume, voice frequency, number of behaviors, or, for example, by machine learning classification, happy voice, excited behavior. It may be expressed by qualitative characteristics such as.

Further, the first terminal storage unit 212 stores the user information 2123.

The user information 2123 includes the user's biological information, voice, behavior, etc. acquired by the local video recognition process described later, the position where the biological information, voice, and behavior are detected, and the biological information, voice, and behavior. Information including the time.

(Local video recognition processing)
The local moving image recognition process executed by the first terminal 21 will be described with reference to FIG.

In the third embodiment, the processing of FIGS. 16 / STEP502 to FIG.16 / STEP510 is executed at the time of capturing the posted moving image.

The first terminal control unit 211 recognizes the biological information of the first user U1 via the biological sensor 4 (FIG. 16 / STEP502).

The first terminal control unit 211 determines whether or not the acquired biometric information is in a predetermined state (FIG. 16 / STEP504).

Here, the "predetermined state" is a combination of biological information or biological information and a reproduction time, such as a state of a predetermined brain wave, a state in which the heart rate and blood pressure are 1 minute or more and a predetermined value or more in terms of reproduction time. Can be expressed by. When the voice or behavior of the first user U1 or the passenger is acquired, the happy voice, the loudness of the voice is a predetermined digibel or more, the happy voice three times or more, and the playback time is 3 minutes or more. A given state, such as excited behavior, is represented by a combination of qualitative characteristics of voice or behavior and quantitative characteristics of voice or behavior, and one or both of these and the number of times and playback time of voice or behavior. You may.

When the determination result is affirmative (FIG. 16 / STEP504 ... YES), the first terminal control unit 211 of the moving body 1 acquired from the GPS sensor 11 at the time when the biometric information, voice, and behavior are detected. The position and the time acquired from the first terminal timekeeping unit 216 are recognized (FIG. 16 / STEP506).

The first terminal control unit 211 stores the recognized biometric information (or voice or behavior), the position, and the time in the user information 2123 of the first terminal storage unit 212 (FIG. 16 / STEP508).

After the processing of FIG. 16 / STEP508 or when the determination result of FIG. 16 / STEP504 is negative (FIG. 16 / STEP504 ... NO), the first terminal control unit 211 determines whether or not the imaging is completed (FIG. 16 / STEP504 ... NO). FIG. 16 / STEP510).

If the determination result is negative (FIG. 16 / STEP510 ... NO), the first terminal control unit 211 executes the processes shown in FIG. 16 / STEP502 and the like.

When the determination result is affirmative (FIG. 16 / STEP510 ... YES), the first terminal control unit 211 refers to the user information 2123 and starts from the time when the biological information (or voice or behavior) becomes a predetermined state. The moving image and the route up to the time when the predetermined state is lost are recognized as the posted local video and the posted local route, and are added to the moving image information 2122 and stored (FIG. 16 / STEP512). For example, when the biometric information is in a predetermined state 3 minutes after the start of the posted video and the biometric information is not in the predetermined state 5 minutes after the start of the posted video, the first terminal control unit 211 is 3 after the start of the posted video. A video from 1 minute to 5 minutes is recognized as a posted local video, and a route between them is recognized as a posted local route.

After the processing of FIG. 12 / STEP512, the first terminal control unit 211 ends the posting local moving image recognition processing.

(Fourth Embodiment)
A fourth embodiment of the present invention will be described with reference to FIGS. 17 to 20. In the first embodiment, the first search information including the search route is transmitted from the second terminal 22, the image sharing server 3 searches based on the first search information, and the search result is transmitted to the second terminal 22. , The second terminal 22 outputs a screen including the search result (FIG. 9 / STEP202 to STEP210), but in the fourth embodiment, in addition to this, the image sharing server 3 includes a function of recommending a moving image or a search route. It differs from the first embodiment in that it provides a search function based on the second search information. The configurations common to the first to third embodiments are designated by the same reference numerals and the description thereof will be omitted. Further, in the fourth embodiment, similarly to the first embodiment, the video stored in the image sharing server 3 is referred to as a posted video, and the route related to the posted video is referred to as a posted video route. The local video of the posted video is called the posted local video, and the route corresponding to the posted local video is called the posted local route.

(Image sharing server configuration)
As shown in FIG. 17, the server holding unit 32 of the image sharing server 3 further holds the recommendation information 323.

The recommendation information 323 is information about the posted video or the posted local video recommended to each user. The recommendation information 323 includes information for identifying the posted video or the posted local video, and basic information for recommending the posted video or the posted local video.

Basic information for recommending posted videos or posted local videos includes the total number of accesses to posted videos or posted local videos, the total number of views of posted videos or posted local videos, posted videos or posted. Total playback time of completed local videos, number of accesses to posted videos or posted local videos in a predetermined period, number of views of posted videos or posted local videos, playback time of posted videos or posted local videos, and each terminal Includes liking for posted videos or posted local videos received from.

(Recommendation list screen output processing)
The recommendation list screen output process executed by the second terminal 22 and the image sharing server 3 will be described with reference to FIG. In the recommendation list screen output process, for example, the second user U2 of the second terminal 22 plans to go on a trip, etc., but when the destination has not been decided, he / she browses the video and goes where. This is a useful process when you want to consider whether or not.

The second terminal control unit 221 accesses the image sharing server 3 via the second terminal communication unit 225 (FIG. 18 / STEP602).

When the server control unit 31 detects that the access is received from the second terminal 22 (FIG. 18 / STEP652), the server control unit 31 refers to the recommendation information 323 to list the posted local videos to be recommended (hereinafter, “recommendation”). Recognize the list of points corresponding to the posted local video to be recommended (hereinafter referred to as "recommended point list") (FIG. 18 / STEP654). The server control unit 31 uses a predetermined formula from the basic information for recommending the posted video or the posted local video, for example, and the total number of accesses, the total number of plays, the total play time, the number of accesses, the number of plays, and the play time. The recommendation level of each posted local video is determined so that the higher the favorability, the higher the recommendation level, and the number of posted local videos that should be recommended in descending order of recommendation level is recognized as a recommended video list. You may. Further, the server control unit 31 recognizes the posted local route corresponding to each posted local video to be recommended by referring to the moving image information 321. Then, the server control unit 31 recognizes the start point of each posted local route (the point corresponding to the start time of the posted local video) as a recommended point list. The server control unit 31 may include a number of posted local videos to be recommended for each region in the recommended video list.

The server control unit 31 transmits the recognized recommended moving image list and recommended point list to the second terminal 22 via the server communication unit 35 (FIG. 18 / STEP656).

When the second terminal control unit 221 receives the recommended video list and the recommended point list via the second terminal communication unit 225 (FIG. 18 / STEP604 ... YES), the second terminal control unit 221 outputs the first recommendation list screen P5 shown in FIG. (Fig. 18 / STEP606).

The first recommendation list screen P5 includes a free word search box P51, a tag selection box P52, and point displays P531 to P538 corresponding to posted local videos to be recommended. Of these, the point displays P531 to P538 corresponding to the posted local videos to be recommended are displayed at the positions on the map of each point included in the recommended point list. When the second terminal control unit 221 detects a pressing operation of the pull-down button P521 displayed at the right end of the tag selection box P52 via the second terminal operation detection unit 2242, the second terminal control unit 221 displays a tag list under the tag selection box P52. indicate. The first recommendation list screen P5 may include a box for designating a season, a time zone, and the like.

When the second terminal control unit 221 detects that any of the point displays P531 to P538 corresponding to the posted local video to be recommended via the second terminal operation detection unit 2242 is pressed, the second terminal control unit 221 arrives at the current point. The corresponding posted local video to be recommended is recognized from the recommended video list, and the posted local video to be recommended is played.

When the second terminal control unit 221 detects that there is an input to the free word search box P51 or the tag selection box P52 via the second terminal operation detection unit 2242, the second terminal control unit 221 determines the search keyword and free word search or tag selection. The second search information including the indicated information is transmitted to the image sharing server 3 via the second terminal communication unit 225 (FIG. 18 / STEP608).

When the server control unit 31 receives the second search information (FIG. 18 / STEP658 ... YES), the server control unit 31 searches the posted video according to the second search information with reference to the video information 321 (FIG. 18 / STEP660). When the second search information includes information indicating a free word search, the server control unit 31 includes the search keyword in the tag information 3215, the title information 3216, the imaging season information 3217, the imaging time zone information 3218 or the comment 3219. Search for posted videos. When the second search information includes information indicating tag selection, the server control unit 31 searches the tag information 3215 for the posted local video including the search keyword.

The server control unit 31 transmits a list of posted local moving images searched via the server communication unit 35 to the second terminal 22 (FIG. 18 / STEP662). The list of posted local videos corresponds to information for playing the searched posted local videos (for example, URL of posted local videos), title, number of views, comments on posted local videos, and posted local videos. Contains local routes to

When the second terminal control unit 221 receives the list of posted local moving images (FIG. 18 / STEP610 ... YES), the second terminal control unit 221 outputs the second recommendation list screen P6 shown in FIG. 20 (FIG. 18 / STEP612).

The second recommendation list screen P6 is a free word search box P61, a tag selection box P62, a tag list P63, a posted local video list display P64, a display P65 of a local route corresponding to a posted local video, and a start of the local route. Includes point display P66.

The posted local video list display P64 is a display including a title, a number of views, and a comment for each posted local video included in the list of posted local videos.

The display P65 of the local route corresponding to the posted local video and the display P66 of the start point of the local route are the correspondence on the map of the local route for each posted local video included in the list of posted local videos. It is displayed at the position where you want to.

The second terminal control unit 221 presses the portion corresponding to the posted local video of either the posted local video list display P64 or the display P66 of the start point of the local route via the second terminal operation detection unit 2242. When it is detected, the posted local video corresponding to the relevant part is recognized from the recommended video list, and the posted local video is played.

After the process of FIG. 18 / STEP612, the first terminal control unit 211 ends the recommendation list display process.

(Modification mode)
In the first to fourth embodiments, the moving image is the sharing target, but in addition to or instead of this, the still image captured via the first terminal imaging unit 2141 may be the sharing target. .. In this case, the still image corresponds to an example of the "image display" of the present invention.

Further, the moving image may be a moving image in which the number of frames is thinned out.

Further, when playing a moving image, it may be fast-forwarded.

In the first to fourth embodiments, the moving image is shared via the image sharing server 3, but the first terminal 21 and the second terminal 22 directly communicate with each other, and necessary information is transmitted to the second terminal 22. May be done. In this case, the second terminal control unit 221 may execute the processing for the server control unit 31.

Further, the local moving image recognition process of FIG. 13, the process of FIG. 16 / STEP512, and the like may be executed by the image sharing server 3.

Further, in FIG. 11, buttons P341 to P343 for playing the local moving image are displayed, but instead of or in addition to this, any local moving image is automatically played before the button pressing operation is detected. May be done. Further, an image of one of the images constituting the local moving image may be displayed in place of or in addition to the buttons P341 to P343. The reproduced moving image corresponds to an example of the "image display" of the present invention.

Also, in addition to or instead of displaying the local route, the entire route associated with the moving image may be displayed.

Further, in the first embodiment, the route associated with the posted video and the route corresponding to the posted local video are specified by the first user U1 who is the poster of the video, but instead of this, the poster of the video A different user may specify a route associated with the posted video and a route corresponding to the posted local video. In this case, the server control unit 31 may receive an evaluation of whether or not the route corresponds to the moving image from the terminal of another user, and determine the reliability evaluation value based on the evaluation.

221 ... 2nd terminal control unit (display control unit), 2231 ... 2nd terminal image display unit (image display unit), 3 ... image sharing server, 31 ... route search unit 31, P331-P332 ... posting Completed local route display (first route display), P31 ... Map information, P341-P343 ... Buttons for instructing playback of posted local videos (for receiving playback instructions for videos associated with the first route) display).

Claims (8)

A holding unit that holds a still image or a moving image posted by each contributor and a first route as a route associated with the still image or the moving image.
A route designation reception unit that accepts the designation of arbitrary routes,
An image display unit that displays an image and
A route search unit for searching said first path with overlap over a predetermined length or more in the second path is a path that is specified through the routing acceptance unit from said holding portion,
Displaying a first path display of a portion or all of the route search unit according to the first path for each first path found by the search, and map information, a still image or a moving associated with said first path image sharing system, comprising a display control unit for displaying the display at a reproduction instruction display for accepting an instruction for reproducing the video associated with the image display or the first path to the image display unit. In the image sharing system according to claim 1,
The holding unit holds the moving image and the path associated with the moving image as the first path, and holds the moving image.
The first route display includes a display showing a local route which is a part of the first route.
An image sharing system characterized in that the image display displays a local moving image that is a partial moving image of the moving image, or the playback instruction display includes a display for receiving a reproduction instruction of the local moving image. In the image sharing system according to claim 2,
Equipped with a posting reception section that accepts video postings
The local moving image is an image sharing system characterized in that it is a part of a moving image designated by the poster of the moving image. In the image sharing system according to any one of claims 1 to 3,
The moving image is a moving image captured during the movement of the first path, and is a moving image.
The first path is given a direction of movement in the moving image.
The route designation reception unit receives the direction designation together with the route,
The image sharing system is characterized in that the route search unit is configured to search the first route to which the same movement direction as the designated direction of the second route is given. In the image sharing system according to any one of claims 1 to 4,
The image sharing system is characterized in that the route search unit recognizes the second route as a route between two points designated via the route designation reception unit as a point on a map based on the map information. .. In the image sharing system according to claim 5,
When the route search unit recognizes a plurality of the second routes as routes between the two points, the second route overlaps the second route over the predetermined length or more. One route is searched from the holding unit, and
The display control unit displays an image for displaying a still image or a moving image associated with the first path searched for each second path, or a display for receiving a playback instruction of a moving image associated with the first path. An image sharing system characterized in that the playback instruction display is displayed on the image display unit. A communication unit capable of communicating with the first terminal and the second terminal,
A holding unit that holds a still image or a moving image posted by a poster of each first terminal via the communication unit, and a first route as a route associated with the still image or the moving image.
A route search unit that receives a route from the second terminal via the communication unit and searches for the first route that overlaps the received route over a predetermined length or more from the holding unit.
For each first route found by the search by the route search unit, a first route display showing a part or all of the first route, map information, and a still image or moving image associated with the first route are displayed. Information for displaying an image display or a playback instruction display, which is a display for receiving a playback instruction of a moving image associated with the first path, on the image display unit of the second terminal is transmitted to the image display unit of the second terminal via the communication unit. An image sharing server including an information transmission unit for transmitting to a terminal. A single computer having an image display unit, a holding unit for holding a still image or moving image posted by each poster, and a first route as a route associated with the still image or the moving image, alone or It's a way for multiple computers to run together
The recognition step to recognize the route and
A search step of searching said first path there is overlap for a predetermined length or longer in the recognized path from said holding portion,
Image displaying a first path display of a portion or all of each of the first path for the first path found by the search in said searching step, the map information, a still image or a moving associated with said first path An image sharing method comprising a display step of displaying a reproduction instruction interface, which is an interface for receiving a display or a reproduction instruction of a moving image associated with the first path, on the image display unit.

Images