JP6128770B2 - Log generating apparatus, method and program - Google Patents

Description

  The present invention relates to a log generation device, a method, and a program for recording position information obtained by positioning means such as GPS (Global Positioning System) over time.

  A GPS (Global Positioning System) system is well known as a positioning system in the ground coordinate system. In particular, a so-called GPS logger, which continuously records position information measured by GPS with the passage of time, is commercially available and is used for recording a moving course in a marathon or a bicycle (see Patent Document 1). In addition, it is also used for recording a shooting location in a shooting trip.

  Smartphones that are equipped with GPS functions as standard on mobile phones and that allow users to install / uninstall favorite application software (hereinafter abbreviated as “applications”) have become widespread. Under such circumstances, an application (hereinafter referred to as “position recording application”) that records position information with time by using the GPS function of a smartphone has also appeared.

  Regarding positioning, a system that enables positioning even in an environment where radio waves from GPS satellites cannot be received by combining various gyros with a GPS receiver is also known. In addition, although the position determination accuracy is reduced, the installation position of the wireless LAN base station installed in each place is registered in the database in advance, and the positioning is performed within that area, or the distance from the base station of the mobile communication network The method of doing is also known.

JP2012-108001A

  Both GPS loggers and smartphone location recording applications record measured 3D (latitude, longitude and altitude) or 2D (latitude and longitude) location information and positioning time as a positioning log file. Is common. On the other hand, many existing digital cameras have the shooting time embedded in an image data file. By matching the shooting time of the image data with the positioning time of the positioning log file, the shooting position can be specified and can be embedded in the image file as shooting position information.

  Time data recorded in a positioning log file generated by a GPS logger as a dedicated machine is calculated from a radio wave signal (GPS signal) from a GPS satellite, and has high accuracy. On the other hand, the location recording application on the smartphone refers to the output of the RTC (real-time clock) installed in the smartphone as the time of positioning, although the position information obtained by positioning by GPS is accurate. Depends on the accuracy of the RTC.

  In general, a mobile phone has a function of inquiring and correcting the time of an RTC built in the mobile communication network, and a similar function is also implemented in a smartphone. The RTC may be corrected at the time calculated from the GPS signal. However, for this purpose, it is necessary to turn on the GPS receiving circuit to operate it, and thus power consumption cannot be ignored. Therefore, a mobile phone and a smartphone having a GPS function usually refer to a timer on the mobile communication network for RTC time correction.

  In this way, when the RTC output time, which is separately adjusted in time, is sequentially recorded, if the RTC time is changed during recording, temporal continuity is broken, so to speak, a positioning log in which time recording is discontinuous. It becomes data. When such positioning log data is used, for example, when graphing a movement path or converting time data of a captured image into position data, an unnatural position shift occurs, which is difficult to handle.

  An object of the present invention is to eliminate such inconveniences and to generate log data that is easy to handle even when RTC time adjustment is involved.

A log generation device according to the present invention is a log generation device capable of wirelessly communicating with an imaging device, and includes a position acquisition unit that acquires position information, and a time measurement unit that measures time and date by the position acquisition unit. log file that contains the date and time acquisition section, a log data and the date and time information associated indicating the date and time when obtaining the positional information of the respective plurality of positional information to acquire date and time information indicating the date and time when the information was acquired a generating means for generating a receive detection means for detecting the adjustment of date and time the timing unit is timing, and information for identifying the image, and time information associated with the image from the imaging device a receiving means, and time information received by the receiving means, a position based on said date and time information included in the log file contains the information and the log files to identify the image And correlating means for executing a matching process associating the broadcast, the correspondence and a transmitting means for transmitting the result of the matching processing to the image pickup device executed by means detecting the adjustment of the time by the detecting means The generating unit generates a new log file different from the existing log file, and the associating unit selects the new log file from the existing log file and the new log file. It is preferentially used for the collation process .

  According to the present invention, easy-to-handle log data can be generated even when RTC time adjustment is involved.

It is a schematic block diagram of the first embodiment of the present invention. It is an operation | movement flowchart of the position recording application of 1st Example. It is an example of the log file produced | generated immediately after starting in 1st Example. It is an example of the log file produced | generated after time adjustment in 1st Example. It is a schematic block diagram of a digital camera. It is a sequence diagram of the operation | movement which changes the imaging | photography time of the picked-up image by the position determination application to a shooting position. It is another sequence diagram of the operation | movement which changes the imaging | photography time of the picked-up image by a position determination application to a shooting position. It is a schematic block diagram of the second embodiment of the present invention. It is an operation | movement flowchart of the position recording application of 2nd Example. It is an example of the log file produced | generated immediately after starting in 2nd Example. It is an example of the log file produced | generated after time adjustment in 2nd Example. It is an example of a single log file including time adjustment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a schematic block diagram of an embodiment of the present invention. This embodiment is implemented as a position recording application on a smartphone.

  The smartphone 10 includes a CPU 12, a ROM 14, a RAM 16 as a main memory, and an SSD (Solid State Drive) 18 as an auxiliary memory, like a computer. The SSD 18 is connected to the bus 22 via the interface 20, and the CPU 12, ROM 14 and RAM 16 are also connected to the bus 22. The bus 22 is used as a medium for transferring data and control signals between devices connected to the bus 22.

  The ROM 14 stores various fixed data and firmware. The SSD 18 records an OS (operating system) 50 that is basic software executed by the CPU 12 and an application that is application software executed by the CPU 12. In the SSD 18 of the smartphone 10, a position recording application 60 and a position determination application 62 are recorded as application software. One application having the functions of both the position recording application 60 and the position determination application 62 may be recorded. The position recording application 60 is a position information recording program that generates a log file that records the latitude and longitude of the location of the smartphone 10 in time series. The position determination application 62 is an application that refers to a log file generated by the position recording application 60 and determines position information at the time of creation of a file with a creation date and time. The file with the creation date and time is, for example, an image file in which the shooting time by the digital camera is embedded or added, and the position information at the time of creation corresponds to the position information at the time of shooting.

  For example, a display device 24 made of a liquid crystal display (LCD), a touch panel 26 bonded on the screen of the display device 24, and an operation device 28 made of mechanical switches are connected to the bus 22. The display device 24 may be detachable. The operation device 28 includes a power switch, a volume switch for changing the volume, a sleep button for instructing screen sleep, and the like. The voice input / output device 29 connected to the bus 22 includes a microphone for voice input and a speaker for voice output, and is mainly used for calls.

  When the user turns on the power switch of the operation device 28, the smartphone 10 is activated, and the CPU 12 reads out the OS 50 from the SSD, expands it in the RAM 16, and sequentially loads and executes the OS 50. Moreover, each part of the smart phone 10 is controlled according to OS and the application installed on OS. In the following description, the CPU 12 executes a predetermined process according to an application (or an application function or an OS or OS service), and “an application (or an application function or an OS or OS service) is predetermined. It is expressed as “Perform processing”. In addition, instead of the CPU 12 controlling the entire apparatus, a plurality of hardware may control each part of the smartphone 10 by sharing the processing.

  The telephone function itself is the same as an existing mobile phone. A network control unit (NCU) 30 that controls communication with the mobile communication network 34 is connected to the bus 22, and a mobile communication antenna 32 is connected to the NCU 30. The CPU 12 (OS 50) displays a numeric keypad on the display device 24, and the user inputs the other party telephone number using the touch panel 26 and instructs the OS 50 to make a call. In accordance with this call instruction, the OS 50 controls the NCU 30 via the bus 22 to call the partner terminal. The call signal output from the NCU 30 reaches the partner terminal via the portable communication antenna 32 and the portable communication network 34. A call connection between the smartphone 10 and the partner terminal is established by the incoming call operation of the partner terminal, and a call becomes possible.

  In the connection state of the counterpart terminal, the voice from the counterpart terminal is transferred from the NCU 30 to the voice input / output device 29 and is acoustically output. The voice of the user of the smartphone 10 is input by the voice input / output device 29 and transmitted to the partner terminal via the NCU 30, the mobile communication antenna 32, and the mobile communication network 34.

  In addition, a GPS receiver 36, a wireless LAN communication device 42, and an RTC (Real Time Clock) 48 that measures the current date and time are connected to the bus 22. The activation of the GPS receiver 36 is controlled by the CPU 12. The GPS receiving device 36 receives a radio signal from the GPS satellite 40 by the GPS antenna 38 according to an instruction from the CPU 12 at the time of activation, performs positioning, and outputs position data of latitude and longitude (and altitude). The wireless LAN communication device 42 communicates wirelessly with a wireless LAN access point via a wireless LAN antenna 44 using a predetermined protocol, and the wireless LAN access point is connected to the Internet or the like.

  The RTC 48 measures the current date and time by counting clocks (not shown). The RTC 48 measures time in Coordinated Universal Time UTC (Universal Time, Coordinated). If necessary, the CPU 12 converts the UTC output of the RTC 48 into local time according to the time zone of the location of the smartphone 10. The date / time information service 54 can manage date / time information in UTC, local time, or both. The time adjustment function 54 a of the date information service 54 adjusts the output of the RTC 48 based on the timer value on the mobile communication network 34. For example, when the timer on the mobile communication network 34 is local time and the RTC 48 is UTC, the time adjustment function 54a of the date / time information service 54 sets the local time to UTC according to a preset time zone or determined by GPS. Convert and adjust the output of the RTC 48 to indicate the converted UTC.

  The RTC 48 may adjust the time by synchronizing with an NTP server on the Internet connected by a wireless LAN, or may adjust the time by date and time information obtained by positioning by GPS.

  The communication device 49 transmits / receives data to / from the smartphone 10 with an external device (a digital camera in the example described below). The communication device 49 exchanges data with an external device by communication conforming to the USB standard, for example.

  As a data communication function, the smartphone 10 can access the Internet not only via the mobile communication network 34 but also via a wireless LAN access point connected wirelessly. That is, of the apps that run on the CPU 12, apps that require Internet access (for example, browser apps and mail apps) can connect to the Internet via the mobile communication network 34 or a wireless LAN access point.

  The OS 50 not only has the above-described general function for controlling a device installed in the smartphone 10, but also provides various services to the application. As functions characteristic of this embodiment, the OS 50 includes a location information service 52 and a date / time information service 54.

  The position information service 52 provides the position information of the smartphone 10 in response to an inquiry from an application that requires position information, such as the position recording application 60. In other words, the location information service 52 functions as a positioning unit for the location recording application 60. In the present embodiment, the location information service 52 responds to a location information request with a single response mode in which the location information of the smartphone 10 is simply returned to the request source, and the location information is requested for each movement of the specified distance. And a response mode for each distance for replying to.

  Recently, there is a wireless LAN location service that stores a MAC address of a wireless LAN access point in association with its installation location and provides location information to the outside. Further, a technique for searching for the position of the smartphone 10 based on the distance from the base station of the mobile communication network 34 is also known. The location information service 52 uses positioning by GPS when GPS is available, and uses positioning by the wireless LAN access point 46 when GPS cannot be used. Use positioning from the station.

  The position determination function 52a of the position information service 52 reads out the position information from the GPS receiver 36 or inquires of the above-mentioned wireless LAN position service for the MAC address of the wireless signal output from the wireless LAN access point 46, and accesses those wireless LANs. The position information of the point is acquired, or the position of the smartphone 10 is determined using the distance from the base station of the mobile communication network 34. The movement distance calculation function 52b of the position information service 52 is means for calculating a movement distance by referring to the position information obtained by the position determination function 52a, and operates in a distance-by-distance response mode.

  The date and time adjustment function 54a of the date and time information service 54 compares the date and time indicated by the RTC 48 as a time measuring means with a reference timer on the mobile communication network 34, and detects a time difference (for example, 1 minute) above a certain level, Synchronize with a timer. As a result, the RTC 48 is time-adjusted once or several times a day according to the accuracy. The adjustment of the date and time counted by the RTC 48 by the date and time adjustment function 54a is performed independently and in parallel with the location information service 52. The date / time output function 54b of the date / time information service 54 captures the current date / time information from the output of the RTC 48 in response to an inquiry from an application such as the position recording application 60, and provides it to the requesting application.

  With reference to FIG. 2, the log generation operation by the position recording application 60 will be described in detail. FIG. 2 shows a flowchart of log file generation by the CPU 12 operating in accordance with the position recording application 60. Each process of this flowchart is realized by the CPU 12 operating according to the functions of the position recording application 60 and the OS 50. This flowchart is started when the position recording application 60 is activated. In the flow shown in FIG. 2, the response mode for each distance of the location information service 52 is used. The position recording application 60 includes a log generation function 60a and a log recording function 60b as characteristic functions. The log generation function 60a is a function for opening / closing a log file. The log recording function 60b is a function for recording a pair of position information and date / time information in a log file.

  When the location recording application 60 is activated, the location recording application 60 initializes a movement distance D set in the location information service, a threshold value Δt for determining whether or not to adjust time, and other internal variables (S1).

  Next, the log generation function 60a newly opens a log file on the recording medium, that is, on the SSD 18 (S2).

  The position recording application 60 supplies a position information request in the response mode for each distance specifying the movement distance D (here, horizontal movement distance) to the position information service 52 of the OS 50 (S3). In accordance with this request, the position determination function 52a of the position information service 52 activates the GPS receiver 36 and starts to sequentially acquire the position information output from the GPS receiver 36. After starting this sequential capture, the location information service 52 transmits the location information that was first captured to the location recording application 60. Thereafter, the movement distance calculation function 52b calculates the movement distance using the position information determined by the position determination function 52a and the position information transmitted to the previous position recording application 60, and the movement of the specified movement distance D is performed. Each time, position information (latitude (x), longitude (y)) at that time is transmitted or supplied to the position recording application 60. In this embodiment, the case where the movement distance is obtained by calculating the distance between two points will be described as an example. However, the calculation of the movement distance is not limited to this. For example, each time position information is captured, the movement distance may be calculated from the difference from the previously acquired position information, and added to the previously calculated result.

  As described above, the position determination function 52a of the location information service 52 tries the positioning by the wireless LAN when the GPS positioning cannot be used, and performs the positioning by the base station of the mobile communication network 34 when the positioning by the wireless LAN cannot be used. Try. The position determination function 52a of the position information service 52 may determine position information by combining information from the GPS receiver 36, information from the wireless communication LAN communication apparatus 42, and information from the NCU 30.

  The location recording application 60 waits to receive location information from the location information service 52 of the OS 50 (S4). When the position information is received from the position information service 52, the received latitude and longitude are substituted into variables (Px, Py) (S5). Subsequently, the location recording application 60 inquires the date and time information service 54 of the OS 50 about the current date and time (S6). The date / time output function 54b of the date / time information service 54 of the OS 50 reads the current date / time, which is the output value of the RTC 48, and supplies it to the location recording application 60 that is the request source. Thereby, the position recording application 60 receives the current date and time information.

  Next, the position recording application 60 determines whether or not position information has already been written in the log file (S7). In other words, it is determined whether or not the position information to be written to the log file is the first position information to be written to the log file.

  First, a case where the position recording application 60 determines that position information has not been written in the log file will be described. In this case, the position recording application 60 substitutes the current date and time information received from the date and time information service 54 for the variable Tp (S8). Next, the log recording function 60b of the position recording application 60 records the position information (Px, Py) in step S5 and the date / time information Tp in step S8 in pairs in the log file (S9). Thereafter, the process proceeds to step S16. The description after step S16 will be described later.

  On the other hand, a case where the position recording application 60 determines that position information has already been written in the log file will be described. In this case, the location recording application 60 substitutes the current date and time information received from the date and time information service 54 for the variable Tc (S10).

  The position recording application 60 compares the current acquisition date and time Tc with the previous acquisition date and time Tp under an error Δt, and adjusts the time according to whether or not a temporal contradiction can be assumed between two temporally adjacent positioning times. Whether or not there is is determined (S11). Specifically, it is examined whether Tp + Δt is smaller than Tc. For example, when it is assumed that the positioning time interval is about 5 minutes with respect to the set movement distance D, Δt is set to 3 minutes. At this time, if Tc indicates that less than 3 minutes have elapsed from Tp, the position recording application 60 determines that the time adjustment of the RTC 48 has been performed. When 0 is set in Δt, the time adjustment of the RTC 48 is executed when Tc <Tp. This step acts as a time adjustment detection means and a time adjustment detection step.

  If the position recording application 60 determines that the time has been adjusted, the process proceeds to step S10. Specifically, when Tp + Δt is smaller than Tc (N in S11), the log generation function 60a of the position recording application 60 closes the open log file (S12). Subsequently, the log generation function 60a opens a new log file in which the date and time acquired in step S8 is incorporated in the file name (S13). Then, the log recording function 60b adds the position information (Px, Py) at step S6 and the date / time information Tc at step S8 to the log file (S14).

  If the position recording application 60 determines that the time has not been adjusted, the process proceeds to step S12. Specifically, when Tp + Δt is equal to or greater than Tc (Y in S11), the log recording function 60b adds the position information (Px, Py) in step S5 and the date / time information Tc in step S8 as a pair to the log file ( S14).

  After step S14, the position recording application 60 substitutes the date and time Tc into the immediately preceding date and time variable Tp (S15), and confirms whether or not the user has performed an end operation (S16). When it is determined that the position recording application 60 has not accepted the end operation (N in S16), the process returns to step S5. When it is determined that the position recording application 60 has received the end operation (Y in S16), the position recording application 60 closes the open log file by the log generation function 60a (S17) and ends.

  FIG. 3 shows an example of the log file generated first by the flowchart shown in FIG. FIG. 4 shows an example of a log file generated as a separate file in step S10 following the log file shown in FIG. In the log file shown in FIG. 3 and the log file shown in FIG. 4, the file name is generated from the serial number given in the log file generation order and the date / time information corresponding to the position information recorded first in the log file. .

  A record at a point moved by a predetermined distance D from the point of the last record in the log file shown in FIG. 3 is recorded as the first point in the log file shown in FIG. That is, in the example shown in FIG. 3 and FIG. 4, the time adjustment of the RTC 48 was performed before moving from the point (35.680999, 139.766018) to the point (35.680999, 139.766021). Become. The date and time of the first entry or record of the log file shown in FIG. 4 is relatively past with respect to the date and time of the last entry or record of the log file shown in FIG. 3, and this indicates the occurrence of time adjustment of the RTC 48. Yes.

  As described above, in this embodiment, a new log file is generated each time a significant time adjustment of the RTC 48 is performed. Thereby, even if the time of the RTC 48 is adjusted during the recording of the log data, the continuity of time within one log file is maintained.

  In the present embodiment, latitude and longitude are recorded as position information, but it is obvious that an altitude value may be added. In this case, the moving distance D is a distance that takes into account the altitude difference.

  Using the log file generated by the position recording application 60 in this manner, position information can be added to a photographed image with a photographing time by a digital camera.

  FIG. 5 is a block diagram showing a schematic configuration of a digital camera that records position information added to a shot image with a shooting time. The control device 524 of the imaging device 510 controls each unit according to the operation and setting of the operation device 528 including the release button, and particularly determines the imaging conditions (exposure and shutter speed) of the imaging unit 514 according to the operation of the release button. Start the recording process.

  The imaging unit 514 converts an optical image of a subject by the photographing lens 512 into an electric image signal. The camera signal processing device 516 performs known camera signal processing such as color balance adjustment and gamma conversion on the image signal from the imaging unit 514. In accordance with a recording instruction from the control device 524, the encoding device 518 compresses and encodes an image signal output from the camera signal processing device 516 using a known encoding method, for example, the JPEG method, and writes and reads the compressed image data. To supply.

  The control device 524 refers to the RTC 526 to determine the time of imaging, that is, the imaging time, and supplies it to the writing / reading device 520 together with the imaging conditions. The writing / reading device 520 multiplexes the information from the control device 524 as the imaging parameter with the compressed image data from the encoding device 518, and records it on the recording medium 522. The shooting parameters are stored in, for example, the header of an image file that contains compressed image data, but may of course be recorded in another file or location that has a one-to-one correspondence with the image file. The recording medium 522 is composed of a nonvolatile recording medium such as a flash memory or a hard disk.

  As will be described below, the control device 524 cooperates with the external device, here the smartphone 10, via the communication device 530, and in the image file recorded on the recording medium 522, the position coordinates of the shooting location (shooting position coordinates). Can be embedded or associated.

  FIG. 6 shows a sequence example of an operation in which the position determination application 62 of the smartphone 10 embeds shooting position coordinates in a shot image recorded on the recording medium 522 of the digital camera 510 in cooperation with the digital camera 510.

  The position determination application 62 (smart phone 10) requests the camera 510 for date and time information indicated by the RTC 526 (S601). In response to this request, the control device 524 of the camera 510 reads the current date and time information from the output of the RTC 526 and transmits it to the position determination application 62 (S611).

  The position determination application 62 compares the date / time information of the camera 510 received from the camera 510 with the date / time information output from the RTC 48, and calculates the time difference between the two (S602). By acquiring this time difference, it is possible to accurately collate the photographing time of the photographed image of the camera 510 with the positioning time of the log file recorded by the position recording application 60. The position determination application 62 corrects the log collection period (start time and end time) of the position recording application 60 with the calculated time difference, and transmits the corrected log collection period to the camera 510 (S603). As a result, the ID (for example, serial number) of the image taken during the log collection period and the shooting time are requested. By specifying the requested information by the log collection period in this way, it is possible to prevent unnecessary communication. Thereafter, the position determination application 62 waits for a response from the camera 510.

  The control device 524 of the camera 510 extracts a captured image that falls within the log collection period according to the log collection period corrected by the time difference from the position determination application 62 (S612). Whether or not it is within the log collection period can be confirmed by reading the photographing time added to the photographed image recorded in the recording medium 522 and checking whether or not the photographing time is within the log collection period.

  The control device 524 of the camera 510 selects one of the extracted captured images (S613), and transmits the ID (for example, serial number) and the capturing time of the selected captured image to the smartphone 10 via the communication device 530. (S614). The camera 510 waits for reception of position information for the same ID.

  The position determination application 62 corrects the shooting time transmitted from the camera 510 by the time difference calculated in step S602 (S604), and calculates the corrected shooting time and date / time information included in the log file generated by the position recording application 60. Collation is performed (S605). If a plurality of log files are recorded, priority is given to collation with a newly generated log file. For example, when the log files of FIGS. 3 and 4 are recorded, the log file of FIG. 4 is collated first. This is done for the following reason. For example, as in the case where the log file of FIG. 4 is generated, a new log file may be generated by adjusting the time. Since the date and time information recorded in the newly generated log file is the date and time information after adjustment, for example, the date and time information of the log file in FIG. 4 is more accurate than the date and time information of the log file in FIG. It is believed that there is. Therefore, the newly generated log file is preferentially collated with the intention of giving priority to the log file generated using more accurate date and time information. As a result of this collation, the position determination application 62 determines position information corresponding to the time as a shooting position, and transmits it to the camera 510 as a pair with the received ID together with the shooting time. The position determination application 62 receives an end notification from the camera 510 (S606), or waits to receive the ID and shooting time of the next image.

  Upon receiving the position information and the ID from the position determination application 62, the control device 524 of the camera 510 adds the received position information to the captured image indicated by the received ID (S615). If the received ID does not match the ID previously transmitted to the position determination application 62 in step S614, an error has occurred somewhere. At this time, the control device 524 displays the fact on a display device (not shown) and interrupts the processing shown in FIG.

  The control device 524 of the camera 510 checks whether or not there is a photographic image that has not yet been added with the photographic position in the extracted photographic image (S616). If there is an unprocessed captured image (S616), the next unprocessed captured image is selected (S617), and steps S614 and S615 are repeated. When all the extracted captured images have been processed (S166), the control device 524 transmits an end notification to the position determination application 62 (S618), and ends.

  The position determination application 62 waits for reception of the next image ID and shooting time until receiving an end notification from the camera 510. When the end notification is received from the camera 510, the position determination application 62 ends.

  In the sequence illustrated in FIG. 6, the control device 524 of the camera 510 and the position determination application 62 of the smartphone 10 interact with each other. For example, a recording medium of a recent digital camera can often be mounted on an external device as a USB mass storage while attached to the camera. Therefore, when the smartphone 10 mounts the recording medium 522 of the camera 510 as a USB mass storage, the sequence shown in FIG. 6 can be executed only by the application on the smartphone 10.

  FIG. 7 shows another sequence example of the operation in which the position determination application 62 of the smartphone 10 embeds the shooting position coordinates in the shot image recorded on the recording medium 522 of the digital camera 510.

  The position determination application 62 (smart phone 10) requests the camera 510 for date and time information indicated by the RTC 526 (S701). In response to this request, the camera 510 (the control device 524) reads the current date / time information from the output of the RTC 526 and transmits it to the position determination application 62 (S711).

  The position determination application 62 compares the date / time information of the camera 510 received from the camera 510 with the date / time information output from the RTC 48, and calculates the time difference between the two (S702). The position determination application 62 corrects the log collection period (start time and end time) of the position recording application 60 with the calculated time difference, and transmits the corrected log collection period to the camera 510 (S703). Thereafter, the position determination application 62 waits for a response from the camera 510.

  The control device 524 of the camera 510 extracts a captured image that falls within the log collection period according to the log collection period corrected by the time difference from the position determination application 62 (S712). The control device 524 reads the shooting time of each extracted captured image, generates a list paired with the ID of each captured image, and transmits it to the position determination application (S713). The digital camera 510 waits for a response from the position determination application 62.

  When receiving the list from the camera 510, the position determination application 62 selects the first shooting time described in the list (S704), and corrects the shooting time with a time difference (S705). In the position determination application 62, the position recording application 60 collates the shooting time corrected for time difference with the log data (S706). As a result of this collation, the position determination application 62 determines the position information corresponding to the time as the shooting position, and stores it as a pair with the ID received together with the shooting time.

  The position determination application 62 checks whether there is a next unprocessed shooting time in the list (S707), and if there is (S707), selects the next shooting time and repeats steps S705 and S706. When the unprocessed shooting time does not exist in the list (S707), the position determination application 62 transmits the ID and shooting position list determined in step S706 to the camera 510 (S709), and ends.

  In accordance with the list transmitted from the position determination application 62, the control device 524 of the digital camera 510 adds position information paired with the ID as a shooting position to the shot image specified by the ID of the list (S714). When all the IDs in the list have been processed, the control device 524 ends the processing shown in FIG.

  As described above, in this embodiment, the log data is divided at the timing when it is determined that the date / time information is adjusted, thereby maintaining the continuity of the date / time in one log data. Thereby, for example, it is possible to prevent a movement path from being graphed or an unnatural position shift or the like when converting time data of a captured image into position data.

  FIG. 8 shows a schematic block diagram of the second embodiment of the present invention. The same components as those in FIG. 1 are denoted by the same reference numerals. Specifically, in the smartphone 810, the OS 850 is different from the function of the OS 50, and the function of the position recording application 860 is different from that of the position recording application 60 according to this difference.

  The following description will focus on the changed part and the characteristic part of the present embodiment. Similar to the OS 50, the OS 850 not only has a general function of controlling a device installed in the smartphone 810, but also provides various services to the application.

  The location information service 852 of the OS 850 has the same function as the location information service 52. The functions of the position determination function 852a and the movement distance calculation function 852b are the same as the position determination function 52a and the movement distance calculation function 52b of the position information service 52 described in the first embodiment, respectively.

  When the time adjustment of the RTC 48 occurs, the date adjustment function 854a of the date information service 854 supplies a notification to that effect (RTC adjustment notification signal) to the position recording application 860. In addition, the date / time output function 854b of the date / time information service 854 captures the current date / time information from the output of the RTC 48 in response to an inquiry from the position recording application 860 and provides it to the position recording application 860 in the same manner as the date / time output function 54b.

  With reference to FIG. 9, the log generation operation by the position recording application 860 will be described in detail. FIG. 9 shows a flowchart of log file generation by the position recording application 860. In the flow shown in FIG. 9, the response mode for each distance of the location information service 852 is used. The position recording application 860 includes a log generation function 860a, a log recording function 860b, and an RTC adjustment value storage function 860c as characteristic functions. The log generation function 860a is a function for opening / closing a log file. The log recording function 860b is a function for recording a pair of position information and date / time information in a log file. The RTC adjustment value storage function 860c is a function of storing the time adjustment value of the RTC 48 and the date and time when the time adjustment is performed.

  When the location recording application 860 is activated, it initializes the distance D set in the location information service and other internal variables (S901). At this time, the location recording application 860 requests the date and time information service 854 of the OS 850 to notify the adjustment value when the time adjustment of the RTC 48 is performed. In response to this request, the date / time adjustment function 854a of the date / time information service 854 adjusts the time of the RTC 48 and includes the date / time after adjustment and a date / time adjustment value indicating the amount of date / time changed by the adjustment. The position notification application 860 is notified of the notification.

  Next, the log generation function 860a of the position recording application 860 newly opens a log file on the SSD 18 (S902).

  The position recording application 860 supplies the position information request in the response mode for each distance designating the movement distance D (here, the horizontal movement distance) to the position information service 852 of the OS 850 (S903). In accordance with this request, the position determination function 52a of the position information service 852 activates the GPS receiver 36 and starts to sequentially acquire position information output from the GPS receiver 36. The process of step S903 and the process of the location information service 852 responding thereto are the same as the process performed in step S3 of FIG. 2 and the process of the location information service 52 responding thereto.

  The location recording application 860 waits to receive location information from the location information service 852 of the OS 850 (S904). When receiving the position information from the position information service 852, the position recording application 860 substitutes the two-dimensional coordinate value of the received position information into variables (Px, Py) (S905). Subsequently, the position recording application 860 inquires the date and time information service 854 about the current date and time (S906). The date and time output function 854b of the date and time information service 854 reads the current date and time that is the output value of the RTC 48 and supplies it to the location recording application 860 that is the request source. Thereby, the position recording application 860 receives the current date and time information.

  The position recording application 860 substitutes the current date and time information acquired from the date and time information service 854 for the variable Tc (S907).

  Next, the location recording application 860 determines whether location information has already been written in the log file (S908). In other words, it is determined whether or not the position information to be written to the log file is the first position information to be written to the log file.

  If the position recording application 860 determines that position information has not been written in the log file, the process proceeds to step S913 without passing through step S909. The log recording function 860b of the position recording application 860 appends the position information (Px, Py) in step S905 and the date / time information Tc in step S907 as a pair to the open log file (S913).

  On the other hand, if the position recording application 860 determines that position information has already been written in the log file, the process proceeds to step S909.

  The position recording application 860 checks whether or not a date / time adjustment notification has been received from the date / time information service 854 between the current date acquisition and the previous date / time acquisition (S909). The RTC adjustment value storage function 860c stores the date / time adjustment notification (including the date / time after the date / time adjustment and the date / time adjustment value) from the date / time information service 854.

  When the date / time adjustment notification has been received (Y in S909), the position recording application 860 accumulates the date / time adjustment value from the time of activation, and records the date / time adjustment value accumulated in the log file by the log recording function 860b (S910). . The log generation function 860a of the position recording application 860 closes the opened log file (S911), and then opens a new log file in which the date and time acquired in step S907 is incorporated in the file name (S912). Then, the log recording function 860b of the position recording application 860 appends the position information (Px, Py) in step S905 and the date / time information Tc in step S907 to the opened log file as a pair (S913).

  When the date / time adjustment notification has not been received (N in S909), the log recording function 860b of the position recording application 860 adds the position information (Px, Py) in step S905 and the date / time information Tc in step S907 to the open log file. Additional information is added as a pair (S913).

  After step S913, the position recording application 860 confirms the presence / absence of an end operation by the user (S914). If there is no end operation (N in S914), the position recording application 860 returns to Step S904. If the end operation has been performed (Y in S914), the position recording application 860 closes the log file opened by the log generation function 860a (S915), and ends.

  FIG. 10 shows an example of a log file generated first by the flowchart shown in FIG. FIG. 11 shows an example of a log file generated as a separate file by time adjustment following the log file shown in FIG. Since the log file shown in FIG. 10 is closed when the date / time adjustment occurs, the date / time adjustment value is recorded last in step S910. In the example shown in FIG. 10, the RTC 48 is postponed by 6 minutes. This date and time adjustment value may be recorded in the header part of the log file or may be recorded in the form embedded in the file name. In the log file shown in FIG. 10 and the log file shown in FIG. 11, the file name is generated from the serial number given in the log file generation order and the date / time information corresponding to the position information first recorded in the log file. ing.

  A record at a point moved by a predetermined distance D from the point of the last record in the log file shown in FIG. 10 is recorded as the first point in the log file shown in FIG. That is, in the example shown in FIG. 10 and FIG. 11, the date and time adjustment of the RTC 48 was performed before moving from the point (35.680999, 139.766018) to the point (35.680999, 139.766021). Become.

  As in the log file shown in FIG. 10, in the log file in which the date / time adjustment value is recorded, the date / time of each log data is used for time comparison after being corrected by the date / time adjustment value. After the correction by the date and time adjustment value, the log file shown in FIG. 10 and the log file shown in FIG. 11 can be data files lined up at the same time.

  For example, when performing time comparison as shown in FIG. 6 and FIG. 7, each time data of the log file shown in FIG. 10 is adjusted with the date and time adjustment value recorded in the same log file, and the time difference is adjusted. And will be used for time comparison.

  As described above, in this embodiment, a new log file is generated every time the date / time adjustment of the RTC 48 is performed, and the date / time adjustment value (a cumulative value when a plurality of date / time adjustments have been performed) is recorded in the log file. . As a result, when referring to the contents of the log file, the date and time adjustment can be easily corrected, and the timely movement trajectory and movement speed can be accurately depicted. Even when the shooting position information is associated with an image shot with a digital camera and the time stamp is embedded, more appropriate position information can be associated even when the date and time of the RTC 48 is adjusted.

  Although latitude and longitude are recorded as position information, it is obvious that an altitude value may be added. In this case, the moving distance D is a distance that takes into account the altitude difference.

  In the log file examples shown in FIGS. 10 and 11, the position immediately before the RTC date and time adjustment occurs is the last record of the preceding log file, and the position immediately after the RTC date and time adjustment is the first record of the new log file. .

  On the other hand, the position immediately before the time adjustment of the RTC 48 may be set as the first record of the new log file. In this case, the positioning date and time recorded as the first record is a value adjusted by the time adjustment value.

  Further, the positioning data immediately before the time adjustment of the RTC 48 may be recorded as the first record of the new log file while being the last record of the log file. That is, duplicate registration is performed in two log files. At this time, the positioning date and time recorded as the first record of the new log file is a value adjusted by the time adjustment value.

  In the above embodiment, the log file is a separate file before and after the time adjustment. In contrast, a time adjustment value field may be provided for each record or entry in a single log file, and the time adjustment value (cumulative value) may be recorded for records after the time adjustment. In this case, the time adjustment value recorded independently at the head of the log file is naturally unnecessary. The date and time supplied from the RTC 48 is recorded as the date and time of positioning. FIG. 12 shows a single log file example corresponding to the log examples shown in FIGS.

  By using such a log file, it is possible to easily realize any time adjustment from the past or the future. This is useful when a relative time difference is more important than an absolute date and time. In addition, the time reference can be set at an arbitrary time point, and various uses are possible.

  As a modification example, when the time is adjusted, the date / time information of the record or entry of the recorded log file may be adjusted similarly in the past.

  In addition to the above-described embodiment, when time adjustment is performed, for a log file older than the time adjustment, data or flag indicating that the date and time before time adjustment is recorded in the file name and other elements It may be added. Thereby, it becomes easy to confirm the reliability with respect to the recorded date.

  It is also convenient if a plurality of log files separated by time adjustment can be used in series. For such a use, a file naming rule may be adopted in which the same name is set in the first half of the file name and a serial number is added to the second half under a certain rule. Instead of a simple serial number, text indicating the amount of change in date / time information may be adopted. In any method, since a plurality of log files can be easily aggregated into one log file, subsequent use becomes easy.

  The above-described embodiments are examples as means for realizing the present invention, and can be appropriately modified or changed depending on the configuration of the apparatus to which the present invention is applied and various conditions. Moreover, each Example can be combined suitably.

  The above-described embodiment can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. To be executed.

  The functions of the above-described embodiments are not only realized by executing the program code read by the computer. For example, an OS (operation system) running on a computer performs part or all of the actual processing based on an instruction of the program code, and the functions of the above-described embodiments may be realized by the processing. Needless to say, it is included.

Furthermore, it goes without saying that the case where the functions of the above-described embodiments are realized by the following processing is also included. First, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU provided in the function expansion board or function expansion unit performs part or all of the actual processing.

Claims (10)

A log generation device capable of wireless communication with an imaging device,
Position acquisition means for acquiring position information;
Date and time acquisition means for acquiring date and time information indicating the date and time when the position information is acquired by the position acquisition means from the time measuring unit that measures the date and time;
Generating means for generating a log file containing the log data and the date and time information associated indicating the date and time when obtaining the positional information of each a plurality of position information,
Detection means for detecting adjustment of the date and time that the timekeeping unit measures,
Receiving means for receiving information for identifying an image and time information associated with the image from the imaging device;
Correspondence for executing collation processing for associating information for identifying the image and position information included in the log file based on time information received by the receiving unit and date / time information included in the log file Means,
Transmission means for transmitting the result of the collation processing executed by the association means to the imaging device
And
When the date and time adjustment is detected by the detecting means, the generating means generates a new log file different from the existing log file ,
The association unit preferentially uses the new log file among the existing log file and the new log file for the collation process . 2. The log generating apparatus according to claim 1, wherein the position information acquired after the date and time adjustment is detected by the detecting unit is recorded in another log file newly generated by the generating unit. The position information acquired before the detection unit detects the date and time adjustment and the position information acquired after the detection unit detects the date and time adjustment are recorded in separate log files. The log generation device according to claim 1, wherein The said detection means detects the adjustment of the said date based on the time difference between the several date information acquired continuously by the said date acquisition means, The said date and time of any one of Claim 1 thru | or 3 characterized by the above-mentioned. Log generator. When the date and time information acquired later among the plurality of date and time information continuously acquired by the date and time acquisition unit indicates a date and time that is earlier than the date and time indicated by the date and time information acquired earlier, the detection unit log generating device according to any one of claims 1 to 4 for detecting that the adjustments were made. Of the plurality of date and time information continuously acquired by the date and time acquisition means, when the date and time information acquired later indicates a date and time that is a predetermined time or more after the date and time indicated by the date and time information acquired earlier It means log generating device according to any one of claims 1 to 5 to detect that the adjustment of the time is performed. If the adjustment of the time is detected by the pre-Symbol detection means, said generating means, by opening the closed new log files existing log file, claims, characterized in that to generate a new log file The log generation device according to any one of 1 to 6 . When the date and time adjustment is detected by the detection unit, the generation unit records a value indicating the amount of the date and time adjustment in an existing log file and closes the existing log file. The log generation device according to claim 7 . A method of controlling a log generation device capable of wireless communication with an imaging device,
A position acquisition step of acquiring position information;
A date and time acquisition step of acquiring date and time information indicating the date and time when the position information is acquired from the time measuring unit that measures the date and time;
A first generating step of generating a log file containing the log data and the date and time information associated indicating the date and time when obtaining the positional information of each a plurality of position information,
A detection step of detecting an adjustment of the date and time that the timekeeping unit counts;
A receiving step of receiving information for identifying an image and time information associated with the image from the imaging device;
Correspondence for executing collation processing for associating information for identifying the image and position information included in the log file based on the time information received in the reception step and the date / time information included in the log file Process,
A transmission step of transmitting the result of the collation processing executed in the association step to the imaging device ;
A log generation method comprising: a second generation step of generating new log data different from existing log data when date and time adjustment is detected in the detection step. A computer-readable program for causing a computer to function as each unit of the log generation device according to any one of claims 1 to 8 .

Images