JP6203166B2 - Image reproduction system, image reproduction method, image data transmission server, image data transmission method, and image data transmission program - Google Patents

Description

  The present invention relates to an image generation system, an image generation method, an image data transmission server, an image data transmission method, and an image data transmission program. In particular, the present invention accurately identifies the current location of an indoor user and is useful for the user. The present invention relates to communication technology when providing information appropriately.

  Conventionally, a navigation system using a positioning system that uses positioning information is known (for example, see Patent Document 1).

  Patent Document 1 discloses a navigation device that uses a wired or wirelessly connected information terminal as a display unit, receiving a start signal from the information terminal and starting it, and a travel route to the destination. There is disclosed a navigation system comprising: a travel route search means for searching for a vehicle; and a guide data transmission means for transmitting guide data for the searched travel route to the information terminal.

JP 2011-227088 A

  However, since the navigation system described in Patent Document 1 uses a transmission radio wave transmitted from an artificial satellite, the radio wave is difficult to reach indoors, and the user's exact current location may not be specified indoors. There is a possibility that indoor information useful for indoor users cannot be appropriately provided.

  Therefore, the present invention can be one of the objects to accurately specify the current location of an indoor user and appropriately provide indoor information useful for the user.

An image reproduction system according to one aspect of the present invention includes an image data transmission server that transmits image data, and a mobile device that reproduces an image based on the image data. The image data transmission server includes: For each of one or more signal sources indoors, signal source information including one or more image data obtained by imaging the surroundings of the signal source and signal source installation position information corresponding to the installation position of the signal source; A first receiving unit that receives the image data, a storage unit that stores the image data and the signal source information in association with each other, and identification information that identifies the signal source transferred by the mobile device is collated with the signal source information. A matching unit, a specifying unit that identifies the current location of the mobile device based on a result of the matching performed by the matching unit, and one or more routes from the current location to the destination are calculated and arranged on the route A calculation unit that calculates the shortest route from the current position to the destination was based on the number of signal sources to be adjacent to the signal source, the image data stored in association with the signal source identified And a transmitter that transmits the route information indicating the shortest route to the mobile device, and the mobile device is associated with each of the one or more signal sources installed at the signal source installation position. A second receiving unit that receives identification information for identifying the signal source from the signal source, and a transfer unit that transfers the received identification information to the image data transmission server when entering the communicable area, Based on the image data transmitted from the image data transmission server and the route information, a display unit that reproduces an image associated with each of the signal sources arranged along the shortest route; Provided.

In the image reproduction method according to one aspect of the present invention, the image data transmission server includes, for each of one or more signal sources indoors, one or more image data obtained by the surroundings of the signal source and the signal source. Signal source information including signal source installation position information corresponding to the installation position, the image data transmission server stores the image data and the signal source information in association with each other, and the mobile device transmits the signal source. When entering a predetermined communicable area associated with each of the one or more signal sources installed at the installation position, the mobile station receives identification information for identifying the signal source from the signal source, The received identification information is transferred to the image data transmission server, and the image data transmission server collates identification information for identifying the signal source transferred by the mobile device with the signal source information, and The transmission server specifies the current location of the mobile device based on the result of the collation, and the image data transmission server calculates one or more routes from the current location to the destination, and the signal arranged on the route The shortest route from the present location to the destination is calculated based on the number of signal sources adjacent to the source , and the image data transmission server stores the image data associated with the identified signal source. And route information indicating the shortest route are transmitted to the mobile device, and the mobile device is arranged along the shortest route based on the image data and the route information transmitted from the image data transmission server. Replaying an image associated with each signal source.

The image data transmission server according to an aspect of the present invention corresponds to one or more signal sources indoors, the signal source corresponding to one or more image data obtained by imaging the surroundings and the signal source installation position. A receiving unit that receives signal source information including signal source installation position information, a storage unit that stores the image data and the signal source information in association with each other, and one or more signals installed at the signal source installation position A collation unit for collating identification information for identifying the signal source transferred by the mobile device with the signal source information when the mobile device enters a predetermined communicable area associated with each of the sources; A specifying unit for specifying the current location of the mobile device based on a result of verification by the verification unit, one or more routes from the current location to the destination, and a signal adjacent to the signal source arranged on the route the number of source Based on the calculation unit for calculating the shortest route from the current location to the destination, the image data stored in association with the identified signal source, and route information indicating the shortest route. And a transmission unit for transmitting to.

An image data transmission method according to one aspect of the present invention corresponds to one or more image sources obtained by imaging the surroundings of the signal source and the signal source installation position for each of one or more signal sources indoors. A reception step of receiving signal source information including signal source installation position information, a storage step of storing the image data and the signal source information in association with each other, and one or more signals installed at the signal source installation position A collating step of collating identification information for identifying the signal source transferred by the mobile device with the signal source information when the mobile device enters a predetermined communicable area associated with each of the sources; A specifying step of specifying the current location of the mobile device based on the result of the verification in the verification step; and calculating one or more routes from the current location to the destination before being placed on the route Wherein the calculating step of calculating the shortest route from the current position to the destination based on the number of signal sources adjacent to the signal source, and the image data stored in association with the signal source identified shortest Transmitting the route information indicating the route to the mobile device.

An image data transmission program according to one aspect of the present invention provides a computer with one or more image data obtained by imaging the surroundings of the signal source and the signal source installation position for each of one or more signal sources indoors. A reception function for receiving signal source information including signal source installation position information corresponding to the above, a storage function for storing the image data and the signal source information in association with each other, and one installed at the signal source installation position A collation function for collating identification information for identifying the signal source transferred by the mobile device with the signal source information when the mobile device enters a predetermined communicable area associated with each of the above signal sources. And a specific function for identifying the current location of the mobile device based on the result of collation by the collation function, and one or more routes from the current location to the destination are calculated and arranged on the route Wherein from the current location based on the number of signal sources adjacent to the serial signal source and calculating function for calculating the shortest route to the destination, and the image data stored in association with the signal source identified And a transmission function for transmitting route information indicating the shortest route to the mobile device.

  In the present invention, “part”, “apparatus”, and “system” do not simply mean physical means, but the functions of the “part”, “apparatus”, and “system” are realized by software. This includes cases where Further, even if the functions of one “part”, “apparatus”, and “system” are realized by two or more physical means and apparatuses, two or more “parts”, “apparatus”, “system” The function may be realized by one physical means or apparatus.

  According to the present invention, when the mobile device enters the communicable area of the signal source, the mobile device acquires identification information from the signal source and transfers it to the image data transmission server. As a result of collation with the information stored in the storage unit, the communicable area and signal source to which the mobile device belongs is identified from the identification information, and the image data stored in association with the identified signal source is read out By transmitting to the mobile device, the current location of the indoor user can be accurately specified, and indoor information useful for the user can be appropriately provided.

1 is an overall configuration diagram of an image generation system according to a first embodiment of the present invention. It is a block diagram of the image data transmission server which concerns on 1st Embodiment of this invention. It is a figure which shows an example of each table | surface of the data stored in the memory | storage part of the image data transmission server which concerns on 1st Embodiment of this invention, and information. It is a figure which shows an example of the facility table memorize | stored in the memory | storage part of the image data transmission server which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the installation table memorize | stored in the memory | storage part of the image data transmission server which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the Beacon table memorize | stored in the memory | storage part of the image data transmission server which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the Map table memorize | stored in the memory | storage part of the image data transmission server which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the adjacent Map table memorize | stored in the memory | storage part of the image data transmission server which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the installation position of the signal source which concerns on 1st Embodiment of this invention. It is a block diagram which shows schematically the hardware constitutions of the mobile apparatus which concerns on 1st Embodiment of this invention. 1 is a block diagram of a mobile device according to a first embodiment of the present invention. It is the figure which showed the indoor installation which concerns on 1st Embodiment of this invention, and the communicable area of the signal source installed indoors. It is a figure which shows an example of the image displayed on the display of the mobile apparatus which concerns on 1st Embodiment of this invention. It is a flowchart which shows an example of the navigation processing flow which concerns on 1st Embodiment of this invention. It is a flowchart which shows an example of the navigation processing flow which concerns on 2nd Embodiment of this invention. It is a flowchart which shows an example of the navigation processing flow which concerns on 2nd Embodiment of this invention. It is a flowchart which shows an example of the Map image processing flow which concerns on 3rd Embodiment of this invention.

<First Embodiment>
FIG. 1 is an overall configuration diagram of an image generation system according to the first embodiment of the present invention. As shown in FIG. 1, the image generation system 1 exemplarily includes a plurality of signal sources 3 installed in an indoor I, an image data transmission server 5, and a mobile device 7 possessed by a user. Yes. The image data transmission server 5 is connected to each of the signal source 3 and the mobile device 7 via the communication network N.

  The specific configuration of the communication network N is not limited. For example, the communication network N may be constructed by one or both of a wired network and a wireless network. The wireless network is, for example, Wi-Fi (Wireless Fidelity), Bluetooth, or the like. The communication network N may be constructed by one or both of the Internet and the LAN.

  The signal source 3 is a device that can communicate with another communication device including an imaging device (for example, an omnidirectional camera) (not shown). Each signal source 3 communicates with the image data transmission server 5 through one or both of a wired network and a wireless network. Each signal source 3 communicates with the mobile device 7 via a wireless network (for example, Bluetooth). Each signal source 3 has an area where radio waves from each signal source 3 reach, that is, a communicable area associated with each signal source 3. Although the image generation system 1 includes three signal sources 3, the number of signal sources 3 is not limited and may be one or more.

  The signal source 3 images the surroundings of the signal source installation position for each position (signal source installation position) where one or more signal sources are installed indoors by the imaging device. Each signal source 3 is image data for each signal source installation position obtained by imaging the surroundings of the signal source installation position for each position (signal source installation position) where one or more signal sources are installed indoors. And signal source information including signal source installation position information corresponding to the signal source installation position is transmitted to the image data transmission server 5. Note that objects to be imaged by the imaging device include indoor facilities, that is, indoor stores, elevators, escalators, toilets, passages, and objects (for example, benches) installed indoors. The image data is obtained by imaging the indoor equipment.

  The signal source 3 transmits information corresponding to the imaging direction of the imaging device (imaging direction information) together with the image data to the image data transmission server 5. The imaging direction may be a direction in which the imaging device captures an image. Further, with respect to the imaging direction, a certain azimuth may be used as a reference azimuth, and a change from the reference azimuth may be indicated by an angle. Further, the signal source 3 transmits identification information (for example, UUID (Universally Unique Identifier), Major Value, and Minor Value), and the mobile device 7 enters (comes into) the communication area. The mobile device 7 receives the identification information.

  Note that the imaging device may be configured separately from the signal source 3, and may image the periphery of the signal source 3 at a position away from the signal source 3. In this case, the image pickup apparatus captures the image data for each signal source installation position and the signal source obtained by imaging the periphery of the signal source installation position for each of one or more signal source installation positions in the room. Signal source information including signal source installation position information corresponding to the installation position is transmitted to the image data transmission server 5. The imaging device also transmits the imaging direction information to the image data transmission server 5.

  The image data transmission server 5 is a computer that provides indoor information (for example, image data) to the mobile device 7. The image data transmission server 5 may be configured by a single computer or may be configured by a plurality of computers.

  FIG. 2 is a block diagram of the image data transmission server according to the first embodiment of the present invention. As illustrated in FIG. 2, the image data transmission server 5 includes a reception unit 51, a storage unit 53, a collation unit 55, a specification unit 57, a calculation unit 59, an image generation unit 61, and a transmission unit 63. It is configured to include. Among the above, the collation unit 55, the identification unit 57, the calculation unit 59, and the image generation unit 61 are functional blocks that are realized when the image data transmission server 5 executes a predetermined software program.

  The receiving unit 51 is a block that receives various data and information from the signal source 3 and the mobile device 7. Specifically, the receiving unit 51 receives image data obtained by imaging the periphery of the signal source installation position from the signal source 3 with the imaging device. Further, when the signal source 3 and the imaging device are separate, the receiving unit 51 receives image data obtained by imaging the periphery of the signal source installation position by the imaging device from the imaging device. More specifically, the receiving unit 51 obtains image data for each signal source installation position obtained by the imaging device imaging the periphery of the signal source installation position for each of one or more signal source installation positions indoors. And signal source information including signal source installation position information corresponding to the signal source installation position.

  Furthermore, the receiving unit 51 receives various information and requests from the mobile device 7 or a predetermined network. For example, the receiving unit 51 receives the identification information of each signal source 3 transferred from the mobile device 7. The receiving unit 51 receives a navigation process execution request, a destination specifying process request by web search, and the like. Furthermore, the receiving unit 51 receives the lifting / lowering means information such as stairs / elevators / escalators from the mobile device 7 or a predetermined network.

The storage unit 53 is a block that stores various data and information received by the receiving unit 51. Specifically, the storage unit 53 stores information including at least image data 53A, signal source information 53B, identification information 53C, imaging direction information 53D, and route information 53E. For example, the storage unit 53 stores image data 53A, signal source information 53B, identification information 53C, imaging direction information 53D, and route information 53E in association with each other. For example, the storage unit 53 can store image data obtained by the imaging device imaging indoor equipment in a predetermined direction from the signal source installation position in association with imaging direction information corresponding to the direction.
Here, the signal source information 53B includes “location” where each signal source 3 is installed, “building” where each signal source 3 is installed, and “floor number” where each signal source 3 is installed. ”, Information including at least information corresponding to the position where each signal source 3 is installed, for example,“ latitude ”,“ longitude ”, and“ altitude ”where each signal source 3 is installed.
The image data 53A includes not only at least one image data around the signal source 3, but also at least one image data of a map image generated by an image generation unit 61 described later.

  FIG. 3 is a diagram illustrating an example of each table of data and information stored in the storage unit of the image data transmission server according to the first embodiment of the present invention. Specifically, as shown in FIG. 3, the storage unit 53 includes a facility table in FIG. 3A, an equipment table in FIG. 3B, a Beacon (beacon: signal source) table in FIG. The Map table in FIG. 3D and the adjacent Map table in FIG.

  FIG. 4 is a diagram illustrating an example of a facility table stored in the storage unit of the image data transmission server according to the first embodiment of the present invention. Specifically, as illustrated in FIG. 4, the storage unit 53 illustratively includes “facility ID”, “address 1”, “address 2”, “address 3”, “address 4” assigned to each facility. ”,“ Address 5 ”, and information corresponding to“ building ”are stored in association with each other.

  For example, as illustrated in FIG. 4, the storage unit 53 stores “facility ID” as “1”, “address 1” as “prefecture”, “address 2” as “city”, and “address 3” as “ “City, Large Character”, “Address 4” are stored in association with each other as “Chome, Character”, “Address 5” as “Address”, and “Building” as “X Building”.

  FIG. 5 is a diagram illustrating an example of an equipment table stored in the storage unit of the image data transmission server according to the first embodiment of the present invention. Specifically, as shown in FIG. 5, the storage unit 53 illustratively corresponds to “facility ID” attached to each facility, “facility ID” in FIG. 4, and image data 53 </ b> A of each signal source 3. "Map", indoor "equipment name", "hierarchy" where the equipment is located, and information corresponding to information regarding the imaging direction ("angle") when the imaging device of each signal source 3 images the indoor equipment Remember. This indicates that the indoor equipment is installed in this imaging direction. Information relating to the imaging direction (imaging direction information) is defined by an “angle” from the reference line R1, R2, R3 of each signal source 3, for example, as described in FIG.

  For example, as shown in FIG. 5, the storage unit 53 has “equipment ID” of “1”, “facility ID” of “1 (address + building)”, “Map” of “MapA”, and “equipment name” of “A1 store” and “angle” are stored in association with each other as “45 degrees”.

  FIG. 6 is a diagram showing an example of a Beacon (beacon: signal source) table stored in the storage unit of the image data transmission server according to the first embodiment of the present invention. Specifically, as illustrated in FIG. 6, the storage unit 53 exemplarily includes “Beacon ID” that is an ID of the signal source 3, “UUID”, “Major”, and / or “ "Minor" (identification information), "Map" corresponding to the image data 53A of each signal source 3, and information corresponding to "latitude", "longitude", and "altitude" of the position where each signal source 3 is installed. Store it in association.

  For example, as illustrated in FIG. 6, the storage unit 53 stores “Beacon ID” as “1”, “UUID” as “A”, “Major” as “MAA”, “Minor” as “MIA”, and “Map”. Are stored in association with each other as “MapA”, “latitude” as “Xla-A”, “longitude” as “Xlo-A”, and “altitude” as “Xh”.

  FIG. 7 is a diagram illustrating an example of a Map table stored in the storage unit of the image data transmission server according to the first embodiment of the present invention. Specifically, as illustrated in FIG. 7, the storage unit 53 illustratively includes “Map ID” assigned to each Map, “Map” corresponding to the image data 53 </ b> A of each signal source 3, and each signal source. The information corresponding to “Latitude”, “Longitude”, “Altitude”, “Flag”, and “Adjacent Map” indicating Map adjacent to “Map” is stored in association with each other. The “adjacent Map” will be described in detail in FIG.

  For example, as illustrated in FIG. 7, the storage unit 53 stores “Map ID” as “1”, “Map” as “MapA”, “Latitude” as “Xla-A”, and “Longitude” as “Xlo-A”. “Altitude” is stored as “Xh”, “Flag” as “1”, and “Adjacent Map” as “MapA-0, MapA-1, MapA-2”. As for the “flag”, “1” is set when the information and data are set for the signal source (beacon), and “0” is set when the information and data are set for the adjacent map. Is done.

  FIG. 8 is a diagram illustrating an example of an adjacent Map table stored in the storage unit of the image data transmission server according to the first embodiment of the present invention. Specifically, as shown in FIG. 8, the storage unit 53 exemplarily includes “adjacent Map ID” assigned to each adjacent Map, “From” indicating the reference Map, and adjacent to the reference Map. The information corresponding to the “angle” indicating the “To” Map to which the “To” Map is located from the “To” and “From” Map indicating the Map to be associated is stored.

  For example, as illustrated in FIG. 8, the storage unit 53 sets “Neighboring Map ID” to “1”, “From” to “MapA”, “To” to “MapA-0”, and “Angle” to “0”. Store them in association with each other.

  Here, FIG. 9 is a diagram illustrating an example of an installation position of the signal source according to the first embodiment of the present invention. As shown in FIG. 9, a plurality of signal sources 3 are installed in the indoor I, and MapA, MapA-0, MapA-1, MapA-2,. Yes. Here, when MapA is “From” shown in FIG. 8, with reference to the virtual reference line R1 (reference angle: 0 degree), “MapA-0” that is “To” is in the 0 degree direction from MapA. “MapA-1” that is “To” in the imaginary line L1 direction is 315 degrees from MapA, and “MapA-2” that is “To” in the imaginary line L2 direction is 270 degrees from MapA. Understandable. Thus, for example, the adjacent maps for MapA are MapA-0, MapA-1, and MapA-2.

  Returning to FIG. 2, the collation unit 55 is a block that collates each identification information of one or more signal sources 3 received by the reception unit 51 with information stored in the storage unit 53. For example, the collation unit 55 collates each identification information for identifying each signal source 3 transferred by the mobile device 7 with the signal source information stored in the storage unit 53.

  The identifying unit 57 is a block that identifies the communicable area to which the mobile device 7 belongs and the signal source 3 based on the collation result of the collation unit 55. For example, when the collation unit 55 collates each of the identification information for identifying each signal source 3 transferred by the mobile device 7 with the signal source information stored in the storage unit 53, the specifying unit 57 identifies each communicable area to which the mobile device 7 belongs and each signal source 3 corresponding to each communicable area.

  The calculation unit 59 is a functional block that calculates a route from the current location of the user (mobile device 7) to the destination. For example, when the receiving unit 51 receives a route guidance request from the mobile device 7, the calculating unit 59 calculates a route from the current location of the user (mobile device 7) to the destination. The calculation unit 59 outputs route information corresponding to the calculated route. For example, the calculation unit 59 determines whether the destination input to the mobile device 7 and the current location of the mobile device 7 are on the same floor or different floors. Then, the calculation unit 59 counts the number of adjacent maps in the route to the destination, and determines the route having the smallest map number count as the optimum route.

  The image generation unit 61 is a block that generates a map (Map) image based on at least one of the image data around the signal source 3 from the signal source 3. The image generation unit 61 generates an image for each signal source 3 based on the image data stored in association with the signal source 3. Furthermore, the image generation unit 61 generates an image based on the image data based on detection results of various sensors such as an orientation sensor 36 and an acceleration sensor 38 described later.

  The transmission unit 63 is a block that transmits various data and information (for example, image data) of the image data transmission server 5 to the mobile device 7. For example, the transmission unit 61 is a block that transmits the image data 53 </ b> A stored in the storage unit 53 to the mobile device 7. The transmission unit 63 transmits the image data 53 </ b> A stored in association with the signal source 3 specified by the specifying unit 57 to the mobile device 7.

  The mobile device 7 is a type of wireless communication device and is a device capable of transmitting and receiving data and information to and from other devices by radio waves or the like. For example, an image (map image) based on image data from the image data transmission server 5 is used. ) Is played (displayed).

  FIG. 10 is a configuration diagram schematically illustrating the hardware configuration of the mobile device 7. The mobile device 7 includes, for example, a rectangular thin housing, and a touch panel 14 for displaying and inputting various images is configured to occupy many portions on one surface of the thin housing. Yes. In addition, a speaker 16 for outputting voice during a call, a mail ringtone, a telephone ringing tone, music, and the like, and a microphone 18 for inputting a signal such as voice are provided. On the side surface and bottom surface of the mobile device 7, an external interface such as a hard button 20, a hard key 22, and an audio output terminal 24 </ b> A that allows the user to turn on / off the power supply of the mobile device 7 and perform various operations. 24 is provided. Further, a camera 26 is provided on the back of the housing.

  The touch panel 14 has functions of both a display device and an input device, and includes a display (display screen) 14A that bears the display function and a touch sensor 14B that bears the input function. The display 14A is configured by a general display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The touch sensor 14B includes an element that is disposed on the upper surface of the display 14A and detects a contact operation (contact) and a transparent operation surface stacked on the element. As a contact detection method of the touch sensor 14B, any of known methods such as a capacitance type, a resistance film type (pressure sensitive type), and an electromagnetic induction type can be adopted.

  The display 14A as a display device displays an image generated by execution of an image generation program (not shown) in the storage unit 34 by the central processing unit 28. The touch sensor 14B as an input device detects an operation of a contact object (including a user's finger or stylus, which will be described as a representative example) in contact with the operation surface. Then, an operation input is received and information on the contact position is given to the central processing unit 28. The movement of the finger is detected as coordinate information indicating the position or area of the contact point, and the coordinate information is expressed as coordinate values on two axes in the short side direction and the long side direction of the touch panel 14, for example. Hereinafter, for the sake of simplicity, both the display 14A as a display device and the touch sensor 14B as an input device are simply referred to as “touch panel 14”.

  In the mobile device 7, as shown in FIG. 10, each of the above components is connected to an internal central processing unit 28. The central processing unit 28 is further connected to a mobile communication antenna 30A, a mobile communication unit 30, a wireless LAN communication antenna 32A, a wireless LAN communication unit 32, and a storage unit 34.

  The direction sensor 36 detects the direction of the user (mobile device 7) and determines the traveling direction of the user (mobile device 7). For example, the direction sensor 36 determines the traveling direction of the user based on the attitude of the mobile device 7 at a certain time. In general, a geomagnetic sensor is used as the azimuth sensor 36, but there is no particular limitation as long as it has a function of determining the traveling direction of the user.

  The direction sensor 36 can also determine the user's traveling direction using the relationship between the vertical acceleration and the traveling direction acceleration after determining the vertical direction to derive the attitude of the mobile device 7. The direction sensor 36 can also determine the traveling direction based on the horizontal acceleration distribution detected by an acceleration sensor 38 described later. Furthermore, the azimuth sensor 36 can also determine the traveling direction from the characteristics of the pedestrian's arm swing.

  The acceleration sensor 38 detects the acceleration of the user (mobile device 7). For example, the acceleration sensor 38 detects acceleration for each of the X axis, the Y axis, and the Z axis. The acceleration sensor 38 outputs the detected acceleration data to the central processing unit 28. For example, the acceleration sensor 38 is fixedly incorporated in the mobile device 7, and if the orientation of the mobile device 7 is determined, the direction of the axis of the acceleration sensor 38 is also determined. The mobile device 7 may be configured to include other sensors such as an atmospheric pressure sensor (not shown) as sensors other than the direction sensor 36 and the acceleration sensor 38.

  FIG. 11 is a functional block diagram of the mobile device 7. As shown in FIG. 11, the mobile device 7 includes a reception unit 71, a storage unit 73, a transfer unit 75, an orientation detection unit 77, an acceleration detection unit 79, and a display unit 81. . Among the above, at least the azimuth detecting unit 77 and the acceleration detecting unit 79 are functional blocks realized when the mobile device 7 executes a predetermined software program.

  The receiving unit 71 is a block that receives various data and information from the signal source 3 and the image data transmission server 5. For example, identification information for identifying the signal source 3 transmitted from the signal source 3 is received. Specifically, the signal source 3 is identified from the signal source 3 when the user (mobile device 7) enters a predetermined communicable area of each of the one or more signal sources installed at the signal source installation position. The identification information to be received is received.

  The receiving unit 71 receives image data 53A transmitted from the image data transmitting server 5 and information stored in the storage unit 53, such as signal source information 53B, imaging direction information 53D, route information 53E, and the like.

  The storage unit 73 is a block that stores various data and information from the signal source 3 and the image data transmission server 5. Specifically, the storage unit 73 includes image data 73A, signal source information 73B, identification information 73C, imaging direction information 73D, direction information 73E detected by the direction detection unit 77 (direction sensor 36), and acceleration detection unit 79 ( Information including at least acceleration information 73F detected by the acceleration sensor 38) and route information 73G is stored. For example, the storage unit 73 stores information corresponding to image data (including Map image data) from the image data transmission server 5 and various types of information (for example, “equipment name” and “angle”) included in the tables of FIGS. And the like are stored in association with each other.

  The information stored in the storage unit 53 of the image data transmission server 5 and the storage unit 73 of the mobile device 7 partially or entirely match. For example, the imaging direction information 53D stored in the storage unit 53 of the image data transmission server 5 and the imaging direction information 73D stored in the storage unit 73 of the mobile device 7 may coincide with each other. A part of the imaging direction information 53D matches a part of the plurality of imaging direction information 73D, and the other part of the plurality of imaging direction information 53D and the other part of the plurality of imaging direction information 73D. It does not have to match.

  The transfer unit 75 is a block that transfers the identification information of the signal source 3 from the signal source 3 received by the receiving unit 71 to the image data transmission server 5.

  The direction detection unit 77 is, for example, the direction sensor 36. The acceleration detection unit 79 is an acceleration sensor 38, for example.

  The display unit 81 (image reproduction unit) is a block that displays (reproduces) an image based on the image data from the image data transmission server 5. The display unit 81 is, for example, the display 14A.

  FIG. 12 is a diagram illustrating indoor facilities (address: X, building name: X building, number of floors: 1st floor) and a communicable area of a signal source installed indoors according to the first embodiment of the present invention. . As shown in FIG. 12, the indoor I has a downwardly U-shaped passage P connected from the entrance to the exit. And, in the indoor I, the passage P along the direction of the arrow, for example, A2 store 101, A3 store 102, A1 store 100, B3 store 105, B2 store 104, B1 store 103, emergency staircase 106, toilet 107, C1 store 108, 1EV (elevator) 109, and 2EV (elevator) 110 indoor facilities are installed. In addition, a detection device D that detects that a user (mobile device 7) has entered the room I is installed at the entrance.

  In addition, signal sources 3A, 3B, and 3C are installed in the indoor I, and the signal sources 3A, 3B, and 3C have communication areas A1, A2, and A3, respectively. The surroundings of the signal sources 3A, 3B, and 3C are imaged by the imaging devices of the signal sources 3A, 3B, and 3C, so that the image data (MapA, MapB, and MapC) around the signal sources 3A, 3B, and 3C are captured. ) Is obtained. Note that the imaging device may be provided for each of the signal sources 3A, 3B, and 3C, or separately from the signal source 3 and may image the surroundings of each signal source 3 as a single unit.

  Further, in order to grasp which direction (orientation) each indoor facility is from each signal source 3A, 3B, 3C, and in what imaging direction the imaging device has imaged each indoor facility, Assuming that the reference lines R1, R2, and R3 used virtually by the signal sources 3A, 3B, and 3C are 0 degrees, the direction (azimuth) in which each indoor facility is arranged is defined by the “angle”.

  For example, with respect to the virtual reference line R1 of the signal source 3A, the “angle” of “A1 store” is “45 degrees”, the “angle” of “A2 store” is “120 degrees”, and “A3 store” The “angle” is “270 degrees” (see FIG. 5).

  FIG. 13 is a diagram illustrating an example of an image (Map) displayed on the touch panel 14 of the mobile device 7. Specifically, FIG. 13 is obtained when the imaging device captures a direction (azimuth) having an “angle” of 110 degrees from the reference line R2 of the signal source 3B in the mobile device 7 automatically or by user operation. An example of displaying an image of the image data to be displayed is shown. As shown in FIG. 13, B2 stores are installed in the direction (azimuth) where the “angle” is 110 degrees from the reference line R2 of the signal source 3B, and the B1 store 103 and the A1 store are located on both sides of the B2 store. It can be seen that 100 is installed.

  As shown in FIG. 13, buttons B <b> 1 to B <b> 7 are displayed on the touch panel 14. For example, when the user selects the button B1 on the touch panel 14 (for example, the user's finger touches), the image display is enlarged on the touch panel 14. Further, when the user selects the button B <b> 2 on the touch panel 14, the display image is reduced on the touch panel 14. Further, when the user selects the button B3 on the touch panel 14, the display image slides leftward on the touch panel 14. When the user selects the button B4 on the touch panel 14, the display image slides in the right direction on the touch panel 14. When the user selects the button B5 on the touch panel 14, the display image slides upward on the touch panel 14. When the user selects the button B6 on the touch panel 14, the display image slides downward on the touch panel 14. When the user selects the button B7 on the touch panel 14, the image display is canceled on the touch panel 14, and control such as returning to the home screen or returning to the previous display screen is performed. As described above, the central processing unit 28 of the mobile device 7 performs image display control by user operation.

(Navigation process)
FIG. 14 is a flowchart showing an example of a navigation processing flow according to the first embodiment of the present invention. As a premise, the user downloads the navigation processing application software according to the embodiment of the present invention from a predetermined site of the network, and stores it in the mobile device 7 so that it can be executed. When the execution of the application software is instructed by the user, the program operation based on the application software starts.

  As shown in FIG. 14, the image data transmission server 5 receives image data and signal source information from the signal source 3 (step SP1). The image data transmission server 5 also receives imaging direction information.

  Next, the image data transmission server 5 stores the image data and the signal source information in association with each other (step SP2). Further, the image data transmission server 5 stores the imaging direction information in association with the information. The image data transmission server 5 may store the image data from the signal source 3 as it is in association with the signal source information, or generates a Map image from the image data from the signal source 3, and generates the generated Map image. The image data may be stored in association with the signal source information.

  Next, when the user (mobile device 7) enters at least one of the communicable areas A1, A2, A3 of the signal sources 3A, 3B, 3C, the mobile device 7 enters each communicable area A1, A2, A2 that has entered. The identification information of each signal source 3A, 3B, 3C corresponding to A3 is received (step SP3). For example, as shown in FIG. 12, when the user (mobile device 7) first enters the communicable area A1, then enters the communicable area A2, and then enters the communicable area A3, the entry. In this order, the mobile device 7 receives the identification information from the signal source 3. In this case, the following steps may be executed every time the identification information is received, and the steps once performed may not be executed repeatedly.

  Next, the mobile device 7 transfers the identification information to the image data transmission server 5 (step SP4).

  Next, the mobile device 7 transmits a route guidance request to the destination to the image data transmission server 5 (step SP5).

  Next, the image data transmission server 5 collates the identification information with the signal source information according to the request (step SP6). Next, the image data transmission server 5 identifies the communicable area and signal source to which the mobile device 7 belongs based on the result of the collation (step SP7).

  Next, the image data transmission server 5 transmits the image data stored in association with each identified signal source 3 to the mobile device 7 (step SP8).

  Next, the display unit 81 of the mobile device 7 reproduces an image based on the image data from the image data transmission server 5 (step SP9).

  For example, the mobile device 7 controls the display image according to the posture of the user (mobile device 7), the traveling direction and / or the traveling speed. Specifically, when the user is traveling at a high speed in the same direction, the mobile device 7 displays an image (Map image) of indoor equipment installed in the imaging direction corresponding to the traveling direction on the touch panel 14. indicate.

  Further, when the user enters a position where the communicable areas of the signal sources 3 overlap, for example, when the user enters the area where the communicable areas A1 and A2 overlap from the communicable area A1, the mobile device 7 displays an image related to the signal source 3A (for example, an image of at least one of the A1 store, the A2 store, and the A3 store), and an image related to the signal source 3B (for example, the B1 store, At least one of the B2 store and the B3 store) may be displayed. Conversely, when the user enters an area where the communicable areas A1 and A2 overlap from the communicable area A2, the mobile device 7 displays images related to the signal source 3B (for example, B1 store, B2 store, and B3 store). At least one of the images) is configured to display an image related to the signal source 3A (for example, at least one of the A1 store, the A2 store, and the A3 store). Also good.

  Next, the mobile device 7 instructs the image data transmission server 5 to update the route, for example, change the destination or change the waypoint (step SP10). Thereafter, the step for route guidance is started again.

  According to 1st Embodiment of this invention, the present location of an indoor user can be pinpointed correctly and indoor information useful for the said user can be provided appropriately.

  FIG. 15 is a flowchart showing an example of a navigation processing flow according to the second embodiment of the present invention. As a premise, the user downloads the navigation processing application software according to the embodiment of the present invention from a predetermined site of the network, and stores it in the mobile device 7 so that it can be executed. When the execution of the application software is instructed by the user, the program operation based on the application software starts.

  As shown in FIG. 15, first, the user inputs a destination in the mobile device 7 (step SP21). Next, the mobile device 7 transmits the input destination information to the image data transmission server 5 (step SP22).

  Next, the image data transmission server 5 refers to the destination information (step SP23). Next, the image data transmission server 5 determines which Map the destination is included in (Step SP24). Then, the destination Map corresponding to the destination is transmitted to the mobile device 7 (step SP25).

  When there is a positioning request from the user to the mobile device 7 (step SP26), the mobile device 7 executes positioning (step SP27). For positioning for executing navigation, for example, Wi-Fi positioning, GPS positioning, and Bluetooth positioning are performed. In the Bluetooth positioning, the mobile device 7 acquires the ID of the peripheral signal source 3 (beacon), and creates a peripheral signal source 3 (beacon) list. Next, the mobile device 7 transmits the signal source 3 (beacon) list to the image data transmission server 5 (step SP28). In addition, you may acquire position information regularly in order to perform navigation (step SP27 and step SP28).

  Next, the collation unit 55 of the image data transmission server 5 collates (matches) the beacon list with each table shown in FIG. 3 (step SP29). Then, the image data transmission server 5 transmits the positioning result (step SP30).

  The mobile device 7 that has completed the beacon positioning detects entry (entrance) to the indoor I (step SP31). The process proceeds from step SP31 to step SP32 in FIG.

  FIG. 16 is a flowchart showing an example of the navigation processing flow according to the second embodiment of the present invention. After detecting the entry (entrance) to the indoor I (step SP31 in FIG. 15), the mobile device 7 requests the route guidance information from the image data transmission server 5 as shown in FIG. 16 (step SP32).

  Next, the image data transmission server 5 acquires all Map IDs of the facility and one or more adjacent Map IDs associated with each Map ID from the storage unit 53 (Step SP33). Next, the calculation unit 59 of the image data transmission server 5 determines whether the input destination and the current location are on the same floor or different floors (step SP34).

  Next, when it is determined that the destination and the current location are on the same floor, the calculation unit 59 of the image data transmission server 5 counts the number of adjacent Maps to the destination, and the one with the smallest Map count is counted. It is determined that the route is optimal (step SP35).

  When it is determined that the destination and the current location are on the same floor, the transmission unit 63 of the image data transmission server 5 transmits route guidance information (step SP41). The route guidance information includes the following information. For example, the route guidance information includes a map image (and / or an adjacent map image) of the current location, a route guidance display, and an image of store data. Further, the route guidance information includes additional information, and the additional information includes advertisement information related to facilities and equipment, and in-house information (lost child information, etc.).

  Next, the mobile device 7 receives the route guidance information and displays a Map image and / or additional information based on the route guidance information (step SP42).

  On the other hand, when the destination and the current location are on different floors, the image data transmission server 5 obtains lifting / lowering means information such as stairs / elevators / escalators (step SP36). Next, the image data transmission server 5 transmits a request for selecting the lifting means to the mobile device 7 (step SP37).

  The user selects the lifting means displayed on the mobile device 7, and the mobile device 7 selects the lifting means input by the user (step SP38). Then, the mobile device 7 transmits the selection result of the lifting means to the image data transmission server 5 (step SP39).

  The calculation unit 59 of the image data transmission server 5 counts the number of adjacent maps to the destination, and determines that the route with the smallest map count is the optimum route (step SP40). The transmission unit 63 of the image data transmission server 5 transmits route guidance information (step SP41).

  Next, the mobile device 7 receives the route guidance information and displays a Map image and / or additional information based on the route guidance information (step SP42).

  According to 2nd Embodiment of this invention, in addition to the effect of 1st Embodiment, the optimal route | root to a destination can be provided with respect to a user.

(Map image processing)
FIG. 17 is a flowchart showing an example of a Map image processing flow according to the third embodiment of the present invention. For example, following step SP42 in FIG. 16, as shown in FIG. 17, the mobile device 7 transmits display angle information related to display of a Map image or the like to the image data transmission server 5 (step SP43).

  Next, the calculation unit 55 of the image data transmission server 5 calculates (selects) an optimal Map from all adjacent Maps based on the display angle information (step SP44). Next, the image data transmission server 5 transmits the ID of the selected Map to the mobile device 7 (step SP45).

  Next, the mobile device 7 determines whether or not a Map image has been acquired (step SP46).

  When the mobile device 7 has acquired the Map image, the mobile device 7 displays the Map image based on the received Map ID and Map image (step SP49). In addition, since the mobile device 7 can rotate the image displayed on the mobile device 7 by 360 degrees, the mobile device 7 may be configured to display the next Map image in the displayed direction.

  On the other hand, when the mobile device 7 has not acquired the Map image, the mobile device 7 requests the image data transmission server 5 to transmit the Map image (Step SP47).

  Next, the image data transmission server 5 transmits a Map image based on the request (step SP48).

  Then, the mobile device 7 displays a Map image based on the received Map ID and Map image (step SP49). In addition, since the mobile device 7 can rotate the image displayed on the mobile device 7 by 360 degrees, the mobile device 7 may be configured to display the next Map image in the displayed direction.

  According to 3rd Embodiment of this invention, in addition to the effect of 1st Embodiment and 2nd Embodiment, the optimal Map image display can be provided with respect to a user.

<Other variations>
In addition, each said embodiment is for making an understanding of this invention easy, and does not limit this invention and interpret it. The present invention can be changed / improved (for example, by combining the embodiments, omitting a part of the configuration of each embodiment) without departing from the spirit thereof, and the present invention includes equivalents thereof. It is.

  For example, as another embodiment, following the entrance detection described in FIG. 15 (step SP31), various sensors such as an acceleration sensor, a direction sensor, and a pressure sensor (not shown) included in the mobile device 7 are used. You may be comprised so that the position in Map may be pinpointed correctly. Moreover, it may be configured to accurately identify the position of the mobile device 7 in the Map by acquiring Proximity information (Immediate / Near / Far / Unknown) of the signal source 3 (beacon).

  For example, as another embodiment, the mobile device 7 uses indoor image information around each signal source 3 in order to accurately grasp in advance the destination or the target facility searched in the browser of the mobile device 7. It may be configured to display an image accurately.

  In addition, each step SP in each flowchart (see FIGS. 14 to 17) does not necessarily have to be executed in accordance with the steps described above.

  In the embodiment of the present invention, the image data transmission server 5 can accurately identify the current location of an indoor user and appropriately provide indoor image information useful for the user. In addition to appropriately providing indoor image information to the mobile device 7, other indoor information such as facility, indoor equipment advertisement information / event information, store opening hours, store service charge discount information, lost child information and the above information May be obtained from a certain network and provided to the mobile device 7 in association with or without association with the indoor image information.

1: Image generation system 3: Signal source 5: Image data transmission server 7: Mobile device 14: Touch panel 36: Direction sensor 38: Acceleration sensor 51: Receiving unit 53: Storage unit 55: Verification unit 57: Identification unit 59: Calculation unit 61: Image generation unit 63: Transmission unit 71: Reception unit 73: Storage unit 75: Transfer unit 77: Direction detection unit 79: Acceleration detection unit 81: Display unit I: Indoor N: Communication network

Claims (9)

In an image reproduction system comprising: an image data transmission server that transmits image data; and a mobile device that reproduces an image based on the image data.
The image data transmission server
For each of one or more indoor signal sources, one or more image data obtained by imaging the surroundings of the signal source and signal source information including signal source installation position information corresponding to the installation position of the signal source. A first receiving unit for receiving;
A storage unit for storing the image data and the signal source information in association with each other;
A collation unit for collating identification information for identifying the signal source transferred by the mobile device with the signal source information;
A specifying unit for specifying the current location of the mobile device based on a result of the verification by the verification unit;
A calculation unit that calculates one or more routes from the current location to the destination, and calculates a shortest route from the current location to the destination based on the number of signal sources adjacent to the signal source arranged on the route When,
A transmitting unit that transmits the image data stored in association with the identified signal source and route information indicating the shortest route to the mobile device;
With
The mobile device is
Second reception for receiving identification information for identifying the signal source from the signal source when entering a predetermined communicable area associated with each of the one or more signal sources installed at the signal source installation position And
A transfer unit that transfers the received identification information to the image data transmission server;
A display unit that reproduces an image associated with each of the signal sources arranged along the shortest route based on the image data transmitted from the image data transmission server and the route information.
Image playback system. The image data transmission server
An image generation unit configured to generate an image for each signal source based on the image data stored in association with the signal source;
The image reproduction system according to claim 1. The mobile device further includes an orientation sensor,
The first receiving unit receives a detection result of the direction sensor,
The image generation unit generates an image based on the image data based on a detection result of the direction sensor.
The image reproduction system according to claim 2. The mobile device further includes an acceleration sensor,
The first receiving unit receives a detection result of the acceleration sensor,
The image generation unit generates an image based on the image data based on a detection result of the acceleration sensor;
The image reproduction system according to claim 2 or claim 3. The storage unit further stores the image data obtained by imaging indoor equipment in a predetermined direction from the signal source installation position in association with imaging direction information corresponding to the direction,
The image reproduction system according to any one of claims 1 to 4. The image data transmission server includes, for each indoor one or more signal sources, one or more image data obtained by imaging the surroundings of the signal source and signal source installation position information corresponding to the installation position of the signal source. Including signal source information including,
The image data transmission server stores the image data and the signal source information in association with each other,
When the mobile device enters a predetermined communicable area associated with each of the one or more signal sources installed at the signal source installation position, the mobile device receives identification information for identifying the signal source from the signal source. And
The mobile device transfers the received identification information to the image data transmission server,
The image data transmission server collates identification information for identifying the signal source transferred by the mobile device with the signal source information,
The image data transmission server identifies the current location of the mobile device based on the result of the verification,
The image data transmission server calculates one or more routes from the current location to the destination, and based on the number of signal sources adjacent to the signal source arranged on the route, from the current location to the destination Calculate the shortest route,
The image data transmission server transmits the image data stored in association with the identified signal source and route information indicating the shortest route to the mobile device,
The mobile device reproduces an image associated with each signal source arranged along the shortest route based on the image data and the route information transmitted from the image data transmission server. Including,
Image playback method. For each of one or more indoor signal sources, one or more image data obtained by imaging the surroundings of the signal source and signal source information including signal source installation position information corresponding to the installation position of the signal source. A receiving unit for receiving;
A storage unit for storing the image data and the signal source information in association with each other;
Identification information for identifying the signal source transferred by the mobile device when the mobile device enters a predetermined communicable area associated with each of the one or more signal sources installed at the signal source installation position. A verification unit for verifying the signal source information,
A specifying unit for specifying the current location of the mobile device based on a result of checking by the checking unit;
A calculation unit that calculates one or more routes from the current location to the destination, and calculates the shortest route from the current location to the destination based on the number of signal sources adjacent to the signal source arranged on the route When,
A transmitting unit that transmits the image data stored in association with the identified signal source and route information indicating the shortest route to the mobile device;
An image data transmission server comprising: For each of one or more indoor signal sources, one or more image data obtained by imaging the surroundings of the signal source and signal source information including signal source installation position information corresponding to the installation position of the signal source. A receiving step for receiving;
A storage step of storing the image data and the signal source information in association with each other;
Identification information for identifying the signal source transferred by the mobile device when the mobile device enters a predetermined communicable area associated with each of the one or more signal sources installed at the signal source installation position. Collating with the signal source information;
A specifying step of specifying the current location of the mobile device based on the result of the verification in the verification step;
Calculating one or more routes from the current location to the destination, and calculating a shortest route from the current location to the destination based on the number of signal sources adjacent to the signal source arranged on the route When,
Transmitting the image data stored in association with the identified signal source and route information indicating the shortest route to the mobile device;
Including image data transmission method. On the computer,
For each of one or more indoor signal sources, the signal source receives one or more image data obtained by imaging the surroundings and signal source information including signal source installation position information corresponding to the signal source installation position. Receiving function,
A storage function for storing the image data and the signal source information in association with each other;
Identification information for identifying the signal source transferred by the mobile device when the mobile device enters a predetermined communicable area associated with each of the one or more signal sources installed at the signal source installation position. A verification function for verifying the signal source information,
A specific function for identifying the current location of the mobile device based on the result of verification by the verification function;
A calculation function that calculates one or more routes from the current location to the destination, and calculates a shortest route from the current location to the destination based on the number of signal sources adjacent to the signal source arranged on the route When,
A transmission function for transmitting the image data stored in association with the identified signal source and route information indicating the shortest route to the mobile device;
An image data transmission program for executing

Images