JP6826829B2 - Information sharing support system, information sharing support method, and program - Google Patents

Description

The present invention relates to an information sharing support system, an information sharing support method, and a program.

In operations such as maintenance of a building or equipment attached to the building, it is necessary to grasp the situation of the target building and share information on the situation. As a means of sharing information, an information sharing method using drawings, equipment ledgers, failure history, repair history, photographs, reports, etc. is generally used. The information shared by the above information sharing method is treated as independent. For example, the property manager (hereinafter PM) acquires the above information provided by the building maintenance company (hereinafter BM), and associates the acquired information based on his / her own knowledge and experience to determine the status of the building. I have an image of.
Techniques for realizing related information sharing are known (see, for example, Patent Document 1 and Patent Document 2).

Japanese Unexamined Patent Publication No. 2001-14316 JP-A-2010-102595

However, in the information sharing method that requires imagining the situation of a building etc. based on knowledge and experience, subjective judgment may be included in the process, and it is necessary to understand the surrounding situation among the parties concerned. Inconsistencies may occur. The information sharing method described in the above document may not provide information in a form that is easy to share.
An object to be solved by the present invention is to provide an information sharing support system, an information sharing support method, and a program that enable sharing of the surrounding situation of a certain position by a simpler method.

In the information sharing support system of one aspect of the present invention, the situation around the observation point in the real space is shown in the browsed image, and the position information of the predetermined position in the browsed image and the character corresponding to the predetermined position in the browsed image are displayed. The designated information acquisition unit for acquiring information and a predetermined position in the browsed image are associated with a position on a spatial model formed with reference to the observation point, and the acquired character information and the acquired character information are associated with each other. A provision information generation unit that generates provision information including position information in the spatial model corresponding to the above, a storage unit that stores the provision information in association with the observation point, and the presence / absence of the provision information stored in the storage unit. Is provided with a display image information generation unit that generates list image information that displays the information corresponding to the observation point.
Further, in the information sharing support system, the display image information generation unit generates the list image information indicating that the character information to be displayed in the browsing image is included in the stored provided information. To do.
Further, in the information sharing support system, the display image information generation unit generates the list image information indicating the number of provided information including the character information to be displayed in the browsing image.
Further, in the above-mentioned information sharing support system, the display image information generation unit uses the collected information satisfying a predetermined search condition as the provided information.
Further, the information sharing support system includes a peripheral image acquisition unit that acquires a peripheral image and a browsing image information generation unit that generates information on the browsing image based on the peripheral image.
Further, in the above-mentioned information sharing support system, the browsing image information generation unit includes at least one image of an equirectangular projection image and an all-sky image in the surrounding image, and the equirectangular projection. Acquire a part or all of at least one of the projection image and the all-sky image.
Further, in the above-mentioned information sharing support system, the browsing image information generation unit corrects the distortion of the acquired surrounding image to generate the browsing image.
Further, in the above-mentioned information sharing support system, the surrounding image acquisition unit allocates the acquired surrounding image to the surface of the spatial model.
In the information sharing support method of one aspect of the present invention, the situation around the observation point in the real space is shown in the browsed image, and the computer of the information sharing support system uses the position information of a predetermined position in the browsed image and the browsed image. The computer acquires the character information corresponding to the predetermined position in the above, associates the predetermined position in the browsed image with the position on the spatial model formed with reference to the observation point, and obtains the acquired character information. And the provided information including the position information in the spatial model corresponding to the acquired character information is generated, the computer associates the provided information with the observation point and stores the provided information in the storage unit, and the computer performs the said. It includes a step of generating list image information that displays the presence / absence of provided information stored in the storage unit in correspondence with the observation point.
In the program of one aspect of the present invention, the situation around the observation point in the real space is shown in the browsed image on the computer of the information sharing support system, and the position information of the predetermined position in the browsed image and the predetermined position in the browsed image are displayed. The step of acquiring the character information corresponding to the position and the predetermined position in the browsed image are associated with the position on the spatial model formed with reference to the observation point, and the acquired character information and the acquired character information are obtained. A step of generating provided information including position information in the spatial model corresponding to character information, a step of associating the provided information with the observation point and storing the provided information in a storage unit, and a step of storing the provided information stored in the storage unit. This is a program for executing a step of generating list image information that displays the presence / absence corresponding to the observation point.

According to the present invention, it is possible to provide an information sharing support system, an information sharing support method, and a program that enable sharing of the situation around a certain position by a simpler method.

It is a block diagram of the information sharing support system which concerns on embodiment of this invention. It is a figure which shows an example of the space model which concerns on embodiment. It is a block diagram of the image pickup apparatus 100 which concerns on embodiment. It is a figure which shows the image by the equirectangular projection which concerns on embodiment. It is a block diagram of the terminal apparatus 200 which concerns on embodiment. It is a hardware block diagram of the information sharing support apparatus 400 which concerns on embodiment. It is a functional block diagram of the information sharing support device 400 which concerns on embodiment. It is a figure which shows an example of the content of the space model information 411 which concerns on embodiment. It is a figure which shows an example of the content of the collected information 412 which concerns on embodiment. It is a figure which shows an example of the content of the provided information 413 which concerns on embodiment. It is a flowchart which shows the procedure of the process for sharing information in the information sharing support apparatus 400 which concerns on embodiment. It is a flowchart which shows an example of the process which generates the provided information 413 which concerns on embodiment. It is a figure which shows an example of the browsing image which displays the situation around the observation point which concerns on embodiment. It is a figure which shows an example of the browsing image which displays the acquired information which concerns on embodiment. It is a flowchart which shows an example of the process of acquiring the collected information which concerns on 2nd Embodiment. It is a flowchart which shows an example of the process of selecting an observation point from the list display which concerns on embodiment. It is a figure which shows an example of the display of the list image which shows the existence of the provided information which concerns on embodiment in a list. It is a figure which shows an example of the display of the list image which shows the existence of the provided information which concerns on embodiment in a list. It is a figure which shows an example of the process which displays the browsing image which concerns on embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

(First Embodiment)
FIG. 1 is a configuration diagram of an information sharing support system according to an embodiment of the present invention.

[Information sharing support system]
The information sharing support system 1 includes an imaging device 100, a terminal device 200, a management device 300, and an information sharing support device 400. The image pickup device 100, the terminal device 200, the management device 300, and the information sharing support device 400 are connected via a network NW.

First, the outline of the information sharing support system 1 will be described. The information sharing support system 1 supports sharing of information regarding the target range 10 in the real space. For example, the target range 10 includes a part or all of an existing building 2. Further, the target range 10 includes equipment, fixtures and the like provided in the above-mentioned building. The range of the target range 10 is predetermined. For example, the position in the target range 10 is specified using the Cartesian coordinate system (X, Y, Z). Several observation points (not shown) are provided within the target range 10. For example, the position of the observation point P is determined so as to share the situation around the observation point P. In the following description, the observation point P is simply referred to as an observation point.

The information sharing support system 1 supports sharing of the surrounding situation with reference to this observation point. The information shared by the information sharing support system 1 includes an image around the observation point. The peripheral image of the observation point is an image obtained by imaging at the observation point by the imaging device 100, or a set of a plurality of images obtained by imaging at the observation point. For example, the position of the observation point is determined based on the position of the optical system of the image pickup apparatus 100. The details of the surrounding image will be described later. The surrounding image of the observation point may be an image taken by the user U1 by operating the image pickup device 100, or may be an image taken by the image pickup device 10 at a predetermined timing.

The information sharing support system 1 supports the situation of the target facility 10 to be shared among a plurality of users who operate the terminal device 200 or the like by using the surrounding image of the observation point. For example, the information sharing support device 400 collects the data of the image captured by the image pickup device 100 and the data (information) from the management device 300 or the like. The information sharing support device 400 causes the collected data to be displayed on the display unit of the terminal device 200 in response to a request from the terminal device 200. User U2 is an example of the above-mentioned plurality of users.

The information sharing support system 1 uses the concept of a spatial model in performing the processing related to information sharing as described above. As a result, the information sharing support system 1 makes it possible to share information such as the surrounding situation and the position where the event is occurring.

Here, the spatial model will be described. The spatial model has a virtual surface on which the situation in the range visible from the observation point is projected with reference to the observation point. The virtual surface is predetermined in association with the observation point. The information sharing support system 1 projects the situation in the range visible from the observation point onto the spatial model so as to maintain the direction in which the observation point is expected. In this embodiment, the spatial model is defined as a virtual structure. The information sharing support system 1 manages information related to the situation around the observation point by using the spatial model.

FIG. 2 is a diagram showing an example of a spatial model according to the embodiment. For example, the spatial model is formed as a hollow sphere. The information sharing support system 1 projects an image of each subject seen from the position of the observation point on the surface of the sphere. By placing the viewpoint at the center C of the sphere, the direction in which the image of the subject projected on the surface of the sphere is viewed from the center C of the sphere and the direction in which the subject is viewed from the position of the observation point P (FIG. 1) in the real space are different. Match.

In the above description, the image is shown as an example, but the type of information associated with the spatial model is not limited to this. The information sharing support system 1 may associate various types of information with a spatial model in addition to images. For example, the information sharing support system 1 forms a spatial model as a hollow sphere, and associates various information such as collected information with the surface of the sphere. The above-mentioned collected information is information collected for sharing the situation around the observation point. The above-mentioned collected information includes image information obtained by imaging the surroundings of the observation point, information of a type different from the image information, and the like. As a type of information different from the image information, for example, text (character information) indicating the situation around the observation point may be included.

Hereinafter, each device related to the information sharing support system 1 will be described.

[Imaging device]
An example of the configuration of the image pickup apparatus 100 will be described. FIG. 3 is a configuration diagram of the image pickup apparatus 100 according to the embodiment. The image pickup apparatus 100 photographs the surroundings thereof and outputs the obtained surrounding image.

The image pickup apparatus 100 includes an optical system 111, an optical system 112, an image pickup unit 121, an image pickup unit 122, a signal processing unit 130, a reception unit 140, a control unit 150, and an output unit 160.

The optical system 111 and the optical system 112 each form a fisheye lens, and each of them enables shooting at an angle of view of 180 degrees or more. The optical system 111 and the optical system 112 are supported by a housing of the image pickup apparatus 100 or the like so that the optical axis of the optical system 111 and the optical axis of the optical system 112 are substantially parallel to each other. The optical axis direction of the optical system 111 and the optical axis direction of the optical system 112 are directed in opposite directions.

The imaging unit 121 is provided so as to be paired with the optical system 111, and images an object (subject) within the angle of view of the optical system 111. The imaging unit 122 is provided so as to be paired with the optical system 112, and images an object (subject) within the angle of view of the optical system 112.

The signal processing unit 130 is based on the equirectangular projection from the image taken by synthesizing the image obtained by the image pickup unit 121 and the image obtained by the image pickup unit 122. Generate a composite image such as an image or an omnidirectional image.

The reception unit 140 receives an operation instructing the user to take an image.

The control unit 150 causes the imaging unit 121 and the imaging unit 122 to take an image based on the imaging instruction received by the receiving unit 140. The control unit 150 controls each image pickup unit so that the image pickup unit 121 and the image pickup unit 122 take images in synchronization with each other. The control unit 150 causes the signal processing unit 130 to generate a composite image based on the results imaged by the image pickup unit 121 and the image pickup unit 122. The control unit 150 outputs the composite image generated by the signal processing unit 130 from the output unit 160.

For example, it is desirable that the surrounding image output by the image pickup apparatus 100 as a composite image includes an image in all directions such as an equirectangular projection image and an all-sky image. FIG. 4 is a diagram showing an image obtained by equirectangular projection according to the embodiment. The equirectangular projection is a projection in which the surface of a sphere as shown in FIG. 2 described above is developed and the surface is projected onto a rectangle. The latitude and longitude of each part of the sphere are adjusted so that they intersect at right angles and at equal intervals within the rectangle. On the contrary, the image pickup apparatus 100 projects an image drawn on the side surface of the cylinder by equirectangular projection onto the surface of the sphere shown in FIG. The image projected on the surface of the sphere is an all-sky image when viewed from the inside of the sphere. That is, by projecting the image captured by the image pickup apparatus 100 onto the spatial model formed as the surface of the sphere, the image information is provided around the observation point. The image pickup apparatus 100 outputs a part or all of at least one of an equirectangular projection image and an all-sky image. With such an imaging device 100, it is possible to take a picture of the entire surroundings in a single operation, and it is possible to take a picture of the surroundings without omission.

That is, the image pickup apparatus 100 can save the user time and effort for synthesizing the images, and can further improve the quality of the continuity of the images in the spatial direction. In addition, the imaging device 100 shortens the time required for photographing by photographing the entire periphery with one operation. Further, with the image pickup apparatus 100 as described above, there is no possibility that a partial defect will occur due to an omission of photography or the like. Due to these, the work efficiency of the user is improved.

In addition, instead of the above-mentioned image pickup apparatus 100, a general camera using a wide-angle lens or a standard lens may be used. The angle of view of an image acquired by a general camera is limited to 40 to 60 degrees or less by using a wide-angle lens or a standard lens. When photographing the entire circumference using a wide-angle lens or a standard lens, it is necessary to divide the entire circumference into a plurality of times for imaging. Images captured by such a photographing method may be subjected to a compositing process that combines them. A general method can be applied to the method of synthesizing the images captured by dividing the entire circumference into a plurality of times.

In the following description of the embodiment, the image pickup apparatus 100 shall output an image obtained by equirectangular projection as a peripheral image of the object. The imaging device 100 transmits the surrounding image of the target to the information sharing support device 400.

[Terminal device]
FIG. 5 is a configuration diagram of the terminal device 200 according to the embodiment. The terminal device 200 includes, for example, a CPU 200A, a RAM (Random Access Memory) 200B, a non-volatile storage device 200C, a portable storage medium drive device 200D, an input / output device 200E, and a communication interface 200F. The terminal device 200 may include a processor of any form instead of the CPU 200A, or a part of each component shown in FIG. 5 may be omitted.

The CPU 200A will be described below by expanding the program stored in the non-volatile storage device 200C or the program stored in the portable storage medium mounted on the portable storage medium drive device 200D into the RAM 200B and executing the program. Perform various processes. The RAM 200B is used as a working area by the CPU 200A. The non-volatile storage device 200C is, for example, an HDD, a flash memory, a ROM (Read Only Memory), or the like. A portable storage medium such as a DVD (Digital Versatile Disc), a CD (Compact Disc), or an SD card is mounted on the portable storage medium drive device 200D. The input / output device 200E includes, for example, a keyboard, a mouse, a touch panel, a display device, and the like. The communication interface 200F is connected to the network NW and controls communication in the terminal device 200.

The functional configuration of the terminal device 200 according to the embodiment will be described with reference to FIG. The terminal device 200 includes a reception processing unit 211, a data acquisition unit 212, and a display control unit 213. These functional units are realized, for example, by the CPU 200A executing a program. Further, these functional units may be realized by hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), and software and hardware cooperate. It may be realized by doing.

The reception processing unit 211 receives the user's operation detected by the input / output device 200E. For example, the reception processing unit 211 detects an operation of selecting a button or the like on the image displayed by the input / output device 200E, and accepts the operation as a user operation. The reception processing unit 211 transmits a request for sharing information to the information sharing support device 400 based on the detected user operation.

The data acquisition unit 212 acquires the information transmitted from the information sharing support device 400. The information acquired from the information sharing support device 400 includes the acquired information corresponding to a specific observation point.

The display control unit 213 generates an image to be displayed on the display unit of the input / output device 200E based on the information transmitted from the information sharing support device 400. For example, the display control unit 213 generates a browsing image based on the acquired information corresponding to a specific observation point and displays it on the display unit.

The terminal device 200 may realize a part or all of the reception processing unit 211, the data acquisition unit 212, and the display control unit 213 by using a browser applied to the Web system. The terminal device 200 may allow the use of the terminal device 200 only by a predetermined user.

[Management device]
The management device 300 is a computer that manages information about the building 2 included in the target range. For example, as shown in FIG. 1, the management device 300 includes a storage unit 310 and a control unit 320.

The storage unit 310 stores various drawings related to the building 2, attribute information for identifying the equipment attached to the building 2, history information of maintenance and inspection of the building 2 and the attached equipment, and the like. For example, various drawings relating to the building 2 include a part or all of various drawings such as a structural drawing of the building 2, a plan view for each floor, a facility layout drawing, a piping drawing, and a power supply system drawing.

The control unit 320 shares the information so that the information referred to by the storage unit 310 and the information referred to by the information sharing support device 400 match. For example, the information may be synchronized so that the information stored in the storage unit 310 and the information stored in the information sharing support device 400 match. The control unit 320 receives a request from the information sharing support device 400, and secures the identity of the information stored in the information sharing support device 400 in response to the request. The control unit 320 and the information sharing support device 400 may synchronize the above information according to a predetermined plan. Alternatively, an external storage device such as a NAS (Network Attached Storage) device accessible from the control unit 320 and the information sharing support device 400 is provided, and the above information is stored in the external storage area to ensure the identity of the information. May be secured.

[Information sharing support device]
FIG. 6 is a hardware configuration diagram of the information sharing support device 400 according to the embodiment. The information sharing support device 400 includes, for example, a CPU 400A, a RAM 400B, a non-volatile storage device 400C, a portable storage medium drive device 400D, an input / output device 400E, and a communication interface 400F. The information sharing support device 400 may include a processor of any form instead of the CPU 400A, or a part of each component shown in FIG. 6 may be omitted.

The CPU 400A will be described below by expanding the program stored in the non-volatile storage device 400C or the program stored in the portable storage medium mounted on the portable storage medium drive device 400D into the RAM 400B and executing the program. Perform various processes. The RAM 400B is used as a working area by the CPU 400A. The non-volatile storage device 400C is, for example, an HDD, a flash memory, a ROM, or the like. A portable storage medium such as a DVD, a CD, or an SD card is mounted on the portable storage medium drive device 400D. The input / output device 400E includes, for example, a keyboard, a mouse, a touch panel, a display device, and the like. The communication interface 400F is connected to the network NW and controls communication in the information sharing support device 400. The communication interface 400F may have a function as a Web server applied to the Web system.

FIG. 7 is a functional configuration diagram of the information sharing support device 400 according to the embodiment. The information sharing support device 400 includes a storage unit 410 and a control unit 420.

The storage unit 410 is a storage area provided in the RAM 400B or the non-volatile storage device 400C. The storage unit 410 may be realized by an external storage device such as a NAS device accessible from the information sharing support device 400.

The storage unit 410 stores information such as spatial model information 411, collected information 412, provided information 413, and user information 414.

Spatial model information 411 includes information about a spatial model provided for each observation point. FIG. 8 is a diagram showing an example of the contents of the spatial model information 411 according to the embodiment. For example, in principle, one spatial model is assigned to the observation points. Spatial model information 411 includes information about the spatial model. For example, the spatial model information 411 includes information such as a spatial model ID, an area ID, a position in real space, and a radius. The spatial model information 411 includes information for each spatial model.

The spatial model ID is identification information for identifying the spatial model assigned to the observation point. For example, the spatial model ID may be an observation point ID (observation point identification information) for identifying an observation point, or may be a coordinate value of the observation point or a value generated based on the coordinate value. Good.

The area ID is identification information for identifying an area including a spatial model. For example, the area ID is information such as the identification number of each divided area when the inside of the building is divided into a plurality of areas according to a desired rule such as the number of floors in the building, zones on the same floor, tenants, rooms, and the like. including. For example, when the area corresponds to the floor of the building, the area ID indicates the number of floors in the building, the first floor may be indicated as the first floor, and the second floor may be indicated as the second floor. Further, the area division may be hierarchized, for example, such as a major classification, a middle classification, and a minor classification. For example, the classification by tenant is a major classification, the classification by floor used by the tenant is a middle classification, and the classification by the conference room (room) used by the tenant is a minor classification. According to the above rules, it can be classified as "Tenant A"-"1F"-"First meeting room", etc., and each of the classified objects can be easily classified by using the area ID. Can be identified in.

The position in the real space indicates the position of the observation point in the Cartesian coordinate system determined for each area. The radius is information indicating the size of the spatial model. For example, assuming that the radius (R1) is 2 m and the height of the observation point from the floor surface is 1.5 m, the lower part of the spatial model is arranged so as to project below the floor. Alternatively, assuming that the radius (R1) is 0.5 m and the height of the observation point from the floor surface is 1.5 m, the spatial model is arranged in a floating state on the floor.

Returning to FIG. 7, the collected information 412 will be described. The collected information 412 includes various information collected as the situation around the observation point. The provided information 413 includes information extracted from the information collected as the situation around the observation point. More specific explanations of the collected information 412 and the provided information 413 will be described later.

The user information 414 is information of a user who is permitted to use the information sharing support system 1. For example, the information sharing support system 1 is permitted to be used only by authorized users. The user information 414 includes data such as a user ID, a password, and user attribute information. The user ID is identification information for identifying the user. The user attribute information includes basic information for determining the range in which information can be shared, such as the group, company, and organization to which the user belongs. The user information 414 may also serve as the account information of the information sharing support system 1, and may be used as information for identifying a user who is permitted to use the terminal device 200. Further, the range of information that can be shared by the user (sharing range) may be set for each user. In this case, the user information 414 includes information about the sharing range corresponding to the user ID. For example, the sharing range is determined based on the commonality of user attribute information that specifies the range corresponding to the group, organization, etc. to which the user belongs.

The control unit 420 includes a designated information acquisition unit 421, a surrounding image acquisition unit 422, an extraction processing unit 423, a provision information generation unit 424, a browsing image information generation unit 425, a display image information generation unit 426, and user management. A unit 427 is provided. The designated information acquisition unit 421 and the surrounding image acquisition unit 422 are examples of acquisition units.

The designated information acquisition unit 421 acquires the detection result of the user's operation in the terminal device 200 from the terminal device 200. For example, the detection result of the operation of the user includes the position information of the predetermined position in the browsed image and the information corresponding to the predetermined position in the browsed image. The information corresponding to the predetermined position in the above-mentioned browsing image includes information such as text (hereinafter, may be simply referred to as text) described in a comment by a user or the like. The designated information acquisition unit 421 adds the information acquired from the terminal device 200 to the collected information 412 in the storage unit 410.

The surrounding image acquisition unit 422 acquires a peripheral image of the observation point in the real space, a drawing showing the state of the real space, and the like, and similarly adds it to the collected information 412.

Here, an example will be described in the contents of the collected information 412. FIG. 9 is a diagram showing an example of the contents of the collected information 412 according to the embodiment. The collected information 412 includes information such as image information and text collected for each spatial model.

For example, the collected information 412 includes a spatial model ID (observation point ID), collected information ID, valid flag, data type, data identification ID (file name), date and time (time), management information, reference direction (θ0), and user ID. Includes information such as.

The spatial model ID corresponds to the spatial model ID of the spatial model information.
The collected information ID is identification information for identifying the position of a point on the spatial model indicated by the polar coordinate system with the observation point as the origin. For example, when the coordinates of the target position are (R1, θ1, φ1), even if a value such as “R1θ1φ1” is calculated as a result of weighting and adding the values of each axis of the coordinate system. Good.

The valid flag is information indicating the validity of the collected information. For example, it is invalid when the collected information is not available, and valid when it is available. The situation where the collected information is not available includes the case where the data is determined to be damaged, the case where new information is collected and the information becomes obsolete, and the like.

The data type is information indicating the type of data such as an image or text. For example, the extension of the file name may be diverted.

The data identification ID is identification information for identifying data to be handled as collected information, such as a file name when the collected information is treated as a file.

The date and time is information indicating the date and time related to the collected information. For example, when the data type is an image, the date and time is the shooting date and time of the image, the date and time when the image information is stored, and the like. When the data type is text, the date and time is the date and time when the file containing the text was stored or updated. Alternatively, the above date and time may be appropriately selected from various times such as the time when the file was posted, the time described by the user in the comment, and the time when the posting of the file was detected.

The management information is information such as the status with respect to the contents of the collected information. For example, when the type of collected information is image information, it includes a flag as to whether or not it is the latest information, a flag as to whether or not update is necessary, and the like. If the type of collected information is text, it includes the progress of countermeasures according to the content. The progress of the countermeasures may indicate various stages such as the countermeasures are being examined, the countermeasures are decided, the countermeasures are being prepared, the countermeasures are being taken, and the countermeasures have been taken.

The reference direction (θ0) is applied when the type of information is image information. For example, when allocating an image to a spatial model, the surrounding image acquisition unit 422 rotates the image around the z-axis (FIG. 2) in the vertical direction so that the directions of the images match in the three-dimensional virtual space. Adjust the orientation of the image. The reference direction (θ0) is a correction angle when adjustment is required, and when correction is not performed, the value is set to 0.

The user ID is identification information of a user who has been subjected to a process of writing information in the collected information 412, and corresponds to the user ID of the above-mentioned user information 414.

Some examples of data will be described. For example, the designated information acquisition unit 421 captures image data referred to as the spatial model ID “1001”, the collected information ID “Rθ1φ1”, and the data identification ID “FP001” based on the operation of the user U1. Obtained from 100, the user ID is set to "U1", and each of the above data is added to the collected information 412.

For example, the surrounding image acquisition unit 422 acquires a peripheral image of the observation point in the real space from the image pickup device 100 or the like and adds it to the collected information 412. As shown in the figure, the surrounding image acquisition unit 422 acquires the drawing data referred to as the spatial model ID “1001”, the collection information ID “Rθ1φ1”, and the data identification ID “FD002” from the management device 300. Then, each of the above data is added to the collected information 412.

For example, the surrounding image acquisition unit 422 acquires a drawing showing the state of the real space from the management device 300 or the like and adds it to the collected information 412. As shown in the figure, the surrounding image acquisition unit 422 uses the text data referred to as the spatial model ID "1001", the collected information ID "Rθ1φ1", and the data identification ID "FT003" as the operation of the user U2. Based on this, it is acquired from the terminal device 200, the user ID is set to "U2", and each of the above data is added to the collected information 412.

Returning to FIG. 7, the extraction processing unit 423 will be described. The extraction processing unit 423 extracts the information included in the range determined based on the search condition instructed from the terminal device 200. In the above extraction, the extraction processing unit 423 refers to the identification information given to the information stored in the collection information 412. The above-mentioned assigned identification information includes identification information such as a spatial model ID indicating the position of the information stored in the collection information 412 and a collection information ID. That is, the extraction processing unit 423 determines a range to be selected as a browsing image from the entire circumference of the specific spatial model instructed by the terminal device 200 based on the above instruction.

The provided information generation unit 424 generates the provided information 413 corresponding to the observation point based on the range selected as the above-mentioned browsing image.

Here, an example of the contents of the provided information 413 will be described. FIG. 10 is a diagram showing an example of the contents of the provided information 413 according to the embodiment. The provided information 413 includes information extracted from the above-mentioned collected information 412. In the provided information 413, the following information is added to the collected information 412.

For example, the provided information 413 includes spatial model ID (observation point ID), collected information ID, valid flag, data type, data identification ID (file name), date and time (time), management information, reference direction (θ0), and display range. Includes information such as. The display range is information indicating a range to be selected as the range of the browsed image from the entire circumference of the spatial model. By performing the selection process by the extraction processing unit 423, the information to be actually displayed is selected. As a result, the number of information selected as the provided information 413 is smaller than the number of information stored in the collected information 412.

As shown in FIG. 10, the information to be shared obtained as a result of the extraction process is associated with each spatial model. As described above, the extraction processing unit 423 may cut out a predetermined range in the spatial model determined by the information acquired by the designated information acquisition unit 421. For example, the extraction processing unit 423 includes the position information of a predetermined position identified based on the spatial model in the information search condition. The extraction processing unit 423 extracts information to be shared from the collected information 412 based on the above search conditions.

For example, the provided information generation unit 424 refers to the display range of the provided information 413, identifies the range of the browsed image, and sets a predetermined position in the browsed image to a position on the spatial model formed with reference to the observation point. Correspond. The provided information generation unit 424 generates the provided information corresponding to the observation point corresponding to the browsed image whose range is identified by the above. The provided information corresponding to the observation point includes the text acquired by the designated information acquisition unit 421 and the position information in the spatial model corresponding to the above text.

Returning to FIG. 7, the description will be continued. The browsing image information generation unit 425 generates information (browsing image information) for displaying the browsing image whose range is identified based on the surrounding image. An example of displaying the browsed image will be described later.

The display image information generation unit 426 generates list image information that displays the presence / absence of the provided information stored in the storage unit 410 in correspondence with the observation points. An example of displaying the presence / absence of provided information will be described later.

The user management unit 427 writes the information of the user who is permitted to use the user information 414 in the user information 414. For example, the information of the user who is permitted to use includes data such as a user ID, a password, and user attribute information. The user management unit 427 may include information such as a determination rule for determining the information sharing range in the user information 414 and store the information.

A more specific case will be illustrated. For example, when browsing information that is common to the entire company, it is necessary to share the information regardless of the region. On the other hand, information specific to each region may be sufficient to be shared by users in that region. In this case, the user management unit 427 may limit the area as a shared range by using the information of the area to which the user belongs as a key. In this case, the extraction processing unit 423 extracts the information in accordance with the rule that limits the above area as a shared range.

Further, for example, a property manager (hereinafter PM) and a building maintenance business operator (hereinafter BM) may share information on a common object between companies having different positions. In such a case, the user management unit 427 may determine the sharing range of the information by referring to the user information 414 or the like and using the information of the organization or company to which the user belongs as a key.

For example, the user management unit 427 compares the user attribute information corresponding to the user ID of the poster who posted the information with the user attribute information corresponding to the user ID of the viewer, and has a predetermined commonality. In some cases, it may be viewable. For example, if the poster and the viewer are employees of the same company, the corresponding information can be viewed. In this case, the extraction processing unit 423 extracts the information according to the rule that limits the range determined based on the commonality of the user attribute information of the poster and the viewer as the shared range.

[Processing for sharing information]
Next, a process for sharing information in the information sharing support device 400 will be described.

FIG. 11 is a flowchart showing a processing procedure for sharing information in the information sharing support device 400 according to the embodiment. For example, the information sharing support device 400 performs the following processing according to the operation of the terminal device 200 by a user who is permitted to use the information sharing support system 1.

The designated information acquisition unit 421 determines the mode selected in the operation of the user in the terminal device 200 (S11). When the list mode is selected in S11, the control unit 420 executes the process (S30) by selection from the list display, and advances the process to S19. The details of the list mode processing will be described later as a second embodiment.

When the individual mode is selected in S11, the designated information acquisition unit 421 acquires the position of the observation point corresponding to the request from the terminal device 200 (S12).

Next, the designated information acquisition unit 421 determines whether or not a spatial model corresponding to the above observation point exists (S13).

When the corresponding spatial model does not exist (S13: NO), the designated information acquisition unit 421 generates a spatial model (S14) and proceeds to the process in S16.

When the corresponding spatial model exists (S13: YES), the designated information acquisition unit 421 determines whether or not the change of the peripheral image is requested (S15).

When the change of the peripheral image is not requested (S15: NO), the control unit 420 advances the process to S19.

Next, after the processing of S14 is completed, or when the change of the peripheral image is requested by the result of the determination in S15 (S15: YES), the peripheral image acquisition unit 422 acquires the peripheral image (S16). ..

Next, the peripheral image acquisition unit 422 synthesizes the peripheral image acquired in S16 into the spatial model (S17).

Next, the surrounding image acquisition unit 422 writes and registers the spatial model synthesized in S17 in the spatial model information 411 of the storage unit 410 (S18).

Next, after the processing of S18 or the processing of S30 is completed, or when the change of the peripheral image is not requested by the result of the determination in S15 (S15: NO), the control unit 420 is identified based on the spatial model. Based on the position information of the predetermined position, the provided information 413 corresponding to the observation point is generated (S19).

FIG. 12 is a flowchart showing an example of the process of generating the provided information 413 according to the embodiment.
For example, the extraction processing unit 423 extracts information to be shared from the collection information table related to the spatial model based on the position information of the predetermined position identified based on the spatial model (S191).

Next, the provided information generation unit 424 associates the position of the information to be shared on the spatial model with the position on the browsed image (S192).

Next, the browsing image information generation unit 425 generates browsing image information for displaying the browsing image including the provided information based on the position information of the position on the browsing image (S193). An example of displaying a browsing image including collected information will be described later.

Returning to FIG. 11, the description will be continued. Next, the designated information acquisition unit 421 determines whether or not the posting of information is requested (S20).

When the posting of information is requested (S20: YES), the designated information acquisition unit 421 acquires the position information of the predetermined position in the browsed image, and acquires the information such as the text corresponding to the predetermined position in the browsed image. Then (S21), the acquired information is written in the collection information table of the corresponding storage unit 410.

Next, after the processing of S21 is completed, or when the posting of information is not requested due to the result of the determination in S20 (S20: NO), whether or not the designated information acquisition unit 421 continues to browse the collected information. (S22).

When continuing to browse the collected information (S22: YES), the designated information acquisition unit 421 proceeds with the process to S11.

When the browsing of the collected information is not continued (S22: NO), the control unit 420 ends the browsing of the information and ends the series of processes shown in the figure.

Through the above processing, the information sharing support system 1 makes it possible to share the situation around the observation point.

A browsing image that displays the situation around the observation point and selection of the direction around the observation point will be described. FIG. 13 is a diagram showing an example of a browsing image displaying the situation around the observation point according to the embodiment.

Nine browsing images are shown in FIG. Three images, PICLU, PICCU, and PICRU, are shown in order from left to right in the upper row. Three images, PICL, PICCC, and PICCR, are shown in order from left to right in the middle row. Three images of PICLD, PICCD, and PICRD are shown in order from the lower left to the right.

The image PICCC located at the center of FIG. 13 shows the situation around the reference direction determined horizontally from the observation point. That is, the image PICCC shows a situation in which the position of the observation point can be confirmed while standing with the front of the body facing the reference direction.

The image PICCR shown on the right side of the image PICCC in FIG. 13 is orthogonal to the above-mentioned reference direction and shows the surrounding situation in the direction determined horizontally from the observation point. That is, the image PICCR shows a situation in which the face is turned to the right while standing at the position of the observation point with the front of the body facing the reference direction.

The image PICCU shown above the image PICCC in FIG. 13 shows the surrounding conditions in the vertical direction (upward direction) from the observation point. That is, the image PICCU shows a situation in which the face is turned upward while standing at the position of the observation point with the front of the body facing the reference direction.

As for the other images, the situation around the observation point can be displayed without omission by selecting a plurality of browsing images as in the case of each of the above images. In the above example, each image is switched and displayed, but the display range may be continuously adjusted by continuously changing the display direction of the browsed image.

As described above, by having the surrounding situation centered on the observation point as collected information, it is possible to visually share the surrounding situation of the observation point even among people who are not at the observation point.

FIG. 14 is a diagram showing an example of a browsing image displaying acquired information according to the embodiment.

Reference numeral Z200 indicates a display area of the browsed image displayed on the terminal device 20. Image information, which is collected information, is displayed as a background image in the area Z200. The browsed image is generated by the browsed image information generation unit 425. The terminal device 200 displays the browsed image on the display unit, detects the user's operation on the browsed image, and notifies the information sharing support device 400. The browsed image is continuously updated through such an operation.

Objects such as OBJ201, OBJ202, OBJ203, and OBJ204 are displayed in the area Z200. Further, in the area Z200, information display areas such as the area Z210, the area Z220, the area Z230, and the area Z240 are provided.

Objects such as OBJ201, OBJ202, and OBJ203 are pins that indicate that there is information associated with the object shown in a portion of the background image. The user can open and display the corresponding information by selecting a pin using a mouse or the like. For example, OBJ201 is associated with a set of tables and chairs. The OBJ202 is associated with an indoor unit of an air conditioner provided on the ceiling. OBJ203 is associated with a lighting device provided on the ceiling.
Pins such as OBJ201, OBJ202, and OBJ203 may be displayed so as to be identifiable by visual features such as the shape or color of the icon indicating the pins. For example, the browsing image information generation unit 425 refers to the collected information 412 to indicate the content indicated by the information such as the type of information associated with the object corresponding to the pin and the status identified from the above information. , You may set the color of the above icon. For example, the browsing image information generation unit 425 classifies the contents indicated by the information into classes and assigns different colors as icon colors. As a result, the user can recognize the difference in the content indicated by the information from the color of the pin displayed on the image.

The object of OBJ204 indicates that another spatial model exists within the display range of the background image. For example, the user can switch to the display of information of another spatial model corresponding to the OBJ204 by selecting the object OBJ204 using a mouse or the like. By the above operation, the user can browse the information corresponding to the observation point as if he / she moved to another observation point.

A plan view of the target area and objects OBJ211, OBJ212, and OBJ213 within the area are shown in the area of the area Z200 with reference numeral 210. Each of OBJ211, OBJ212, and OBJ213 is a pin indicating the position of an observation point. By selecting pins such as OBJ211, OBJ212, and OBJ213 using a mouse or the like, it is possible to switch to the display of information of other spatial models corresponding to each. By the above operation, the user can browse the information corresponding to the observation point as if he / she moved to another observation point.
Pins such as OBJ211, OBJ212, and OBJ213 may be displayed with an icon indicating the pin identifiable by a visual feature. For example, the color, shape, pattern, transparency, overlay display, etc. of the icon may be used as the visual feature of the icon, and the combination of these may be used as the visual feature of the icon. Overlapping display is a state in which the same or different icons are overlaid. For example, the same icon may be displayed twice or three times, or an object smaller than the icon may be displayed as a batch on the basic icon.

For example, the browsing image information generation unit 425 refers to the collected information 412, and refers to the performance of the corresponding imaging device (camera), the position of the observation point selected at the time of imaging, the shooting time, the user who registered the collected information, and the captured image. The visual features of the above icons may be set to indicate some or all of the main purpose or use of the above.

For example, the performance of the imaging device includes, for example, the resolution of the image obtained by imaging, the number of pixels of the photographing device, the characteristics of the optical system, and the like. The browsing image information generation unit 425 sets the visual features of the above icons based on the results of these performance classifications. Thereby, for example, the user can recognize the difference in performance depending on the resolution of the low resolution image pickup device or the high resolution image pickup device from the color of the pin displayed on the image.
In addition, as the positions of the observation points selected at the time of imaging, for example, the positions divided into the attic, the height of the human field of view (for example, 1.5 m), the floor surface, the floor surface, etc. are selected as candidates for selection. Can be mentioned. The browsing image information generation unit 425 sets the visual features of the above icons based on the result of the classification. As a result, for example, the user can easily identify the position in the building 2 while looking at the viewing image displayed in the standing field of view, and easily display the viewing image showing the situation under the ceiling or under the floor corresponding to the position. You can switch.
In addition, the shooting time includes the year (year) and month of shooting. The browsing image information generation unit 425 sets the visual features of the above icons based on these shooting times. This allows, for example, the user to identify that there are images taken at or near the position of the image taken in a given year at different times, and easily display other images related to that position. can do.
Further, for example, the browsing image information generation unit 425 sets the visual characteristics of the above icon based on the identification information of the user who has registered the collected information. As a result, the user can easily select the image to be displayed next by using the user who registered the collected information as a key.
Further, for example, the main purpose (use) of the captured image is for design supervision, inspection, layout grasp, and the like. The browsing image information generation unit 425 sets the visual features of the above icon based on its purpose (use). Thereby, for example, the user can easily switch to the browsing image corresponding to the purpose (use).

On the OBJ2111, OBJ2111 showing a triangle having an apex at the position of the OBJ211 is semi-transparently drawn. OBJ2111 is displayed corresponding to the selected observation point, indicating that the range included in the triangle is displayed. In the case of this figure, the observation point identified by OBJ211 is currently selected, and the displayed direction is shown to be upward in the plan view with respect to the observation point.

The pin of OBJ213 indicates an observation point corresponding to the above-mentioned spatial model of OBJ204. From the example displayed in this figure, it can be seen that the positions of the observation points of OBJ211 and OBJ213 are close to each other.

A comment or the like posted by the user is displayed as text in the area of reference numeral 220 in the area Z200. The display of the area Z200 is associated with the above-mentioned OBJ202. When the user detects the pin selection of the OBJ202 using a mouse or the like, the display of the area Z200 is opened and the corresponding information is displayed.

Areas Z221, Z222, Z223, Z224 and button OBJ225 are shown in the area Z220.

Area Z221 shows the text posted by the user. Area Z222 shows the date associated with this post. Region Z223 outlines the above comments. For example, as an outline, "complaint", "serious failure", "minor failure", "other" and the like are displayed in an easily identifiable manner. The browsing image information generation unit 425 may display different types of statuses in the area Z223, such as a status indicating a status, a status indicating an urgency, and a status indicating progress, and may display a plurality of types of statuses. You may increase them and display them together. For example, as an example of the display of the status indicating the state, there is a display such as "Status: ● Claim ○ Major failure ○ Minor failure ○ Other". As an example of the display of the status indicating urgency, there is a display such as "Urgent: ○ Urgent ● Early ○ Within the fiscal year ○ Medium- to long-term". As an example of the status indicating the progress, there is a display such as "Progress: ○ Checking ○ Under consideration ● Follow-up ○ Treatment ○ Completed". Further, as an example of the display in which a plurality of types of statuses are written together, the following example can be given.

"Condition: ● Complaint ○ Major failure ○ Minor failure ○ Other urgency: ○ Emergency ● Early ○ Within the fiscal year ○ Medium- to long-term progress: ○ Under confirmation ○ Under consideration ● Follow-up ○ Under treatment"

The status is displayed in the area Z224. In the example shown in the figure, "completed" indicating that the response has been completed is indicated as the status. The column with the word "spare" is prepared to add the content of the display in the future.

When it is detected that the user has selected the button of OBJ225 using a mouse or the like, the display of the area Z220 is closed.

In the area of the area Z200, the area of reference numeral 230 displays various buttons such as buttons OBJ231, OBJ232, OBJ233, OBJ234, OBJ235, and OBJ236 for performing operations incidental to the control of the display of the browsing screen.
When the user detects the selection of each of the above buttons using a mouse or the like, the following processing is performed.

When the terminal device 200 detects an operation on the OBJ231, the terminal device 200 refers to the user information 414 and executes an authentication process of the user's operation authority on the terminal device 200 or the information sharing support device 400. For example, the terminal device 200 reads the identification information presented by the user and obtains a collation result of the read identification information. The terminal device 200 permits its use to the extent permitted based on the collation result.

When the terminal device 200 detects an operation on the OBJ232, it switches whether or not to display a drawing such as a plan view in the area 210.

When the terminal device 200 detects an operation on the OBJ233, the terminal device 200 switches whether to display or hide various icons in the display area.

When the terminal device 200 detects an operation on the OBJ234, it takes a snapshot of the screen being displayed.

When the terminal device 200 detects an operation on the OBJ 235 (S20 in FIG. 11), the terminal device 200 switches between a display mode for displaying the browsing screen and an editing mode (S21 in FIG. 11) for accepting posting of information such as comments.

When the terminal device 200 detects an operation on the OBJ 236, the terminal device 200 displays the history information of the browsing screen displayed by the relatively latest operation. The user selects specific history information from the displayed history information. The terminal device 200 detects this and displays a browsing screen corresponding to the history information.

Area Z240 shows a bar 241 and a slider 242 moving over the bar 241. Area Z240 indicates the direction of the displayed viewing screen. For example, the browsing image information generation unit 425 indicates the direction of the browsing screen with respect to the entire circumference indicated by the surrounding image by the position of the slider 242 with respect to the bar 241.

When the slider 242 is located substantially in the center of the screen in the left-right direction, it indicates that the user is viewing the direction on the upper side of the plan view, for example. For example, when the position of the slider 242 is moved to the right from the substantially center in the left-right direction of the screen, the viewing image information generation unit 425 changes the direction clockwise from the direction from the upper side of the plan view. Generate a browsing image. On the other hand, when the position of the slider 242 is moved to the left side from the substantially center in the left-right direction of the screen, the viewing image information generation unit 425 counterclockwise from the direction from the upper side of the plan view. Generate a browsing image with the direction changed to. The browsing image information generation unit 425 generates a browsing image in the direction corresponding to the position of the slider 242 in response to such an operation.

In this way, the terminal device 200 detects an operation in which an object in the displayed browsing screen is selected, and then selects and displays information according to the detected operation.

According to the above embodiment, the designated information acquisition unit 421 shows the situation around the observation point in the real space in the browsed image, and corresponds to the position information of the predetermined position in the browsed image and the predetermined position in the browsed image. Get the character information to be done. The provided information generation unit 424 associates a predetermined position in the browsed image with a position on the space model formed with reference to the observation point, and the acquired character information and the space corresponding to the acquired character information. Generate provided information including position information in the model. The display image information generation unit 426 generates list image information that displays the presence / absence of the provided information stored in the storage unit 410 in correspondence with the observation points, thereby displaying the situation around a certain position in a simpler method. Make it shareable.

(Modification 1 of the first embodiment)
A modification of the first embodiment will be described. In this modification, the extraction process based on the position on the spatial model and the time information is performed as the condition for extracting the collected information.

[Display of collected information]
When collected information is continuously collected over a relatively long period of time, relatively old information to relatively new information may be associated with the same spatial model. In this case, if the number of pieces of information is large, it may be difficult to display the information. Also, if the situation changes frequently, the information is likely to become obsolete and it may not be necessary to display relatively old information.

Therefore, the extraction processing unit 423 of the present modification includes, in the information search condition, the position information of the predetermined position identified based on the spatial model and the time information that defines the range of the information to be shared. For example, the extraction processing unit 423 defines the range of information to be searched from the designated start date to the designated end date and performs the search. The extraction processing unit 423 may specify at least one of a start date and an end date. The above may be a period from the start date to the present, or from the past to the end date, in the extraction processing unit 423.

According to the first modification, the same effect as that of the first embodiment can be obtained, and information about a desired period specified by the user can be shared.

(Modification 2 of the first embodiment)
The second modification of the first embodiment will be described. In this modification, as a condition for extracting the collected information, an extraction process is performed based on the attribute information different from the position and time information on the spatial model among the attribute information given to the collected information.

As described above, the collected information 412 includes, as described above, the collected information such as image information and text includes attribute information given to each of the collected information in addition to the above collected information. Therefore, the extraction processing unit 423 of the present modification includes a part of the information included in the attribute information given to each of the search conditions of the collected information.

According to the second modification, the same effect as that of the first embodiment can be obtained, and the information selected based on the attribute information of the collected information 412 can be shared.

(Second Embodiment)
A second embodiment will be described. In the second embodiment, an example for facilitating the designation of the observation point will be described.

The individual mode shown in the first embodiment described above facilitates sharing of the situation around the observation point. However, it may not be possible to recognize that the collected information corresponding to the observation point exists until the browsed image is opened only by the method using the individual mode described above.

Therefore, in the present embodiment, a method of making it possible to recognize the existence of collected information that enables information sharing will be described by performing the following list mode processing.

As shown in the first embodiment, the information sharing support device 400 appropriately acquires the collected information and causes the acquired information to be shared. Here, a detailed example of the processing of S21 will be described.

FIG. 15 is a flowchart showing an example of the process of acquiring the collected information according to the embodiment. For example, the situation around the observation point in the real space is shown as a browsing image on the display unit of the terminal device 200 or the like. The user looks at the browsing screen shown on the display unit of the terminal device 200, and performs an operation of adding new information within the range displayed on the browsing screen.

The terminal device 200 detects the above operation and notifies the information sharing support device 400. On the other hand, the designated information acquisition unit 421 of the information sharing support device 400 acquires the position information of the position instructed by the operation of the mouse or the like from the terminal device 200, that is, the position information of the predetermined position in the browsed image, and obtains the position information of the predetermined position in the browsed image. Information such as text corresponding to the position is acquired (S211).

The provided information generation unit 424 associates a predetermined position in the browsed image with a position on the spatial model formed with reference to the observation point (S212).

The provided information generation unit 424 generates the provided information and writes the generated provided information in the storage unit 410 (provided information 413) (S213). The provided information generation unit 424 adds the generated provided information to the provided information 413 associated with the corresponding observation point. For example, the above-mentioned provided information includes the acquired text and position information in the spatial model corresponding to the acquired text.

By the above processing, the collected information shared by the information sharing support device 400 changes at any time.

FIG. 16 is a flowchart showing an example of a process of selecting an observation point from the list display according to the embodiment. When the list mode is selected by the determination in S11 of FIG. 11 described above, the following processing is executed.

First, the display image information generation unit 426 extracts an observation point in which the collection information satisfying the search condition exists from the collection information stored in the storage unit 410 (S31).

Next, the display image information generation unit 426 refers to the collected information 412 and counts the number of collected information satisfying the search condition for each observation point at the observation points extracted in S31 (S32).

Next, the display image information generation unit 426 displays the presence / absence of the provided information included in the collected information 412 of the storage unit 410 based on the observation points extracted in S31 in association with the above observation points. Is generated (S33).

Next, the display image information generation unit 426 adds the number of provided information corresponding to the observation points of the counting result in S32 to the list image information generated in S33 (S34).

Next, the display image information generation unit 426 transmits the list image information generated in S33 and S34 to the terminal device 200 (S35).

Next, the display image information generation unit 426 waits for a response from the terminal device 200, and determines whether or not the observation point has been selected in the terminal device 200 (S36).

When the observation point is selected in the terminal device 200 (S36: YES), the display image information generation unit 426 ends a series of processes shown in the figure.

When the observation point is not selected in the terminal device 200 (S36: NO), the display image information generation unit 426 determines whether or not the list image needs to be updated (S37).

When it is not necessary to update the list image (S37: NO), the process proceeds to S36. When it is necessary to update the list image (S37: NO), the process proceeds to S31.

According to the procedure shown above, the display image information generation unit 426 selects a desired observation point from the observation points displayed in the list.

As described above, the list image indicates that the text to be displayed in the browsed image is included in the provided information stored in the storage unit 410. By having the above list image, it is possible to identify the observation point to which the provided information is associated without opening the browsed image individually.

The display image information generation unit 426 generates list image information so that the presence or absence of text to be displayed in the browsed image and the number of provided information including the text are shown in the list image. The display image information generation unit 426 generates list image information that displays the presence / absence of the provided information stored in the storage unit 410 in correspondence with the observation points.

17 and 18 are diagrams showing an example of displaying a list image showing the presence or absence of provided information according to the embodiment in a list.

Reference numeral Z300 indicates a display area of the list image displayed on the terminal device 200.
An information display area of the area Z310 and the area Z320 is provided in the area Z300. Area Z310 is an area indicating search conditions. For example, the area Z310 shown in the figure shows a period defined as a search condition.

Z320 shows the configuration of the entire building set as the target range. For example, the F building (building) has each floor from the first floor (1F) to the fifth floor (5F) and a rooftop (RF). "04" is shown to correspond to the 1st floor, and "02" is shown to correspond to the 2nd floor. There is no "○" mark on the 3rd to 5th floors and RF. The "○" mark in the figure indicates that an observation point has been set and the collected information related to that observation point is stored. The number attached to the "○" mark indicates the number of observation points in that layer (floor).

That is, from the information shown in FIG. 17, it can be seen that four observation points are set on the 1st floor and two observation points are set on the 2nd floor. When "1F" in FIG. 17 is selected by operating a mouse or the like, the screen transitions to the screen shown in FIG. FIG. 18 shows an example of a screen for confirming the observation point corresponding to the 1st floor.

FIG. 19 is a diagram showing an example of a process for displaying a browsed image according to an embodiment.
The information sharing support system 1 makes a plurality of users share the situation around one or a plurality of observation points by using a spatial model provided in a three-dimensional virtual space corresponding to the observation points.

The range visible from the observation point in the real space is projected on the spatial model. The position on the spatial model corresponds to any position in the visible range around the observation point in real space. The storage unit 410 stores a plurality of types of collected information 412 such as images, texts, and drawings in association with the observation points. For example, attribute information is added to each of various information such as images, texts, and drawings in the collected information 412, and the above attribute information is stored in correspondence with the above various information.

The extraction processing unit 423 extracts the collected information satisfying a predetermined desired condition from the collected information 412 of the storage unit 410. The display image information generation unit 426 outputs information for displaying the list image as shown in FIGS. 17 and 18 to the terminal device 200 based on the collected information extracted by the extraction processing unit 423. The terminal device 200 displays the above list image.

Here, the user operates the terminal device 200 to select an observation point belonging to a desired range. The terminal device 200 detects an observation point selected by the user and notifies the information sharing support device 400 of the identification information of the observation point. In response to this, the information sharing support device 400 generates a browsing image corresponding to the selected observation point, and notifies the terminal device 200 of the generated browsing image. The terminal device 200 receives this and displays the browsed image.

According to the above embodiment, in addition to achieving the same effect as that of the first embodiment, it is determined that the provided information to be shared exists by using the list image listing the presence or absence of the provided information. make it easier. Further, according to the present embodiment, it is possible to share information about a desired period specified by the user.

(1) According to the above embodiment, in the information sharing support system 1, the situation around the observation point in the real space is shown in the browsed image, and the position information of the predetermined position in the browsed image and the browsed image are shown. The designated information acquisition unit 421 that acquires the character information corresponding to the predetermined position in the above, and the predetermined position in the browsed image are associated with the position on the spatial model formed with reference to the observation point, and the acquisition is performed. The provision information generation unit 424 that generates the provision information including the character information and the position information in the spatial model corresponding to the acquired character information, and the storage unit 410 that stores the provision information in association with the observation point. It includes a display image information generation unit 426 that generates list image information that displays the presence or absence of provided information stored in the storage unit in correspondence with the observation point. As a result, the information sharing support system 1 can provide a list image that displays the presence or absence of the provided information corresponding to the observation point, and is simpler even when the content and the number of information to be provided sequentially change. In a way that makes it possible to share the situation around a location.
(2) The display image information generation unit 426 may generate list image information indicating that the character information to be displayed in the browsed image is included in the stored provided information. Thereby, from the display of the list image, it is possible to identify that the character information to be displayed in the browsed image is stored as the provided information.
(3) The display image information generation unit 426 may generate the list image information indicating the number of provided information including the character information to be displayed in the browsed image. Thereby, the number of provided information including the character information to be displayed in the browsed image can be identified from the display of the list image.
(4) The display image information generation unit 426 may use the collected information satisfying a predetermined search condition as the provided information. As a result, the desired search condition determined by the user who receives the information can be determined, and the collected information satisfying the predetermined search condition can be provided as the provided information, and the information desired by the user who receives the information can be shared. can do.
(5) Further, the information sharing support system 1 includes a peripheral image acquisition unit 422 that acquires a peripheral image and a browsing image information generation unit 425 that generates information on the browsing image based on the peripheral image. There may be. This makes it possible to share information using the acquired surrounding image.
(6) In the browsing image information generation unit 425, the surrounding image includes at least one image of the equirectangular projection and the all-sky image, and the image by the equirectangular projection and the all-sky image. Part or all of at least one of the images may be acquired. As a result, at least one of the equirectangular projection image and the all-sky image can be acquired as a peripheral image.
(7) The browsing image information generation unit 425 may generate the browsing image by correcting the distortion of the acquired surrounding image. This makes it possible to provide a viewed image after correcting the distortion of the acquired surrounding image.
(8) The peripheral image acquisition unit 422 may allocate the acquired peripheral image to the surface of the spatial model. As a result, the spatial model can be associated with the surrounding situation indicated by the surrounding image, and the convenience of sharing information using the spatial model is enhanced.

Further, according to the above embodiment, the information sharing support system 1 observes with the designated information acquisition unit 421 that acquires the situation around the observation point in the real space as the collected information corresponding to the identification information of the observation point. In a spatial model showing a range that can be visually recognized from a point, information for including the position information of a predetermined position on the spatial model in the information search condition and sharing the information is included in the collected information acquired by the designated information acquisition unit 421. , An extraction processing unit 423 for extracting based on search conditions, and the like. As a result, the information sharing support system 1 makes it possible to share the situation around a certain position by a simpler method.
Further, in the spatial model, the distance from the observation point to the virtual surface becomes the radius of the sphere by forming a part or all of the surface of the hollow sphere, and the calculation when projecting the image onto the above virtual surface. Processing can be reduced.
In addition, the spatial model formed as a sphere corresponds to the real space and the three-dimensional virtual space by arranging the center of the sphere at the position in the three-dimensional virtual space corresponding to the position of the observation point in the real space. Easy to attach.
Further, the extraction processing unit 423 may include the position information of the predetermined position identified based on the spatial model and the time information that defines the range of the information to be shared in the above search condition. By including time information, it becomes possible to select a necessary range of information in time and space.
Further, the extraction processing unit 423 may include image information obtained by capturing the surroundings of the observation point in the real space and information of a type different from the image information as the information to be shared. This makes it easy to share information of types other than image information.
Further, the browsing image information generation unit 425 can share the information as the image information by generating the image information for imaging the information to be shared.
Further, the browsing image information generation unit 425 allocates the information to be shared to the spatial model based on the position information given to the information to be shared, cuts out a predetermined range of the spatial model, and outputs the image information. It may be generated. The browsing image information generation unit 425 can cut out a predetermined range of the spatial model and generate image information.

Although the embodiment of the present invention has been described above, the information sharing support system 1 shown in FIG. 1 has a computer system inside. A series of processing processes related to the above-mentioned processing is stored in a computer-readable storage medium in the form of a program, and the above processing is performed by the computer reading and executing this program. Here, the computer-readable storage medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Further, this computer program may be distributed to a computer via a communication line, and the computer receiving the distribution may execute the program. Further, the term "computer system" as used herein includes an OS and the like.

Although one embodiment of the present invention has been described above, the embodiment of the present invention is not limited to the above. The embodiment of the present invention can be, for example, a modification of the above embodiment as follows.
For example, in the above-described embodiment, the configuration related to the present invention has been described by dividing the information sharing support system 1 into an imaging device 100, a terminal device 200, a management device 300, and an information sharing support device 400 for convenience. The division of the image pickup device 100, the terminal device 200, the management device 300, and the information sharing support device 400 may be changed from those illustrated above, or the devices may be integrated with each other. Further, a part of the configurations included in each device may be included in the configurations of other devices.

The data structure shown in the figure is shown in a table format for ease of explanation, but the data structure format may be another format.

In the above embodiment, the method of using the image in the real space taken by the image pickup apparatus 100 has been illustrated, but instead, an image generated based on a three-dimensional model in which a building or the like is modeled is used. You may use it.

1 Information sharing plan support system, 100 imaging device, 200 terminal device, 300 management device, 400 information sharing support device, 410 storage unit, 420 control unit, 421 designated information acquisition unit, 422 surrounding image acquisition unit, 423 extraction processing unit, 424 Provided information generation unit, 425 Browsing image information generation unit, 426 Display image information generation unit.

Claims (10)

A designated information acquisition unit that shows the situation around the observation point in the real space in the browsed image and acquires the position information of the predetermined position in the browsed image and the character information corresponding to the predetermined position in the browsed image.
A predetermined position in the browsed image is associated with a position on a spatial model formed with reference to the observation point, and the acquired character information and the position information in the spatial model corresponding to the acquired character information are associated with each other. The provision information generation unit that generates the provision information including
A storage unit that stores the provided information in association with the observation point,
A display image information generation unit that generates list image information that displays the presence or absence of provided information stored in the storage unit in correspondence with the observation point.
Information sharing support system equipped with. The display image information generation unit
Generates the list image information indicating that the character information to be displayed in the browsed image is included in the stored provided information.
The information sharing support system according to claim 1. The display image information generation unit
Generates the list image information indicating the number of provided information including the character information to be displayed in the browsed image.
The information sharing support system according to claim 1 or 2. The display image information generation unit
The collected information satisfying a predetermined search condition is used as the provided information.
The information sharing support system according to any one of claims 1 to 3. A peripheral image acquisition unit that acquires a peripheral image,
A browsing image information generation unit that generates information on the browsing image based on the surrounding image,
The information sharing support system according to any one of claims 1 to 4. The browsed image information generation unit
The surrounding image includes at least one of an equirectangular projection image and an all-sky image, and a part of or at least one of the equirectangular projection image and the all-sky image. Get it all,
The information sharing support system according to claim 5. The browsed image information generation unit
The browsing image is generated by correcting the distortion of the acquired surrounding image.
The information sharing support system according to claim 5 or 6. The surrounding image acquisition unit
Allocate the acquired surrounding image to the surface of the spatial model.
The information sharing support system according to any one of claims 5 to 7. The situation around the observation point in the real space is shown in the browsed image, and the computer of the information sharing support system acquires the position information of the predetermined position in the browsed image and the character information corresponding to the predetermined position in the browsed image. And
The computer associates a predetermined position in the browsed image with a position on a spatial model formed with reference to the observation point, and the acquired character information and the spatial model corresponding to the acquired character information. Generates provided information, including location information,
The computer associates the provided information with the observation point and stores it in the storage unit.
A step in which the computer generates list image information that displays the presence or absence of provided information stored in the storage unit in correspondence with the observation point.
Information sharing support methods including. On the computer of the information sharing support system
The step of acquiring the position information of a predetermined position in the browsed image and the character information corresponding to the predetermined position in the browsed image by showing the situation around the observation point in the real space in the browsed image, and
A predetermined position in the browsed image is associated with a position on a spatial model formed with reference to the observation point, and the acquired character information and the position information in the spatial model corresponding to the acquired character information are associated with each other. Steps to generate the provided information, including
A step of associating the provided information with the observation point and storing it in the storage unit,
A step of generating list image information that displays the presence / absence of provided information stored in the storage unit in correspondence with the observation point, and
A program to execute.