JP6931171B2 - Image search device, image search program, and image search method - Google Patents

Description

The present invention relates to an image search device, an image search program, and an image search method.

There is known an image sharing service that can publish (for example, non-) the image data taken by the user to an unspecified user by uploading (posting) the image data to a specific server on the Internet. See Patent Document 1). The image sharing service is provided with an image search function for searching for desired image data from a large number of image data uploaded to a server. For example, when a user searches using "carbonara" as a search keyword, a list of image data tagged with "carbonara" is displayed as a search result.

"Instagram", [online], [Searched November 2, 2018], Internet <URL: https://www.instagram.com/>

By the way, a user who wants to eat delicious carbonara may use the image search function to search for a restaurant that offers delicious carbonara. However, the search results when a search is performed using "carbonara" as a search keyword include not only image data posted by restaurants but also image data posted by general users. Therefore, even if a delicious carbonara image is found in the image data displayed as the search result, the image data may be an image data of a carbonara cooked by a general user. Therefore, the user cannot efficiently search for a restaurant that offers delicious carbonara.

An object of the present invention is to provide an image search device, an image search method, and an image search program capable of easily determining the type of user account associated with the image data displayed as a search result. be.

The image search device according to the present invention includes a search processing unit that extracts image data that matches the search conditions from a plurality of image data associated with a user account, and one or more image data extracted by the search processing unit. The image data is provided with a display processing unit that displays the image data in a display mode capable of determining the type of user account corresponding to the image data.

The image search program according to the present invention is extracted by a search step of extracting image data matching the search conditions from a plurality of image data associated with a user account on one or a plurality of processors, and the search step. It is an image search program for executing a display step of displaying one or more of the image data in a display mode in which the type of user account corresponding to the image data can be determined.

The image search method according to the present invention includes a search step of extracting image data matching the search conditions from a plurality of image data associated with a user account, and one or a plurality of the images extracted in the search step. A display step of displaying the data in a display mode capable of determining the type of the user account corresponding to the image data is included.

According to the present invention, there is provided an image search device, an image search method, and an image search program that can easily determine the type of user account associated with the image data displayed as a search result.

FIG. 1 is a block diagram showing a configuration of an image search system according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of user account information used in the image search system according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of image information used in the image search system according to the embodiment of the present invention. FIG. 4 is a diagram showing an example of company profile information used in the image search system according to the embodiment of the present invention. FIG. 5 is a flowchart showing an example of the procedure of the upload process executed by the image search device according to the embodiment of the present invention. FIG. 6 is a flowchart showing an example of a procedure of image search processing executed by the image search device according to the embodiment of the present invention. FIG. 7 is a diagram showing an example of a search result page displayed on a user terminal in the image search system according to the embodiment of the present invention. FIG. 8 is a diagram showing an example of a display setting page displayed on a user terminal in the image search system according to the embodiment of the present invention. FIG. 9 is a diagram showing an example of a search result page displayed on a user terminal in the image search system according to the embodiment of the present invention. FIG. 10 is a diagram showing an example of a profile page displayed on a user terminal in the image search system according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings for the purpose of understanding the present invention. The following embodiments are examples that embody the present invention, and do not limit the technical scope of the present invention.

[Image search system 1]
As shown in FIG. 1, the image search system 1 according to the embodiment of the present invention includes an image search device 2 and one or more user terminals 3. The image search device 2 and the user terminal 3 can communicate with each other via a communication network N1 such as the Internet, LAN, WAN, or a public telephone line.

The image search device 2 is a server that provides an image sharing service capable of disclosing image data taken by the user himself / herself to an unspecified user. The image search device 2 has an image search function for searching image data that matches the search conditions from a large number of image data uploaded (posted) by a plurality of users.

By the way, it is conceivable that a user who wants to eat delicious carbonara uses the image search function in the image sharing service to search for a restaurant that offers delicious carbonara. However, the search results when a search is performed using "carbonara" as a search keyword include not only image data posted by restaurants but also image data posted by general users. Therefore, even if a delicious carbonara image is found in the image data displayed as the search result, the image data may be an image data of a carbonara cooked by a general user. Therefore, the user cannot efficiently search for a restaurant that offers delicious carbonara. On the other hand, according to the image search device 2 according to the present embodiment, it is possible to easily determine the type of user account associated with the image data displayed as the search result.

[Image search device 2]
As shown in FIG. 1, the image retrieval device 2 is a server including a control unit 21, a storage unit 22, an operation display unit 23, a communication I / F 24, and the like. The image search device 2 is not limited to one computer, and may be a computer system in which a plurality of computers operate in cooperation with each other. Further, various processes executed by the image search device 2 may be distributed and executed by one or a plurality of processors.

The communication I / F 24 connects the image search device 2 to the communication network N1 by wire or wirelessly, and executes data communication according to a predetermined communication protocol with an external device such as a user terminal 3 via the communication network N1. It is a communication interface for

The operation display unit 23 is a user interface including a display unit such as a liquid crystal display or an organic EL display that displays various information, and an operation unit such as a mouse, keyboard, or touch panel that accepts operations.

The storage unit 22 is a non-volatile storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various types of information. Specifically, the storage unit 22 stores data such as user account information D1, image information D2, and company profile information D3. Here, FIG. 2 is a diagram showing an example of user account information D1, FIG. 3 is a diagram showing an example of image information D2, and FIG. 3 is a diagram showing an example of company profile information D3.

As shown in FIG. 2, the user account information D1 includes information such as a "user ID", a "password", and an "account type" for each user registered in the image sharing service. The "user ID" is identification information for identifying the user. The "password" is authentication information for authenticating the user. The "account type" is the account type of the user (specifically, an individual account or a corporate account). The personal account is a user account of a general user. The personal account is an example of the "first type user account" of the present invention. The corporate account is a user account of a company such as a restaurant, an accommodation facility, or an online shop. The corporate account is an example of the "second type user account" of the present invention. The user account information D1 is referred to by the control unit 21 as necessary during the upload process (see FIG. 5) or the image search process (see FIG. 6), which will be described later.

The image information D2 includes information such as "image ID", "user ID", "tag information", and "location information" for each image data uploaded (posted) to the image search device 2. The "image ID" is identification information for identifying the image data. The "user ID" is identification information for identifying the user who uploaded the image data. The "tag information" is information indicating a hash tag associated with the image data. The hashtag is an arbitrary character string specified by the user as needed when the image data is uploaded. A plurality of hashtags may be associated with one image data. In another embodiment, the hashtag may be automatically set based on the image recognition result by AI (artificial intelligence). The "location information" is information indicating the place where the image data was taken, and is, for example, a place name, a facility name, or the like. The "location information" is specified or selected by the user when the image data is uploaded. In another embodiment, it may be automatically set based on the Exif (Exif image file format) information included in the image data. Further, the image data may be automatically set based on the current position of the user terminal 3 when the image data is uploaded from the user terminal 3 to the image search device 2.

The company profile information D3 includes information such as a "user ID", a "facility name", a "telephone number", an "email address", a "location", and a "reservation page" for each company account. The "user ID" is identification information for identifying the company account. The "facility name" is the name of a facility (for example, a restaurant, an accommodation facility, etc.) corresponding to the corporate account. The "telephone number" is the telephone number of the facility. The "email address" is the email address of the facility. "Location" is the location of the facility. The "reservation page" is an address of a web page for accepting online reservations for the facility (for example, the URL of the web page). The web page may be provided by a server different from the image search device 2 (for example, a server of a gourmet information providing site that provides information about restaurants). Information such as "facility name", "phone number", "email address", "location", and "reservation page" in the company profile information D3 is used as necessary when registering the company account in the image sharing service. Set by.

As another embodiment, a part or all of the information such as the user account information D1, the image information D2, and the company profile information D3 is stored in another server accessible from the image search device 2 via the communication network N1. It is also possible that it has been done. Then, the control unit 21 of the image search device 2 may acquire various information from the server and execute each process such as an image search process (see FIG. 6) described later.

In addition, the storage unit 22 also stores data on a search page (not shown) for inputting search conditions. In addition, data such as a search result page P1 (see FIGS. 7 and 9), a display setting page P2 (see FIG. 8), and a profile page P3 (see FIG. 10), which will be described later, are also stored in the storage unit 22.

Further, the storage unit 22 stores a control program such as an image search program for causing the control unit 21 to execute an image search process (see FIG. 6) described later. For example, the image search program is non-temporarily recorded on a computer-readable recording medium such as a CD or DVD, and is read by a reader (not shown) such as a CD drive or a DVD drive included in the image search device 2. It is stored in the storage unit 22.

The control unit 21 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage unit in which control programs such as a BIOS and an OS for causing the CPU to execute various arithmetic processes are stored in advance. The RAM is a volatile or non-volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 21 controls the image search device 2 by executing various control programs stored in advance in the ROM or the storage unit 22 on the CPU.

Specifically, as shown in FIG. 1, the control unit 21 includes various processing units such as a search processing unit 211 and a display processing unit 212. The control unit 21 functions as these processing units by executing various processes according to the image search program on the CPU. A part or all of the processing units included in the control unit 21 may be composed of an electronic circuit such as an ASIC (Application Specific Integrated Circuit). The image search program may be a program for causing a plurality of processors to function as the various processing units.

The search processing unit 211 extracts image data that matches the search conditions from the plurality of image data associated with the user account. The image data is, for example, image data uploaded from the user terminal 3 to the image search device 2 and stored in the storage unit 22. The image data uploaded from the user terminal 3 to the image search device 2 is associated with the user account by the image information D2 shown in FIG. For example, the "image A" shown in FIG. 3 is associated with a user account whose user ID is "user C". Further, the "image C" is associated with a user account whose user ID is "user D". The search conditions are set according to, for example, a user operation on the user terminal 3. The user of the user terminal 3 can input a search keyword consisting of an arbitrary character string as the search condition. The search processing unit 211 refers to the image information D2 and extracts the image data associated with the hashtag that matches the search keyword from the plurality of image data stored in the storage unit 22. Can be done.

The display processing unit 212 displays one or more of the image data extracted by the search processing unit 211 in a display mode capable of determining the type of user account corresponding to the image data. Specifically, the display processing unit 212 has at least the image data associated with the first type user account (for example, the personal account) and the second type user account (for example, the company account) different from the first type. The image data associated with is displayed in a display mode that can be discriminated from. Hereinafter, a case where the first type user account is a personal account and the second type user account is a corporate account will be described.

For example, the display processing unit 212 generates the data of the search result page P1 as shown in FIG. 7, and transmits the data to the user terminal 3 through the communication I / F24 and the communication network N1. As a result, the search result page P1 is displayed on the operation display unit 33 of the user terminal 3. FIG. 7 shows the search result page P1 when the character string "Carbonara" is input as the search condition. In this example, 52,658 image data with the hashtag of "Carbonara" are extracted, and the user scrolls the search result page P1 to obtain 52,658 of these image data. Image data can be freely browsed.

The display processing unit 212 may combine and display the corporate account identification image B1 on the image data G2, G9, and G10 associated with the corporate account, as shown on the search result page P1 shown in FIG. As a result, the user can use the image data G1, G3 to G8, G11, G12 associated with the personal account and the image data G2 associated with the corporate account among the plurality of image data G1 to G12 displayed on the search result page P1. , G9, G10 can be easily distinguished. The corporate account is an example of the "specific type of user account" of the present invention. Further, the corporate account identification image B1 is an example of the "identification image" of the present invention. That is, as shown in FIG. 7, the first display processing unit 212 displays the image data associated with the company account among the plurality of image data on the search result page P1 in which the plurality of the image data are displayed side by side at the same time. It is possible to synthesize and display the company account identification image B1 on the data.

In another embodiment, the display processing unit 212 links the image data linked to the personal account and the corporate account by compositing and displaying the predetermined personal account identification image with the image data linked to the personal account. The image data may be displayed so as to be distinguishable from the image data. Further, the display processing unit 212 makes the display size of the image data associated with the personal count different from the display size of the image data associated with the corporate account (for example, the display size of the latter is made larger than the display size of the former). ), The image data associated with the personal account and the image data associated with the corporate account may be displayed in a distinguishable manner. Further, the display processing unit 212 is associated with the personal account by making the color or thickness of the outline of the image data associated with the personal account different from the color or thickness of the outline of the image data associated with the corporate account. The image data and the image data associated with the corporate account may be displayed in a distinguishable manner.

The display processing unit 212 displays the display mode of the image data associated with the corporate account according to the user input, the first display mode in which the corporate account identification image B1 is compositely displayed and the second display mode in which the corporate account identification image B1 is not compositely displayed. It may be switched between the display mode and the display mode. For example, the display processing unit 212 displays the display mode of the image data associated with the corporate account in the first display mode and the second display mode in response to the operation of the switch key SW1 included in the display setting page P2 shown in FIG. It may be switched between modes. The display setting page P2 shown in FIG. 8 is displayed, for example, when the display setting key K11 included in the search result page P1 is operated. As a result, the user can hide the corporate account identification image B1 as needed to improve the visibility of the image data on the search result page P1.

The display processing unit 212 displays the corporate account identification image B1 in a composite manner in response to a predetermined operation (for example, tap operation, click operation, long press operation, etc.) performed on the corporate account identification image B1. Information (for example, facility name, location, etc.) regarding the user account (that is, the company account) corresponding to the image data may be displayed. For example, the display processing unit 212 changes the facility name and location of the facility corresponding to the corporate account while the long press operation on the corporate account identification image B1 that is compositely displayed in the image data associated with the corporate account is detected. It may be displayed in a pop-up. As a result, the user can easily confirm the facility name and location of the facility corresponding to the corporate account.

The display processing unit 212 may display the image data associated with the corporate account with priority over the image data associated with the personal account. For example, the display processing unit 212 displays only the image data associated with the corporate account on the search result page P1 when the switch key SW2 included in the display setting page P2 shown in FIG. 8 is set to the ON state. You may. Alternatively, the display processing unit 212 places the image data associated with the corporate account on the search result page P1 higher than the image data associated with the personal account (that is, at a position closer to the top on the search result page P1). It may be displayed. This allows the user to find the desired facility more easily.

The display processing unit 212 may display the image data associated with the corporate account in a display mode capable of discriminating the genre of the corporate account. For example, the display processing unit 212 sets the image data associated with the corporate account of the first genre (for example, the genre of a restaurant) as a predetermined first genre as a corporate account identification image corresponding to the first genre. The identification image may be combined and displayed. Then, the display processing unit 212 displays the image data associated with the corporate account of the second genre (for example, the genre of the accommodation facility) with the first genre identification image as the corporate account identification image corresponding to the second genre. May combine and display different predetermined second genre identification images. This allows the user to find the desired facility more easily.

The display processing unit 212 links the image data associated with the corporate account of a predetermined specific genre (for example, the genre of the restaurant) to the corporate account of the genre other than the specific genre (for example, the genre of the accommodation facility). It may be displayed with priority over the image data. For example, when the switch key SW3 included in the display setting page P2 shown in FIG. 8 is set to the ON state, the display processing unit 212 is linked to the company account of the restaurant genre on the search result page P1. Only the image data may be displayed. Alternatively, on the search result page P1, the display processing unit 212 places the image data associated with the corporate account of the restaurant genre higher than the image data associated with the corporate account of another genre (that is, the search result page P1). (At a position closer to the beginning). This allows the user to more easily find the desired facility of the desired genre.

The display processing unit 212 may display one or a plurality of the image data extracted by the search processing unit 211 in a state of being collected for each facility corresponding to the corporate account. For example, the display processing unit 212 has image data associated with the corporate account for each facility corresponding to the corporate account when the switch key SW4 included in the display setting page P2 shown in FIG. 8 is set to the ON state. And the image data associated with the personal account taken at the facility corresponding to the corporate account may be displayed together. For example, in the search result page P1 shown in FIG. 9, the image data Ga1 and the image data Ga2 are image data (for example, image B shown in FIG. 3) associated with the corporate account of the restaurant C, and the image data Ga3. ~ Ga6 is the image data associated with the restaurant C (for example, the image D shown in FIG. 3) among the image data associated with the personal account. Further, the image data Gb1 is image data associated with the corporate account of the restaurant F, and the image data Gb2 to Gb5 are image data associated with the restaurant F among the image data associated with the personal account. Further, the image data Gc1 is image data associated with the corporate account of the restaurant H. As a result, the user can collectively check a plurality of image data related to the same facility regardless of whether the image data is associated with the corporate account or the personal account. Therefore, it becomes possible to find the desired facility more easily.

When the number of image data related to the same facility exceeds a predetermined upper limit, the display processing unit 212 searches only the image data for the upper limit among the image data related to the facility on the search result page. In addition to the initial display on P1, the expansion operation key for displaying the remaining image data may be displayed on the search result page P1. Then, the display processing unit 212 may display the remaining image data on the search result page P1 when the expansion operation key is operated. In this case, the display processing unit 212 may preferentially initially display the image data associated with the corporate account among the image data related to the facility on the search result page P1.

The display processing unit 212 may display the image data associated with the corporate account with priority over the image data associated with the personal account among the plurality of image data collected for each facility. For example, as shown in the search result page P1 shown in FIG. 9, the display processing unit 212 sets the image data Ga1 and the image data Ga2 associated with the corporate account among the image data Ga1 to Ga6 related to the restaurant C as individuals. It may be displayed higher than the image data Ga3 to Ga6 associated with the account (that is, at a position closer to the top on the search result page P1). Similarly, the display processing unit 212 ranks the image data Gb1 associated with the corporate account among the image data Gb1 to Gb5 related to the restaurant F higher than the image data Gb2 to Gb5 associated with the personal account (that is,). It may be displayed (at a position closer to the beginning) on the search result page P1. As a result, the user can easily find and confirm the image data associated with the corporate account from the plurality of image data collected for each facility.

The display processing unit 212 collects one or more of the image data extracted by the search processing unit 211 for each facility corresponding to the corporate account, and the distance from the point indicated by the input position information to the facility. It may be displayed in the order according to. For example, the display processing unit 212 can display one or more of the image data extracted by the search processing unit 211 when the switch key SW6 included in the display setting page P2 shown in FIG. 8 is set to the ON state. , The distance from the point specified by the user to the facility may be displayed in the order of the shortest distance in the state of grouping each facility corresponding to the corporate account. As a result, on the search result page P1, image data related to the facility is displayed in order from the facility closest to the point indicated by the location information. Therefore, the user can easily find a desired facility from the facilities near the point indicated by the location information. The position information may indicate the current position of the user terminal 3 or may indicate an arbitrary point designated by the user.

The display processing unit 212 may display one or more of the image data extracted by the search processing unit 211 in a display mode in which a group of the image data related to the same facility can be visually recognized. For example, the display processing unit 212 encloses a plurality of image data related to the same facility with a frame when the switch key SW5 included in the display setting page P2 shown in FIG. 8 is set to the ON state. , The group of the image data related to the same facility may be made visible. For example, in the search result page P1 shown in FIG. 9, the image data Ga1 to Ga6 related to the restaurant C are surrounded by the frame line L1, and the image data Gb1 to Gb5 related to the restaurant F are surrounded by the frame line L2. being surrounded. As a result, the user can easily identify the image data related to the same facility. In another embodiment, the display processing unit 212 makes it possible to visually recognize a collection of the image data related to the same facility by making the outline color or the background color of each image data different for each facility. good.

[User terminal 3]
As shown in FIG. 3, the user terminal 3 includes a control unit 31, a storage unit 32, an operation display unit 33, a communication I / F 34, a GPS (Global Positioning System) sensor 35, a camera 36, and the like. The user terminal 3 is an information processing device such as a mobile phone, a smartphone, a tablet terminal, or a personal computer.

The communication I / F 34 connects the user terminal 3 to the communication network N1 by wire or wirelessly, and executes data communication according to a predetermined communication protocol with an external device such as an image search device 2 via the communication network N1. It is a communication interface for

The operation display unit 33 includes a display unit such as a liquid crystal display or an organic EL display that displays various information such as a message or a web page, and an operation unit such as a mouse, keyboard, hard key, or touch panel that accepts operations. It is a user interface.

The storage unit 32 is a non-volatile storage unit such as a flash memory that stores various types of information. For example, a control program such as an image sharing program is stored in the storage unit 32. The image sharing program controls the control unit 31 to execute a process for uploading (posting) image data to the image search device 2 and viewing the image data uploaded to the image search device 2. It is a program. In another embodiment, in order to cause the control unit 31 to execute a process for uploading (posting) image data to the image search device 2 and viewing the image data uploaded to the image search device 2. As the control program of, a browser program may be used instead of the image sharing program. The browser program is a control program for causing the control unit 31 to execute communication processing with an external device such as an image retrieval device 2 according to a communication protocol such as HTTP (Hypertext Transfer Protocol).

The control unit 31 has control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The ROM is a non-volatile storage unit in which control programs such as a BIOS and an OS for causing the CPU to execute various processes are stored in advance. The RAM is a volatile or non-volatile storage unit that stores various types of information, and is used as a temporary storage memory (working area) for various processes executed by the CPU. Then, the control unit 31 controls the user terminal 3 by executing various control programs stored in advance in the ROM or the storage unit 32 on the CPU.

Based on the signal from the GPS satellite, the GPS sensor 35 acquires GPS information including latitude information and longitude information indicating the current position of the user terminal 3.

The camera 36 has a lens, an image sensor, and the like, and outputs image data according to the light incident on the image sensor. The image data output from the camera 36 is converted into image data in a JPEG format or the like and recorded in the storage unit 32. GPS information (longitude, latitude, altitude) acquired by the GPS sensor 35 at the time of shooting may be embedded in the image data as metadata.

[Upload process]
Hereinafter, the upload process executed by the control unit 21 of the image search device 2 will be described with reference to FIG. When an access (upload request) from the user terminal 3 occurs, the control unit 21 individually executes the upload process corresponding to each user terminal 3. That is, the control unit 21 may execute the upload process corresponding to the plurality of user terminals 3 in substantially parallel time division. In addition, the upload process may be terminated in the middle by a predetermined operation of the user terminal 3.

<Step S11>
First, in step S11, the control unit 21 executes a login process. Specifically, the control unit 21 receives the user ID and password from the user terminal 3 through the communication network N1. Then, the control unit 21 determines whether or not the combination of the user ID and the password received from the user terminal 3 is registered in the user account information D1 (see FIG. 2). When the combination is registered in the user account information D1, the process proceeds to step S12. On the other hand, if the combination is not registered in the user account information D1, the upload process ends.

<Step S12>
In step S12, the control unit 21 receives image data, tag information, and position information from the user terminal 3 through the communication network N1. The tag information and the position information may be omitted.

<Step S13>
In step S13, the control unit 21 stores the image data received in step S12 in the storage unit 22.

<Step S14>
In step S14, the control unit 21 updates the image information D2 (see FIG. 3) based on the user ID received in step S11, the image data received in step S12, the tag information, and the position information. As a result, the user ID, tag information, and position information are associated with the image data saved in the storage unit 22 in step S13. Then, the upload process is completed.

As a result of the upload process, the image data uploaded (posted) from the user terminal 3 is stored in the storage unit 22 in a state of being linked to a user account of either a personal account or a corporate account. Become.

[Image search process]
Hereinafter, the image search process executed by the control unit 21 of the image search device 2 will be described with reference to FIG. When an access (image search request) from the user terminal 3 occurs, the control unit 21 individually executes the image search process corresponding to each user terminal 3. That is, the control unit 21 may execute the image search process corresponding to the plurality of user terminals 3 in substantially parallel time division. In addition, the image search process may be terminated in the middle by a predetermined operation of the user terminal 3.

The present invention can be regarded as an invention of an image search method for executing one or a plurality of steps included in the image search process, and the one or a plurality of steps included in the image search process described here may be appropriately used. It may be omitted. The execution order of each step in the image search process may be different as long as the same effect is produced. Further, here, a case where each step in the image search process is executed by the control unit 21 will be described as an example, but an image search method in which each step in the image search process is distributed and executed by a plurality of processors. Can also be considered as another embodiment.

<Step S21>
First, in step S21, the control unit 21 receives the search conditions for searching the image data from the user terminal 3 through the communication network N1. For example, the control unit 21 causes the operation display unit 33 of the user terminal 3 to display a search condition input page (not shown) for inputting the search condition. Then, the control unit 21 receives the search condition input by the user of the user terminal 3 via the search condition input page from the user terminal 3 through the communication network N1. The search condition includes a search keyword consisting of an arbitrary character string input by the user.

<Step S22>
In step S22, the control unit 21 searches the plurality of image data stored in the storage unit 22 (that is, a plurality of image data uploaded from the plurality of user terminals 3) obtained in step S21. Extract image data that matches the conditions. Specifically, the control unit 21 compares the search keyword acquired in step S21 with the tag information (see FIG. 3) included in the image information D2, and associates a hashtag that matches the search keyword. Extract the image data. The process of step S22 is executed by the search processing unit 211 of the control unit 21. The step S22 is an example of the "search step" of the present invention.

In another embodiment, the control unit 21 extracts image data associated with the position information including the character string indicated by the search keyword from the plurality of image data stored in the storage unit 22. You may. Further, the control unit 21 may extract the image data associated with the user ID including the character string indicated by the search keyword from the plurality of image data stored in the storage unit 22.

<Step S23>
In step S23, the control unit 21 synthesizes the company account identification image B1 with the image data associated with the company account among the image data extracted in step S22. When the location information included in the image information D2 corresponding to the image data and the location included in the company profile information D3 corresponding to the company account match, the company account is included in the image data. The identification information B1 may be synthesized.

<Step S24>
In step S24, the control unit 21 causes the operation display unit 33 of the user terminal 3 to display the search result page P1 including the image data extracted in the step S22. Specifically, the control unit 21 transmits the data of the search result page P1 as shown in FIG. 7 to the user terminal 3 through the communication network N1. As a result, the search result page P1 is displayed on the operation display unit 33 of the user terminal 3. On the search result page P1, the image data extracted in step S22 is displayed. Then, among those image data, the image data associated with the corporate account is displayed in a state in which the corporate account identification image B1 is combined. The process of step S24 is executed by the display processing unit 212 of the control unit 21. The step S24 is an example of the "display step" of the present invention.

<Step S25>
In step S25, the control unit 21 determines whether or not the display setting has been changed. Specifically, when the display setting key K11 included in the search result page P1 is operated, the control unit 21 causes the operation display unit 33 of the user terminal 3 to display the display setting page P2 as shown in FIG. .. Then, when any of the switch keys SW1 to SW6 included in the display setting page P2 is operated, it is determined that the display setting has been changed. When it is determined that the display setting has been changed (S25: Yes), the process proceeds to step S26. On the other hand, if it is determined that the display setting has not been changed (S25: No), the process proceeds to step S27.

<Step S26>
In step S26, the control unit 21 updates the search result page P1. Specifically, the control unit 21 updates the search result page P1 in response to a user operation on the display setting page P2, and causes the operation display unit 33 of the user terminal 3 to display the updated search result page P1. The process of step S26 is executed by the display processing unit 212 of the control unit 21.

For example, when the switch key SW1 included in the display setting page P2 is changed from the on state to the off state, the control unit 21 hides the company account identification image B1 on the search result page P1. On the other hand, when the switch key SW1 included in the display setting page P2 is changed from the off state to the on state, the control unit 21 displays the company account identification image B1 on the search result page P1. As a result, the corporate account identification image B1 is compositely displayed on the image data associated with the corporate account.

Further, when the switch key SW2 included in the display setting page P2 is changed from the off state to the on state, the control unit 21 hides the image data associated with the personal account on the search result page P1. As a result, only the image data associated with the corporate account is displayed on the search result page P1. On the other hand, when the switch key SW2 included in the display setting page P2 is changed from the on state to the off state, the control unit 21 displays the image data associated with the personal account on the search result page P1. As a result, in addition to the image data associated with the corporate account, the image data associated with the personal account is also displayed on the search result page P1.

Further, when the switch key SW3 included in the display setting page P2 is changed from the off state to the on state, the control unit 21 hides the image data associated with the personal account on the search result page P1 and at the restaurant. Hide the image data associated with corporate accounts of other genres. As a result, only the image data associated with the corporate account of the restaurant genre is displayed on the search result page P1. On the other hand, when the switch key SW3 included in the display setting page P2 is changed from the on state to the off state, the control unit 21 displays the image data associated with the personal account on the search result page P1 and the corporate account of a genre other than the restaurant. The image data associated with is displayed. As a result, in addition to the image data linked to the corporate account of the restaurant genre, the image data linked to the personal account and the image data linked to the corporate account of the genre other than the restaurant are also displayed on the search result page P1. Will be done.

Further, when the switch key SW4 included in the display setting page P2 is changed from the off state to the on state, the control unit 21 collects the image data to be displayed on the search result page P1 for each facility corresponding to the corporate account. It is rearranged as follows and arranged on the search result page P1. As a result, the image data is displayed on the search result page P1 in a state of being summarized for each facility corresponding to the corporate account. On the other hand, when the switch key SW4 included in the display setting page P2 is changed from the on state to the off state, the control unit 21 uploads the image data to be displayed on the search result page P1 in a predetermined order (for example, uploading). The date and time are sorted in the order of newest) and placed on the search result page P1. As a result, the image data is displayed on the search result page P1 in a state of being arranged in a predetermined order.

Further, when the switch key SW5 included in the display setting page P2 is changed from the off state to the on state, the control unit 21 sets a frame line (for example,) on the search result page P1 so as to surround the image data related to the same facility. , Border line L1, frame line L2, etc. shown in FIG. 9) are displayed. On the other hand, when the switch key SW5 included in the display setting page P2 is changed from the on state to the off state, the control unit 21 hides the frame line.

Further, when the switch key SW6 included in the display setting page P2 is changed from the off state to the on state, the control unit 21 causes, for example, the operation display unit 33 of the user terminal 3 to display the point setting page (not shown). And let the user specify the point. The user can specify the current position of the user terminal 3 or any other point on the point setting page. When the current position of the user terminal 3 is specified on the point setting page, the control unit 21 receives the GPS information detected by the GPS sensor 35 of the user terminal 3 from the user terminal through the communication network N1. When a point is specified by the user on the point setting page, the control unit 21 displays the image data to be displayed on the search result page P1 in ascending order of the distance from the point to the facility associated with the image data. It is rearranged and placed on the search result page P1. The distance from the point to the facility associated with the image data is calculated based on, for example, the location information included in the company profile information D3. On the other hand, when the switch key SW6 included in the display setting page P2 is changed from the on state to the off state, the control unit 21 uploads the image data to be displayed on the search result page P1 in a predetermined order (for example, uploading). The date and time are sorted in the order of newest) and placed on the search result page P1. As a result, the image data is displayed on the search result page P1 in a state of being arranged in a predetermined order.

<Step S27>
In step S27, the control unit 21 determines whether or not any of the image data included in the search result page P1 has been manipulated. For example, the control unit 21 determines that the image data has been manipulated when any of the image data included in the search result page P1 is tapped. Then, when it is determined that any of the image data included in the search result page P1 has been manipulated (S27: Yes), the process proceeds to step S28. On the other hand, if it is determined that none of the image data included in the search result page P1 has been manipulated (S27: No), the process proceeds to step S29.

In another embodiment, the control unit 21 enlarges and displays the operated image data when any of the image data included in the search result page P1 is operated (for example, when tapped). You may let me. Then, when the enlarged image data is further manipulated (for example, when it is further tapped), the process may shift to step S28. When the enlarged image data is the image data associated with the corporate account, the corporate account identification image B1 may or may not be compositely displayed in the enlarged image data. good. In addition, the corporate account identification image B1 is not compositely displayed in the image data (image data associated with the corporate account) before being enlarged and displayed, and is used as the image data (image data associated with the corporate account) after being enlarged and displayed. Only the company account identification image B1 may be displayed compositely.

<Step S28>
In step S28, the control unit 21 causes the operation display unit 33 of the user terminal 3 to display the profile page P3 corresponding to the operated image data. Specifically, the control unit 21 transmits the data of the profile page P3 as shown in FIG. 10 to the user terminal 3 through the communication network N1. As a result, the profile page P3 is displayed on the operation display unit 33 of the user terminal 3. The profile page P3 is a page provided for each user account. On the profile page P3, the user ID of the corresponding user account, the image data associated with the user account, and the like are displayed.

FIG. 10 is a profile page P3 corresponding to the corporate account of the restaurant C. As shown in FIG. 10, the profile page P3 corresponding to the corporate account of the restaurant genre may include at least one of the reservation key K31, the telephone key K32, the mail key K33, and the route key K34. ..

The reservation key K31 is an operation key for reserving a facility corresponding to the corporate account. When the reservation key K31 is operated, the control unit 21 transmits the information of the reservation page included in the company profile information D3 to the user terminal 3. The control unit 31 of the user terminal 3 causes the operation display unit 33 to display a reservation page for reserving the facility based on the information on the reservation page.

The telephone key K32 is an operation key for making a call to the facility corresponding to the corporate account. When the telephone key K32 is operated, the control unit 21 transmits the information of the telephone number included in the company profile information D3 to the user terminal 3. The control unit 31 of the user terminal 3 makes a call to the facility based on the information of the telephone number.

The mail key K33 is an operation key for sending an e-mail to the facility corresponding to the corporate account. When the mail key K33 is operated, the control unit 21 transmits the information of the mail address included in the company profile information D3 to the user terminal 3. The control unit 31 of the user terminal 3 causes the operation display unit 33 to display an e-mail creation screen for creating an e-mail addressed to the facility based on the information of the e-mail address.

The route key K34 is an operation key for starting route guidance to the facility corresponding to the company account. When the route key K34 is operated, the control unit 21 transmits the location information included in the company profile information D3 to the user terminal 3. Based on the location information, the control unit 31 of the user terminal 3 causes the operation display unit 33 to display a map showing directions from the current position of the user terminal 3 to the location of the facility, and provides directions to the facility. Start.

<Step S29>
In step S29, the control unit 21 determines whether or not to end the image search process. For example, the control unit 21 may determine that the image search process should be terminated when a predetermined termination operation is performed. Further, the control unit 21 determines that the image search process should be terminated when the reservation key K31, the telephone key K32, the mail key K33, or the route key K34 included in the profile page P3 is operated. Also good. When it is determined that the image search process should be completed (S29: Yes), the image search process is terminated. On the other hand, if it is determined that the image search process should not be completed (S29: No), the process returns to step S25.

As described above, in the image search device 2 according to the present embodiment, the company account identification image B1 is compositely displayed on the image data associated with the company account among the image data matching the search conditions. Therefore, according to the image search device 2 according to the present embodiment, on the search result page P1, the user can use the image data associated with the personal account (for example, the image data taken by a general user at a restaurant) and the corporate account. It is possible to easily distinguish the associated image data (for example, image data uploaded by a restaurant).

Further, in the image search device 2 according to the present embodiment, it is possible to collectively display image data that matches the search conditions for each facility related to the image data. Therefore, according to the image search device 2 according to the present embodiment, the user has a plurality of images related to the same facility regardless of whether the image data is associated with a corporate account or an individual account. Since the data can be checked together, the desired facility can be found more easily.

In the present embodiment, in step S23 shown in FIG. 6, the company account identification image B1 is synthesized with the image data associated with the company account, but the present invention is not limited to this. In another embodiment, when the image data is uploaded from the user terminal 3 to the image search device 2, the company account identification image B1 may be combined with the image data. In this case, for example, the image sharing program executed by the control unit 31 of the user terminal 3 may include an instruction code for synthesizing the company account identification image B1 with the image data.

By the way, as another embodiment, in the step S22, the control unit 21 extracts the image data that matches the search condition acquired in the step S21 from the plurality of image data stored in the storage unit 22. At that time, it may be possible to extract only the image data corresponding to the facility where the online reservation (Web reservation) is possible. For example, in the company profile information D3, it is conceivable that the information on the reservation page is registered for the facility where online reservation is possible, and the information on the reservation page is not registered for the facility where online reservation is not possible. In this case, when the company profile information D3 of the company account of the facility corresponding to the image data includes the information of the reservation page, the control unit 21 determines that the facility can be reserved online. It is possible. The company profile information D3 may include information indicating whether or not an online reservation is possible. As the extraction method in step S22, the control unit 21 may be able to switch whether or not to extract only the facilities that can be reserved online according to the user operation. Further, when the image search device 2 has a function of managing vacant seat information in each of the facilities, the control unit 21 corresponds to a facility that can be reserved for the current date and time or a facility that can be reserved for a designated reserved date and time. It may be possible to extract only the image data.

Further, when the facility corresponding to the image data is a facility that can be reserved from the reservation page, the control unit 21 indicates that the facility can be reserved on the Web as the company account identification image B1. If the first identification image such as the image surrounded by ◯ is displayed and the facility corresponding to the image data is not a facility that can be reserved from the reservation page, the company's "company" is set as the company account identification image B1. A second identification image such as an image surrounded by a circle may be displayed. That is, the control unit 21 switches the company account identification image B1 depending on whether or not the facility corresponding to the image data is a facility that can be reserved from the reservation page, and the company account identification image B1 is used to convert the image data to the image data. It may indicate whether the corresponding facility can be booked online. As a result, the user can easily grasp whether or not the facility can be reserved by looking at the company account identification image B1.

When the facility can be reserved from the reservation page, two company account identification images B1 of the first identification image and the second identification image may be displayed. Further, when the image search device 2 has a function of managing vacant seat information in each of the facilities, the control unit 21 corresponds to a facility that can be reserved for the current date and time or a facility that can be reserved for a designated reserved date and time. For only the image data, an image indicating that reservation is possible may be combined and displayed.

Further, when the first identification image displayed as the company account identification image B1 is operated, the control unit 21 displays the reservation page of the facility corresponding to the image data in which the first identification image is synthesized. You may let me. As a result, for facilities that can be reserved from the reservation page, it is possible to prompt the user to make a reservation for the facility. For example, the control unit 21 can search or display a reservable date or date and time on the reservation page displayed on the user terminal 3, and makes a reservation request for the displayed reservable date or date. It is possible to accept from the user terminal 3. Further, the reservation page may be a Web page on a site stored in an external server managed by a company corresponding to the company account.

Further, in the above-described embodiment, as shown in FIG. 7 and the like, the case where the company account identification image B1 is an image in which the characters “company” of the company are surrounded by 〇 has been described, but as another embodiment, , The corporate account identification image B1 may be composed of only one or a plurality of characters. Further, the corporate account identification image B1 may be only an image such as a mark that does not include characters.

1 Image search system 2 Image search device 21 Control unit 211 Search processing unit 212 Display processing unit 22 Storage unit 23 Operation display unit 24 Communication I / F
3 User terminal 31 Control unit 32 Storage unit 33 Operation display unit 34 Communication I / F
35 GPS sensor 36 camera

Claims (18)

A search processing unit that extracts image data that matches the search conditions from multiple image data linked to the user account,
A display processing unit that displays one or more of the image data extracted by the search processing unit in a display mode in which the type of user account corresponding to the image data can be determined.
An image search device comprising. The display processing unit can synthesize and display a predetermined identification image corresponding to the specific type with the image data associated with the user account of the predetermined specific type.
The image search device according to claim 1. The display processing unit can display a plurality of the image data extracted by the search processing unit side by side, and can synthesize and display the identification image with the image data associated with the user account of the specific type among the image data. Is,
The image search device according to claim 2. The display processing unit displays with the identification image whether or not the facility of the user account of the specific type corresponding to the image data can be reserved online.
The image search device according to claim 2 or 3. The display processing unit displays the display mode of the image data associated with the user account of the specific type in response to the user input, the first display mode in which the identification image is compositely displayed and the second display mode in which the identification image is not compositely displayed. It is possible to switch between the display mode and
The image search device according to any one of claims 2 to 4. The display processing unit can display information about a user account corresponding to the image data in which the identification image is compositely displayed in response to a predetermined operation being performed on the identification image.
The image search device according to any one of claims 2 to 5. The display processing unit can display at least the image data associated with the first type user account and the image data associated with the second type user account different from the first type in a display mode capable of discriminating.
The image search device according to any one of claims 1 to 6. The first type user account is a personal account, and the second type user account is a corporate account.
The image search device according to claim 7. The display processing unit can display the image data associated with the second type user account with priority over the image data associated with the first type user account.
The image search device according to claim 7 or 8. The display processing unit can display the image data associated with the second type user account in a display mode capable of discriminating the genre of the second type user account.
The image search device according to any one of claims 7 to 9. The display processing unit gives priority to the image data associated with the second type user account of the specific genre defined in advance over the image data associated with the second type user account of the genre other than the specific genre. Can be displayed on,
The image search device according to claim 10. The display processing unit can display one or a plurality of the image data extracted by the search processing unit in a state of being collected for each facility corresponding to the second type user account.
The image search device according to any one of claims 7 to 11. The display processing unit captures image data associated with the second type user account and images taken at the facility corresponding to the second type user account for each facility corresponding to the second type user account. It can be displayed in a state where the image data associated with the first type user account is collected.
The image search device according to claim 12. Among the plurality of image data collected for each facility, the display processing unit gives priority to the image data associated with the second type user account over the image data associated with the first type user account. Can be displayed,
The image search device according to claim 12 or 13. The display processing unit collects one or more of the image data extracted by the search processing unit for each facility corresponding to the second type user account, and starts from a point indicated by the input position information. It can be displayed in order according to the distance to the facility.
The image search device according to any one of claims 12 to 14. The display processing unit can display one or more of the image data extracted by the search processing unit in a display mode in which a group of the image data related to the same facility can be visually recognized.
The image search device according to any one of claims 12 to 15. For one or more processors
A search step that extracts image data that matches the search conditions from multiple image data linked to the user account, and
A display step of displaying one or more of the image data extracted in the search step in a display mode in which the type of the user account corresponding to the image data can be determined.
An image search program for running. One or more processors
A search step that extracts image data that matches the search conditions from multiple image data linked to the user account, and
A display step of displaying one or more of the image data extracted in the search step in a display mode in which the type of the user account corresponding to the image data can be determined.
Image search method to execute.

Images