JP5865811B2 - Search instruction device, search instruction method and program - Google Patents

Description

  The present invention relates to a technique for retrieving information.

  Japanese Patent Application Laid-Open No. 2004-133867 describes an apparatus for searching for an image. In this apparatus, when a magnifying glass-like virtual icon is dragged and superimposed on a displayed image, a search is performed, and a search result of information on the image on which the virtual icon is superimposed is displayed. In this apparatus, information can be retrieved simply by dragging a virtual icon, so that retrieval can be easily performed.

JP 2011-43875 A

  By the way, when searching for information, there are cases in which it is desired to obtain character information such as texts instead of still image or moving image information depending on the purpose of use of the information. In some cases, it is desired to obtain image information such as still images and moving images instead of text information. However, in Patent Document 1, it is not possible to search for the type of information desired by the user, such as only the search result for text information, only the search result for still images, or only the search result for moving images. The kind of information can not be obtained as search results.

  The present invention has been made under the above-described background, and an object of the present invention is to provide a technique that allows a user to easily obtain the type of information desired when searching for information.

  In order to solve the above-described problem, the present invention provides a first display control unit that displays content and a search image indicating a search function on a display unit, and moves the displayed search image according to a user operation. Moving means for causing the information to be displayed to overlap the search image in the displayed content, an instruction means for determining the type of search processing and instructing the search means to search for the information, and the user A change unit that changes a type of the search process according to an operation performed on the image, an acquisition unit that acquires a result of a search performed by the search unit according to the instruction, and a result acquired by the acquisition unit There is provided a search instruction device having a second display control means for controlling the display means to be displayed.

  In the present invention, when the user performs an operation to stop the search image for a predetermined time or more by superimposing the search image on the information in the content, the changing unit performs a search process according to the time when the search image is stopped. It is good also as a structure which changes a kind.

  In the present invention, the change means may be configured to change the type of search processing when the user performs an operation of bringing a pointer into contact with a position where the search image is displayed on the display means.

  In the present invention, the first display control unit may change the search image to an image corresponding to the type of the search process after the change when the type of the search process is changed.

  In addition, the present invention provides a first display control step for displaying content and a search image indicating a search function on a display unit, and a movement step for moving the displayed search image according to a user operation; An instruction step for instructing search means to search for the information by specifying a type of search processing for information in a position overlapping the search image in the displayed content, and a user performed on the search image The change step of changing the type of the search process according to the operation, the acquisition step of acquiring the result of the search performed by the search means according to the instruction, and the result acquired at the acquisition step are displayed And a second display control step for controlling the display means.

  In addition, the present invention provides a first display control step for causing a computer to display content and a search image indicating a search function on a display unit, and movement for moving the displayed search image in accordance with a user operation. An instruction step for instructing search means to search for the information by specifying a type of search processing for information in a position overlapping the search image in the displayed content; The change step of changing the type of the search process according to the operation performed in the step, the acquisition step of acquiring the result of the search performed by the search means according to the instruction, and the result acquired in the acquisition step are displayed. A program for executing the second display control step for controlling the display means is provided.

  According to the present invention, it is possible to easily obtain the type of information desired by the user when searching for information.

2 is a block diagram showing a hardware configuration of the information processing apparatus 1. FIG. 2 is a block diagram showing a functional configuration of the information processing apparatus 1. FIG. The flowchart which showed the flow of the process which the control part 102 performs. The flowchart which showed the flow of the process which the control part 102 performs. The flowchart which showed the flow of the process which the control part 102 performs. The flowchart which showed the flow of the process which the control part 102 performs. The figure which showed an example of the screen displayed. The figure which showed an example of the screen displayed. The figure which showed an example of the screen displayed. The figure which showed an example of the screen displayed. The figure which showed an example of the screen displayed. The figure which showed an example of the screen displayed. The flowchart which showed the flow of the process which the control part 102 which concerns on 2nd Embodiment performs. The figure which showed the modification of pictogram C1.

[First Embodiment]
(Hardware configuration)
FIG. 1 is a diagram showing a hardware configuration of an information processing apparatus 1 (search instruction apparatus) according to an embodiment of the present invention. The information processing apparatus 1 of the present embodiment is a computer device called a so-called tablet terminal provided with a touch screen, hardware buttons, and the like on a plate-shaped housing. As illustrated in FIG. 1, each unit of the information processing apparatus 1 is connected by a bus 101.

The communication unit 105 has a function of a communication interface that performs wireless communication. The information processing apparatus 1 controls the communication unit 105 to connect to the Internet or the like via a wireless local area network (LAN) or a mobile communication network, and performs data communication and voice communication.
The operation unit 104 includes a plurality of hardware buttons for operating the information processing apparatus 1. The operation unit 104 is provided on the surface of the display unit 1042 and the display unit 1042, which is an example of a display unit that displays an image. The operation unit 104 transmits the image displayed on the display unit 1042, and detects a position touched by a finger. A touch screen 104A integrated with the position detection unit 1041 is provided. As the display unit 1042, a liquid crystal display, an organic EL (Electro Luminescence) display, or the like is used. However, the display unit 1042 is not limited thereto, and may be another display. The position detection unit 1041 is an example of an operated means operated by a user. The position detection unit 1041 is an electrostatic capacitance type, and electrodes are arranged in a matrix. When the user's finger is touching the touch screen 104A, position data representing the coordinates of the position touched by the finger is generated in the position detection unit 1041, and the generated position data is supplied from the position detection unit 1041 to the control unit 102. The If the user's finger is not touching the position detection unit 1041, position data is not generated and position data is not supplied to the control unit 102.

  The storage unit 103 includes a nonvolatile memory. The storage unit 103 stores a program OS that realizes an operating system and various application programs. As the application program, there are a program P1 that realizes the function of a Web browser, a program P2 that realizes a function of performing a search using an external device (an example of a search unit, for example, a server device) having a search engine function, and the like. I remember it.

The control unit 102 includes a CPU (Central Processing Unit) 102A, a ROM (Read Only Memory) 102B, a RAM (Random Access Memory) 102C, and the like. When the CPU 102A executes an IPL (Initial Program Loader) stored in the ROM 102B, the program OS stored in the storage unit 103 is executed, an operating system is realized, and various application programs can be executed.
When the user performs an operation to instruct execution of the program P1, the function of the Web browser is realized. When the function of the Web browser is realized, the communication unit 105 is controlled to connect to the Internet, and a Web page can be acquired and displayed. Further, when the user performs an operation to instruct execution of the program P2, a function of performing a search using a search engine is realized.

(Description of functional block)
FIG. 2 is a diagram showing functional blocks related to the characteristic functions according to the present invention among the functions realized in the control unit 102.
The first display control unit 201 is a block that controls the display unit 1042 so that an image of a Web browser and an image of a pictograph C1 described later are displayed.
The moving unit 202 is a block that moves the pictograph C <b> 1 in accordance with an operation performed by the user in the position detecting unit 1041.

The instruction unit 203 is a block that instructs an external device having a search engine function to search for information. The instruction unit 203 determines the keyword to be searched and the type of search processing based on the image displayed on the display unit 1042 and the operation performed by the user in the position detection unit 1041. The instruction unit 203 includes the determined keyword and the type of search processing as search parameters, and transmits a message for instructing search to the external device by controlling the communication unit 105.
The acquisition unit 204 acquires search result data transmitted from the external device via the communication unit 105. The acquisition unit 204 sends the acquired data to the second display control unit 205.
The second display control unit 205 is a block that controls the display unit 1042 so that the search result image represented by the data sent from the acquisition unit 204 is displayed.
The change unit 206 is a block that changes the type of search processing according to the operation performed by the user in the position detection unit 1041.

(Operation example of the first embodiment)
Next, an example of the operation of the present embodiment will be described using the flowcharts of FIGS. 3 to 6 and the screen examples shown in FIGS. FIG. 7 is a diagram illustrating an example of a screen in a state where the control unit 102 (first display control unit 201) that has executed the program P1 and the program P2 displays the Web page and the pictogram C1. An area A1 shown in FIG. 7 is a display area of the Web browser, and displays a Web page URL (Uniform Resource Locator) and a Web page as an example of content. The Web page includes text information such as text and image information such as still images and moving images. An area A2 shown in FIG. 7 is a display area for the program P2. In the area A2, a pictograph C1, which is an example of a search image indicating a search function, is displayed. In the area A2, a text box T1 that displays a character string that serves as a search keyword and radio buttons R1 to R3 that select the type of search processing are displayed.

When the user touches the position of the pictogram C1 with a finger and moves the finger without releasing the touch screen 104A, the control unit 102 (the moving unit 202) controls the display unit 1042, and the area A2 as shown in FIG. The pictogram C1 that is the same as the pictogram C1 displayed on the screen is moved as the finger moves. The user moves the pictograph C1 to a position where information to be searched is displayed.
When the moved pictogram C1 overlaps the character string in the Web page, the control unit 102 executes the process shown in FIG. First, the control unit 102 performs morphological analysis of a character string at a position where the pictogram C1 overlaps, and specifies a word overlapping the pictogram C1 (step SA1). When the control unit 102 specifies a word that overlaps the pictogram C1, the control unit 102 controls the display unit 1042 so that the specified word is displayed in the text box T1 (step SA2).
For example, when the user wants to search for “DVD + RW”, the user moves the pictograph C1 to the position “DVD + RW”. As illustrated in FIG. 9, when the pictogram C1 moves to a position where it overlaps “DVD + RW”, the control unit 102 identifies “DVD + RW” as a character string that overlaps the pictogram C1, and displays “DVD + RW” in the text box T1. The display unit 1042 is controlled as described above.

  Further, the control unit 102 determines whether or not the finger touching the position detection unit 1041 is stopped based on the position data, and when the finger touching the position detection unit 1041 is stopped, the processing illustrated in FIG. 4 is performed. Run. Specifically, the control unit 102 first determines whether the pictograph C1 overlaps the character string. When the pictogram C1 does not overlap the character string (NO in step SB1), the control unit 102 ends the process of FIG. Further, when the control unit 102 determines YES in Step SB1, the control unit 102 determines whether the time (hereinafter referred to as elapsed time) elapsed from the state where the pictogram C1 is superimposed on the character string and the finger is stopped is being measured, If the elapsed time is not being measured (NO in step SB2), the measurement of the elapsed time is started (step SB3). Note that if the control unit 102 determines NO in step SB2, the process of FIG. 4 ends.

  When the finger is still stopped after starting the measurement of the elapsed time, that is, when the position of the pictogram C1 is not changed and is in a state stopped for a predetermined time or longer, the control unit 102 performs the process of FIG. Execute, and change the selection state of the radio buttons R1 to R3 according to the measured elapsed time. Specifically, if the elapsed time is less than 2 seconds (YES in step SC1), control unit 102 (change unit 206) controls display unit 1042 so that radio button R1 is selected ( Step SC2). If the elapsed time is 2 seconds or longer and less than 4 seconds (YES in step SC3), the control unit 102 controls the display unit 1042 so that the radio button R2 is selected (step SC4). If the time is 4 seconds or longer (NO in step SC3), display unit 1042 is controlled so that radio button R3 is selected (step SC5). Regarding the elapsed time, less than 2 seconds, 2 seconds to less than 4 seconds, and 4 seconds or more are merely examples, and other times may be used.

  Further, when the finger is separated from the position detection unit 1041, the control unit 102 executes the process of FIG. Specifically, first, the control unit 102 determines whether or not the pictogram C1 is in a position where it overlaps the character string before the finger is released. If the pictogram C1 does not overlap the character string before the finger is released (NO in step SD1), the control unit 102 ends the process of FIG.

  On the other hand, if the pictogram C1 is in a position where the character string overlaps the character string before the finger is released (YES in step SD1), the control unit 102 (instruction unit 203) connects to an external device having a search engine function (for example, connected to the Internet). The server apparatus) is instructed to retrieve information (step SD2). Specifically, the control unit 102 determines a character string displayed in the text box T1 as a search keyword. Further, the control unit 102 determines the type of search processing. For example, when the radio button R1 is selected, that is, when the elapsed time is less than 2 seconds, the control unit 102 determines the type of search processing to search for a character string on a Web page. In addition, when the radio button R2 is selected, that is, when the elapsed time is 2 seconds or more and less than 4 seconds, the control unit 102 determines the type of search processing as still image search processing, and sets the radio button When R3 is in a selected state, that is, when the elapsed time is 4 seconds or more, the type of search processing is determined to be video search processing. The control unit 102 includes the determined keyword and the type of search processing as search parameters, and controls the communication unit 105 to transmit a message instructing the search to the external device.

  When the external device having the search engine function acquires this message, the external device searches for information according to the parameters included in the acquired message, and transmits Web page data indicating the search result to the information processing device 1. . Data transmitted from the external device is received by the communication unit 105. When the communication unit 105 receives Web page data as a search result, the control unit 102 (acquiring unit 204, second display control unit 205) acquires the received data (step SD3), and the Web page represented by the acquired data That is, the display unit 1042 is controlled so that the search result is displayed (step SD4).

  For example, when the pictogram C1 overlaps the character string and the user releases his / her finger from the position detection unit 1041 with the radio button R1 selected, as shown in FIG. 10, the web page including the specified character string is displayed. A web page describing the hyperlink is displayed. When the user releases his / her finger from the position detection unit 1041 while the radio button R2 is selected, as shown in FIG. 11, a Web page on which a still image related to the specified character string is arranged is displayed. . When the user releases his / her finger from the position detection unit 1041 with the radio button R3 selected, as shown in FIG. 12, the hyperlink to the moving image related to the specified character string and the moving image are extracted from the moving image. A web page on which an image of one frame is arranged is displayed.

According to the present embodiment, it is possible to easily obtain a search result of the type of information desired by the user simply by moving the pictograph C1. In addition, according to the present embodiment, after the pictogram C1 is overlaid on the character string and stopped, the type of search processing can be easily instructed only by stopping the finger without performing a new operation. .
In the above-described embodiment, the radio button R3 is selected when the elapsed time is 4 seconds or longer. However, the present invention is not limited to this configuration, and each time a predetermined time elapses, The selected radio button may be changed. For example, in the embodiment described above, the elapsed time for switching the selected radio button is 1 second, and the radio button R1 → radio button R2 → radio button R3 → radio button R1 →. The radio buttons may be switched repeatedly.
In the above-described embodiment, when the pictogram C1 does not overlap with the character string, the character string in the text box T1 may be deleted.
In the embodiment described above, when the type of search processing is specified in step SD2, the type of search processing may be specified from the radio button selection state without using the elapsed time.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the second embodiment, information is searched by the information processing apparatus 1 as in the first embodiment, but the operation for determining the type of search processing is different from that in the first embodiment. For this reason, the description about the same structure as 1st Embodiment is abbreviate | omitted, and difference with 1st Embodiment is demonstrated hereafter.

(Operation example of the second embodiment)
Next, an operation example of the second embodiment will be described. When the program P1 and the program P2 according to the present embodiment are executed in the information processing apparatus 1 and a Web page is displayed, the screen illustrated in FIG. 7 is displayed.

When the user performs an operation of hitting the position of the pictogram C1 displayed in the area A2 (operation for bringing a finger (an example of an indicator) into contact with the position detection unit 1041 for less than a predetermined time), the control unit 102 Then, the process shown in FIG. 13 is executed to change the selection state of the radio buttons R1 to R3.
For example, when an operation of hitting the pictogram C1 with a finger is performed in a state where the radio button R1 is selected (YES in step SE1), the control unit 102 displays the display unit so that the radio button R2 is selected. 1042 is controlled (step SE2). In addition, when an operation of tapping the pictogram C1 with a finger is performed in a state where the radio button R2 is selected (YES in step SE3), the control unit 102 displays the display unit so that the radio button R3 is selected. 1042 is controlled (step SE4). Further, when an operation of hitting the pictogram C1 with a finger is performed in a state where the radio button R3 is selected (NO in step SE1 and NO in step SE3), the control unit 102 displays that the radio button R1 is selected. The display unit 1042 is controlled so as to be (step SE5).

  Further, when the user touches the position of the pictogram C1 and moves his / her finger without releasing it from the image display surface, the same pictogram C1 as the pictogram C1 displayed in the area A2 is moved as shown in FIG. It moves with. The user moves the pictograph C1 to a position where information to be searched is displayed.

  When the moved pictogram C1 overlaps the character string in the Web page, the control unit 102 executes the process shown in FIG. First, the control unit 102 performs morphological analysis of a character string at a position where the pictogram C1 overlaps, and specifies a word overlapping the pictogram C1 (step SA1). When the control unit 102 specifies a word that overlaps the pictogram C1, the control unit 102 controls the display unit 1042 so that the specified word is displayed in the text box T1 (step SA2).

Further, when the finger is separated from the position detection unit 1041, the control unit 102 executes the process of FIG. When the pictogram C1 is in a position where it overlaps the character string before the finger is released (YES in step SD1), the control unit 102 instructs the external device having the search engine function to search for information (step SD2). . For example, when the radio button R1 is selected, the control unit 102 determines the type of search processing to search for a character string on a Web page. In addition, when the radio button R2 is selected, the control unit 102 determines the search processing type as a still image search process. When the radio button R3 is selected, the control unit 102 determines the search processing type. Decide on video search processing. The control unit 102 includes the determined keyword and the type of search processing as search parameters, and controls the communication unit 105 to transmit a message instructing the search to the external device.
Hereinafter, the operation of acquiring and displaying the search result from the external device is the same as that of the first embodiment, and thus the description thereof is omitted.

  Also in the present embodiment, when the pictogram C1 is moved, a search result for the type of information desired by the user can be easily obtained. Further, according to the present embodiment, it is possible to easily instruct the type of search processing by a simple operation of hitting the pictogram C1.

[Modification]
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. For example, the present invention may be implemented by modifying the above-described embodiment as follows. In addition, you may combine each of embodiment mentioned above and the following modifications.

  In the embodiment described above, the information processing apparatus 1 is a tablet terminal, but is not limited to a tablet terminal. For example, even in a desktop computer device, the display device may be provided with a touch screen, and the configuration of the above-described embodiment may be employed. In a configuration without a touch screen, the pictogram C1 may be moved by dragging the pictogram C1 by operating the mouse. Alternatively, the radio button selection state may be switched each time the mouse is clicked with the mouse cursor over the pictogram C1. In addition, in the devices having a touch screen such as a feature phone, a smartphone, a PDA (Personal Digital Assistant), a printer device, a facsimile device, a navigation device, a video camera, a digital camera, an electronic dictionary, and an electronic book reader, A configuration may be adopted.

  In the embodiment described above, an image search is performed in response to an operation with a finger, but the use of the operation is not limited to the finger. For example, a stylus pen that is an example of a pointer is used. You may make it operate by.

  In the second embodiment described above, when the pictogram C1 moved with the finger is in the area A1, and the user taps the pictogram C1 in the area A2 with another finger, the selection state of the radio buttons R1 to R3 is changed. You may make it do.

In the embodiment described above, the type of search processing is notified to the user using a radio button, but the method of notifying the type of search processing is not limited to this method.
For example, in the first embodiment, when the elapsed time is less than 2 seconds, an image of the pictograph C1 is shown in FIG. 14A so as to notify that the type of search processing is character string search processing. It may be a thing. In the first embodiment, when the elapsed time is 2 seconds or more and less than 4 seconds, the image of the pictograph C1 is displayed in FIG. 14B so as to notify that the type of the search process is a still image search process. In the first embodiment, when the elapsed time is 4 seconds or more, the image of the pictograph C1 is displayed in FIG. 14 (c) so as to notify that the type of the search process is a video search process. It is good also as shown in.
In the second embodiment, the contents of the pictogram C1 are changed each time an operation of hitting the pictogram C1 in the area A2 is performed, and any one of the images (a) to (c) in FIG. 14 is displayed. It may be.
Further, when the type of search processing is informed by the contents of pictograms, the search processing is performed with the color of pictograms instead of the text strings “text”, “images”, and “videos” shown in FIG. You may make it notify the kind of. For example, when the background of the magnifying glass picture in FIG. 14 is blue, a character string search process is shown, and when the background of the magnifying glass picture in FIG. 14 is yellow, the still picture search process is shown. When the background of the magnifying glass picture is red, a moving image search process may be indicated. When the type of search processing is informed by the color of pictograms, the text strings “text”, “images”, and “videos” may be deleted.

  In the above-described embodiment, the search function is realized by executing the program P2. However, when the program P1 is executed, the function related to the program P2 may be realized. In the above-described embodiment, the function related to the program P2 may be provided in the operating system instead of the application program.

  In the embodiment described above, the search is performed by superimposing the pictograph C1 on the character string. However, the pictograph C1 may be superposed on the image in the Web page to search for information related to the image.

  In the embodiment described above, the pictogram C1 is an image indicating the search function, but the content of the image indicating the search function is not limited to that shown in the drawings. For example, a character string image such as “search” or “search” may be used as an image indicating a search function, and the image may be moved according to the movement of the finger to perform the search.

  In the embodiment described above, the search is performed by superimposing the pictogram C1 on the Web page, but the superimposition of the pictogram C1 is not limited to the Web page. For example, a pictograph C1 may be superimposed on a sentence (an example of content) displayed by a word processor, and a search may be performed for a word in which the pictograph C1 overlaps.

In the above-described embodiment, there are a character string search process, a still image search process, and a moving image search process as types of search processes, and the user switches these to perform a search. However, it is not limited to these.
For example, when the radio button R1 is selected, a search engine that searches Japanese information is used, and when the radio button R2 is selected, a search engine that searches English information is used. When the radio button R3 is selected, the type of language to be searched may be switched, such as using a search engine that searches German information.

  In the above-described embodiment, the external device is instructed to search for information. However, the present invention is not limited to this configuration. For example, the information processing apparatus 1 executes a search function (an example of a search unit) that is realized by executing a program that searches character information and image information stored in the information processing apparatus 1, and stores information on the program. A search may be instructed.

  The program for realizing the functions of the above-described embodiments includes a magnetic recording medium (magnetic tape, magnetic disk (HDD (Hard Disk Drive), FD (Flexible Disk))), optical recording medium (optical disk, etc.), and magneto-optical recording medium. Alternatively, the program may be provided in a state stored in a computer-readable recording medium such as a semiconductor memory and installed in the information processing apparatus 1. Alternatively, the information processing apparatus 1 may be downloaded and installed via a communication line.

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 101 ... Bus, 102 ... Control part, 102A ... CPU, 102B ... ROM, 102C ... RAM, 103 ... Memory | storage part, 104 ... Operation part, 104A ... Touch screen, 105 ... Communication part, 201 ... 1st DESCRIPTION OF SYMBOLS 1 Display control part, 202 ... Moving part, 203 ... Instruction part, 204 ... Acquisition part, 205 ... 2nd display control part, 206 ... Change part, 1041 ... Position detection part, 1042 ... Display part.

Claims (6)

First display control means for causing the display means to display content and a search image indicating a search function;
Moving means for moving the displayed search image according to a user operation;
An instruction unit that determines a type of search processing and instructs the search unit to search the information for information in a position overlapping the search image in the displayed content;
Changing means for changing a type of the search process according to an operation performed on the search image by the user;
Obtaining means for obtaining a result of a search performed by the search means in response to the instruction;
And a second display control means for controlling the display means so that the result obtained by the obtaining means is displayed.   The change unit changes a type of search processing according to a time when the search image is stopped when the user performs an operation to stop the search image for a predetermined time or more by superimposing the search image on the information in the content. The search instruction device according to Item 1.   The search instruction device according to claim 1, wherein the change unit changes a type of search processing when the user performs an operation of bringing the indicator into contact with a position where the search image is displayed on the display unit.   The said 1st display control means changes the said search image into the image corresponding to the type of the search process after a change, if the kind of said search process is changed. The described search instruction device. A first display control step of displaying content and a search image indicating a search function on the display means;
A moving step of moving the displayed search image according to a user operation;
An instruction step for instructing search means to search the information by specifying a type of search processing for information in a position overlapping the search image in the displayed content,
A change step of changing a type of the search process according to an operation performed by the user on the search image;
An acquisition step of acquiring a result of the search performed by the search means in response to the instruction;
And a second display control step of controlling the display means so that the result acquired in the acquisition step is displayed. On the computer,
A first display control step of displaying content and a search image indicating a search function on the display means;
A moving step of moving the displayed search image according to a user operation;
An instruction step for instructing search means to search the information by specifying a type of search processing for information in a position overlapping the search image in the displayed content,
A change step of changing a type of the search process according to an operation performed by the user on the search image;
An acquisition step of acquiring a result of the search performed by the search means in response to the instruction;
And a second display control step for controlling the display means so that the result obtained in the obtaining step is displayed.

Images