JP5841378B2 - How to display operation videos and operation / operation logs - Google Patents

Description

  The present invention relates to a display method of an operation video and an operation / operation log, and in particular, in a service providing information processing apparatus that operates according to a user's operation act such as an automatic ticket vending machine, an automatic checkout machine, and an automatic commuter pass issuing machine. On the log display screen of the management display section provided in the service providing information processing machine, the video related to the user's operation in the customer service section recorded by the video camera and the recorded operation / operation log are displayed on the same screen. It is related with the display method of the operation moving image and the operation / operation log that are displayed in association with each other at the same time, and are improved in convenience and visibility in management.

  For example, a conventional automatic ticket vending machine has a built-in information processing function unit composed of a computer and memory, etc. From the viewpoint of machine management, the operation log and operation log of the automatic ticket vending machine use the customer service date and time as clue information. It was recorded in memory. Here, the “operation log” is a content operated by a user (passenger or the like) through a customer service section of an automatic ticket vending machine, and is recorded in characters. The operation log is recorded together with the operation time. The “operation log” is the content of an operation (screen display or the like) executed on the machine side in response to a user operation at the automatic ticket vending machine, and is recorded in characters. The operation log is stored together with the operation time. A manager in charge of the operation log and the recorded contents of the operation log can be viewed on a log display screen of a management display unit provided in the automatic ticket vending machine.

  Conventionally, automatic ticket vending machines or the like have a technique of recording an operation performed by a user in a customer service section with a video camera (Patent Documents 1 and 2). In the ticket issuing device (automatic ticket vending machine, etc.) disclosed in Patent Document 1, the user's operation is photographed with a video camera when the forgetting to collect the fishing tag is collected, and the attendant plays the video later. Judgment was made on whether or not there was fraud at the time of collection. In this way, the ticket issuing device displays “video shooting” to the user, thereby suppressing fraudulent acts associated with forgetting to collect the fishing tag. In addition, the user-operated processor disclosed in Patent Document 2 has a configuration in which a customer service surface is imaged in the same manner. When a call signal is input from an input unit provided on the customer service surface, the user operation type processor is captured. Reproducing means for reproducing the content data is provided. As a result, it is possible to accurately grasp the operation status of the user and solve the trouble.

  Furthermore, in an information processing apparatus configured by an X-ray diagnostic apparatus or the like installed in a medical institution, when an operation is performed by an operator, time stamp information (date / time) and log information (having a temporal order) The operation log is output as an operation log, the operation log is output to the recording / playback apparatus, and the user operation performed on the operation screen is output as a video signal to the recording / playback apparatus, thereby corresponding to the operation log. There is also a conventional technique in which a content image is displayed on a display screen (monitor) (Patent Document 3). In the information processing apparatus disclosed in Patent Document 3, the operation log and the video corresponding to the operation log (video content by the camera) are linked through the time stamp information (date / time), and the database is stored in the database. It is recorded. A time stamp display area, an operation log display area, and a marking information display area are provided on the operation log display screen shown in FIGS. Time stamp information is displayed in the time stamp display area, and an operation log (user operation) video is displayed in the operation log display area. As shown in FIG. 11, the video displayed in the operation log display area and the time corresponding to the video displayed in the time stamp display area are linked by highlighting.

JP 2006-24131 A JP-A-9-330429 JP 2010-157076 (paragraph 0014, etc.)

  In the conventional automatic ticket vending machine described above, the data related to the contents recorded by the video camera and the data related to the operation / operation log in the above sense are not actively associated with each other through time. For this reason, it is difficult to understand the relationship between the video related to the user's operational actions obtained by camera shooting, the operations performed by the user or staff, and the operation of the automatic ticket vending machine based on these operations. there were. In addition, when the clerk views the log contents on the log display screen of the management display section provided in the conventional automatic ticket vending machine, the display of the video related to the operation action and the display of the operation / operation log are separated. Therefore, it was not easy for the staff to grasp the situation and the relationship intuitively.

  The problems with the automatic ticket vending machines described above generally apply to service providing information processing machines that operate according to the user's operation, such as automatic payment machines and automatic commuter pass issuing machines with similar configurations. It is a problem that arises. Here, the “service providing information processing device” is driven in accordance with an operation action such as button selection, money insertion, etc. of a user who wants to receive a necessary service, and the service is provided to the user. Means an information processing machine to be provided.

  The information processing apparatus disclosed in Patent Document 3 also has a configuration capable of outputting the operation content on the screen as a video signal, and further includes the video displayed in the operation log display area and the time stamp display area. The time corresponding to the video displayed in the above is linked based on the highlighting, but the video related to the action recorded in advance and the display of the operation / action log are displayed simultaneously on the same screen. In addition, there is a drawback in that it is not very convenient to use because it is not designed to display in conjunction with a predetermined easy-to-view positional relationship.

In view of the above problems, the object of the present invention is to provide service providing information that operates in accordance with a user's operation act such as an automatic ticket vending machine, an automatic checkout machine, an automatic commuter pass issuing machine, etc., having a log display screen in the management display unit. In the processing machine, the video related to the user's operation in the customer service section recorded by the video camera and the recorded operation / operation log are displayed in association with each other so as to be linked on the same screen. Scrolling operation can be scrolled at the same time while maintaining the relationship between them, and the operation video and operation / operation log display method that improves convenience and intuitive visibility in management are provided. There is.
Still another object of the present invention is to simultaneously display a video relating to a user's operation in the customer service section and an operation / operation log in association with each other on the same screen in the service providing information processing apparatus. In addition, it has a configuration that can automatically judge and recognize fraud and failure based on the content of the video or operation / action log, and easily and quickly detect fraud and failure from either the video or the operation / action log. An object of the present invention is to provide a display method of an operation moving image and an operation / operation log that can be found and can improve management convenience.

  The operation moving image and operation / operation log display method according to the present invention are configured as follows in order to achieve the above object.

The first operation moving image and the operation / operation log display method (corresponding to claim 1) include a moving image related to the user's operation action in a partial area of the log display screen of the management display unit of the service providing information processing device. Display and display the contents related to multiple operations / video logs in chronological order together with the log recording time in other areas of the log display screen, and display either the video related to the operation action or the contents related to the operation / action log When it is determined to be an illegal act or an abnormality, an object determined to be an illegal act or an anomaly is displayed in conjunction with each area .

  The above operation video and operation / operation log display method is used for management in service-providing information processing machines such as automatic ticket vending machines installed at stations, etc. When displaying and managing video data and log data related to video data and log data, the video data and log data are displayed in relation to the time in the adjacent area, thereby making management convenient and intuitive It becomes possible to improve visibility.

  The display method of the second operation moving image and the operation / operation log (corresponding to claim 2) is preferably the above method, and the moving image related to the operation action displayed in a part of the area and the display in the other area. The content related to the operation / action log is associated with time (image acquisition time, event occurrence time) as a medium.

  The third operation moving image and the operation / operation log display method (corresponding to claim 3) is preferably the above method, preferably, the moving image related to the operation act displayed in a part of the area is scrollable, The contents related to the operation / action log displayed in other areas can be scrolled, and the scroll contents of the moving picture related to the operation action and the scroll contents of the contents related to the operation / action log are associated with each other via the time. When one is scrolled, the other is also scrolled and displayed in conjunction.

  The fourth operation moving image and operation / operation log display method (corresponding to claim 4) is preferably the above-mentioned method, preferably the contents related to a plurality of operation / moving image logs displayed in other areas of the log display screen. Among them, the content portion corresponding to the moving image currently displayed in a partial area of the log display screen is highlighted.

  The fifth operation moving image and the operation / operation log display method (corresponding to claim 5) are preferably displayed in the above method, the moving image relating to the operation action that can be displayed in a part of the region, or in another region. The contents relating to the operation / action log that can be performed are individually determined to be fraudulent or abnormal, and a display relating to a warning notification is made.

The sixth operation moving image and operation / operation log display method (corresponding to claim 6 ) is preferably the above method, wherein the service providing information processing machine is an automatic ticket vending machine, an automatic checkout machine, or an automatic commuter pass issuing machine. It is characterized by being.

The display method of the operation moving image and the operation / operation log according to the present invention has the following effects.
In a service providing information processing machine such as an automatic ticket vending machine equipped with a log display screen in the management display section, a part of the log display screen relates to a user's operation in the customer service section recorded by a video camera. In addition to displaying videos and displaying the contents related to multiple operations and video logs in chronological order together with the log recording time in other areas adjacent to some areas on the log display screen, Convenience and intuitive visibility can be improved.
In addition, with regard to video display and log display, it is possible to simultaneously scroll while maintaining the relevance of one of the scrolling operations with respect to the time axis, and to improve convenience and intuitive visibility on management. Can do.
Furthermore, in the service providing information processing device, the video relating to the user's operation in the customer service section and the operation / action log are displayed in association with each other so as to be linked on the same screen, and the video content or the operation / action log is displayed. Because it was designed to automatically identify and recognize fraud and malfunctions based on the content, fraudulent acts and malfunctions can be detected easily and quickly from either videos or operation / operation logs. Convenience can be improved.

It is a front view which shows the example of the automatic ticket vending machine to which the display method of the operation moving image and the operation / operation log which concerns on this invention is applied, and shows the external appearance of the whole automatic ticket vending machine. It is a rear view of an automatic ticket vending machine. It is a side view of an automatic ticket vending machine. It is a block diagram which shows the various function parts in an automatic ticket vending machine. It is a block diagram which shows the fundamental structure which implement | achieves the display method of the operation moving image and operation / operation log which concern on 1st Embodiment. It is a screen figure which shows the typical display example of a display screen. It is a block diagram explaining the basic concept of the display method of the operation moving image and the operation / operation log according to the first embodiment. It is a flowchart which shows the flow of a process of the display method of the operation moving image and operation / action log which concern on 1st Embodiment. It is a block diagram which shows the principal part structure which implement | achieves the display method of the operation moving image and operation / operation log which concern on 2nd Embodiment. It is a block diagram explaining the basic concept of the display method of the operation moving image and the operation / operation log according to the second embodiment. It is a flowchart which shows the flow of a process of the display method of the operation moving image and operation / action log which concern on 2nd Embodiment.

  DESCRIPTION OF EMBODIMENTS Preferred embodiments (examples) of the present invention will be described below with reference to the accompanying drawings.

  With reference to FIGS. 1-8, 1st Embodiment of the display method of the operation moving image and operation / operation log which concern on this invention is described. In the first embodiment, an example of an automatic ticket vending machine will be described as an example of a service providing information processing device that operates according to a user's operation. This display method is, for example, a display method performed on the display content of the log display screen in the management display unit in an automatic ticket vending machine having a management display unit on the back. Automatic ticket vending machines are usually installed near the ticket gates of stations, and people who want to use railways (trains, trains, etc.), which are public transportation, throw in money and obtain tickets. It is a device for equalizing. Accordingly, the automatic ticket vending machine has a function for processing banknotes and coins (including a change return function), a ticket issuing function, and a card for processing data such as an IC card or a magnetic card that functions as a boarding ticket or commuter pass. It has a processing function. It also has a computer equipped with a function for controlling the entire apparatus and a communication function, a coin safe and a power supply device.

  In FIG. 1, a customer service portion 11 is provided mainly in the upper half of the front portion of the automatic ticket vending machine 10. The customer service section 11 is provided with an upper display / touch operation section 12 and an area 13 having various lower insertion / release ports and a return section. The upper display / touch operation unit 12 is mainly formed by a panel member in which a color liquid crystal display panel and a touch panel are overlapped. In the lower area 13, there are an IC card insertion / discharge port 14, a bill insertion / discharge port 15, a coin insertion port 16, a coin return unit 17, and a ticket / receipt receiving port 18. Is provided.

  In the display / touch operation unit 12 of the customer service unit 11, a function related to a selected object by touching one of the plurality of selection buttons 21 displayed as a button image on the color liquid crystal display panel with a fingertip. A process for confirming is executed. Further, a plurality of various selection buttons 22 having a physical structure are arranged along the left side portion of the display / touch operation unit 12.

  The IC card is a card with a built-in wireless IC chip that is used as so-called electronic money (passage ticket, commuter pass, etc.). At the IC card insertion / release port 14, an IC card having a normal ticket function, an IC card as a commuter pass, and other cards (such as a magnetic card) are inserted (or inserted), and a required selection operation is performed. Released after the processing associated therewith is executed. The banknote insertion / release port 15 is loaded with a necessary cash banknote when a user such as a passenger attempts a charge process in order to increase the balance of an IC card which is electronic money, for example. After completion, if there is a fishing tag (fishing banknote), the banknote is released. The coin insertion slot 16 is used when, for example, purchasing an individual ticket or the like, and when coins are required. When change is generated with respect to a coin, the change coin is discharged to the coin return unit 17. At the receiving port 18, the purchased ticket or the receipt desired to be received is discharged.

  In the customer service section 11, a user (passenger or passenger, etc.) inserts an IC card, particularly when performing a predetermined process such as ticketing with an IC card, and further displays on the display screen of the display / touch operation section 12. Select one of the selection buttons (departure station, destination station, travel route (via contact), etc.) related to the displayed ticket issue.

  Further, for example, when a button for charging an IC card is selected on the display / touch operation unit 12, a button for selecting a charge charge (1000 yen, 2000 yen, etc.) is further displayed on the display / touch operation unit 12 at that time. ) Is displayed, and the user selects one of the selection buttons for the desired charge charge. Thereafter, the user inserts the IC card possessed by the user into the IC card insertion / discharge port 14 and also inserts the banknotes necessary for charging the IC card into the bill insertion / discharge port 15. In the IC card charge function unit built in the automatic ticket vending machine 10, based on the IC card charge designation command, the charge request fee designation command, the IC card insertion confirmation, and the cash bill insertion confirmation, The amount of data corresponding to the desired charge charge is recorded in the memory and the settlement process is performed. If there is a fishing tag, a fishing tag is prepared. The fully charged IC card is discharged from the IC card insertion / discharge port 14, and the fishing tag is discharged from the bill insertion / discharge port 15, whereby the IC card or the like is returned to the user. In addition, when receiving a request designation that a receipt is necessary, a receipt is created and discharged from the receiving port 18.

Further, the automatic ticket vending machine 10 is provided with a video camera (moving camera) 23 for monitoring. The video camera 23 preferably has, for example, a bill insertion / discharge port 15, a coin insertion port 16, a coin return unit 17, and a ticket / receipt receiving port 18 at a location near the receiving port 18. It is installed so that the movement of the user etc. in a certain period in each surrounding area can be monitored. According to the video camera 23, when the user uses the automatic ticket vending machine 10, the moving image acquired by the shooting operation of the video camera 23 causes the body such as the user's hand or arm to be related to the operation or the like. You can know the movement.
For example, two monitoring video cameras may be provided in the front portion of the automatic ticket vending machine 10. In FIG. 1, the element indicated by reference numeral 23A indicates another video camera. The video camera 23 </ b> A photographs the user from a position slightly above the front part of the automatic ticket vending machine 10. For this reason, according to the moving image acquired by the shooting operation of the video camera 23A, it is possible to know the movement of the user's hand and arm related to the operation, etc. Movement (including facial expressions) can also be monitored. This makes it possible to detect fraud more accurately.
As described above, when two video cameras are configured, it is preferable that the start and stop control of the video cameras 23 and 23A be performed in synchronization.
The number and arrangement positions of the video cameras are not limited to those described in the present embodiment, and can be arbitrarily set according to the structure of the service providing information processing apparatus to be applied.

  As shown in FIG. 2 and FIG. 3, the automatic ticket vending machine 10 usually has a card processing unit 31, a ticket issuing unit 32, a banknote processing unit 33, and a coin processing unit as various functional units or component elements. 34, an alarm unit 35, a coin safe 36, and a power supply device 37 are provided. A printer 38 and a line connection unit 39 are provided as external devices of the automatic ticket vending machine 10. As shown in FIG. 4, the coin safe 36 is arranged below the coin processing unit 34 and has a safe container for each type of coin. Furthermore, a management staff display / operation unit 40 is provided on the back of the automatic ticket vending machine 10. The staff display / operation unit 40 includes a display screen 41 and an operation unit 42. Each of the card processing unit 31, the ticket issuing unit 32, the banknote processing unit 33, the coin processing unit 34, and the like is provided with a control processing means using a microcomputer.

  FIG. 4 shows a system configuration of various functional units provided in the automatic ticket vending machine 10. Various functions provided in the automatic ticket vending machine 10 will be described with reference to FIG.

  An arithmetic processing unit 51 is provided as a control processing means for managing and supervising the overall operation of the automatic ticket vending machine 10. Signals related to various selection commands (or operation commands) input by the user through the display / touch operation unit 12 are input to the arithmetic processing unit 51. The arithmetic processing unit 51 creates and outputs predetermined operation instruction signals corresponding to various input selection commands. The instruction signal is supplied to control processing means built in each of the card processing unit 31, the ticket issuing unit 32, the banknote processing unit 33, the coin processing unit 34, and the like as necessary. Further, each of the IC card insertion / discharge port 14, the bill insertion / discharge port 15, the coin insertion port 16, the coin return unit 17, the receiving port 18, etc. has its object (IC card, A well-known sensor (not shown) is provided for detecting the presence or absence of bills, fishing bills, coins, and the like. Detection signals output from these sensors are provided to the arithmetic processing unit 51, for example.

  The IC card 52 inserted into the IC card insertion / release port 14 by the user's action is transported to the card processing unit 31 by the card transport mechanism. In the card processing unit 31, necessary information is read from and written to the built-in memory of the conveyed IC card 52 by wireless or the like by a built-in reader / writer. For example, when the function of the IC card charging device is executed, the corresponding charge amount is written to the built-in memory of the IC card 52 in accordance with the designated charge desired amount, with the remaining charge amount being added. When the card processor 31 completes the charging process, the IC card 52 is returned by the card transport mechanism and discharged from the IC card insertion / release port 14. Thereafter, the user performs an action of taking out the released IC card 52.

  Further, for example, at least one banknote 53 for deposit inserted into the banknote insertion / discharge port 15 by the user's action is transported to the banknote processing unit 33 by the banknote transport mechanism. In the banknote processing part 33, the conveyed banknote 53 is discriminate | determined, the amount of money based on the said banknote 53 is counted, for example, the designated amount of charge is compared with the counted amount of money, and the presence or absence of satisfaction of conditions is determined. If it is determined that a fishing tag is necessary, the amount of the fishing tag is calculated, and a necessary fishing tag is prepared for return. The prepared at least one fishing tag 54 is returned by the bill transport mechanism and discharged from the bill insertion / release port 15. Thereafter, the user performs an action of taking out the released fishing tag 54.

  The insertion and return of coins is similarly performed by the user by using the coin insertion slot 16 and the coin return unit 17.

  Further, for example, the ticket issuing unit 32 creates a receipt based on a receipt request signal by the user, conveys the receipt to the receiving port 18 by the transport mechanism, and discharges the receipt from the receiving port 18. The discharged receipt is taken out by the user.

  With respect to the various functions executed by the automatic ticket vending machine 10, the operating state in the machine that occurs in response to the user's operation is acquired as processing content (event content) in the arithmetic processing unit 51. Data relating to the processing content (operation state or event content) is recorded / saved as operation / operation log data. Further, when the user performs an action such as a necessary operation, an operation state related to the operation is captured by the video camera 23, for example. A video signal (moving image signal) obtained by shooting with the video camera 23 is supplied to the arithmetic processing unit 51 and recorded and stored as moving image data. In this configuration example, moving image data obtained by shooting with the video camera 23 will be described for convenience of description.

  The arithmetic processing unit 51 is provided with a memory 55, and various processing programs 55A executed by the arithmetic processing unit 51 are stored in the memory 55, and the arithmetic processing unit 51 stores a predetermined period (for example, one month). Log data (operation log, operation log, etc.) 55B relating to various processing contents executed in the meantime is recorded and stored. The memory 55 preferably includes a video memory portion, and moving image data 55C is recorded and stored in the video memory. The processing program 55A includes a screen display program 55A-1 for displaying an operation moving image and an operation / operation log on a single screen and simultaneously displaying them in a predetermined arrangement relationship. The moving image data 55C stored in the video memory in the memory 55 is the moving image data supplied from the video camera 23 to the arithmetic processing unit 51 and has the predetermined time (for example, one month). ) Video data.

  The arithmetic processing unit 51 is further provided with a timer 56, and the timer 56 always measures time. The arithmetic processing unit 51 associates the measured time with them when the arithmetic processing unit 51 handles the above-described moving image data or when handling the operation / operation log data. That is, when the moving image data 55C is stored in the video memory of the memory 55, each moving image data as a unit is recorded and stored in association with the acquisition time of the image, and log data (operation / operation log data) 55B is stored. When recording, each log data (event contents of operation or action) as a unit is recorded / saved in association with the event occurrence time. Since the above-mentioned “image acquisition time” and “event occurrence time” coincide with each other for the same image and event content, the moving image data and log data can be related via the time. The image acquisition time and the event occurrence time do not have to be exactly the same, and may be almost or substantially the same.

  Therefore, when the arithmetic processing unit 51 displays a log or the like on the display screen 41 of the staff display / operation unit 40 based on the screen display program 55A-1, the screen display program 55A-1 The moving image data 55C stored in the memory 55 and the log data 55B (operation / operation log data) can be associated with each other on the same screen and displayed simultaneously. Furthermore, by scrolling either one of the moving image data and the operation / operation log data, it is possible to simultaneously scroll while maintaining the relationship between the two through a common time.

  Next, a conceptual configuration and specific contents of a display method of log data (operation / operation log) and moving image data (operation moving image) performed in the automatic ticket vending machine 10 will be described with reference to FIGS.

  FIG. 5 shows the relationship between log data 55B and moving image data 55C stored in the memory 55. The moving image data 55C includes, for example, a plurality of (or many) units of moving image data 61 (referred to as “unit moving image data 61”) for one month, and image acquisition time data 62 for each unit moving image data 61. The unit moving image data 61 is stored as a set. The plurality of unit moving image data 61 are stored over time. The contents of the plurality of unit moving image data 61 are different from each other and are continuous moving image images along the image acquisition time data 62. The image acquisition time data 62 is, for example, a recording start time. Similarly, in the log data 55B, for example, the event occurrence time data 72 and the corresponding unit for each log data 71 in multiple (or many) units for one month (that is, event contents; referred to as “unit log data 71”). Log data 71 is stored as a set. The plurality of unit log data 71 are stored over time. The contents of the plurality of unit log data 71 are different from each other, and the user's operation action (action) is continuous along the event occurrence time data 72. In the above, the “unit” can be arbitrarily set. In the case of the unit log data 71, it is a predetermined user action or action set in advance. In the case of the unit moving image data 61, it is a moving image (video) at an arbitrary time interval determined by the start and end of recording corresponding to a predetermined operation action or action of the user.

  The log data 55B and the moving image data 55C stored in the memory 55 have a relationship described later on the display screen 41 of the clerk display / operation unit 40 at the same time when called based on the management act of the clerk. Displayed with status. That is, when the clerk operates the operation unit 42 of the clerk display / operation unit 40 and inputs a display command by designating time, for example, the screen display program 55A-1 is executed (screen display processing unit 81). The log data 55B and the moving image data 55C corresponding to the designated time are called, and the called log data 55B and moving image data 55C are displayed on the display screen 41 at the same time. In this case, with respect to the log data 55B, the unit log data 71 corresponding to the event occurrence time 72 is positioned on the basis of the event occurrence time 72 corresponding to the specified time, and the time relative to the unit log data 71 in terms of time. Some unit log data 71 is called. A plurality of required unit log data 71 are displayed on the set screen area on the display screen 41. On the other hand, for the moving image data 55C, the unit moving image data 61 related to the image acquisition time 62 that is substantially coincident with the reference event occurrence time 72 is called. The called unit image data 61 is displayed in a set screen area on the display screen 41.

FIG. 6 shows an example of display on the display screen 41 of the staff display / operation unit 40. In this display example, the display screen 41 is divided into two rectangular areas 82 and 83 adjacent to each other in the horizontal direction.
A rectangular area 82 on the right side in FIG. 6 is an area for displaying the log data 55B, and a plurality of unit log data 71 are displayed along with the event occurrence time data 72 along the time axis (axis from top to bottom). . Here, “event occurrence time” has the same meaning as “time when log is recorded”. As unit log data (event contents) 71, for example, “Media IC card insertion”, “Screen regular type selection”, “Button commuter pass”, “Screen departure station input,“ Button Katsuta station ”,“ Screen arriving station input "is displayed. Along the upper edge of the rectangular area 82, “date and time (year / month / day)” 84 and the like in which log data is recorded are displayed. Further, along the lower edge of the rectangular area 82, operation buttons 85 and 86 for scrolling the cursor set in any of the plurality of unit log data 71 displayed in the rectangular area 82 to "up" or "down". Is displayed.
A rectangular area 83 on the left side in the sixth is an area for displaying the moving image data 55C. In this illustrated example, each unit log data 71 of “08:04:57 button Katsuta station” and “08:04:57 screen arrival station input” displayed in the rectangular area 82 displaying the log data is displayed. Unit moving image data 61 is reproduced and displayed. Since the moving image data is displayed in the rectangular area 83, an operation button 87 for moving the moving image forward or backward and a stop button 88 for stopping the moving image are provided. In the time display column 89, the time obtained by adding the reproduction time from the recording start time is displayed. In the column 90 along the upper edge of the rectangular area 83, the contents of the moving image displayed in the rectangular area 83 (for example, “detailed breakdown of purchase information”) are described.

  As described above, according to the display example on the display screen 41, for example, a plurality of unit log data 71 are displayed in characters together with the event occurrence time data 72 in the right rectangular area 82 in time series, and at the same time, the same screen The unit moving image data 61 corresponding to the unit log data 71 of “08:04:57 button Katsuta station” and “08:04:57 screen arrival station input” is reproduced and displayed in the rectangular area 83 on the left side adjacent to each other. . According to the operation moving image and the operation / operation log display method according to this embodiment, the unit moving image corresponding to the unit log data 71 that is highlighted (special color, slanted line display, etc.) is positioned substantially at the center of the rectangular area 82. A log 61 is displayed. The log content and the moving image content displayed in the two rectangular areas 82 and 83 on the display screen 41 are related to each other by making the event occurrence time and the image acquisition time the same, and are thereby displayed on one display screen 41 at the same time. . The above relationship in the display operation is shown in FIG. 7 which is a state diagram. When displaying the log data and the image data on the display screen 41, the unit log data 71 and the unit moving image data 61 whose image acquisition time and event occurrence time substantially match are selected by the “comparison / association” function unit 91. And displayed on the display screen 41. In this case, with respect to the unit log data 71, as described above, the event occurrence time of the highlighted unit log data located at the approximate center of the rectangular area 82 is used. As for the selection / display of the unit log data 71, several unit log data before and after the highlighted unit log data 71 located almost at the center of the rectangular area 82 are also selected and displayed.

In the display of the log data 55B and the moving image data 55C on the display screen 41, the display is performed based on the comparison / association function unit 91 so that the above relationship is always satisfied. Accordingly, for example, when the log data 55B is scrolled up and down with the operation buttons 85 and 86 to change the log data (a plurality of unit log data 71) displayed in the rectangular area 82, the highlighted unit log data is displayed. The unit moving image data 61 displayed in the rectangular area 83 is also changed so as to correspond to 71. This is also true when the unit moving image data 61 displayed in the rectangular area 83 is changed, and the display of the log data displayed in the rectangular area 82 can be changed in the same manner. The display contents of the two rectangular regions 82 and 83 are associated with each other and changed in conjunction with each other so that the condition that the image acquisition time and the event occurrence time coincide with each other.
As described above, when two video cameras are provided, the button 101 displayed as “medium” in FIG. 6 indicates that the moving image data displayed in the rectangular area 83 is, for example, the above video camera 23 or This is a switching button used to select any moving image data in the video camera 23A. In this case, the video camera 23A is also configured so that the moving image data is stored in the memory 55 in the same manner as the video camera 23, and which moving image data is to be displayed in the rectangular area 83 by the switching button 101. You can choose. Even when the moving image data of the video camera 23A is selected, the moving image data and the log data are associated with each other and change in conjunction with each other.
Furthermore, by providing a plurality of moving image display areas (arbitrary shape display areas) in the rectangular area 83 or the like of the display screen 41, two or more moving image data can be displayed simultaneously. Since the plurality of moving image data are obtained by photographing the same object from different angles, the moving image data are also related to each other.

Next, with reference to FIG. 8, the basic processing flow of the screen display processing based on the screen display program 55A-1 will be described.
In the first determination step S <b> 11, it is determined whether or not a “display command” by the clerk is input from the operation unit 42 of the clerk display operation unit 40. If NO in determination step S11, the standby state is maintained. If YES, unit log data 71 and unit moving image data 61 corresponding to the specified time included in the display command are captured (processing step S12). In the processing step S12, it is a condition that the condition “image acquisition time = event occurrence time” is satisfied. In the next processing step S13, the acquired unit log data 71 and unit moving image data 61 are displayed in the two rectangular areas 82 and 83 of the display screen 41 on the assumption that the above condition is satisfied.
In the next determination step S14, it is determined whether or not there is an instruction to change the display contents regarding the log data or moving image data displayed in the rectangular areas 82 and 83 of the display screen 41. If NO in determination step S14, the display content of display screen 41 is maintained (processing step S15). If YES in the determination step S14, the necessary unit log data 71 or unit moving image data 61 is stored while maintaining the condition of “image acquisition time = event occurrence time” according to the contents of the changed log data or moving image data. The remaining contents are changed based on this (processing step S16).

  Next, a second embodiment of the operation moving image and operation / operation log display method according to the present invention will be described with reference to FIGS. Also in the second embodiment, the service providing information processing machine is an example of an automatic ticket vending machine, and the function is further enhanced in the display method of the automatic ticket vending machine according to the first embodiment described above. In other words, the video related to the user's operation in the customer service section and the operation / action log are displayed in association with each other so as to be linked on the same screen, and further, the illegal act based on the content of the video or the operation / action log And a configuration that can automatically determine and recognize failures. As a result, it is possible to easily and quickly find an illegal act or failure from either a moving image or an operation / operation log.

  FIG. 9 shows the internal structure of the memory 55 in FIG. In addition to the “screen display program 55A-1” having the configuration shown in FIG. 4, the memory 55 further includes an “injustice / fault determination program 55A-2”. Correspondingly, the operation unit 42 of the clerk display / operation unit 40 can be equipped with an operation button called a fraud / failure indication display button. Other configurations are basically the same as those described in the first embodiment. According to the display method of the operation moving image and the operation / operation log according to this embodiment, at the time of the above-described display, fraud or failure of the log data 55B or the moving image data 55C is automatically determined and displayed.

  The fraud / failure determination program 55A-2 determines whether or not there has been a fraud in the content of the log data 55B or the content of the moving image data 55C stored in the memory 55, or whether there has been a machine failure. The determination of fraudulent behavior or failure regarding the log data 55B is made by using a plurality of operations / motion patterns (unnatural operations / motion patterns) related to the user's cheating behavior or a plurality of operations / motion patterns related to abnormal behavior. By preparing in advance and comparing and collating with these patterns, fraud or failure is determined. In order to determine whether the video data 55C is fraudulent or malfunction, a plurality of operation patterns (unnatural operation patterns) related to the user's fraud are prepared in advance, and these patterns are compared and verified. , Trying to judge fraud.

  FIG. 10 is a block diagram similar to FIG. 7 described above. As described above, the log content (log data) and the video content displayed in the two rectangular areas 82 and 83 on the display screen 41 by the “comparison / association” function unit 91 provided in the screen display processing unit 81. The (moving image data) is related to each other by making the event occurrence time and the image acquisition time the same, and thereby displayed on one display screen 41 at the same time. In addition, the fraud / fault determination unit 92 realized by the fraud / fault determination program 55A-2 determines whether each unit log data 71 in the log data 55B and each unit video data 61 in the video data 55C are fraudulent or faulty. Then, the determination data is stored in the memory in association with the determined unit log data 71 or unit moving image data 61. In this embodiment, the fraud / fault determination program 55A-2 is attached to the screen display program 55A-1, and the fraud / fault determination unit 92 is drawn in the block of the screen display unit 81 in FIG. . The screen display processing unit 81 displays the fraud / failure determination data obtained by the fraud / failure determination unit 92 on the display screen 41 together with the associated log data and / or unit moving image data in response to a request or necessity. provide. On the display screen 41, the moving image data pointed out to be illegal or faulty is reproduced and the log data is displayed in the rectangular areas 82 and 83 based on the provided data.

Next, with reference to FIG. 11, the basic processing flow of the screen display processing based on the screen display program 55A-1 and the fraud / fault determination program 55A-2 will be described. In the flowchart of FIG. 11, the same elements as those described in the flowchart of FIG.
In determination step S <b> 11, it is determined whether or not a “display command” is input from the operation unit 42 of the staff display operation unit 40. If NO in determination step S11, the standby state is maintained. If YES, unit log data 71 and unit moving image data 61 corresponding to the specified time included in the display command are captured (processing step S12). In the processing step S12, it is a condition that the condition “image acquisition time = event occurrence time” is satisfied. In the next processing step S13, the acquired unit log data 71 and unit moving image data 61 are displayed in the two rectangular areas 82 and 83 of the display screen 41 on the assumption that the above condition is satisfied.
Next, in accordance with the instruction or automatically, the fraud / fault determination process is executed for each unit log data 71 in the log data 55B and each unit video data 61 in the video data 55C (processing step S21). Thereafter, the unit log data 71 and the unit moving image data 61 determined to be illegal / failure are stored. Thereafter, the unit log data 71 and the unit moving image data 61 determined to be illegal / failure are displayed on the display screen 41 (processing step S23). At the time of this display, a warning is notified to the staff on the display screen 41.
For the subsequent processing, the processing steps S14 to S16 described in FIG. 8 can be provided, or any other display can be performed.

  In the above description of the embodiment, the execution of the fraud / failure determination program 55A-2 is performed at the time of display at the time of management. However, the timing for performing the fraud / failure determination is not limited to this. For example, it can be configured to do this as soon as moving image data and log data are acquired. Therefore, in this case, it is possible to display moving image data and log data representing fraud / failure from the beginning when displaying during management. Furthermore, in such a case, when the response is urgent, it is possible to notify the staff immediately via the communication means and give a warning notification before the display at the time of management. it can.

  In the first and second embodiments described above, an example in which the display method of the operation moving image and the operation / operation log is applied to an automatic ticket vending machine has been described. However, the display method according to the present invention includes an automatic checkout machine and an automatic commuter pass. The present invention can be generally applied to a service providing information processing device that operates according to an operation action of a user such as an issuing machine. In this case, since the staff display / operation unit and the display contents are different for each machine, it is a matter of course that the display method of the operation moving image and the operation / operation log is modified accordingly.

  The configurations, shapes, sizes, and arrangement relationships described in the above embodiments are merely schematically shown to the extent that the present invention can be understood and implemented. Therefore, the present invention is not limited to the described embodiments, and can be variously modified without departing from the scope of the technical idea shown in the claims.

  The display method of the operation video and operation / operation log according to the present invention is used for management of a service providing information processing machine that operates in accordance with a user's operation act such as an automatic ticket vending machine, an automatic settlement machine, and an automatic commuter pass issuing machine. It is used as a display method that enhances convenience and intuitive visibility in management.

DESCRIPTION OF SYMBOLS 11 Automatic ticket machine 12 Customer service part 13 Display / touch operation part 21 Selection button 22 Selection button 23,23A Video camera (video camera)
40 staff display / operation unit 41 display screen 42 operation unit 51 arithmetic processing unit 55 memory 55A processing program 55A-1 screen display program 55A-2 fraud / fault determination program 55B log data 55C video data 56 timer 61 unit video data 62 image acquisition Time data 71 Unit log data 72 Event occurrence time data 81 Screen display processing unit 82, 83 Rectangular area 91 Comparison / association function unit 92 Fraud / failure determination unit 101 Switch button

Claims (6)

A video related to the user's operation is displayed in a part of the log display screen of the management display section of the service providing information processing machine,
The contents related to a plurality of operation / video logs are displayed in chronological order along with the log recording time in other areas of the log display screen,
When it is determined that either the video related to the operation action or the content related to the operation / action log is an illegal action or an abnormality, an object determined to be an illegal action or an abnormality is included in each of the areas. Displayed in conjunction,
A method for displaying an operation video and operation / operation log.   The moving image related to the operation action displayed in the partial area and the content related to the operation / action log displayed in the other area are associated with each other through time. Item 1. A display method of an operation video and an operation / operation log according to Item 1. The video related to the operation act displayed in the partial area is scrollable, and the content related to the operation / action log displayed in the other area is scrollable,
The scroll content of the moving image related to the operation action and the scroll content of the content related to the operation / operation log are associated through time, and when one of them is scrolled, the other is also scrolled and displayed in conjunction with it. The display method of the operation moving image and the operation / operation log according to claim 1 or 2.   Among the contents related to the plurality of operation / moving image logs displayed in the other area of the log display screen, a content portion corresponding to the moving image currently displayed in the partial area of the log display screen is The display method of the operation moving image and the operation / operation log according to claim 1, wherein the operation moving image and the operation / operation log are displayed.     Regarding the moving image related to the operation action that can be displayed in the partial area, or the content related to the operation / action log that can be displayed in the other area, it is determined individually that it is an illegal action or an abnormality, and a warning is given. 5. The operation moving image and operation / operation log display method according to any one of claims 1 to 4, wherein display according to notification is performed. Said service providing processing machine vending machine, the display method of the operation moving the operation and action log according to any one of claims 1 to 5, wherein it is an automatic checkout machine or automatic commutation ticket issuing machine, .

Images