JP7620972B2 - Product sales data processing device and computer program - Google Patents

Description

The present invention relates to a technology that makes it easy to view captured images on the operation screen of a POS terminal.

Conventionally, in stores such as supermarkets, POS (Point Of Sales) registers are used to register products purchased by customers and to settle the bill. Self-service registers, where customers perform the settlement operation, are becoming more and more common. In self-service registers, customers operate the POS register themselves, so there is a risk of fraud by customers. For this reason, various measures against fraudulent activities are being taken.
For example, Patent Document 1 discloses a system that notifies errors or fraud using a sign light or the like.

JP 2017-187821 A

On the other hand, in recent years, POS register displays have become larger, and when displaying information on the screen, consideration must be given to operability and visibility.

Therefore, one of the objectives of the present invention is to provide a device capable of displaying a screen that is both easy to use and easy to see.

To achieve the above object, the product sales data processing device according to the present invention has an imaging means for imaging the operation status of an operator and a display means for displaying predetermined information, and the display means has a first display area for displaying an operation screen for accepting operations by the operator, and a second display area for displaying an image captured by the imaging means.

1 is a network configuration diagram of a POS system according to an embodiment of the present invention. 1A and 1B are external perspective views showing POS terminals according to an embodiment of the present invention, in which (A) is an example of a terminal operated by a customer, and (B) is an example of a terminal operated by a store clerk. 2 is a block diagram showing a functional configuration of a POS terminal according to the embodiment of the present invention; FIG. 1A and 1B are diagrams illustrating an example of the screen configuration of a customer display unit and a store clerk display unit of a POS terminal according to an embodiment of the present invention. 11 is a process flow diagram showing the flow of processes executed in a face-to-face self-service mode in the POS terminal according to the embodiment of the present invention. FIG. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. 11 is a process flow diagram showing the flow of processes executed in a self-checkout mode in the POS terminal according to the embodiment of the present invention. FIG. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 11 is a process flow diagram showing the flow of processes executed in a full self-service mode in the POS terminal according to the embodiment of the present invention. FIG. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention. 11A to 11C are diagrams illustrating an example of a notification mode of a notification section according to a status in the POS terminal according to the embodiment of the present invention. 13A and 13B are diagrams showing an example of the screen configuration of a customer-side display unit and a store clerk-side display unit of a POS terminal according to another embodiment of the present invention. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. A figure showing an example of a screen displayed in face-to-face self-service mode on a POS terminal according to an embodiment of the present invention, in which (A) is a screen displayed on the customer-side display unit, and (B) is a screen displayed on the store clerk-side display unit. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 13A and 13B are diagrams illustrating an example of a screen displayed in a self-checkout mode on the POS terminal according to the embodiment of the present invention. 11 is a process flow diagram showing the flow of processes executed in a full self-service mode in the POS terminal according to the embodiment of the present invention. FIG. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention. 11A and 11B are diagrams showing an example of a screen displayed in a full self-service mode on the POS terminal according to the embodiment of the present invention.

A POS system or a POS terminal that realizes a product sales data processing device according to an embodiment of the present invention will be described below with reference to the drawings.
FIG. 1 is a network configuration diagram of a POS (Point Of Sales) system according to an embodiment of the present invention. The POS system 1 shown in FIG. 1 includes three POS terminals 20-1, 20-2, and 20-3, a store controller (store computer, management device) 10, and a transaction status management device 11. Hereinafter, the POS terminals 20-1, 20-2, and 20-3 will be collectively referred to as the POS terminals 20 when there is no particular distinction between them. The store controller 10, the transaction status management device 11, and the POS terminals 20 are communicatively connected via a LAN 55. Note that, although the number of POS terminals 20 in the POS system 1 is three, it may be one, or four or more.

The POS system 1 can be installed in a variety of stores, such as supermarkets, home improvement centers, convenience stores, and various supply stores. The store controller 10 records various information such as the items and prices of products in the store, inventory status, sales history, and deposit and withdrawal records. The transaction status management device 11 displays the status of the POS terminal 20 (operation mode, processing status, change inventory status, fault status, etc., and remote operation of clerk approval processing for age-authenticated products, etc.) and controls the POS terminal 20. The POS terminal 20 is a cash register device that registers and settles products. From the perspective of executing settlement for registered products, the POS terminal 20 can be said to constitute a settlement device.

The POS system 1 may also include a mobile terminal carried by the store clerk. The mobile terminal can display the status of the POS terminal 20 (operation mode, processing status, change inventory status, fault status, remote operation of store clerk approval processing for age-verified products, etc.) and control the POS terminal 20. The mobile terminal can also receive notification information from the POS terminal 20 that a store clerk will be called and display that fact.

Functions may also be provided to client terminals such as tablet POS via cloud services. This type of configuration is also known as Web-Pos, and specifically, some or all of the functions executed by client terminals such as tablet POS are executed by a server device using a so-called thin client method or a web client method that webifies applications. In this case, the client terminal may be held by the customer, and a series of processes may be completed without the intervention of a store clerk or a terminal in the store.

Functional Configuration FIG. 2 is a diagram showing an example of the POS terminal 20. As shown in FIG.
2A shows a terminal operated by a customer, and FIG 2B shows a terminal operated by a store clerk, and the POS terminal 20 is made up of these two terminals. However, in the example of FIG 2, the terminal operated by the customer and the terminal operated by the store clerk are configured as separate devices capable of communicating with each other, but the customer side display unit 205 and the store clerk side display unit 210 may be configured as one unit with their backs facing each other.
Furthermore, a counter on which shopping baskets can be placed may be provided appropriately next to the POS terminal 20 .

Below, an example of the configuration of the POS terminal 20 will be described with reference to FIG. 3. The POS terminal 20 comprises a CPU 201, a ROM 202, a RAM 203, a hard disk 204, a customer display unit 205, a customer scanner unit 206, an alarm unit 207, a card payment unit 208, a change dispenser 209, a store clerk display unit 210, a key operation unit 211, a store clerk scanner unit 212, a printing unit 213, an audio output unit 214, a communication unit 215, and a camera 216. These can communicate with each other via a bus.

The CPU 201 is a central processing unit that reads and executes various programs stored in the ROM 202 to control the operation of the POS terminal 20. The various programs include a settlement program according to this embodiment.
The ROM 202 is a read-only memory, and stores various types of information used by the CPU 201, including programs.

RAM 203 is a readable and writable memory that stores various information. For example, RAM 203 stores information acquired from the outside (e.g., product master data acquired from store controller 10) and information generated during processing. This information is, for example, registration information (registration data) generated during the registration process to register products, and settlement information generated during the settlement process to settle (pay) the registered products (purchased products).

The hard disk 204 stores various information. For example, the hard disk 204 may store programs executed by the CPU 201 instead of the ROM 202. Also, instead of the RAM 203, the hard disk 204 may store information acquired from the outside and information generated during processing.

The customer-side display unit 205 is a touch display for customers. This customer-side display unit 205 constitutes one of the display means for displaying predetermined information to customers, and also constitutes one of the input means for accepting input of predetermined information from customers. In addition, the customer-side display unit 205 constitutes one of the registration means for registering products by accepting input of product information.

This customer side display unit 205 is a vertically long display, for example a wide display corresponding to a resolution of 1920×1080.
As shown in Figure 4, in this embodiment, the display area of the customer side display unit 205 is composed of a first display area G1 at the bottom and a second display area G2 at the top, and while the product registration process or payment process is being executed, different information can be displayed in the first display area G1 and the second display area G2, respectively.

As an example of the display content, an operation screen that accepts operations from the customer (operator), such as registering products and settling payments, can be displayed in the first display area G1, and an image captured by the camera 216 can be displayed in the second display area G2.
In such an example, the captured image displayed in the second display area G2 can be displayed at various times. For example, in the self-checkout mode or full self-service mode described later, the captured image is displayed in response to the start of an operation by a customer who is an operator. The timing of the start of an operation can be grasped, for example, by pressing a predetermined operation start button, or by providing a human presence sensor in the POS terminal 20 and detecting a customer standing in front of the POS terminal 20 with the human presence sensor. In another example, in the face-to-face self-service mode described later, the captured image may be displayed at a timing such as the detection of the insertion of cash into the change dispenser 209. In these examples, the functional unit that detects the pressing of the operation start button, the human presence sensor, and the functional unit that detects the insertion of cash constitute a detection unit that detects the operator.

In another example of the display contents, the first display area G1 displays a sub-screen, settlement screen, maintenance screen, etc., while the second display area G2 displays operation history, change balance, maintenance history (connected communication history), etc.

In the example of Fig. 4, the first display area G1 and the second display area G2 are arranged in two levels, one above the other, and the first display area G1 is slightly larger than the second display area G2, but regardless of this, the vertical width of the first display area G1 and the second display area G2 can be set to any width. This allows, for example, the second display area G2 to be provided in the approximate middle in the vertical direction of the customer-side display unit 205, so that the captured image can be shown to the customer at a position that matches the customer's line of sight. This allows the customer's attention to be directed to the captured image, and the customer can easily view the captured image even while operating the device.
Specific examples of information displayed in each area and screen transitions will be described later.

The customer-side scanner unit 206 is a scanner unit for customers, and optically reads various information. For example, the customer-side scanner unit 206 optically reads barcodes (product codes, etc.) attached to products and codes (barcodes, two-dimensional codes, etc.) printed on bills (registered trademarks). In addition to the above, the customer-side scanner unit 206 may read gift certificates (gift certificates, coupons, and complimentary coupons) and codes (barcodes, two-dimensional codes, etc.) printed on various cards (for example, membership cards, point cards, etc.). The customer-side scanner unit 206 is also used for reading processing in code settlement. The customer-side scanner unit 206 may be either a fixed scanner or a handy scanner, or may be composed of both.
The customer-side scanner unit 206 constitutes one of the registration means for registering products by reading the barcodes of the products, etc. However, product registration is not limited to registration by reading the codes by the customer-side scanner unit 206. For example, a preset key (a button for ordering the product) corresponding to the product may be displayed on the customer-side display unit 205, and the product may be registered by the customer operating (pressing) the preset key.

The notification unit 207 is a light-emitting unit that emits light according to the status of the POS terminal 20, and notifies the outside of the status by a predetermined blinking pattern or color. This notification unit 207 is, for example, a sign lamp composed of a lamp or an LED (Light Emitting Diode), and can be lit in a predetermined color or a predetermined blinking pattern. The notification unit 207 is provided at the highest position of the POS terminal 20, and the lighting pattern can be recognized even by store staff who are not around the POS terminal 20.

The card payment unit 208 is a payment mechanism that uses various cards (credit cards, prepaid cards such as transportation cards, point cards, etc.) and is compatible with IC cards, magnetic cards, etc. The card payment unit 208 is equipped with a card recognition unit (reading unit), a display unit, and an operation unit. The card recognition unit magnetically or electrically reads information from various cards. The read information is used to settle the purchase. The card recognition unit is also capable of recognizing information to be used in settling the current purchase, for example, when using points held on a point card. The card recognition unit is also capable of recognizing information that is not used in settling the current purchase, for example, when adding points to a point card.

The card payment unit 208 in this embodiment includes a card recognition unit, a display unit, and an operation unit, but is not limited to these as long as it includes at least the card recognition unit. The card recognition unit in this embodiment is compatible with contact cards (IC cards, magnetic cards), but is not limited to this. For example, the card recognition unit may be compatible with non-contact cards (IC cards) instead of or in addition to a card recognition unit compatible with contact cards.

The change machine 209 (cash settlement unit) constitutes a deposit/withdrawal unit that deposits and withdraws cash, and performs settlement with cash. This change machine 209 faces the customer side, and has an input port for banknotes and coins, and an output port for banknotes and coins. When the change machine 209 receives various operations and cash input from a customer, it calculates the amount of money inserted through the input port. When it calculates the change amount, which is the difference between the input amount and the purchase amount, it outputs the change or change bills from the output port.
The change dispenser 209 has a sensor that detects bills and coins inserted into the insertion slot. The sensor detects that bills and coins have been inserted into the insertion slot, and detects the number of bills and coins by denomination. The card settlement unit 208 and the change dispenser 209 form a settlement unit.

The store clerk display unit 210 is a touch display for the store clerk. This store clerk display unit 210 constitutes one of the display means for displaying predetermined information to the store clerk, and also constitutes one of the input means for accepting input of predetermined information from the store clerk. In addition, the store clerk display unit 210 constitutes one of the registration means for registering products by accepting input of product information.
In this embodiment, the clerk-side display unit 210 is vertically long like the customer-side display unit 205, and is composed of a first display area G1 on the lower side and a second display area G2 on the upper side as shown in Fig. 4, and different information can be displayed in the first display area G1 and the second display area G2 while product registration processing and payment processing are being executed. However, while the customer-side display unit 205 is a vertically long touch display, the clerk-side display unit 210 can be a square display compatible with a resolution of 1024 x 768, and the clerk-side display unit 210 can be composed of only one display area.

Like the customer display unit 205, the clerk-side display unit 210 can display an operation screen in the first display area G1 that accepts operations by the clerk as an operator, such as registering products and settling payments, and can display captured images taken by the camera 216 in the second display area G2. The captured images displayed in the second display area G2 can be displayed at various times, such as when a customer or clerk starts an operation. The vertical width of the first display area G1 and the second display area G2 can also be set to any width.

The key operation unit 211 is composed of various keys (hardware keys, buttons). The key operation unit 211 accepts various inputs from the store clerk. Specifically, the key operation unit 211 includes a mode switching button, a collective switching button, and a self-checkout machine mode switching button. The mode switching button is a button for switching the operation mode. The collective switching button is a button for switching the operation mode of each POS terminal 20 collectively by being operated on a specific POS terminal 20 (for example, a POS terminal 20 to which a store manager or the like is logged in). The self-checkout machine mode switching button is a button for switching to the "self-checkout machine mode (semi-self-checkout mode)" described below.

The mode switching button is a button that can switch the destination mode in a predetermined order each time it is pressed. This order is preset, for example, as follows: face-to-face self-service mode → full self-service → self-service checkout machine mode → face-to-face self-service mode → ... For this reason, to switch from face-to-face self-service mode to self-service checkout machine mode, the store clerk must press the mode switching button twice.

The button for switching modes is not limited to a hard key (mechanical key) such as a mode switching button, but may be a selection button (soft key) displayed on the store clerk display unit 210. This selection button may, for example, display multiple buttons corresponding to the destination mode. Specifically, if the current mode is the face-to-face self-service mode, a button for switching to the self-service checkout mode and a button for switching to the full self-service mode may be displayed. This makes it possible to switch modes with a single touch. In other words, the store clerk does not need to press a button multiple times, but simply presses the button for the mode to which the user wishes to switch.

However, the selection button displayed on the store clerk display unit 210 may be a single button, similar to the mode switching button, that switches to the destination mode in a predetermined order each time it is pressed.

In principle, the button for switching modes is displayed on the clerk-side display unit 210, but it may also be displayed on the customer-side display unit 205. For example, if it is determined that a clerk is clearly on the customer side, it is also possible to display the button on the customer-side display unit 205. Examples of situations in which a clerk is clearly on the customer side include when the customer-side scanner unit 206 is used to transition to a maintenance screen exclusively for clerks, or when the customer-side display unit 205 is operated to transition to a maintenance screen exclusively for clerks.

The clerk scanner unit 212 is a scanner unit for use by clerks, and optically reads various types of information. For example, the clerk scanner unit 212 optically reads barcodes attached to products and clerk codes attached to clerk nametags. In addition to the above, the clerk scanner unit 212 may also read codes printed on bills, gift certificates, and codes printed on various cards. The clerk scanner unit 212 is also used for reading processes in code payments. The clerk scanner unit 212 may be either a fixed scanner or a handheld scanner, or may be configured with both.

The store clerk scanner unit 212 constitutes one of the registration means for registering products by reading the product's barcode, etc. However, product registration is not limited to registration by reading a code with the store clerk scanner unit 212. For example, a key corresponding to a product (e.g., a key corresponding to a sports newspaper) may be placed on the key operation unit 211, and the product may be registered by the store clerk operating (pressing) that key. It is also possible to display a preset key corresponding to the product on the store clerk display unit 210, and register the product by the store clerk operating that preset key.

The printing unit 213 prints and outputs various media (receipts, bills, etc.). The printing unit 213 can change the direction of the media issuing port. Specifically, the printing unit 213 has a rotatable mechanism, and is configured so that the media issuing port faces from the store clerk side to the customer side, and from the customer side to the store clerk side. The orientation of the media issuing port may be manually changeable, or may be automatically changeable in response to a change in the operating mode. The printing unit 213 may be equipped with a sensor that detects whether the orientation of the printing issuing port is correct. In the following, a change in the operating mode may sometimes be referred to as a transition in the operating mode.

The audio output unit 214 outputs audio. For example, the audio output unit 214 outputs audio guidance and warning sounds. The audio guidance and warning sounds are related to product registration and payment.

The communication unit 215 is an interface that transmits and receives information with other devices (the store controller 10, the transaction status management device 11, and other POS terminals 20).

The camera 216 is an imaging unit that continuously captures moving or still images of the operating status of an operator such as a customer or a store clerk. The camera 216 is attached to the upper right of the customer side display unit 205 when viewed from the customer side.
For example, the camera 216 captures an image of the customer's operation during checkout. Specifically, the camera 216 captures images of the banknotes and coins held by the customer, the change dispenser 209, hand movements, and other operational statuses during and after cash deposit and withdrawal. The camera 216 also captures images of the customer's operation during product registration. Specifically, the camera 216 can capture images of the inside (products) of a shopping basket on the counter provided on both sides of the POS terminal 20, and the customer's operation during registration.

In addition, the captured image capturing the above-mentioned imaging location may be an image obtained by enlarging or cutting out a specific location from a wider captured image, or may be an image obtained by focusing the camera 216 on a specific location.
In addition, the captured images displayed on the customer display unit 205 and the store clerk display unit 210 can be live footage from the camera 216, or the capture can be started and stopped at a specified timing, or they can be temporarily stored recorded footage.

Overview of each operation mode Next, the operation modes of the POS terminal 20 will be described. The POS terminal 20 has multiple operation modes. The multiple operation modes are operation modes during normal business (operation modes related to registration processing and settlement processing). The multiple operation modes are a face-to-face self-service mode, a self-checkout machine mode, and a full self-service mode. The POS terminal 20 is controlled to one of the multiple operation modes.

In addition to registration and settlement, there are other processing modes such as tally mode, maintenance mode, and training mode. Tally mode is a mode for tallying and inquiring about sales and inventory. Maintenance mode is a mode in which store clerks and maintenance personnel perform setup and maintenance work. Training mode is a mode in which new employees are trained.

Below, we will mainly explain in detail the face-to-face self-service mode, the self-service checkout machine mode, and the full self-service mode. Note that below, the self-service checkout machine mode and the full self-service mode may be collectively referred to as "self-service mode."

(Face-to-face selfie mode)
The face-to-face self-service mode is an operation mode in which product registration by the store clerk (hereinafter sometimes referred to as "product registration") is enabled and product registration by the customer is disabled. In other words, the face-to-face self-service mode is an operation mode in which registration processing by the store clerk is executed without executing registration processing by the customer. In product registration by the store clerk, purchased products are registered using the store clerk scanner unit 212, the store clerk display unit 210, and the key operation unit 211.

In addition, in the face-to-face self-service mode, settlement is possible, such as inserting currency (bills and coins) and reading various cards. Specifically, in the face-to-face self-service mode, for example, it is possible to accept operations for settlement with cash (inserting currency into the change dispenser 209). Below, settlement in the face-to-face self-service mode may be referred to as "face-to-face settlement."

In addition, in the face-to-face self mode, it is possible to transmit registration information to another POS terminal 20. Transmitting registration information to another POS terminal 20 means transmitting the registration information generated in the registration process to another POS terminal 20 capable of executing the settlement process. The registration information may be transmitted directly from the POS terminal 20 to the other POS terminal 20, or may be transmitted indirectly to the other POS terminal 20 via another device such as the store controller 10 or the transaction status management device 11. In the following explanation, the transmission of information between the devices is not specifically described, but like the transmission of registration information, it may be transmitted directly or indirectly.

In addition, in the face-to-face self-service mode, it is possible to issue a receipt. Issuing a receipt means that the registration information generated in the registration process is coded and printed on a print medium (receipt). Another POS terminal 20 can carry out the settlement process by reading the code on the receipt.

In addition, in the face-to-face self-service mode, it is also possible to receive registration information from other POS terminals 20. That is, in the face-to-face self-service mode, it is possible to execute the settlement process based on the registration information generated in the other POS terminals 20. Note that, when the POS terminal 20 receives registration information in the face-to-face self-service mode, it may switch to the self-service checkout mode (semi-self-service mode). Similarly, in the face-to-face self-service mode, the POS terminal 20 may switch to the self-service checkout mode when it reads the code on the bill in the face-to-face self-service mode. Also, after switching to the self-service checkout mode and completing the settlement process, it may return from the self-service checkout mode to the face-to-face self-service mode automatically or according to the permission of the store clerk. Also, even after switching to the self-service checkout mode and completing the settlement process, it may remain in the self-service checkout mode. Note that, in the face-to-face self-service mode, it may disable the reception of registration information from other POS terminals 20, it may disable the reading of the bill in the face-to-face self-service mode, or it may disable both of these.

(Self-service mode)
The self-checkout mode is an operation mode in which the reception of registration information from other POS terminals 20, the reading of receipts, and the insertion of coins are enabled, and product registration by the store clerk and customer is disabled. A POS terminal 20 operating in this self-checkout mode constitutes a checkout device, and has the function of receiving registration information generated in the registration process of other POS terminals 20.
The registration information may be received directly from another POS terminal 20, or indirectly from another POS terminal 20 via another device such as the store controller 10 or the transaction status management device 11. In the following description, the reception of information between the devices is not specifically described, but like the reception of the registration information, the reception may be direct or indirect.

Reading a receipt means reading the code printed on the receipt or reading the coded information. The self-payment machine mode is an operating mode in which the registration process is not performed on the terminal itself, but rather the payment process is performed solely based on the registration information generated on another POS terminal 20. Note that since the self-payment machine mode is an operating mode in which the registration process is not performed, i.e., no registration information is generated, the sending of registration information to other POS terminals 20 and the issuance of receipts are both disabled.

(Full selfie mode)
The full self-service mode is an operation mode in which product registration by the customer is enabled. In other words, the full self-service mode is an operation mode that assumes registration processing on the customer's side. In product registration on the customer's side, the customer scanner unit 206 and the customer display unit 205 are used to register purchased products.

In addition, in full self-service mode, it is possible to enable product registration by the store clerk as well. In other words, full self-service mode is an operating mode that assumes registration processing on the customer side, but also allows registration processing on the store clerk side. Note that a state in which registration processing is performed on both the customer side and the store clerk side is sometimes called double scan mode. Note that in full self-service mode, product registration by the store clerk side may be disabled.

Furthermore, the full self-service mode is an operating mode in which the settlement process can be performed at the terminal itself. Specifically, the full self-service mode is an operating mode in which the insertion of coins is enabled, and the transmission of registration information to other POS terminals 20 and the issuance of accounting tickets are disabled.

Furthermore, like the self-service checkout machine mode, the full self-service mode is an operating mode in which both the reception of registration information from other POS terminals 20 and the reading of bills are enabled. In other words, like the self-service checkout machine mode, in the full self-service mode, the checkout process can be performed based on the registration information generated in other POS terminals 20.

When the POS terminal 20 receives registration information in full self-service mode, it may switch to self-service mode (semi-self-service mode). Similarly, when the POS terminal 20 reads the code on a bill in full self-service mode, it may switch to self-service mode. After switching to self-service mode and completing the payment process, it may automatically return from self-service mode to full self-service mode. Even after switching to self-service mode and completing the payment process, it may remain in self-service mode. In full self-service mode, it may disable the reception of registration information from other POS terminals 20, disable the reading of bills, or disable both.

The POS terminal 20 does not necessarily have to have all the functions. For example, the POS terminal 20 may obtain a program for implementing the functions required for each operation mode from an external device (e.g., the store controller 10, the transaction status management device 11, a server outside the store, etc.) and make it executable, and if the POS terminal 20 holds a program for implementing functions not required for each operation mode, it may make the program inexecutable (e.g., by erasing it).

Also, after making a program for implementing unnecessary functions in an unexecutable state, a program for implementing necessary functions may be acquired and made executable. Also, for example, when switching between operation modes, the POS terminal 20 may first make all programs in an unexecutable state regardless of the operation mode to which it is transitioned, and then acquire a program for implementing functions required in that operation mode from an external source and make it executable. In other words, the POS terminal 20 may be configured to disable some of the various functions that it originally has depending on the operation mode, or to have only the necessary functions depending on the operation mode. It may also be a dedicated terminal equipped only with functions corresponding to a specific operation mode.

● Switching (transitioning) operation modes
Next, a description will be given of switching (transitioning) the operation mode of the POS terminal 20. The POS terminal 20 switches the operation mode in response to a mode switching operation, a store clerk code reading operation, a mode switching command, or the like.

More specifically, the POS terminal 20 switches between operation modes in response to an explicit mode switching operation performed by a store clerk, such as pressing a mode switching button.
In addition, the POS terminal 20 switches the operation mode in response to an operation other than the mode switching operation, such as reading a store clerk code.

The POS terminal 20 also switches its operating mode in response to a mode switching command from another POS terminal 20, the transaction status management device 11, a mobile terminal, etc. The POS terminal 20 may also switch its operating mode in response to a time-related condition. The time-related condition may be, for example, the time elapsed since the last operation or a fixed time according to a schedule.

The POS terminal 20 may also be configured to switch operating modes when a process starts. The start of a process may be, for example, when a settlement process based on registration information received from another POS terminal 20 starts, or when a settlement process based on reading a bill is started.

The POS terminal 20 may also switch operating modes when a process ends. The end of a process may be, for example, when a settlement process based on registration information received from another POS terminal 20 ends, or when a settlement process based on reading a bill ends.

(Face-to-face self-mode → Full self-mode)
First, switching from the face-to-face self-service mode to the full-self-service mode will be described. When the device is controlled in the face-to-face self-service mode, for example, when a mode switching operation, a mode switching command, or a predetermined time has elapsed (a predetermined time of non-use) occurs, the operation mode switches from the face-to-face self-service mode to the full-self-service mode. The mode switching command here is a mode switching command that specifies the full-self-service mode as the operation mode to be transitioned to.

(Face-to-face self-service mode → Self-service payment machine mode)
Next, switching from the face-to-face self-service mode to the self-service checkout machine mode will be described. When the face-to-face self-service mode is being controlled, for example, if a mode switching operation or a mode switching command is issued, the operation mode switches from the face-to-face self-service mode to the self-service checkout machine mode. The mode switching command here is a mode switching command that specifies the self-service checkout machine mode as the operation mode to be transitioned to. In addition, when the face-to-face self-service mode is being controlled, for example, if registration information is received from another POS terminal 20 or if a bill is read, the operation mode may be switched from the face-to-face self-service mode to the self-service checkout machine mode.

(Full self-time mode → Face-to-face self-time mode)
Next, switching from the full self-service mode to the face-to-face self-service mode will be described. When the full self-service mode is being controlled, for example, if there is a mode switching operation or a mode switching command, the operation mode switches from the full self-service mode to the face-to-face self-service mode. The mode switching command here is a mode switching command that specifies the face-to-face self-service mode as the operation mode to be switched to.

(Full self-service mode → Self-service payment machine mode)
Next, switching from the full self-service mode to the self-service checkout machine mode will be described. When the full self-service mode is being controlled, for example, if a mode switching operation or a mode switching command is issued, the operation mode switches from the full self-service mode to the self-service checkout machine mode. The mode switching command here is a mode switching command that specifies the self-service checkout machine mode as the operation mode to be transitioned to. In addition, when the full self-service mode is being controlled, for example, if registration information is received from another POS terminal 20 or if a bill is read, the operation mode may be switched from the full self-service mode to the self-service checkout machine mode.

(Self-service checkout mode → Face-to-face self-service mode)
Next, switching from the self-checkout mode to the face-to-face self-service mode will be described. When the self-checkout mode is being controlled, for example, if there is a mode switching operation or a mode switching command, the operation mode switches from the self-checkout mode to the face-to-face self-service mode. The mode switching command here is a mode switching command that specifies the face-to-face self-service mode as the operation mode to be transitioned to. In addition, when the self-checkout mode is being controlled, for example, if the payment process based on the received registration information or the payment process based on the bill is completed, the operation mode may be switched from the self-checkout mode to the face-to-face self-service mode.

(Self-service mode → Full self-service mode)
Next, switching from the self-checkout mode to the full self-checkout mode will be described. When the self-checkout mode is being controlled, for example, if a mode switching operation or a mode switching command is issued, the operation mode switches from the self-checkout mode to the full self-checkout mode. The mode switching command here is a mode switching command that specifies the full self-checkout mode as the operation mode to be transitioned to.

In addition, when the device is controlled in the self-service checkout mode, for example, when the checkout process based on the received registration information or the checkout process based on the bill is completed, the operating mode may be switched from the self-service checkout mode to the full self-service mode.

Note that the mode switching operation may be any operation that specifies the destination operation mode depending on the operation. For example, if there are buttons for each destination, the operation mode may be switched depending on the mode switching operation in which the respective button is pressed. Also, if there is one button that switches the destination each time it is pressed, the operation mode may be switched each time the button is pressed for a mode switching operation. Note that there may be separate buttons for selecting the destination operation mode and for confirming the transition to the operation mode selected by that button.

Processing Flow and Screen Configuration in Face-to-Face Self-Service Mode Next, the processing flow and screen examples of the POS terminal 20 in each operation mode will be described.
FIG. 5 shows the flow of processing by the POS terminal 20 in the face-to-face self-service mode.
First, the store clerk starts the process of registering the purchased items that have been placed in a shopping cart or the like by a customer (S101).

The POS terminal 20 uses the camera 216 to capture images of the operation status of a customer in front of the customer display unit 205. The camera 216 may capture images at all times while the POS terminal 20 is in operation, but it is performed at least during a series of processes from registering the purchased items to settlement. The images captured by the camera 216 are recorded in a reproducible manner in a storage unit such as the RAM 203 or a separately stored HDD. The captured images may be stored in a server or the like configured to be able to communicate via a network, and in this case, for example, the POS terminal 20 transmits the captured images to the server or the like in association with transaction identification information at a predetermined timing.

Here, FIG. 6 shows an example of a screen displayed on the POS terminal 20 when starting a product registration operation in the face-to-face self-service mode. For ease of explanation, in the following explanation of the screen in the face-to-face self-service mode, the above-mentioned first display area G1 and second display area G2 will be referred to as the first display area G1-1 and second display area G2-1 on the customer display unit 205, and as the first display area G1-2 and second display area G2-2 on the store clerk display unit 210.

As shown in FIG. 6A, the customer side display unit 205 displays the message "Welcome" in the first display area G1-1, and displays an advertisement in the second display area G2-1.
As shown in FIG. 6B, the store clerk display unit 210 displays a product registration operation screen in the first display area G1-2, and displays the change status of the POS terminal 20 in the second display area G2-2.
Regardless of the example of FIG. 6A, a screen saver or the like can be displayed instead of an advertisement until the customer operates the POS terminal 20.

The POS terminal 20 accepts operations by the clerk using the clerk scanner unit 212, clerk display unit 210, and key operation unit 211, and begins registering the products purchased by the customer. In response, the screen changes to an execution screen for product registration operations, as shown in Figure 7. Figure 7 (A) is an example of a screen on the customer display unit 205, and Figure 7 (B) is an example of a screen on the clerk display unit 210.

7A, the customer-side display unit 205 displays the product registration status in the first display area G1-1, and continues to display advertisements in the second display area G2-1. The product registration status includes information such as the name, price, and quantity of each registered product, as well as the total price of the registered products.
It should be noted that while the product is being registered by the store clerk, the image screen showing the image capture results of the camera 216 is not displayed on the customer side display unit 205 .
7B, the store clerk display unit 210 displays a product registration screen in the first display area G1-2, which displays registered products, prices, etc. The second display area G2-2 continues to display the change status of the POS terminal 20.

When the sales clerk has completed the registration of the purchased items, the sales clerk completes the registration process by, for example, pressing a subtotal button (S102).
If the customer selects to pay by credit card, the store clerk instructs the POS terminal 20 to settle the payment by credit card (S103), and the card settlement unit 208 executes the settlement process (S106). Note that this also applies to payment by code, points, electronic money, etc., in addition to payment by credit card.

On the other hand, if the customer selects cash payment, the store clerk instructs the POS terminal 20 to settle the payment in cash (S103).
In response, the first display area G1-1 of the customer display unit 205 displays the message "Please insert money" together with the total amount of the purchased items, as shown in FIG. 8(A).
The customer checks the total amount of the purchased items displayed on the customer side display unit 205 and inserts cash into the change machine 209.

When a customer inserts cash into the change dispenser 209, the POS terminal 20 detects this (S104) and displays images captured by the camera 216 in the second display area G2-1 of the customer display unit 205 and the second display area G2-2 of the clerk display unit 210 (S105), as shown in Figure 9. Note that Figure 9 (A) shows an example screen of the customer display unit 205, and Figure 9 (B) shows an example screen of the clerk display unit 210.

At this time, the captured images displayed in the second display areas G2-1 and G2-2 are images that have been rewound a predetermined time from the current time and played back, allowing the customer to confirm the state in which he or she has inserted cash into the change machine 209.
The captured image also includes images of locations such as the customer's hands when the customer inserts cash into the change machine 209, the cash to be inserted, and the insertion slot of the change machine 209. The captured image may be one that focuses on the location from a wider captured image captured by the camera 216, or may be one that is captured by focusing on the location.
The display of such captured images is performed in order to prevent trouble caused by fraudulent acts by customers at the time of payment, etc. For example, a customer may falsely or mistakenly say that they inserted a 10,000 yen note when in fact they inserted a 5,000 yen note into the insertion slot, causing trouble between the store and the customer.

When the insertion of the cash is completed, the settlement process, such as the calculation of the change, is executed (S106). As shown in Fig. 10(A), the first display area G1-1 of the customer side display unit 205 displays the message "If you wish, please press the Finish button", as well as information on the deposited cash and the change, a button to request the issuance of a receipt, and an "End (Receipt)" button to announce the end of the series of processes.
When the customer presses the "END (receipt)" button and receives a receipt from the printing unit 213, if there is any change or change tag, the change device 209 will eject the change or change tag. If there is any change or change tag, the customer receives the change or change tag, and the settlement process is completed (S107).

At this time, the first display area G1-2 of the store clerk display unit 210 displays information on the amount of cash deposited by the customer into the change machine 209 (amount deposited in the change machine), as well as a "Cancel deposit" button for canceling the deposit and a "Register next customer" button for moving on to the product registration operation for the next customer.

In the above-mentioned processing in the face-to-face self-service mode, the POS terminal 20 may be configured to accept the insertion of cash into the change dispenser 209 before the registration process by the clerk is completed (before the total amount is determined). In this case, the POS terminal 20 may start displaying the captured image when it detects the insertion of cash while the clerk is performing the registration process. In other words, even if the clerk is registering the purchased items, the POS terminal 20 may display the captured image in the second display area G2-1 of the customer-side display unit 205 or the second display area G2-2 of the clerk-side display unit 210. In addition, the POS terminal 20 may not accept the insertion of cash before the clerk completes the registration process.

In addition, in the face-to-face self-service mode, the POS terminal 20 can register the items purchased by the next customer even before the customer has completed the payment (even before the change has been taken out or the receipt has been printed). In other words, the POS terminal 20 can register the items purchased by the next customer while the payment is being processed at the terminal. Also, the store clerk may not be present while the customer is paying. In other words, the store clerk may finish serving the customer while the customer is paying.

In addition, if there is change, the POS terminal 20 may issue a receipt after the change is taken out. Specifically, the POS terminal 20 may be provided with a sensor that detects the change and change tags, and after controlling the dispensing of the change and change tags, may control the printing unit 213 to issue a receipt when the sensor detects that the change or change tags have been taken out. This makes it possible to prevent the change from being forgotten. Note that in other operating modes as well, a receipt may be issued after the change is taken out in a similar manner.

Furthermore, the POS terminal 20 can receive a selection of a settlement type (payment method) from the customer before the registration process is completed.
In addition, when selecting a payment type (payment method), the POS terminal 20 can consider that cash has been selected as the payment type not only by pressing a specific button, but also by accepting the insertion of cash.

In addition, in the above-described process, when it is detected that cash has been inserted into the change machine 209, captured images taken a predetermined time back are displayed on the customer display unit 205 and the store clerk display unit 210, allowing the customer to check the state of inserting the cash into the change machine 209. On the other hand, the captured images may be displayed when the store clerk accepts a selection of a payment type from the customer and issues a payment request to the POS terminal 20 in accordance with the selection. In this case, the customer has not yet inserted cash, so the captured images may be live footage.

Processing Flow and Screen Configuration in Self-Checkout Machine Mode FIG. 11 shows the processing flow of the POS terminal 20 in the self-checkout machine mode.
In the self-payment machine mode, the POS terminal 20 is divided into a terminal (registration machine) operated by a store clerk to register products, and a terminal (payment machine) to allow a customer to settle payments. In the following explanation, the former (registration machine) is referred to as the "POS terminal 20-1," and the latter (payment machine) is referred to as the "POS terminal 20-2." In reality, a plurality of POS terminals 20-2 as payment machines may be provided for one POS terminal 20-1 as a registration machine, and in that case, the POS terminal 20-1 specifies the POS terminal 20-2 to settle payments from among the plurality of POS terminals 20-2.

First, the store clerk starts the process of registering the purchased items that have been placed in a shopping cart or the like by a customer using the POS terminal 20-1 (S201).
As in the above-mentioned face-to-face self-service mode, the POS terminal 20-2 captures images of the operation status of the customer in front of the customer-side display unit 205 using the camera 216.

FIG. 12 shows an example of a screen displayed on the POS terminal 20-2 during product registration processing in the self-checkout mode.
The customer side display unit 205 displays in the first display area G1 that the POS terminal 20-2 is operating as a settlement machine and is in a standby state so that it can receive registration data, and displays an advertisement in the second display area G2.

The POS terminal 20-2 can also display the captured image in the second display area G2 of the customer display unit 205 when the self-checkout mode is on standby. This makes the customer aware that they are being photographed even when the self-checkout mode is on standby, which can enhance the deterrent effect against fraud.

When the store clerk completes the registration process of the purchased items using the POS terminal 20-1 (S202), he designates the POS terminal 20-2, which is controlled to the self-checkout mode, and transmits the registration data (S203). After transmitting the registration data to the POS terminal 20-2, the store clerk moves on to the registration process of the purchased items of the next customer (S204).
Instead of transmitting the registration data, the POS terminal 20-1 may issue a bill to be read by the POS terminal 20-2 which executes the settlement process.

When the POS terminal 20-2, which is controlled in the self-checkout mode, receives registration information from the POS terminal 20-1 (S205) or reads the code on the bill, it displays a screen showing the captured image on the customer display unit 205, as shown in Figure 13 (S206).
13, the first display area G1 displays the total price of the purchased items, a message saying "Please press the payment method," and a button for selecting the payment method. The second display area G2 displays an image of the customer's operation, captured by the camera 216.
The captured image displayed in the second display area G2 is, for example, the entire image captured by the camera 216, or an image of the customer and the surrounding area of the customer-side display unit 205 being operated by the customer.

If the customer selects to pay by credit card (S207), the card payment unit 208 executes the settlement process (S209). Note that this applies not only to card payments by credit card, but also to code payments, points, electronic money, and the like.

On the other hand, when the customer selects cash payment (S207), the captured image displayed in the second display area G2 of the customer-side display unit 205 is switched to a captured image of the customer's hand when the customer inserts cash into the change machine 209, the cash to be inserted, the insertion slot of the change machine 209, etc. (S208). Such switching of the captured image may be one that focuses on the relevant location from a wider captured image captured by the camera 216, or one that focuses on the relevant location.
The screen of the customer display unit 205 at this time is shown in Fig. 14. In the first display area G1, a message "Please insert money" is displayed together with information on the total amount of the purchased items. In the second display area G2, a captured image of the area around the change machine 209 is displayed.

After checking the total amount of the purchased items displayed on the customer side display unit 205, the customer inserts cash into the change machine 209 and carries out the settlement process (S209).
The state at this time is displayed as a captured image in the second display region G2, as shown in FIG.
Furthermore, when the settlement process is completed, the first display area G1 will display the message "If you are satisfied, please press the Finish button", along with information on the deposited cash and change, a button to request the issuance of a receipt, and an "End (Receipt)" button declaring the end of the series of processes.
When the customer presses the "END (receipt)" button and receives a receipt from the printing unit 213, if there is any change or change tag, the change machine 209 will eject the change or change tag. If there is any change or change tag, the customer receives the change or change tag, and the settlement process is completed (S210).

As in the face-to-face self-service mode described above, in the self-service checkout mode, the POS terminal 20-2 may issue a receipt after the change is taken out if there is any. In addition, when selecting the payment type (payment method), the POS terminal 20-2 can also consider cash to have been selected as the payment type when it receives the insertion of cash, rather than just pressing a specific button, etc.

In the process flow in the self-payment machine mode described above, the captured image is displayed on the customer display unit 205 in response to receiving registration information or reading the code on the bill, but regardless of this, the captured image can also be displayed when the customer selects the payment type. Also, a human presence sensor can be provided in the POS terminal 20, and the captured image can start to be displayed when the human presence sensor detects a customer standing in front of the POS terminal 20.

Processing Flow and Screen Configuration in Full Self-Service Mode FIG. 16 shows the processing flow of the POS terminal 20 in the full self-service mode.
The POS terminal 20 is in a standby state before a customer starts operation. Fig. 17 shows an example of a screen in such a standby state. A button labeled "Start registration" is provided on the screen. The customer presses the "Start registration" button to start operation (S301).
As in the self-checkout mode described above, the POS terminal 20 captures images of the operations being performed by a customer in front of the customer-side display unit 205 using the camera 216 .

When the operation is started, the screen of the customer side display unit 205 transitions to the screen shown in Fig. 18. On the screen, a product registration operation screen is displayed in the first display area G1, and an advertisement is displayed in the second display area G2.
The registration operation screen in the first display area G1 displays the message "Please register a product", as well as a "No barcode" button for registering a product without a barcode, information about the registered product, the total price of the purchased products, and a "Checkout" button to proceed to checkout for the registered products.

The customer performs an operation to register the product by reading the barcode of the product with the customer-side scanner unit 206 or by pressing a preset key displayed on the customer-side display unit 205 (S302).
When the product registration operation is started, as shown in FIG. 19, a captured image is displayed in the second display area G2 of the customer side display unit 205 (S303).

When registering a product that does not have a barcode, the customer presses the "No barcode" button shown in Fig. 18. This causes the screen on the customer display unit 205 to change to the screen shown in Fig. 20.
The screen displays the name and price of the product, as well as a virtual numeric keypad that allows the customer to input the number of products. The customer inputs the quantity of the product to be registered and confirms it.

The customer registers the purchased items (S304), and when registration of all purchased items is completed, the customer proceeds to payment by pressing the "Checkout" button shown in FIG. 18 (S305).
When the "Checkout" button is pressed, a screen similar to that shown in Fig. 13 is displayed. In other words, in the first display area G1, the total price of the purchased items and a message saying "Please press the payment method" are displayed along with a button for selecting the payment method. In the second display area G2, an image of the customer's operation status captured by the camera 216 is displayed.
The captured image displayed in the second display area G2 is, for example, the entire image captured by the camera 216, or an image of the customer and the surrounding area of the customer-side display unit 205 being operated by the customer.

If the customer selects to pay by credit card (S306), the card payment unit 208 executes the settlement process (S308). Note that this applies not only to card payments by credit card, but also to code payments, points, electronic money, and the like.

On the other hand, when the customer selects cash payment (S306), the captured image displayed in the second table area of the customer-side display unit 205 is switched to an image of the customer's hands when the customer inserts cash into the change machine 209, the cash to be inserted, the insertion slot of the change machine 209, etc. (S307). Such switching of the captured image may be an image that focuses on the relevant location from a wider captured image captured by the camera 216, or an image that focuses on the relevant location.
The screen of the customer display unit 205 at this time is the same as that shown in Fig. 14 described in the self-payment mode. That is, the first display area G1 displays the total amount of the purchased items together with a message saying "Please insert money." The second display area G2 displays a captured image of the area around the change machine 209.

When the customer checks the total amount of the purchased items displayed on the customer side display unit 205, the customer inserts cash into the change machine 209 and carries out the settlement process (S308).
The state at this time is displayed as a captured image in the second display region G2, similar to the screen shown in FIG.
15 and receives a receipt from the printing unit 213, the change or change tag, if any, is dispensed from the change dispenser 209. The customer receives the change or change tag, if any, and the settlement process is then completed (S309).

As in the face-to-face self-service mode described above, in the full self-service mode, if there is change, the POS terminal 20 may issue a receipt after the change is taken out. In addition, when selecting the payment type (payment method), the POS terminal 20 can also consider cash to have been selected when it receives the insertion of cash, rather than just pressing a specific button, etc.

In the above-described process flow in the full self-service mode, the captured image is displayed on the customer display unit 205 in response to the customer's product registration. Regardless of this, the captured image can also be displayed when the customer presses the "Start Registration" button. Also, a human presence sensor can be provided in the POS terminal 20, and the captured image can start to be displayed when the human presence sensor detects a customer standing in front of the POS terminal 20.

Notification According to Status In each of the above operation modes, the POS terminal 20 notifies the status via the notification unit 207.
FIG. 21 shows an example of the status of the POS terminal 20 and the manner in which the notification unit 207 notifies the user of the status.
There are various statuses that can be assumed when using the POS terminal 20, such as, for example, paused, registering, settlement, change not collected, change near end, calling a store clerk, etc. The corresponding notification modes are unique for each status, such as different light emission colors, off, on, blinking, or even emitting different colors in sequence.
In this way, by operating the notification unit 207 in a unique notification mode for each status, various statuses can be easily recognized.

The status shown in FIG. 21 is an example, and other statuses can also be handled. For example, in the full self-service mode, when a customer registers a product without a barcode, a multiplication registration is performed by inputting the quantity of the product, and in this case, the status that the multiplication registration is being performed may be notified in a predetermined notification manner to prevent fraud or errors in the quantity. Also, when a product that requires age authentication, such as alcohol, is registered, the status may be notified as one of the predetermined statuses. Furthermore, the status information is transmitted to the transaction status management device 11, etc., and the store clerk can grasp the status of each POS terminal 20 in real time by a monitor, etc. that outputs information obtained from the transaction status management device 11.
In addition, the operation patterns of customers may be learned using AI (Artificial Intelligence), and when an operation that deviates from the learned operation pattern is detected as fraudulent behavior, this may be reported in a predetermined manner.

According to the POS terminal 20 of the present embodiment, a screen display that is both easy to use and easy to see is possible. In particular, since a customer can clearly see the captured image of the operation status while performing the operation, it is possible to effectively prevent fraud.
In addition, since the captured image to be displayed can be switched according to the operation content, or captured images can be played back going back a predetermined time, the situation to be focused on can be accurately displayed as a captured image.
In addition, since the customer can check their own operation while performing the operation, problems due to operational errors or misunderstandings can be prevented.

●Functional configuration In this embodiment, the customer-side display unit 205 of the POS terminal 20 is composed of a first display area G1 at the bottom, a second display area G2 in the middle, and a third display area G3 at the top, as shown in Figure 22, and while the product registration process and settlement process are being executed, different information can be displayed in the first display area G1, the second display area G2, and the third display area G3, respectively.

In one example of the display contents, the first display area G1 displays an operation screen that accepts operations by the customer (operator), such as registering products and making payments. The second display area G2 displays an image captured by the camera 216. The third display area G3 displays the status of the device (the POS terminal 20), thereby informing the customer and store clerk of the status of the device.
In addition, when there is no abnormality in the status of the POS terminal 20, the second display area G2 and the third display area G3 can be regarded as a single display area, and the captured image can be displayed in this single display area.
In addition to the status, the third display area G3 may display the machine number of the POS terminal 20, etc.

In this embodiment, not only the customer side display unit 205 of the POS terminal 20, but also the store clerk side display unit 210 can be configured in this manner with a first display area G1, a second display area G2, and a third display area G3.

Processing flow and screen configuration in face-to-face self-mode Below, examples of the content displayed in the first display area G1, the second display area G2, and the third display area G3 will be described along with examples of the screen in each operation mode.
The basic process flow is as described above for any of the operation modes.

First, a screen example in the face-to-face self-timer mode will be described.
Fig. 23 shows an example of a screen when a customer makes a cash settlement. When a customer inserts cash into the change dispenser 209, the POS terminal 20 detects this and displays an image captured by the camera 216 on the customer display unit 205 and the store clerk display unit 210, as shown in Fig. 23.
23(A), the second display area G2 and the third display area G3 are regarded as one display area and the captured image is displayed on the customer side display unit 205. Regardless of this example, the captured image may be displayed only in the second display area G2 and a status such as "payment in progress" may be displayed in the third display area G3.
On the store clerk display unit 210, as shown in FIG. 23 (B), the captured image is displayed in the second display area G2, and the third display area G3 displays the information "Near 10 yen" as the status of the POS terminal 20, notifying the user that the 10 yen coins are running low.

At this time, the captured image displayed on the customer display unit 205 and the store clerk display unit 210 is, as described above, a video that has been rewound a predetermined time from the current time and played back, allowing the customer to see themselves inserting cash into the change dispenser 209.

FIG. 24 shows a screen that appears after the insertion of cash has been completed, and is an example of a screen that appears when change is due but has been forgotten to be taken.
As shown in FIG. 24A, in the customer side display unit 205, a captured image is displayed in the second display area G2, and a message informing the customer that change has been forgotten is displayed in the third display area G3.
Also on the store clerk display unit 210, as shown in FIG. 24(B), the captured image is displayed in the second display area G2, and a message informing the customer that change has been forgotten is displayed in the third display area G3.
It should be noted that the notification of the status by a message in FIG. 24 is one example, and the background color may be made to flash or light up in a predetermined color depending on the status of forgetting to collect change.

Processing Flow and Screen Configuration in Self-Payment Machine Mode Next, an example of a screen in the self-payment machine mode will be described.
FIG. 25 shows an example of a screen displayed on the POS terminal 20 operated by a store clerk while the store clerk is performing product registration processing using the POS terminal 20 in the self-checkout mode.
The customer side display unit 205 displays in a first display area G1 that the POS terminal 20 is operating as a settlement machine and is in a standby state ready to receive registration data. The second display area G2 displays the message "Welcome." The third display area G3 displays the message "Waiting" as the status of the POS terminal 20, and further displays the unit number assigned to the POS terminal 20 among the multiple POS terminals 20.
Since the machine number is displayed, a customer who is told by a store clerk to go to the POS terminal 20 with a specific machine number can identify the POS terminal 20 with that specific machine number by looking at the machine number displayed in the third display area G3.

FIG. 26 shows an example of a screen displayed on the POS terminal 20 controlled in the self-checkout mode when registration information is received from the POS terminal 20 for product registration.
On the screen, the first display area G1 displays the total amount of the purchased items, a message saying "Please press the payment method", and a button for selecting the payment type. The second display area G2 displays an image of the customer's operation status captured by the camera 216. The third display area G3 displays the status of the POS terminal 20 as in FIG. 25. In this case, the POS terminal 20 has received the registration information and is in a state where the customer is asked to select a payment type, so a guide saying "Settlement in progress" is displayed as the status. In addition, the background color of the third area is different from the "Waiting" state shown in FIG. 25 so that it is clearly understood that this state is different. Note that the effect given to the third display area G3 to make it easier to recognize the difference in status may be a difference in the background color, or may be other forms such as flashing or lighting in a predetermined color.

Figure 27 shows an example of a screen in a state immediately before the process of completing the settlement process, such as receiving a receipt after the customer has performed the settlement process, such as inserting cash into the change dispenser 209. Here, the customer has not pressed the "End (receipt)" button that ends the settlement process, and a predetermined time has passed. Therefore, a message "Settlement time exceeded" is displayed as the status in the third display area G3. Note that the background color of the third area is a different color scheme from the background colors used for the statuses "Waiting" and "Settlement" so that it is clearly understood that this status "Settlement time exceeded" is different from the statuses "Waiting" in Figure 25 and "Settlement in progress" in Figure 26. Note that, as described above, the effect given to the third display area G3 to make it easier to recognize the difference in status may be in other ways.

Processing Flow and Screen Configuration in Full Self-timer Mode Next, an example of a screen in the full self-timer mode will be described.
28 is an example of a screen of the POS terminal 20 in a standby state before a customer starts operation. On the screen, the first display area G1 and the second display area G2 are combined into a single display area, and a button labeled "Start registration" is displayed. In the third display area G3, a message saying "Waiting" is displayed as the status of the POS terminal 20, and further, the unit number assigned to the POS terminal 20 out of multiple POS terminals 20 is displayed.

Figure 29 is an example of a screen at the start of the product registration process. On the screen, the product registration operation screen is displayed in the first display area G1, and an advertisement is displayed in the second display area G2. Furthermore, the status is displayed in the third display area G3. Here, since no products have been registered yet, the status remains "Waiting."

30 shows an example of a screen of the POS terminal 20 when a product registration operation is being performed. The first display area G1 displays information about the product that was just registered, and the second display area G2 displays a captured image. The third display area G3 displays the status "Registering."
Even in full self mode, the background color and other aspects of the third area are different for each of the statuses, such as "Waiting" in Figures 28 and 29, and "Registering" in Figure 30, as well as statuses such as "Settlement" so that it is clearly understood that these are different statuses.

According to the POS terminal 20 according to the present embodiment, the status of the POS terminal 20 can be accurately notified without providing a notification unit 207. In addition, while providing an area for notifying the status, the visibility of the operation screen and the display screen for the captured image is ensured.

In the above description of this embodiment, the status displayed in the third display area G3 of the POS terminal 20 is just one example, and different types of display can be displayed in the third display area depending on the various statuses described in the first embodiment.

In addition, when a product that requires age verification, such as alcoholic beverages, is registered, the status information may be not only displayed on the POS terminal 20 but also transmitted to the transaction status management device 11, etc., if necessary. The information obtained from the transaction status management device 11 can be output to a specified monitor, etc., allowing store staff to grasp the status of each POS terminal 20 in real time and perform remote operation according to the status.

In the above embodiment of the present invention, the POS terminal 20 has been described as operating in a face-to-face self-service mode, a self-checkout mode, or a full self-service mode. However, the present invention can also be applied to a POS terminal that operates in a so-called normal mode, in which the process from product registration to checkout is completed solely by the operation of the store clerk. That is, in this case too, the screen of the POS terminal can be configured with the two display areas, the first display area G1 and the second combined display area G2, or with three display areas, the first display area G1, the second display area G2, and the third display area G3. In addition, each display area can display, for example, a product registration screen in the first display area G1, the change status in the second display area G2, and the status in the third display area G3.

The computer program that realizes the functions constituting the POS system 1 or POS terminal 20 according to the above-described embodiment of the present invention can be provided by downloading via a network such as the Internet, or by recording it on various computer-readable recording media such as a CD-ROM.

Furthermore, these software resources can be distributed or consolidated into any of the hardware resources through appropriate design, and the hardware resources can also be configured as a physically integrated device or as separate devices.
Summary of the implementation form

The present invention relates to a technology that makes it easy to view captured images on the operation screen of a POS terminal.

Conventionally, in stores such as supermarkets, POS (Point Of Sales) registers are used to register products purchased by customers and to settle the bill. Self-service registers, where customers perform the settlement operation, are becoming more and more common. In self-service registers, customers operate the POS register themselves, so there is a risk of fraud by customers. For this reason, various measures against fraudulent activities are being taken.
For example, Japanese Patent Application Laid-Open No. 2017-187821 discloses a system that notifies errors or fraud using a sign light or the like.

On the other hand, in recent years, POS register displays have become larger, and when displaying information on the screen, consideration must be given to ease of use and visibility. More specifically, portrait displays are becoming more common, but because the aspect ratios differ, screen layouts must be tailored to suit those ratios.

Therefore, one of the objectives of the present invention is to provide a device capable of displaying a screen that is both easy to use and easy to see.

To achieve the above object, a product sales data processing device according to one aspect of the present invention has an imaging means for imaging an operation status of an operator, and a display means for displaying predetermined information, and the display means has a first display area for displaying an operation screen for accepting operations by the operator, and a second display area for displaying an image captured by the imaging means.

The display means may display an image captured by the imaging means in the second display area in response to the start of an operation on the operation screen.

The device may further include a detection means for detecting the operator, and the display means may display an image captured by the imaging means in the second display area in response to detection of the operator.

The display means may be configured to provide the second display area above the first display area.

The device may further include a registration means for registering a product, and the display means may display an image of the operation status of the registration operation in the second display area while the registration operation is being performed by the registration means, and the second display area may be located approximately in the middle in the vertical direction.

The device may further include a deposit/withdrawal unit that executes deposits and withdrawals of cash, and the display means may display an image of the cash deposit/withdrawal operation status in the second area while the cash is being deposited or withdrawn in the deposit/withdrawal unit, and the second display area may be provided approximately in the middle.

The display means may include a third display area for notifying the status of the device, the third display area being provided above the second display area.

A settlement device according to another aspect of the present invention has an imaging means for imaging the operation status of an operator and a display means for displaying predetermined information, and the display means has a first display area for displaying an operation screen for accepting operations, and a second display area for displaying the image captured by the imaging means.

A computer program according to another aspect of the present invention causes a computer to execute an imaging process for imaging an operation status of an operator and a display process for displaying predetermined information, and the display process displays a first display area for displaying an operation screen for accepting operations by the operator, and a second display area for displaying an image captured by the imaging means.

According to the above-described product sales data processing device of the embodiment of the present invention, a screen display that combines operability and visibility is possible. In particular, since the customer can clearly see the captured image of the operation status while performing the operation, it is possible to effectively prevent fraud.
In addition, the captured image to be displayed can be switched or rewound or played back in accordance with the operation, so that the customer can perform the operation while checking his/her own operation.
Furthermore, by providing a third display area to display the status, the status of the product sales data processing device can be accurately notified without providing a separate notification unit such as a sign lamp, etc. Furthermore, even when a status notification area is provided, the visibility of the operation screen and the display screen for captured images is ensured.

1: POS system 10: store controller 11: transaction status management device 20: POS terminal 201: CPU
202: ROM
203: RAM
204: Hard disk 205: Customer display unit 206: Customer scanner unit 207: Notification unit 208: Card payment unit 209: Change machine 210: Clerk display unit 211: Key operation unit 212: Clerk scanner unit 213: Printing unit 214: Audio output unit 215: Communication unit 216: Camera G1: First display area G2: Second display area G3: Third display area

Claims (3)

An imaging means for imaging an operating state of an operator ;
A display means for displaying predetermined information ;
A deposit/withdrawal unit for depositing and withdrawing cash ,
the display means includes a first display area that displays an operation screen for receiving an operation by the operator, and a second display area that displays an image captured by the imaging means,
During the depositing or withdrawing of the cash in the depositing or withdrawing unit, an image capturing an operation status of the depositing or withdrawing of the cash is displayed in the second display area, and the second display area is provided in a substantially central area.
Product sales data processing device. the display means includes a third display area for notifying a status of the device itself, the third display area being provided above the second display area;
2. The product sales data processing device according to claim 1. A computer having a deposit/withdrawal unit for depositing and withdrawing cash ,
An imaging process for imaging an operation status of an operator ;
A display process for displaying predetermined information is executed ;
In the display process, a first display area is displayed to display an operation screen for receiving an operation by the operator, and a second display area is displayed to display an image captured by the imaging process.
During the depositing or withdrawing of the cash in the depositing or withdrawing unit, an image capturing an operation status of the depositing or withdrawing of the cash is displayed in the second display area, and the second display area is provided in a substantially central area.
Computer program.

Images