JP7614630B2 - Self-checkout system - Google Patents

Description

The present invention relates to a self-checkout system that allows customers to pay for the products they purchase themselves.

Self-checkout systems equipped with a scanner that allows customers to scan product information to pay for the products they purchase have been known for some time.

For example, Patent Document 1 describes the following self-checkout system invention. In the self-checkout system described in Patent Document 1, at least one of the POS (Point Of Sale) terminals is a self-checkout terminal that can be switched to a self-checkout mode that can be operated by the customer themselves, and is equipped with a product sales registration processing unit that automatically reads and registers product information of purchased products based on the customer's operation when the self-checkout terminal is switched to the self-checkout mode, and a payment processing unit that processes the payment for purchased products and the issuance of receipts based on the customer's operation. A surveillance camera is installed near the self-checkout terminal to check and monitor the reading of product information and payment processing operations by customers using the self-checkout terminal.

JP 2001-76261 A

The invention described in Patent Document 1 is configured so that it can be switched in advance between a mode operated by a store clerk and a self-checkout mode, and does not anticipate converting conventional POS registers operated by store clerks into self-checkouts. As a result, when introducing new self-checkouts to a store or other facility, the equipment needs to be replaced, increasing the introduction costs and causing the old equipment to go to waste. Furthermore, conventional POS registers are developed for each store and applicable system, so when converting to self-checkouts, they need to be developed specifically for each store.

The present invention aims to solve the problems described above, and aims to provide a self-checkout system that can reuse conventional POS registers and is easily compatible with multiple types of devices.

The invention described in claim 1, which has been made to solve the above problem, is a self-checkout system that includes a first processing unit that executes processing related to the settlement of purchased products and generates a first image having a plurality of first button images each assigned with a function related to the settlement, a second processing unit that has at least one second button image corresponding to the first button image, generates a second image that is operated by a customer and is a simpler image than the first image, and an image display unit that displays the second image, and the second button image is associated with the corresponding first button image.

As described above, according to the present invention, the second image operated by the customer is displayed, so that the customer does not directly operate the first image, which is the operation image of a conventional POS register, and conventional POS registers can be made into self-checkout registers. Also, since only the first button image that the customer needs to operate needs to be associated with the second button image, the customer can operate on a simple screen, reducing operational errors. Furthermore, by preparing one type of second image, it can be applied to multiple types of first images (POS registers), making it easy to support multiple models.

1 is an external perspective view of a self-checkout system according to an embodiment of the present invention; FIG. 2 is a functional configuration diagram of the self-checkout system shown in FIG. 1 . FIG. 13 is an explanatory diagram of the relationship between the store clerk screen and the self-checkout screen. FIG. 2 is an explanatory diagram of a hierarchical structure of a skin application, a POS application, hardware, etc.; 2 is a first example of the operation of the self-checkout system shown in FIG. 1 . 2 is a second example of the operation of the self-checkout system shown in FIG. 1 . 3 is a third example of the operation of the self-checkout system shown in FIG. 1 .

The self-checkout system according to one embodiment of the present invention will be described with reference to Figs. 1 to 7. Fig. 1 is an external perspective view of the self-checkout system 1 according to one embodiment of the present invention.

The self-checkout system 1 includes a register device 2, a housing 3, a scanner 4, and a support 5.

The cash register 2 comprises a main body 21 and a display 22. The cash register 2 functions as a cash register with POS functionality by means of a POS application 213a (described later). The main body 21 performs the overall settlement process for product purchases. The main body 21 also communicates with the housing 3, and receives input of product information, amount of money inserted, and the like. Based on the results of operation of the display 22, the main body 21 also issues instructions to the automatic change dispenser 34 (described later) of the housing 3 to dispense change, etc.

The main body 21 also includes a receipt printer 23 (see FIG. 2). The receipt printer 23 prints receipts that include information such as the name of the purchased product, the unit price of the product, the deposit amount, and the amount of change.

On the display unit 22, various operation screens (self-checkout screen 222 described below) for the customer to pay for the products they have purchased are displayed. This self-checkout screen 222 functions as a second image as described below, and the display unit 22 functions as an image display unit. The display unit 22 is composed of, for example, an LCD display, but does not have touch panel functionality. This is because it has a function that replaces a touch panel using a motion sensor 52 as described below. Note that the display unit 22 may also be a touch panel, in which case the functions described below can be omitted.

The housing 3 has a cash register 2 installed on its top surface. Similarly, a scanner 4 and a support 5 are also installed on the top surface. The housing 3 is equipped with an automatic change dispenser 34 (see also FIG. 2) consisting of a coin handling device 34a and a bill handling device 34b. The housing 3 also has a bill insertion slot, a bill withdrawal slot, a coin insertion slot, a coin return slot, a coin withdrawal slot, etc. on the exterior, which serves as the customer's operation surface.

The housing 3 also includes a processing device 31 (see also FIG. 2) that is, for example, a small PC (Personal Computer). The processing device 31 identifies the gender and age of the customer from a face image captured by a face recognition camera 51 using a known method. The processing device 31 also identifies which position on the display unit 22 the fingertip is pointing to based on the position and movement direction of the fingertip detected by a motion sensor 52. The position of the fingertip may be identified using a known method. The processing device 31 is also connected to a microphone 32 and a speaker 33 (see also FIG. 2), and outputs necessary sounds during a series of processes from product input to payment. For example, in this embodiment, it outputs audio guidance to encourage smooth product input, and outputs a warning sound if there is any fraud, such as a product not being input.

The microphone 32 and the speaker 33 are provided in positions where the voice of the user of the housing 3 can be easily picked up and where the user can easily hear. The microphone 32 and the speaker 33 are also used to provide audio guidance based on the results of fingertip position identification by the motion sensor 52 and the results of face recognition by the face recognition camera 51.

Scanner 4 reads the barcode attached to the product by irradiating the product with a laser scanning line or by using a CCD (Charge Coupled Device) scanner or the like. Scanner 4 can also scan any card with a barcode attached, such as a membership card or point card.

The support pole 5 extends upward from the top surface of the housing 3 and bends diagonally upward toward the customer. The support pole 5 is provided with a face recognition camera 51 in the middle and a motion sensor 52 at the tip.

The face recognition camera 51 is a camera for recognizing the gender and age of a customer, and is a camera module having a CCD image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.

The motion sensor 52 detects the shape and movement direction of the customer's fingers. In this embodiment, the motion sensor 52 is configured with a camera.

Then, in the register device 2, the CPU 211 (see FIG. 2) described later determines which of the button images displayed on the display unit 22 has been operated based on the processing result of the processing device 31. Then, based on the determination result, the skin application 213b and the POS application 213a described later are operated.

In addition, in this embodiment, when it is determined that the fingertip has come within, for example, 3 cm of the surface of the display unit 22 based on the position of the fingertip identified by the processing device 31, the CPU 211 displays a mark at the position on the display unit 22 where the fingertip is estimated to be pointing. Then, when it is determined that the fingertip has come within, for example, 1 cm of the surface of the display unit 22, the CPU 211 determines that the button at that position has been pressed (operated). These distance and other determinations can be made based on the results of motion detection.

That is, when the fingertip approaches within 3 cm (within a second distance that is longer than the first distance) of the surface of the display unit 22 (image display unit), the CPU 211 (determination unit) displays a mark at a position on the display unit 22 (image display unit) where the fingertip is estimated to be pointing. Also, when the fingertip approaches within 1 cm (first distance) of the surface of the display unit 22 (image display unit), the CPU 211 (determination unit) determines that the second button image has been operated.

Figure 2 shows the functional configuration of the self-checkout system 1 configured as described above. As shown in Figure 2, the self-checkout system 1 includes a CPU 211, a RAM 212, a HDD 213, a communication interface 214, a graphics processing unit 215, an input/output interface 216, a display unit 22, a receipt printer 23, a scanner 4, a processing unit 31, a microphone 32, a speaker 33, and an automatic change dispenser 34.

The above-mentioned CPU 211, RAM 212, HDD 213, communication interface 214, graphics processing unit 215, and input/output interface 216 are built into the main body 21, and each block is connected to each other via a bus 217.

The CPU 211 reads an application program for processing the settlement of products stored in the HDD 213 or the like via the bus 217, temporarily stores the read program in the RAM 212, and executes the program. Specifically, it reads the POS application 213a and the skin application 213b stored in the HDD 213 and executes each of them.

The RAM 212 temporarily stores a portion of the OS (Operating System) program and application programs to be executed by the CPU 211. The RAM 212 also stores various data necessary for processing by the CPU 211. The HDD 213 stores the above-mentioned POS application 213a and skin application 213b, etc.

The communication interface 214 transmits and receives data to and from the outside, and may use a connection format such as a local area network (LAN). In this embodiment, the communication interface 214 communicates with a system that manages the self-checkout system 1 in the store and with an external server device.

The graphics processing device 215 converts the clerk screen (first image) and the self-checkout screen (second image) into image signals and outputs them to the display unit 22 in accordance with instructions from the CPU 211.

The input/output interface 216 is connected to the scanner 4, receipt printer 23, processing device 31, and automatic change machine 34.

Next, the hierarchical structure of the skin app 213b, POS app 213a, hardware, etc. in this embodiment will be described with reference to FIG. 3. As shown in FIG. 3, hardware such as the main body 21, receipt printer 23, and automatic change dispenser 34 operate based on an OS program. POS app 213a runs on the OS program. POS app 213a is an application program for a conventional cash register operated by a store clerk. Skin app 213b runs on top of POS app 213a.

The skin application 213b is an application program that mainly realizes the GUI (Graphical User Interface) related to the self-checkout function. In other words, the skin application 213b changes the appearance of the GUI of the POS application 213a to self-checkout specifications. The skin application 213b also controls the control device 31 and also controls GUI switching and the like based on the processing results of the control device 31. In this embodiment, the POS application 213a itself is not modified to realize the self-checkout function, but is configured as a separate program.

In this embodiment, the POS application 213a operates as before, and the store clerk screen 221 (see FIG. 4) is generated as image data and stored in memory, etc., although it is not displayed on the display unit 22. The skin application 213b transitions the screen based on changes in the store clerk screen 221 generated by the POS application 213a, as described below.

As shown in FIG. 3, in this embodiment, the hardware and the OS, and the OS and the POS application 213a are tightly coupled. In other words, they are closely linked to each other. On the other hand, the POS application 213a and the skin application 213b are loosely coupled. In other words, they are only weakly linked to each other. Therefore, even if the POS application 213a is changed, the skin application 213b does not need to be changed or can be changed to a minimum. In addition, functions executed by the processing device 31, such as motion detection, face recognition, and voice guidance, are tightly coupled to the skin application 31a.

Next, the relationship between the clerk screen and the self-checkout screen in this embodiment will be described with reference to FIG. 4. In FIG. 4, reference numeral 221 is an example of a clerk screen, and reference numeral 222 is an example of a self-checkout screen.

The store clerk screen 221 has a product/price etc. display section 221a and an operation button display area 221b. The product/price etc. display section 221a displays the name and unit price of the product whose barcode has been scanned by the scanner 4, as well as the current total amount. In other words, the product/price etc. display section 221a corresponds to a product information display area in which information about the purchased product is displayed. The operation button display area 221b has multiple button images for inputting the type of product and the payment method (cash, credit card, electronic money, etc.).

The self-checkout screen 222 has a product/price etc. display section 222a and operation buttons 222b, 222c. The product/price etc. display section 222a is a cut-out of the product/price etc. display section 221a of the clerk screen 221. In other words, the product/price etc. display section 222a is not reconstructed by the skin app 213b that generates the self-checkout screen 222 by obtaining the product name and price information contained in the product/price etc. display section 221a from the POS app 213a, but is a cut-out of the product/price etc. display section 221a from the image of the clerk screen 221 by the skin app 213b and embedded in the self-checkout screen 222. It is not necessary to cut out the entire product/price etc. display section 221a, but only the necessary parts such as the product name and price can be cut out.

Operation buttons 222b and 222c display button images of functions required in the series of processes from product input to payment, such as selecting a payment method, "Next," and "Checkout." Operation buttons 222b and 222c display only the minimum necessary button images, so there are fewer button images than on the store clerk screen 221. Therefore, the self-checkout screen 222 has a simpler screen configuration than the store clerk screen 221.

In addition, since operation button 222b corresponds to button 221b1, operation button 222b is associated with button 221b1 on the clerk screen 221. Since operation button 222c corresponds to button 221b2, operation button 222c is associated with button 221b2 on the clerk screen 221.

Being associated means that there is a link so that when operation button 222b is operated, button 221b1 is operated. This does not mean that when operation button 222b is pressed, the function corresponding to button 221b1 runs on POS application 213a, but rather that when operation button 222b is pressed, button 221b1 is pressed. In other words, the skin application 213b does not know anything about the functions of POS application 213a, but simply communicates that a button on the clerk screen 221 is to be pressed. This is equivalent to the processing device 3 simulating the operation of an input means such as a keyboard or mouse based on the results of motion detection or face recognition, etc., to the register device 2.

The skin app 213b also detects changes in the clerk screen 221 and changes the self-checkout screen 222. For example, if an additional product is scanned and the product/price etc. display section 221a changes, when this change is detected, the product/price etc. display section 221a is cut out again and reflected in the self-checkout screen 222. This can be done, for example, by setting in advance the coordinate range of the product/price etc. display section 221a in the image that becomes the clerk screen 221, and detecting any changes over time in this coordinate range. In other words, the skin app 213b monitors changes in a predetermined area of the clerk screen 221 (first image).

As a method of detecting a change in the store clerk screen 221, for example, if the name of the screen (such as the product input screen or membership card input screen described below) is displayed in the upper left corner of the store clerk screen 221, a change in the name may be detected. As with the above, it is sufficient to detect a change over time in the coordinate range of the portion where the name is displayed.

As explained above, the clerk screen 221 is a first image having multiple first button images each assigned with a function related to the checkout of the purchased item, and the POS app 213a which generates the clerk screen 221 and executes the process related to the checkout of the purchased item functions as a first processing unit. The self-checkout screen 222 is a second image which has at least one second button image corresponding to the first button image, is operated by the customer, and is a simpler image than the first image, and the skin app 213b which generates the self-checkout screen 222 functions as a second processing unit.

Next, an example of the operation of the self-checkout system 1 configured as described above will be described with reference to Figs. 5 to 7. Figs. 5 to 7 show the transition between the self-checkout screen 222 and the store clerk screen 221 when purchasing a product. In Figs. 5 to 7, the left column shows the self-checkout screen 222, and the right column shows the store clerk screen 221, and screens arranged in the same row correspond to each other.

First, when the self-checkout system 1 is started, the POS application 213a and the skin application 213b are started, and the start screen S1 is displayed on the display unit 22 as the self-checkout screen 222 by the skin application 213b. Meanwhile, the product input screen T2-1 is generated as the clerk screen 221 generated by the POS application 213a at this time, and is stored in the memory or the like as described above. Note that at the time of start-up, the clerk screen 221 is displayed, and the self-checkout screen 222 may be displayed by operating the switching button image. In this way, it becomes possible to switch between a conventional POS register and a self-checkout as necessary.

Next, when the customer scans the barcode of a product with the scanner 4 while the start screen S1 is displayed, the POS application 213a receives the scanned information and transitions the store clerk screen 221 to the product input screen T2-2. The product input screen T2-2 includes the product name and price of the scanned product. Meanwhile, the skin application 213b detects the transition (change) of the store clerk screen 221 and transitions the self-checkout screen 222 to the product input screen S2. As explained in FIG. 4, the product input screen S2 displays the product name and price columns cut out from the product input screen T2-2.

Next, the customer operates the "Next" button on the product input screen S2. The "Next" button is associated with the "Read member's card" button on the product input screen T2-2, and when the "Next" button is operated, the "Read member's card" button is operated and the clerk screen 221 transitions to the member's card input screen T3. Meanwhile, the skin app 213b detects the transition (change) of the clerk screen 221 and transitions the self-checkout screen 222 to the member's card input screen S3.

Next, when the customer scans the membership card with the scanner 4 while the membership card input screen S3 is displayed, the POS application 213a receives the scanned information and transitions the clerk screen 221 to the sub-screen T4 (Figure 6). Note that if the customer operates the "Proceed to payment without scanning" button without scanning the membership card, the POS application 213a also transitions the clerk screen 221 to the sub-screen T4. Meanwhile, the skin application 213b detects the transition (change) of the clerk screen 221 and transitions the self-checkout screen 222 to the payment method selection screen S4 (Figure 6).

Next, the customer selects "Cash" on the payment method selection screen S4. The "Cash" button is associated with the "Current Total" button on the sub-screen T4, and when the "Cash" button is operated, the "Current Total" button is operated and the clerk screen 221 transitions to the automatic change machine deposit screen T4-G1. Meanwhile, the skin app 213b detects the transition (change) of the clerk screen 221 and transitions the self-checkout screen 222 to the automatic change machine deposit screen S4-G1.

Next, when the customer inserts banknotes or coins from the banknote handling device 34b or coin handling device 34a of the housing 3 on the automatic change machine deposit screen S4-G1, the POS application 213a receives information on the amount inserted and reflects it on the automatic change machine deposit screen T4-G1. The automatic change machine deposit screen after reflection is designated as T4-G2. Meanwhile, the skin application 213b detects the change in the automatic change machine deposit screen T4-G1 (automatic change machine deposit screen T4-G2) and reflects it in the amount on the automatic change machine deposit screen S4-G1 of the self-checkout screen 222. The automatic change machine deposit screen after reflection is designated as S4-G2.

Next, the customer finishes inserting cash and operates the "Settlement" button on the automatic change machine deposit screen S4-G2. The "Settlement" button is associated with the "Confirm" button on the automatic change machine deposit screen T4-G2, and when the "Settlement" button is operated, the "Confirm" button is operated and the store clerk screen 221 transitions to the actual transaction screen T5-G (FIG. 7). The POS application 213a then causes the automatic change machine 34 in the housing 3 to dispense the change, and prints and outputs a receipt from the receipt printer 23. Meanwhile, the skin application 213b detects that the store clerk screen 221 has transitioned to the actual transaction screen T5-G, and transitions the self-checkout screen 222 to the completion screen S5-G (FIG. 7). The customer receives the change and receipt along with the product, and the purchase is complete.

According to the present embodiment described above, the self-checkout system 1 is equipped with a POS application 213a that executes processing related to the settlement of purchased items and generates a clerk screen 221 having buttons 221b1 and 221b2 to which functions related to the settlement are respectively assigned. The self-checkout system 1 is equipped with a skin application 213b that generates a self-checkout screen 222 that is operated by a customer and has a simpler image than the clerk screen 221, and that has an operation button 222b corresponding to button 221b1 and an operation button 222c corresponding to button 221b2. The self-checkout system 1 is equipped with a display unit 22 that displays the self-checkout screen 222. The button 221b1 is associated with the operation button 222b, and the button 221b2 is associated with the operation button 222c.

By configuring the self-checkout system 1 as described above, the self-checkout screen 222 operated by the customer is displayed, so that the customer does not have to directly operate the clerk screen 221, which is the operation image of a conventional POS register, and thus conventional POS registers can be made into self-checkouts. Also, since it is necessary to associate only the buttons that the customer needs to operate, the customer can operate on a simple screen, reducing operational errors. Furthermore, by preparing one type of self-checkout screen 222, it can be applied to multiple types of clerk screens 221 (POS apps 213a), making it easy to support multiple models.

In addition, the skin app 213b changes the display content of the self-checkout screen 222 based on changes in the store clerk screen 221, making it possible to simplify the screen transition process.

The clerk screen 221 also has a product/price etc. display section 221a that displays information about the purchased product, and when the product/price etc. display section 221a changes, the skin app 213b includes the changed product/price etc. display section 221a in the self-checkout screen 222. This eliminates the need for the skin app 213b to obtain and reconstruct information about the product name and price included in the product/price etc. display section 221a, simplifying the processing in the skin app 213b.

The skin app 213b also monitors changes in predetermined areas of the store clerk screen 221, such as the product/price display area 221a. This makes it possible to narrow down the areas to be monitored, and reduce the processing load required to detect changes.

The self-checkout system 1 also includes a motion sensor 52 that detects the position of the fingers operating the display unit 22, and a CPU 211 that determines the operation of the operation buttons 222b, 222c based on the detection result of the motion sensor 52. In this way, it is possible to achieve the same functionality as a touch panel without requiring a touch panel. Therefore, even a POS register that does not have a touch panel can be made into a self-checkout without the need for hardware modifications.

The CPU 211 also determines whether the second button image has been operated when the fingertip approaches, for example, within 1 cm of the surface of the display unit 22, so it can determine whether an operation has been performed immediately before the finger touches the screen. It also provides the same operational feel as a touch panel.

In addition, when a fingertip approaches, for example, within 3 cm of the surface of the display unit 22, the CPU 211 displays a mark at the position on the display unit 22 where the fingertip is estimated to be pointing, thereby showing the user where the finger is about to point.

Furthermore, the present invention is not limited to the above-described embodiment. In other words, a person skilled in the art can implement various modifications according to conventional knowledge without departing from the gist of the present invention. As long as such modifications still have the configuration of the self-checkout system of the present invention, they are of course included in the scope of the present invention.

REFERENCE SIGNS LIST 1 Self-checkout system 2 Register device 3 Housing 4 Scanner 21 Main end 22 Display unit (image display unit)
31 Processing device (detection unit)
51 Face recognition camera 52 Motion sensor (detection unit)
211 CPU (judgment unit)
213a POS application (first processing unit)
213b Skin application (second processing unit)
221 Clerk screen (first image)
221a Product/amount display area (product information display area)
221b1 button (first button image)
221b2 Button (first button image)
222 Self-checkout screen (second image)
222b Operation button (second button image)
222c Operation button (second button image)

Claims (7)

a first processing unit that executes a process related to payment for a product to be purchased and generates a first image having a plurality of first button images each assigned with a function related to the payment;
a second processing unit that has at least one second button image corresponding to the first button image, is operated by a customer, and generates a second image that is simpler than the first image;
an image display unit that displays the second image,
The second button image is associated with a corresponding one of the first button images.
The self-checkout system is characterized by the following: The self-checkout system according to claim 1 , wherein the second processing unit changes the display content of the second image based on a change in the first image based on an operation by the customer . The self-checkout system according to claim 2, characterized in that the second processing unit monitors changes in a predetermined area of the first image. the first image has a product information display area in which information about a purchased product is displayed;
The self-checkout system according to claim 3, characterized in that, when the product information display area changes, the second processing unit cuts out at least a portion of the changed product information display area and includes it in the second image. A detection unit that detects a position of a fingertip that operates the image display unit;
a determination unit that determines an operation of the second button image based on a detection result of the detection unit;
The self-checkout system according to any one of claims 1 to 4, further comprising: The self-checkout system according to claim 5, characterized in that the determination unit determines that the second button image has been operated when the fingertip approaches within a first distance from the surface of the image display unit. The self-checkout system according to claim 6, characterized in that the determination unit displays a mark at a position on the image display unit where the fingertip is presumed to be pointing when the fingertip approaches within a second distance, which is longer than the first distance, from the surface of the image display unit.

Images