JP7660622B2 - Method and Apparatus for Recycling Electronic Devices - Patent application - Google Patents

Description

The present invention relates generally to recycling of electronic devices. More specifically, the present invention relates to a kiosk for visually analyzing an electronic device and providing compensation to the owner for recycling the electronic device.

The number of electronic devices used by a typical consumer has increased significantly. These devices include, but are not limited to, cell phones, PDAs, mp3 players, GPS devices, cameras, pagers, remote controls, cordless phones, calculators, and the like. As new technologies and models of electronic devices are continually being introduced, many consumers frequently upgrade or replace one or more recyclable devices. In many cases, rather than disposing of an existing electronic device, consumers will discontinue use of the existing electronic device and begin using a new device. This situation may occur over several generations of such devices.

In addition to the electronic devices mentioned above, there are many other types of devices that are replaced relatively frequently, such as portable mobile electronic devices (e.g., cell phones, MP3 players) and non-portable electronic devices (e.g., computers, printers). In addition to electronic devices, there is content-based digital media, such as games or entertainment mass storage items on CDs, DVDs, or cartridges (e.g., CDs, DVDs, Blu-ray). Such items need to be handled in an environmentally friendly manner, using recycling and/or proper disposal procedures. It would be convenient for electronic device owners to be able to recycle such devices or to properly dispose of such devices. There is currently little incentive for device owners to "do the right thing" with used devices. If the owner simply puts the device away when it is no longer in use, the opportunity for recycling or reuse by another party is lost. If the owner simply tosses the device in a regular trash bin, proper recycling or disposal of the device is hindered.

One particular problem associated with this phenomenon can be illustrated with the example of mobile phones. The number of mobile phone users in the world is over 3.6 billion, with an annual growth rate of 10%. Mobile handsets are replaced approximately every 18 months as new models are equipped with new features and new standards are rolled out. Wireless carriers also offer new phones below cost or for free as an incentive to consumers to sign up for lucrative two-year service contracts, resulting in an accumulation of old mobile phones. Old mobile phones and other mobile devices (pagers, PDAs) are now a threat to the environment. As of 2007, there were over 7.5 billion mobile phones waiting to be recycled in the United States, either in drawers or in the waste stream. In addition, an additional 150 million mobile phones are added to the recycling queue each year. Once these devices are in the waste stream, they can leak lead, mercury, cadmium, arsenic, and other toxic substances into the water supply. In municipalities, waste is often incinerated, which quickly releases these toxic substances into the air and back into the Earth's rainwater. A problem that needs to be solved is to allow the general public easy access to recycle or resell their cell phones and other recyclable devices. Two reasons why cell phones are not recycled or resold are the difficulty in accessing recycling or resale facilities and also security concerns about the information stored on cell phones. In addition to cell phones, many other electronic devices have similar problems.

The prior art fails to recognize the problems associated with recycling mobile phones in a manner that is both attractive to consumers and financially rewarding to recyclers. Further, the prior art fails to provide an automated means for visually inspecting the LCD screen of a mobile phone to determine if damage has occurred to the LCD screen. Further, the prior art fails to provide an automated means for determining the authenticity of electronic devices submitted for recycling and compensation.

The present invention allows for the recycling, donation, trade-in and/or sale of mobile phones in a secure, publicly accessible location. In a mobile phone recycling embodiment, the present invention is used by mobile phone owners to submit their mobile phones for recycling via a recycling kiosk and receive compensation in some manner. Compensation may be distributed via cash, vouchers, credit or debit cards or other magnetic or electronic transaction methods.

In one embodiment, a method for collecting used electronic devices for recycling and refurbishing purposes employs a kiosk located at a publicly accessible location. The kiosk displays one or more transaction options. The method further includes interaction between a user and the kiosk-displayed options. The kiosk-displayed options may include powering the electronic device, testing and optical scanning, erasing stored data in the electronic device, and determining and accepting by the consumer a consideration for the value of the electronic device. The method may further include the consumer selecting, through interaction with the kiosk, various methods of consideration (e.g., dispensing cash or a redeemable discount voucher via a coupon, or debiting or crediting a credit card, making an electronic donation to a user-specified charity or charities, or other electronic payment methods).

One aspect of the invention is a method of valuing an electronic device and monetary compensation to a user for submission of the electronic device. The method includes placing the electronic device in an inspection area of a kiosk. The inspection area has a light. The method further includes imaging a display screen of the electronic device in a deactivated mode. Then, the method includes imaging a display screen of the electronic device in an activated mode. The light is turned off and an analysis image of the electronic device is generated. The method further includes imaging a display screen of the electronic device in an activated mode. The light is turned on and a first image of the electronic device is generated. Then, the method includes subtracting the first image of the electronic device from the analysis image of the electronic device to generate a subtraction image of the electronic device. The subtraction image is compared to the image of the electronic device in the deactivated mode to determine if the display screen of the electronic device is defective and define an analyzed electronic device. Finally, the method includes determining a value of the analyzed electronic device. The method may also include automatically binning the electronic device after determining the value of the analyzed electronic device.

The kiosk of the method includes a housing. The housing includes a user interface on an exterior surface of the housing for input of information by a user and includes an upper dome and a lower dome. The upper dome and the lower dome include a plurality of mirrors. The kiosk further includes an upper chamber camera, a lower chamber camera, and a transparent surface. The kiosk further includes a processor. The processor is disposed within the housing and in communication with the at least one camera. The processor is configured to identify a brand and model number of the electronic device based on at least one of the information from the user and an image from the at least one camera. The processor is configured to determine a value of a monetary consideration for the electronic device.

Another aspect of the invention is a method of analyzing an electronic device and monetary compensation to a user for submission of the electronic device. The method includes placing the electronic device within an inspection area of a kiosk. The inspection area has a camera. The method further includes imaging a portion of the electronic device, the portion including a periphery of the electronic device, resulting in a periphery image. The method further includes inspecting the periphery image of the electronic device obtained by at least one camera located within the inspection area to determine if a display screen of the electronic device is defective and defining an analyzed electronic device. Finally, the method includes determining a value of the analyzed electronic device.

The kiosk of the method includes a housing, a user interface provided on an exterior surface of the housing for inputting information by a user, and an upper dome and a lower dome. The upper dome and the lower dome include a plurality of mirrors. The kiosk further includes an upper chamber camera, a lower chamber camera, and a transparent surface. The kiosk also includes a processor. The processor is provided within the housing and in communication with the at least one camera, the processor configured to identify a brand and model number of the electronic device based on at least one of the information from the user and an image from the at least one camera. The processor is configured to determine a value of a monetary consideration for the electronic device.

In the method, the information from the peripheral image further includes a model name and a location of the LED aperture. The processor is further configured to automatically adjust the peripheral image to a rectangular shape. The peripheral image includes a 360 degree image. The information from the peripheral image includes a location of a USB port, a location of a volume control button, a location of a camera button, and a location of a power on/off button. The information from the peripheral image also includes a location of a camera lens and a logo of the electronic device.

Yet another aspect of the present invention is a method for analysis of an electronic device and monetary compensation to a user for submitting the electronic device. The method includes placing the electronic device in an inspection area of a kiosk. The inspection area has a light. The method further includes imaging the display screen of the electronic device with the light of the inspection area illuminating the display screen of the electronic device. The method then includes imaging the display screen of the electronic device with the light of the inspection area turned off to generate an analysis image of the electronic device. The method then includes subtracting the analysis image of the electronic device from a first image of the electronic device to generate a composite image of the electronic device. The subtraction image is compared to a training image of the electronic device. If the electronic device is found to be fake by a photo printed on a cardboard under the glass where the LCD is normally located, there is no electronic component in the electronic device. If the light is off, there is no light coming from the screen. By performing some processing on the first image and detecting that the first image has multiple colors and color changes on the display screen area but no emission from the first image, the method assumes that the electronic device is fake. The method also explicitly trains the fake display electronic device since the fake display electronic device will usually have the same picture in the LCD area. Finally, the method includes determining a value for the analyzed electronic device. The method may also include automatically binning the electronic device after determining the value for the analyzed electronic device.

The method also determines crack detection on a display screen. Crack detection relates to detecting if there are multiple color variations in an electronic device. If the method determines that the actual crack in the glass is not available in the imaging because it is confused with a photograph of the underside of the glass, some kind of color entropy metric helps distinguish one crack from another (cracks in glass do not produce multiple different colors).

Yet another aspect of the invention is a method for determining authenticity of an electronic device by analysis of the electronic device and providing a monetary reward to a user for submitting the electronic device if the electronic device is authentic. The method includes placing the electronic device in an inspection area of a kiosk. The inspection area has a light. The method also includes imaging the electronic device. The light of the inspection area is turned on to generate a first image. The method also includes imaging the electronic device. When the light of the inspection area is turned off, a second image of the electronic device is generated. The method also includes generating a composite image of the electronic device from the first image and the second image. The composite image is generated to resemble an image of the electronic device when the display screen is off. The method also includes comparing the composite image to training images of a plurality of electronic devices to determine authenticity of the electronic device. The training images include display screens used by fraudulent electronic devices.

The method may further include detecting cracks in the display screen. A color entropy metric may also be used in the method.

Yet another aspect of the present invention is a dome-shaped device. The dome-shaped device includes an upper dome and a lower dome. The upper and lower domes include a plurality of walls. The plurality of walls are constituted by mirrors. The dome-shaped device further includes a transparent surface and at least one camera. The camera is capable of obtaining a 360 degree view of an electronic device disposed within the dome-shaped device. The upper dome preferably includes an upper chamber camera. The lower dome preferably includes a lower chamber camera. Preferably, the upper dome and lower dome cameras, respectively, in combination with the plurality of mirrors, obtain an image of the device disposed on the transparent surface. Preferably, the upper dome and lower dome cameras, respectively, in combination with the plurality of mirrors, obtain a 360 degree view of the electronic device disposed on the transparent surface. Each of the upper dome and lower dome cameras is movable.
The present invention provides, for example, the following:
(Item 1)
1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising:
placing an electronic device within an inspection area of a kiosk, the inspection area having a light source;
imaging the electronic device to generate a first image, the light source in the inspection area being on; and
imaging the electronic device to generate an analysis image of the electronic device, the light in the inspection area being off;
subtracting the analysis image of the electronic device from the first image of the electronic device to generate a composite image of the electronic device;
comparing the composite image of the electronic device to a plurality of training images of electronic devices to identify the electronic device and determine whether the electronic device is defective to define an analyzed electronic device;
determining a value of the analyzed electronic device;
A method comprising:
(Item 2)
10. The method of claim 1, further comprising automatically binning the electronic device after determining the value of the analyzed electronic device.
(Item 3)
2. The method of claim 1, further comprising multiplying the analysis image by a multiplier to take into account any brightness changes of the screen.
(Item 4)
1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising:
imaging a portion of an electronic device, the portion including a display screen of the electronic device, the imaging resulting in a partial image;
imaging the portion of the electronic device, the portion including the display screen of the electronic device, where a lit image is obtained when the environment is lit;
inspecting the partial image of the electronic device obtained by at least one camera positioned within an inspection area to determine dimensions of the electronic device;
inspecting the illuminated image of the electronic device to determine if there are any defects in a screen area of the electronic device to define an analyzed electronic device;
determining a value of the analyzed electronic device;
A method comprising:
(Item 5)
The kiosk includes:
Housing and
a user interface provided on an exterior surface of the housing for inputting information by the user;
an upper chamber and a lower chamber;
Further comprising:
the upper chamber includes a plurality of mirrors, an upper chamber camera, a lower chamber camera, a transparent surface, and a processor, the processor being disposed within the housing and in communication with the at least one camera, the processor being configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera, and the processor being configured to determine a monetary value of the electronic device.
The method according to any one of items 1 to 4.
(Item 6)
5. The method of claim 4, wherein the information from the partial image includes a position of the camera lens of the electronic device.
(Item 7)
5. The method of claim 4, wherein the electronic device comprises one of a mobile phone, a tablet computer, or an e-reader.
(Item 8)
1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising:
placing an electronic device within an inspection area of a kiosk, the inspection area having a camera;
imaging the electronic device to generate a contour image of the electronic device;
generating a plurality of parameters of the electronic device based on the contour image;
comparing the plurality of parameters of the contour image to a plurality of training images of electronic devices to identify the electronic device;
A method comprising:
(Item 9)
9. The method of claim 8, wherein the plurality of parameters includes dimensions of the electronic device.
(Item 10)
9. The method of claim 8, wherein generating a plurality of parameters of the electronic device includes determining a size of a side of the electronic device.
(Item 11)
9. The method of claim 8, further comprising generating at least one illuminated image of the electronic device to determine a texture of the electronic device.
(Item 12)
9. The method of claim 8, further comprising determining a value of the electronic device.
(Item 13)
The kiosk includes:
Housing and
a user interface provided on an exterior surface of the housing for inputting information by the user;
an upper chamber and a lower chamber;
Further comprising:
the upper chamber includes a plurality of mirrors, an upper chamber camera, a transparent surface, and a processor, the processor being disposed within the housing and in communication with the at least one camera;
The method according to item 8.
(Item 14)
14. The method of claim 13, wherein the processor is configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera, and the processor is configured to determine a monetary value for the electronic device.
(Item 15)
1. A method for analyzing a submission of an electronic device for monetary consideration to said electronic device and a user, comprising:
placing the electronic device within an inspection area;
imaging the electronic device in a first predetermined lighting environment to generate a first image;
imaging the electronic device in a second predetermined lighting environment to generate a second image;
generating a composite image of the electronic device from the first image and the second image, the composite image being generated to resemble an image of the electronic device as it would be if the display screen was off; and
comparing the composite image to training images of a plurality of electronic devices to determine an identity of the electronic device;
A method comprising:
(Item 16)
20. The method of claim 15, wherein the electronic device comprises one of a mobile phone, a tablet computer, or an e-reader.
(Item 17)
1. A method of analyzing an electronic device to determine authenticity of the electronic device, and providing monetary consideration to a user for submission of the electronic device if the electronic device is authentic, comprising:
placing an electronic device within an inspection area of a kiosk, the inspection area having a light;
imaging the electronic device, turning on the light in the inspection area to generate a first image;
imaging the electronic device, turning off the light in the inspection area to generate an analysis image of the electronic device;
Determining that a display screen of an electronic device includes a plurality of colors but is not emitting light;
determining that the electronic device is not authentic; and
A method comprising:
(Item 18)
The kiosk includes:
Housing and
a user interface provided on an exterior surface of the housing for inputting information by the user;
an upper chamber and a lower chamber;
Further comprising:
the upper chamber includes a plurality of mirrors, an upper chamber camera, a lower chamber camera, a transparent surface, and a processor, the processor being disposed within the housing and in communication with the at least one camera, the processor being configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera, and the processor being configured to determine a monetary value of the electronic device.
18. The method according to item 17.
(Item 19)
20. The method of claim 17, further comprising using a color entropy metric.
(Item 20)
20. The method of claim 17, further comprising detecting cracks in the display screen.

FIG. 1 is a perspective view of a recycling kiosk. FIG. 2 is a front view of the recycling kiosk of FIG. FIG. 2 is a front partial view of the recycling kiosk of FIG. 1. FIG. 2 is a front partial view of the recycling kiosk of FIG. 1. FIG. 2 is a partial view of an electrical connector wheel. FIG. 2 is a perspective view of the internal components of the kiosk. FIG. 2 is a perspective view of the internal components of the kiosk. FIG. 2 is a perspective view of the internal components of the kiosk. FIG. 2 is a perspective view of the internal components of the kiosk. FIG. 13 is a partial view of the phone on the inspection plate of the kiosk. FIG. 13 is a partial view of a phone being moved into a kiosk. FIG. 13 is a partial view of a phone being moved into a kiosk. FIG. 1 is a partial view of how phones are binned into a kiosk. FIG. 2 is a block diagram of the components of a recycling kiosk. FIG. 2 is a block diagram of the components of a recycling kiosk. FIG. 2 is a partial view of an inspection area of the kiosk. FIG. 2 is a partial view of a camera within the dome of a kiosk. FIG. 1 is a partial view of a phone within an inspection area of a kiosk. An image of a cell phone in its illuminated state (light on). 1 is an image of a mobile phone in an unlit state. 13 is an image of the subtraction results for a lit and unlit phone. 1 is an image of a training image of a mobile phone with the screen not turned on. Graph showing intensity profile from above, illustrating the match (spike lines at 211 are text regions, not present in the training images). An image of the fraudulent cell phone in its illuminated state (when the light in the test area is on), showing a photo printed on cardboard and placed under the display screen glass in place of the LCD. 1 shows an image of the fraudulent cell phone in an unlit state (with the light in the inspection area turned off) and displaying nothing. An image of a genuine cell phone with a crack in the display screen. 1 is a flow chart of a method for recycling electronic devices. 1 is a flow chart of a method for recycling electronic devices. 1 is a flow chart of a method for recycling electronic devices.

In accordance with the present invention, an automated analysis of an electronic device can be performed to determine if the device is damaged and to ascertain the recycling value of the electronic device. The automated analysis is preferably performed using a kiosk or recycling machine. The kiosk has an inspection area including an upper chamber and a lower chamber. Preferably, each chamber has a camera. The kiosk also has a transparent plate between the inspection areas, which allows viewing of the underside of the electronic device placed on the transparent plate. Each chamber preferably has a number of mirrors that provide multiple views of the electronic device within the inspection area. The mirrors allow for a multi-dimensional view of the electronic device placed on the transparent plate to be obtained. Preferably, the mirrors allow for a 360 degree view of the electronic device placed on the rotatable transparent plate to be obtained. Preferably, the mirrors allow for the height, width and/or length of the electronic device to be obtained.

Cell phones are preferably classified into three basic shapes: 1) a flip phone or clamshell type (e.g., MOTOROLA RAZR), 2) a slider phone that exposes the keyboard or screen (e.g., MOTOROLA DROID), and 3) a bar phone (e.g., Apple iPhone or Research in Motion BLACKBERRY). The present invention may also be used with a network of kiosks in public spaces. These kiosks perform a combination of recycling process steps that include receiving, identifying, visually inspecting, electrically testing, electrically erasing, grading, containerizing (bagging), labeling, and inventorying recyclable electronic devices. Each kiosk determines some form of compensation for the device owner. This consideration preferably takes the form of a direct payment, a credit on an account, a donation to a charity, a discount coupon for a future purchase, or some similar form of consideration. The device owner has the option to accept the offered consideration or reject the transaction and remove the device.

In the following description, an example is provided with respect to a mobile phone. However, one of ordinary skill in the relevant art will recognize that the system may be implemented with any number of other devices having an LCD screen without departing from the spirit and scope of the system.

1, 1A, 1B and 1C, a kiosk for recycling electronic devices and providing monetary compensation is generally indicated by reference numeral 100. The electronic device may be a smart phone, tablet computer, IPOD® device, MP3 player, GPS device, e-reader, etc. Kiosk 100 has a housing 105 in the shape of a pseudo-cuboid. Kiosk 100 is preferably a vending machine of a typical size and shape (e.g., a soda machine, coin changer, can recycling machine, or other vending machine). A header 103 allows for marketing and video. An access door 130 in a forward body region 131 allows access to an inspection area 106 for electronic devices. A display screen 115 is provided at the front of housing 105. Display screen 115 provides information to a user and functions as a user interface in touch screen embodiments. Also preferably provided on the exterior of the housing 105 are a label printer 125, a coupon dispenser 126, a receipt printer 127, and a cash or card dispenser 128. The exterior housing also includes a thumbprint reader.

The kiosk 100 allows for automated visual analysis of the electronic device to identify the electronic device and determine if the electronic device is damaged to confirm the recycling value of the electronic device. Additionally, the kiosk 100 allows for electrical analysis of the electronic device. As shown in FIG. 2, the kiosk 100 includes a carousel 500 that includes a plurality of electrical connectors 505a-505y. Each of the electrical connectors 505 has a unique connection plug for removable connection to an electronic device. Each of the electrical connectors 505a-505y has a cartridge removably secured within the carousel 500. Thus, a new electrical connector 505 can be replaced with an old electrical connector 505. Additionally, the kiosk 100 is designed to allow for automated removal of the electrical connectors 505 using a removal mechanism 511.

3, 3A, 3B and 3C, the internal mechanism 101 of the kiosk 100 includes an upper chamber 520, a lower chamber 530, a binning plate 540, a transparent plate 545, a door 550, a bin 555 and a carousel 500. Preferably, the carousel 500 can hold about 25 electrical connectors 505. The electrical connectors 505 are replaceable, so that they can easily accommodate changes in USB and other similar connections. As shown in FIG. 3B, the mobile phone 150 is placed on the transparent plate 545 and moved to the inspection area 106 in the upper chamber 520 and the lower chamber 530. Both the upper chamber and the lower chamber preferably have a bell-like shape. As shown in FIG. 3C, the mobile phone is moved between the upper chamber 520 and the lower chamber 530 for visual analysis. The transparent plate is preferably made of glass, a transparent plastic material, which allows the imaging components in the upper chamber 520 and the lower chamber 530 to obtain multiple view images of the mobile phone 150. A 3D profile of the mobile phone is preferably generated to perform a visual analysis of the mobile phone's identity and condition. After the visual analysis is completed, the transparent plate 545 is moved out from between the upper chamber 520 and the lower chamber 530.

4, 4A, 4B and 4C show the automated movement and binning of electronic devices 150 within the internal mechanism 101 of the kiosk 100. As shown in FIG. 4, the door 550 is lowered and placed on the transparent plate 545, and then the door 550 is moved with the mobile phone 150 placed on it. As shown in FIG. 4A, as the transparent plate 545 moves inward, the mobile phone is blocked by the door 550 and engages with the binning plate 540 as it starts to fall into the opening created by the inward movement of the transparent plate 545. As shown in FIG. 4B, once the mobile phone is placed on the binning plate 540, the binning plate 540 slowly moves down on one side and opens into the bin 555. As shown in FIG. 4C, the mobile phone 150 slowly falls through the opening 556 into the bin 555, where the mobile phone 150 is secured and later collected. This entire process is performed at a speed that avoids damage to the electronic devices being recycled.

Kiosk 100 is a typical size and shape of a vending machine (e.g., a soda machine, coin changer, can recycling machine, or other vending machine). The housing 105 of kiosk 100 protects the internal mechanisms 101 and secures electronic devices submitted for recycling. The housing 105 is preferably constructed of a metallic material (e.g., steel or aluminum) to prevent authenticated access to kiosk 100.

The inspection area 106 is preferably designed to allow detailed visual inspection of electronic devices (e.g., tablet computers, e-readers, MP3 players, PDAs). The size of the inspection area 106 is preferably 30 centimeters ("cm") long, 30 cm wide, and 20 cm high. The walls of the inspection area are preferably white and/or mirrored to allow imaging of the electronic device.

The connection from the kiosk 100 and to the remote computer is preferably a single connection to a communications network (e.g., the Internet) via wired LAN, wireless LAN, cellular, or any other proprietary communications system. The kiosk 100 preferably includes a processor 160. The processor 160 processes information obtained from the mobile phone and controls the components of the kiosk 100. The processor 160 is preferably a standard personal computer ("PC") or other type of embedded computer running any operating system (e.g., Linux or MACOS). The processor 160 is most preferably a small form factor PC with an integrated hard disk drive ("HDD"), a central processing unit ("CPU"), and a universal serial bus ("USB") port that communicates with the other components of the kiosk 100. One most preferred CPU is a DELL PC OPTIPLEX780. Alternatively, the processing means is a microprocessor with a separate HDD, power supply, and a stand-alone motherboard that interfaces with the other components of the kiosk 100. The kiosk 100 preferably includes memory 161 or other storage device (e.g., a disk drive) for storing executable applications, testing software, databases, and other software required for the operation of the recycling kiosk 100.

The external communications component for the kiosk 100 preferably includes a wired Ethernet to provide a connection to the Internet, or the external communications component includes a wireless modem (e.g., GSM, CDMA, 3G and 4G technologies for data communications).

7-9, visual inspection of the electronic device (e.g., a mobile phone 150) in the inspection area 106 is preferably performed by at least one camera 610 in the upper chamber 520. The lower chamber 530 also preferably has at least one camera or other imaging component (e.g., a scanner). Alternatively, visual inspection is performed by multiple cameras. A preferred camera 610 is a 1 megapixel machine vision camera. If a single camera 610 is used in the inspection area 106, the camera 610 is preferably movable, thereby increasing the field of view of the inspection area 106 when inspecting the electronic device 150 (e.g., a mobile phone placed on a transparent plate 545). The camera 161 is preferably movable. Preferably, the camera 610 is positioned to image the LCD screen 153 of the electronic device 150 to determine whether the LCD screen 153 is damaged. The inner surfaces of the upper chamber 520 and the lower chamber 530 preferably include a mirror 615 to optimize viewing of the electronic device placed in the inspection area 106. As shown in FIG. 9, a reflection 150' of a cell phone 150 is shown. The camera 610 is also preferably movable and images the data port of the electronic device to determine the type of electrical connector 505 of the electronic device for performing an electrical analysis of the electronic device. Alternatively, the entire inner surface of the upper chamber 520 and the lower chamber 530 is mirrored to optimize imaging of the electronic device. Alternatively, the camera(s) is CCD or CMOSS.

6 is a block diagram of the major components of the kiosk 100. The processor 160 preferably communicates with the other components of the kiosk 100. The memory 161 preferably contains a database of information on multiple mobile phones (e.g., images, physical characteristics, prices, and other similar information). The external communications 167 preferably communicates with a network through a wireless connection or Ethernet to send and receive information to and from remote locations. The power supply 170 is preferably received through a plug-in connection to a wall outlet. The mechanical components 165 include the electrical connectors, carousel 500, transparent plate 545, binning plate 540, door 550, and other similar components. The camera(s), electrical connectors, and user interface interact with the processor 160 as described above. FIG. 5 shows the interior back of the recycling kiosk 100. As shown, the processor 160 is preferably a personal computer and includes a backup battery 170a, a wireless connection 167 for external communications, an electrical connection 140, a receipt dispenser 104, and a display screen 115.

The processor 160 identifies the electronic device 150 submitted for recycling using the visual inspection and information from the user interface. The processor 160 also uses information obtained during the visual inspection or from the user interface to determine the appropriate electrical connector 505 for connection to the data port of the electronic device 150. The processor 160 also directs and receives information from an electrical analysis of the electronic device 150 performed with the electrical connector 505 connected to the data port of the electronic device 150. The processor also preferably determines a monetary value for the submitted electronic device 150 based on the visual inspection, optionally the electrical analysis, and data stored in the kiosk's memory 161 or information obtained externally through the external communication component 167.

A flow chart of a preferred recycling method is shown in FIG. 19. In step 301, the consumer selects whether to sell or recycle the electronic device. The consumer looks at a list on the kiosk screen to see if the electronic device is available for sale/refurbishment. The consumer activates an on-screen menu system and either directly enters the phone model or browses a series of menus to determine if the electronic device is available for sale or can only be recycled. In decision block 302, it is determined that the electronic device can only be recycled. If the electronic device can only be recycled (i.e., the electronic device is not on the list of electronic devices available for resale), the consumer can insert the electronic device into a receptacle in step 303, where it will then drop into the bin 112 for recycling.

If the electronic device is refurbished/resaleable, the consumer is invited to proceed with the system's test/evaluation operations. In step 304, the system determines the correct connector for connection to the electronic device. Connectivity options include but are not limited to cable, standard or proprietary connector, hard dock, removable or external physical memory for reading or other wireless methods (e.g., WiFi, Bluetooth, RFID, NFC). In step 305, the electronic device is connected and inserted into the inspection area 106. If this is done correctly, some notification is given to the consumer (e.g., a green light) and the system proceeds to step 306. In step 306, the electronic device is tested using diagnostics, e.g., operating via the OMSI interface. The diagnostics preferably include electrical and physical tests (e.g., testing the electronic device's battery, screen, memory, button functionality and structural integrity).

Preferably, the electronic device is imaged and analysis software is used to identify scratches, cracks, wear patterns, dents, broken or missing parts, inclusion of features (e.g., lenses, buttons, connectors, badges, labels and/or branding). Identification may be by image comparison methods or other similar methods, where a photographed image of the electronic device is normalized and compared to a reference image. Other inspection methods may be used in conjunction with visual and/or electrical testing (e.g., weighting) to determine a specific weight, which is used to further refine manufacturer matching and correct device model matching. In another embodiment, a photographic image is used to identify the correct manufacturer and model number/product number. Visual identification may include any combination of the following: measurement-based calculations, physical (e.g., mm, inches), pixel count, etc. Identification is based on the dimensions of the electronic device, button location/size, LCD and other physical characteristics. A single camera or multiple cameras may be used to determine height, width, depth as needed. Identification is based on OCR (Optical Character Recognition) of identifiers (e.g., carrier, brand, model, serial number (for phones and tablet computers), other identifiers). Identification is based on bar codes. The consumer may be instructed to orient the CE on the front, back, side, and then change orientation as needed. Additionally, the consumer may be instructed to remove the CE cover(s), battery, etc. to gain access to identifiable items (e.g., alphanumeric or bar code data). The kiosk 100 provides a method to identify the device, determine its value, and reduce the likelihood of fraud using visual inspection in conjunction with electrical inspection.

In one embodiment, the kiosk 100 communicates with the carrier associated with the cell phone to collect all information that may be germane to the device (e.g., validity or authenticity, registered ownership, account status, service terms). In some cases, if the consumer's specific information does not match the registered owner information, the kiosk 100 automatically contacts the assumed owner in some manner (automated phone call, email, text message) to alert the owner of the phone of the potential transaction.

Another feature of the kiosk 100 embodiment is the ability to determine if there is personal information on the electronic device. This is determined by checking for the presence of data in certain storage registers in memory (e.g., quick key storage number) or by checking for file types (e.g., jpeg, mp3) or simply assuming that all non-default storage locations contain personal data. The consumer is given the opportunity to erase the data from the phone. One option allows the consumer to first download the data and then send it to a location specified by the consumer (e.g., email address, website). In another embodiment, a slot is provided for the consumer to insert a memory card (e.g., USB drive, memory stick). Once the memory card is inserted through this slot, the kiosk 100 uploads the data to the memory device. In yet another embodiment, the kiosk 100 provides a web location from which the user can later retrieve the data when desired. In another embodiment, the user chooses to store the data at the kiosk 100 in another electronic device purchased by the consumer or to store it at the kiosk 100's location or some other storage. The consumer preferably selects a username and password to access the storage location provided by the system.

After the value is determined, this value is provided to the kiosk in step 307. The kiosk 100 then provides the consumer with a price or other consideration for the phone, which is typically less than the resale value. In step 311, the kiosk 100 completes any further testing and diagnostics of the electronic device, disconnects the cable from the electronic device, and prints a receipt for the consumer. A funds transfer may be authorized by the kiosk 100 by crediting the consumer's credit card or dispensing a cash account or dispensing a voucher or coupon. In step 312, the kiosk 100 updates its inventory database and sends the updated information over the communications network to the kiosk server.

One preferred method of the present invention is shown in the flow chart of FIG. 18. Method 1000 begins at block 1001. A mobile phone 150 is placed in the inspection area 106 of the kiosk 100. The inspection area has a light. The electronic device is imaged in a deactivated mode. In block 1002, the display screen of the electronic device is imaged. With the electronic device in an active mode and the light in the inspection area 106 turned off, an analysis image of the electronic device is obtained. In block 1003, the display screen of the electronic device 150 is imaged again, but with the light in the inspection area 106 turned on, and a first image of the electronic device is obtained. The mobile phone 150 must have its camera function in camera mode. In block 1004, the first image of the electronic device is subtracted from the analysis image to generate a subtraction image of the electronic device. In block 1005, the subtraction image is compared to the image of the electronic device in the deactivated mode to determine if there are any defects in the display screen of the electronic device, and an analyzed electronic device is defined. In block 1006, the mobile phone value is determined as described in more detail below.

Preferably, the kiosk 100 of the method includes a housing 105. The housing 105 includes a user interface on an exterior surface of the housing for input of information by a user and includes an upper dome and a lower dome. The upper dome and the lower dome include a plurality of mirrors. The kiosk 100 further includes an upper chamber camera, a lower chamber camera, and a transparent surface. The kiosk 100 further includes a processor 160. The processor 160 is disposed within the housing and in communication with the at least one camera. The processor 160 is configured to identify a brand and model number of the electronic device based on at least one of the information from the user and the image from the at least one camera. The processor 160 is configured to determine a value of a monetary consideration for the electronic device.

The upper and lower domes preferably include walls made of mirrors. The dome-shaped device further includes a transparent surface and at least one camera. The camera is capable of obtaining multiple views of an electronic device disposed within the dome-shaped device. The upper dome preferably includes an upper chamber camera. The lower dome preferably includes a lower chamber camera. Preferably, the combination of the upper and lower dome cameras, respectively, and the multiple mirrors allows an image of the device to be positioned on the transparent surface. Preferably, the combination of the upper and lower dome cameras, respectively, and the multiple mirrors allows a 360 degree electronic device to be positioned on the transparent surface. Preferably, the upper and lower dome cameras, respectively, are movable.

Another method of the present invention is illustrated in the flow chart of FIG. 20. Method 2000 begins at block 2001, where an electronic device is placed within an inspection area of kiosk 100. Inspection area 106 includes a camera. At block 2002, a portion of the electronic device is imaged, including a portion of the periphery of the electronic device, resulting in a periphery image. At block 2003, the periphery image of the electronic device obtained by at least one camera located within the inspection area is inspected. At block 2004, it is determined whether a display screen of the electronic device is defective, defining an analyzed electronic device. At block 2005, a value of the analyzed electronic device is determined.

The information from the peripheral image preferably includes the model name and location of the LED aperture. Additionally, the processor 160 is configured to automatically adjust the peripheral edge to a rectangular shape to compensate for screen damage that causes image distortion due to missing certain portions of the screen. The peripheral image includes a 360-degree image. The information from the peripheral image includes the location of the USB port, the location of the volume control button, the location of the camera button, and the location of the power on/off button. The information from the peripheral image also includes the location of the camera lens and the logo of the electronic device.

Preferably, visual inspection and recognition software is used by the kiosk 100 to analyze the mobile phone 150. In one preferred method, a recognition algorithm is applied to the particular make and model of mobile phone 150. The visual inspection and recognition software determines the boundaries of the mobile phone 150 being inspected to determine the exterior dimensions of the mobile phone 150. The exterior dimensions are used to determine a subset of possible mobile phones from a master database of mobile phones stored in the memory 161 of the kiosk 100 or available online to the kiosk 100 using external communications. The visual inspection and recognition software then preferably uses a set of secondary and tertiary features to further differentiate the mobile phone 150. These secondary and tertiary features may include display screen placement and size, keyboard placement and size, unique buttons, port placement, and other distinguishing features. After determining the correct make and model of the mobile phone, the visual inspection and recognition software subtracts an image of the mobile phone 150 from an image of a complete mobile phone of the same make and model. The result of the subtraction is preferably a quantifiable number of pixels that are inspected for broken or missing parts, screen cracks, and categories of low, medium or high levels of wear.

Alternatively, visual inspection may be performed using neural network pattern recognition techniques to identify the mobile phone 150. Filter algorithms may then be used to determine defects (e.g., screen cracks). Additionally, a person skilled in the relevant art will recognize that other visual inspection techniques may be used without departing from the scope and spirit of the present invention.

Additionally, the visual inspection optionally includes obtaining a thermal signature for the mobile phone 150. One preferred method for obtaining a thermal signature for the mobile phone 150 is to raster a laser over the mobile phone to characterize the decay heat profile of the submitted mobile phone 150. This decay heat profile is then compared to the decay heat profile of a complete sample of identical mobile phones 150. The decay heat profile indicates wear on the exterior surface of the mobile phone 150. This wear is used to calculate a monetary value for the mobile phone 150.

Yet another method of the present invention includes placing an electronic device within an inspection area of a recycling kiosk 100, powering the electronic device, and displaying a known image on an LCD screen of the electronic device. Comparing the known image on the LCD screen of the electronic device to a stored copy of the known image stored on the recycling kiosk to determine defects in the LCD screen of the electronic device and define an analyzed electronic device. The method further includes determining a value of the analyzed electronic device.

In one embodiment of the method, the known image is a start-up image for a carrier of the electronic device. In another embodiment, the known image is an image of a national park. The method may further include performing an electrical analysis of the electronic device.

The method preferably images the electronic device when it is placed in the kiosk, whatever state the electronic device is in. The method then compares the image to a training database of all different types of electronic devices that have been previously trained (all training images preferably with the screens off).

The method preferably images more than the display screen of the electronic device, i.e., the method preferably images everything on the electronic device (e.g., any illuminated keyboard on a Blackberry).

The method preferably subtracts the analysis image from the first image. The method also preferably multiplies the analysis image by a multiplier to account for changes in brightness of the screen. For example, if the brightness of the screen did not change between the two images, the multiplier is 1. If the brightness of the screen at the analysis image was 1/2 the brightness of the "first image" at the analysis image, the analysis image is multiplied by 2 to match the brightness and improve the subtraction (essentially the brightness compensation factor is there to account for a screen that has an automatic brightness that changes when the kiosk dome light is turned on and off). This image is the "composite" image because it has been partially composited by subtraction. Subtracted image is used synonymously with composite image.

The method preferably compares the subtracted image with all the different training images of the electronic device to first identify the electronic device, and then analyzes the defects after the electronic device has been identified. However, the main purpose of the subtraction is to generate an image of the appearance of the electronic device when the screen is off, since it is preferred to first identify the electronic device by comparing such an appearance image with the training images of the electronic device with the screen off. Then, after the electronic device has been identified (or after the expected appearance has been identified, which may be a set of 5 or 10 similar electronic devices), the defects are analyzed.

Preferably, an image of the electronic device in the kiosk is generated and compared to the training data to identify the electronic device and determine the state of all of its characteristics.

In another embodiment, there are two steps in the process: 1) obtain an outline image to determine the location of the electronic device within the kiosk and the size of the electronic device (e.g., side view, size of the side of the electronic device); 2) obtain a fully lit image and "map the texture" of the electronic device onto the outline image to determine not just the outline but the actual appearance of the electronic device when surrounded by light.

In one embodiment, the mirror is only a small portion of the chamber wall. Most of the wall is preferably white plastic/painted to diffuse the light to create even lighting and minimize specular reflections.

In the preferred kiosk, five of the six sides of the electronic device are shown. The top camera captures the front and three sides (left, top, right) of the electronic device, and the bottom camera captures the back of the electronic device. Because there are three mirrors instead of four, the top bottom portion of the electronic device (where the cable connector is located in the case of an IPHONE phone) is not visible. Therefore, both cameras combine to capture five of the six sides, and the top camera captures only four of the six sides. The location, size, shape, and color of all buttons are imaged regardless of their function. For example, an IPHONE 4S cell phone looks identical to a VERIZON IPHONE 4 cell phone (except for the SIM card slot on the side). Thus, the kiosk 100 uses the presence of the SIM card slot to determine that the electronic device is an IPHONE 4S cell phone and not a VERIZON IPHONE 4 cell phone.

The present invention preferably extracts features from the training images and stores these features in a database along with other information (e.g., make and model of electronic device, screen area/position and other data).

The "periphery image" is preferably not used to detect defects in the screen. The invention analyzes the image contour (area) to aid in device identification because the contour gives the phone's dimensions, which helps narrow down the devices in the training database to compare (it doesn't make sense to compare to all small phones, so only compare to other phones of similar size).

Figure 10 is an image of the cell phone 150 with the lights on. The cell phone's display screen 153 is visible. Touch screen buttons 153a-153c are visible. Physical buttons 156, 157, and 159 are visible on the periphery of the phone 150. Figure 11 is an image of the phone of Figure 10 with the lights off. The display screen 153 is barely visible. Figure 12 is a subtraction result obtained by subtracting an image of the phone 150 with the lights on from an image of the phone 150 with the lights off. Figure 13 is an image of the phone with the display screen 153 off. Figure 14 shows the line intensity profile of the image of Figure 13 (solid line 1401) and an image of the phone 150 of Figure 12 (dashed line 1402). The spike at time 211 indicates the text area in Figure 12.

Another aspect of the present invention is the detection of fake electronic devices. As shown in FIG. 15, the image of a rogue cell phone 150 in a lighted state (when the light in the inspection area is turned on) shows a photo printed on cardboard and placed under the display screen glass 153 rather than an LCD. The image has a lot of weight and color variations on the screen area. However, there is no light emitted from the cell phone. When the light in the inspection area is turned off, the display screen of the cell phone 150 displays nothing as shown in FIG. 16. Therefore, the kiosk 150 of the present invention can automatically detect non-authentic (fake) electronic devices. Furthermore, images of fake phones are stored in a database for training because such images are likely to be used multiple times. Also, fake phones do not contain electronic components in the housing. Thus, the mass of fake phones is different from genuine phones, so if the kiosk 100 is equipped with a weight scale, another means of detecting fake phones is possible.

Another aspect of the present invention is the detection of cracks in phone screens. As shown in FIG. 17, an image of a genuine cell phone 150 has a crack in the display screen 153. By performing a color entropy metric, the present invention is able to distinguish between an actual crack in the display screen glass and an image that contains multiple color variations, since a crack in the glass would not produce multiple different colors.

Claims (15)

1. A method of operating a kiosk for evaluating and purchasing used electronic devices, the method comprising:
Positioning a transparent support plate of the kiosk in a first position;
receiving the electronic device onto the transparent support plate, the electronic device being received from a user while the transparent support plate is in the first position;
moving the transparent support plate from the first position to a second position after receiving the electronic device on the transparent support plate, where moving the transparent support plate moves the electronic device into an inspection area within the kiosk, the electronic device being inaccessible to the user when the transparent support plate is in the second position;
imaging the electronic device with a camera while the transparent support plate supports the electronic device within the inspection area. The method of claim 1 , wherein the camera is positioned above the transparent support plate when the transparent support plate is in the second position. The method of claim 1, further comprising determining a state of the electronic device based at least in part on the imaging of the electronic device with the camera. The method of claim 1, further comprising determining an identity of the electronic device based at least in part on the imaging of the electronic device with the camera. The method of claim 3, further comprising determining a monetary value for the electronic device based at least in part on the state of the electronic device. The method of claim 4, further comprising determining a monetary value for the electronic device based at least in part on the identity of the electronic device. The method of claim 1 , further comprising performing an electrical test on the electronic device after receiving the electronic device on the transparent support plate. The method of claim 7, wherein performing the electrical test on the electronic device includes performing the electrical test through an electrical connector of the kiosk. 8. The method of claim 7, further comprising providing an electrical connector for manual connection to the electronic device for performing the electrical test prior to moving the transparent support plate from the first position to the second position. 8. The method of claim 7, further comprising determining functionality of the electronic device based at least in part on the electrical tests. 8. The method of claim 7, further comprising determining whether the electronic device is capable of powering up and/or maintaining a charge based at least in part on the electrical test. 8. The method of claim 7, further comprising determining a monetary value for the electronic device based at least in part on the electrical tests. 13. The method of claim 5, 6 or 12, further comprising making an offer to purchase the electronic device from the user for the value of the monetary consideration . The method of claim 13, further comprising, if the user accepts the offer to purchase the electronic device, moving the electronic device into a bin in the kiosk. 15. The method of claim 14, wherein moving the electronic device into the bin includes causing the electronic device to slide off the transparent support plate and into the bin if the user accepts the offer to purchase the electronic device.

Images