JP7511774B2 - Smart Compartment System for Cosmetic Dispensing Device - Google Patents

Description

CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of priority to U.S. Application No. 17/162,513, filed January 29, 2021, and French Application No. 2104313, filed April 26, 2021, the entire contents of each of which are incorporated herein by reference.

The disclosure herein generally relates to systems, devices, and methods for determining combinations of cosmetic ingredients that can be blended and dispensed for a particular user.

In one embodiment, an apparatus for dispensing cosmetic material is provided, the apparatus comprising a dispensing device configured to receive a plurality of cartridges each containing a cosmetic material and to dispense a specified amount of the cosmetic material from each cartridge from a respective outlet corresponding to each cartridge onto a dispensing surface, the dispensing surface including at least one partition dividing the dispensing surface into a plurality of compartments each corresponding to an area surrounding at least one of the respective outlets.

In some embodiments, each compartment of the plurality of compartments corresponds to a distinct type of cosmetic material.

In some embodiments, the dispensing surface, including at least one partition, is removable.

In one embodiment, at least one compartment corresponds to an area surrounding at least two respective outlets.

In one embodiment, the dispensing surface is configured to rotate while the cartridge remains in a fixed position.

In one embodiment, the dispensing surface has at least one of the compartments made of a hydrophilic or hydrophobic material.

In one embodiment, the apparatus is configured to transmit information about the multiple compartments to an external device.

In one embodiment, the dispensing surface includes an embedded object configured to be sensed by a detection device included in the dispensing device, and the dispensing device is configured to transmit information regarding the plurality of compartments and specific current locations of the plurality of compartments to an external device based on the sensed embedded object.

In one embodiment, the embedded object is a Near Field Communication (NFC) tag and the detection device is an NFC reader.

In one embodiment, the dispensing surface includes a visible code disposed at a predetermined location on the dispensing surface, the code configured to have information encoded thereon for a plurality of compartments, and the external device configured to read the code via an image captured by the image capture device and detect specific current locations of the plurality of compartments based on the current location of the code detected within the captured image.

In one embodiment, at least one of the compartments is configured to receive a lid.

A more complete understanding of the present disclosure and many of its attendant advantages will be readily obtained by reference to the following detailed description when considered in conjunction with the accompanying drawings, in which:

FIG. 1 is a general perspective view of a cosmetic dispensing device, or cosmetic dispenser, according to one embodiment. FIG. 1 is a perspective view of a dispenser body according to one embodiment. FIG. 1 illustrates a perspective view of a cosmetic dispenser with the dispenser body removed, according to one embodiment. FIG. 1 illustrates a perspective view of the internal components of a cosmetic dispenser, according to one embodiment. FIG. 1 illustrates a perspective view of the internal components of a cosmetic dispenser, according to one embodiment. FIG. 2 is a perspective view of a cartridge according to one embodiment. FIG. 13 is a perspective view of a cartridge gear according to one embodiment. FIG. 2 is a perspective view of a bottom plate according to one embodiment. FIG. 2 is a perspective view of a bottom plate from the bottom according to one embodiment. FIG. 2 is a perspective view of a base according to one embodiment. FIG. 2 is an exploded perspective view of a compact disposed over a manifold according to one embodiment. FIG. 2 illustrates a perspective view of a compact in an open position, according to one embodiment. FIG. 9 depicts an exemplary sequence of primary processes of a cosmetic blending method 900, according to one embodiment. FIG. 1 is a process diagram illustrating an example of a process for detecting cosmetic materials in a cosmetic dispenser, according to one embodiment. FIG. 2 is a process diagram illustrating an example of a process for selecting a cosmetic formulation, according to one embodiment. FIG. 1 is a process diagram illustrating an example of a process for dispensing cosmetic materials into a cosmetic dispenser, according to one embodiment. FIG. 1 illustrates an example of a connected cosmetic dispensing system, according to one embodiment. FIG. 1 illustrates an example circuit of a controller and a cosmetic dispenser, according to one embodiment. Illustrates components of an ecosystem that utilizes cosmetic dispensers to create personalized doses for users. It shows the ecosystem that has been built by suggesting trending lipstick colors to users. 1 illustrates an exemplary flow of operations in an ecosystem for dispensing personalized lipstick shades from an app perspective. 1 shows an additional flow chart of how an algorithm of a smartphone app in a lipstick ecosystem may allow a user to see the shade of lipstick on the user's selfie image. It further illustrates how a particular set of cartridges can provide areas of different shades to be presented to the user. Showing how the "Match My Look" mode could work for apps within the lipstick ecosystem. Here's a detailed look at how a lipstick recommendation engine works, based on a selfie of the user's outfit. It presents an ecosystem built around suggesting to users the most efficient skin care formulation for them. 1 illustrates an exemplary flow of operations in an ecosystem for dispensing personalized skin care formulas from an app perspective. An example is provided of how a combination of different environmental factors determined to be present for a user can result in different doses from three different cartridges. 1 illustrates an ecosystem used to dispense personalized foundation for a user. 1 illustrates an example flow of operation of an ecosystem for dispensing personalized foundation from an app perspective. Provides details on how to perform a skin tone assessment. We provide details on how deep learning is used to estimate skin tones in an image. 1 shows the structure of a cartridge having an NFC tag. The data format of the data stored in the NFC tag of the cartridge is shown. 1 shows a table with a description of the various fields contained in the NFC tag data format. 1 shows the structure of a dispensing device equipped for a smart replaceable cartridge system. 1 illustrates a handshake between a dispensing device and a user smartphone device. 13 shows a consumer app state machine illustrating the process from the app's perspective of priming a cartridge prior to use of a dispensing device. We will show how to manage defective cartridge NFC tags in the above scenario. FIG. 1 shows a side view of a dispensing device including a retractable plate. 31A and 31B show different states when the retractable plate is at different heights. 1 shows a cleaning formulation reservoir disposed between the body of the dispensing device and the retractable plate. An alternative use of the retractable plate described above is shown to provide a method of flushing the cartridge of any remaining components or residue. 1 illustrates a smart personalized compartment system for use with a dispensing system. 1 illustrates a mechanism that allows detection of tray and compartment locations to be transmitted to a user's mobile device. A method is shown that allows a user to provide final customized toppings in any one of the compartments in the disclosed tray. 1 illustrates a system that enables a user to send a dispensing formulation to the described dispensing device based on the results of a digital beauty consultation with a beauty advisor (BA). 1 illustrates a flow of actions in a beauty consultation session between a consumer and a BA. 10 illustrates examples of all the types of consumer data that may be collected during a consultation session. 1 illustrates another example of a consultation session in which a consumer expresses interest in a hair care product. 13 illustrates another example of a consultation session in which a consumer is interested in a nail gel product dispensed from a dispensing device. 37, 39, and 40 show examples of the types of dispensing device settings that may be determined during a remote consultation.

In the drawings, like reference numerals designate the same or corresponding parts throughout the several views. Furthermore, as used herein, the terms "a," "an," etc. generally have the meaning "one or more" unless otherwise specified.

Referring now to the drawings, like reference numbers designate identical or corresponding parts throughout the several views.

Selecting cosmetic formulations, and the component cosmetic ingredients for formulating cosmetic formulations, is a common activity that often relies on subjective decision-making and manual input. There is a wide variety of cosmetic ingredients available, and an endless number of combinations and permutations of possible cosmetic formulations.

At each occasion where a cosmetic formulation is used, a subjective decision to produce a satisfactory cosmetic formulation is often made by the end user of the cosmetic. The outcome is generally the result of experimentation, possibly requiring multiple iterations to produce a satisfactory outcome. In part, due to limited knowledge of the specific traits and required proportions of the base cosmetic ingredients, the resulting cosmetic formulation may lack precision. Thus, reproducibility in producing a specific cosmetic formulation is difficult to achieve. The following embodiments address these problems in the prior art.

Specifically, the following description relates to an ecosystem for creating a blending personalization system for home use based on a dedicated dispensing device that enables skin care and cosmetic ingredients to be instantly blended into a user's preferred end result and then conveniently transported for portability.

The system shown below is the first AI-powered 3-in-1 device for personalized at-home skin care, foundation, and liquid lipstick. The device and corresponding app evaluate the user's individual skin and local environmental data to create and deliver personalized, on-the-fly skin care and cosmetic formulations optimized for increasing levels of personalization over time.

The overall ecosystem features an AI-enabled motorized cartridge system as described above, which creates personalized skin care and cosmetic formulations in four steps: The device creates personalized skin serums through the following process:
1. Personal Skin Analysis: A user takes a photo with their smartphone camera and opens the smartphone app, which uses AI to analyze the user's overall skin condition, assessing deep wrinkles, fine lines, blackheads, lack of firmness, pore visibility, and lack of radiance.
2. Environmental Assessment: The app (and/or a separate cloud computing platform) assesses local environmental conditions that may affect the user's skin condition, including weather, temperature, humidity, UV index, air quality, and pollen.
3. Product Preferences: The user then inputs their specific skin care concerns into the app, such as fine lines, wrinkles, dark spots, rough texture, and dullness.
4. Custom Blending and Dispensing: A personalized blend of high performance skin care is then dispensed in separate single doses onto the top of the device.

A motor system located at the top of the device moves and compresses the formulation in an upward motion from a cartridge at the base of the machine to a dispensing tray above for clean application.

With regular use, the AI platform can evaluate the appearance of the user's skin over time, helping the user identify what's working and adjust future formulas. The AI-powered system can optimize the effectiveness of personalized formulas. Users can periodically take photos, allowing the smart system to recognize the effectiveness of the formula and adjust the dosage of active ingredients accordingly. That said, users can override the system's recommendations if, for example, they're looking for additional moisturizer.

The skin care system contains active ingredients including AHA, vitamins C and E, hyaluronic acid, ferulic acid, retinol, cucumber, thyme, and mulberry.

Cosmetic offerings for foundations and liquid lipsticks can incorporate real-time trend information as well as color matching technology into personalized product offerings, as described below.
- The lipstick system allows consumers to create liquid lipstick based on their personal skin tone and preferences. The system can shade-match the user's clothing or accessories, or choose to create a specific color that is trending on social media. The device has three cartridges that, together, can create hundreds of shades.
- The foundation system described below includes three cartridges ranging from light to deep shades. Knowing that foundation is never one-size-fits-all, these color trio selections can be offered to match the widest range of shades. With a shade matching tool, the three cartridges dispense various levels of color to create personalized shades. The device has the capability to create hundreds of custom shades. The device creates a single dose of color, but the user can easily double or triple the amount with an additional touch.

The system described herein has three dose settings. There is a standard size dose (approximately the size of a pistachio, 0.7 grams) that the user can double or triple with an additional touch.

The device features a removable mirrored compact so you can carry fractional doses of product with you.

The user experience with this system, from opening the app and taking a photo of their face to dispensing the product, takes about three minutes.

[Dispensing device]
1 is an overall perspective view of a cosmetic dispensing device 100, or cosmetic dispenser, according to one embodiment. The visible portion of the cosmetic dispenser 100 includes a base 102 connected to a power cord 104. The base 102 provides support for a dispenser body 106. A compact 108 is disposed on the dispenser body 106, a power button 110 may be partially disposed within the dispenser body 106 such that the dispenser body 106 fixes the placement of the power button 110, and an indicator light and button 122 may be partially disposed within the dispenser body 106 such that the dispenser body 106 fixes the placement of the indicator light and button 122. The indicator light and button 122 may be a mechanical or capacitive touch button.

2 is a perspective view of the dispenser body 106, according to one embodiment. The dispenser body 106 is a hollow, thin-walled container that serves as a cover for many of the components of the cosmetic dispenser 100. In this embodiment, the dispenser body 106 has a top first end with a generally square cross-section with rounded corners, while a bottom second end has a circular cross-section. The dispenser body 106 may provide a base for the compact 108, or other components that serve as a base for the compact 108. The dispenser body 106 may also include attachment points for a power button 110 and an indicator light and button 122.

3 is a perspective view of the cosmetic dispenser 100 with the dispenser body 106 removed, according to one embodiment. The power button 110, indicator lights and buttons 122, controller 150, bottom plate 166, induction plate 176, and gear housing 170 are visible in this view, as are the lower body section 154, middle body section 155, and upper body section 156. The power button 110 is electrically connected to the controller 150.

The controller 150 includes circuitry for distributing power received via the power cord 104, controlling one or more motors 112 for dispensing cosmetic materials, detecting the readings of the optical encoder 192, charging one or more batteries 126, operating any indicators such as indicator lights and buttons 122, chimes, or other audiovisual signals, such as sensors for detecting availability status, type, and amount of cosmetic materials, and wirelessly communicating with external devices, including circuitry for transmitting and receiving signals and data, for example, via smartphones and other wireless devices, using various communication protocols such as radio frequency (RF), Bluetooth, Wi-Fi, or cellular.

The induction plate 176 supports the bottom plate 166, and the remainder of the cosmetic dispenser 100, except for the base 102 and the power cord 104, is disposed on the bottom plate 166. The gear housing 170 is disposed on, connected to, and provides support for the internal components of the cosmetic dispenser 100, which are further described by Figures 4-9B. Additionally, the gear housing 170 includes a plurality of gear housing cartridge holes 178, one for each cartridge 114 in the cosmetic dispenser 100. The nozzle 160 of each cartridge 114 is disposed inside one of the gear housing cartridge holes 178. Various additional substructures and covers may be disposed between the internal components of the cosmetic dispenser 100 and the dispenser body 106.

For example, the upper body section 156 is disposed above the middle body section 155, and the lower body section 154 is disposed below the middle body section 155. When connected, the dispenser body 106 is attached to the outside of at least one of the lower body section 154, the middle body section 155, and the upper body section 156. The bottom plate 166 is disposed below and connected to the lower body section 154.

4A and 4B are perspective views of the internal components of the cosmetic dispenser 100, according to one embodiment. The internal assembly includes a plurality of dispensing assemblies 120 disposed on a bottom plate 166 and an induction plate 176. Each dispensing assembly 120 includes a cartridge 114, a cartridge gear 116, a motor 112, a motor gear 124, an ejector 140, an ejector index ring 190, an ejector spring 142, an ejector spring pin 144, a detent plunger 146, and a detent spring 152. A controller 150 controls the operation of each of the dispensing assemblies 120. The cosmetic dispenser 100 includes at least one dispensing assembly 120. Although the embodiment described herein includes three dispensing assemblies 120, one skilled in the art will recognize that the cosmetic dispenser 100 may have any number of dispensing assemblies 120.

Additionally, a number of batteries 126 inside the cosmetic dispenser 100 are electrically connected to the multiple dispensing assemblies 120 and provide power for operation of the controller 150, the dispensing assemblies 120, the motor 112, and various indicators such as indicator lights and buttons 122 (further described in FIG. 3), chimes, and other audiovisual signals.

The controller 150 and connected device 300 (shown in FIG. 14) allow a user to wirelessly operate the cosmetic dispenser 100. Cosmetic material blending and recipe commands to the controller 150 may be received from a connected device 300, such as a smartphone, tablet, or personal computer, configured to communicate with the cosmetic dispenser 100. Additionally, dispensing of cosmetic materials may also be triggered by a user by touching an indicator light and button 122 on the cosmetic dispenser 100.

The cartridge 114 also has a cartridge key 162 disposed on or near the nozzle 160, connected to the cartridge gear 116 near a first end, a motor gear 124 connected to the motor 112, the motor gear 124 drivingly connected to the cartridge gear 116, and connected to a bottom plate 166 near a second end. The cartridge 114 and the cartridge gear 116 are held in place by a gear housing 170 (shown in FIG. 3). The cartridge 114 may be disposed inside the cosmetic dispenser 100 and may be fixed in place by an ejector 140 connected to an ejector spring 142, and an ejector spring pin 144 may be connected to the ejector spring 142 at a first end and rigidly connected to an inner surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155, the upper body section 156, and other internal structures at a second end. The dispensing assembly 120 further includes an ejector indexing ring 190 (shown in FIG. 4A) for guiding movement of the ejector 140 within the cosmetic dispenser 100 during insertion and removal of the cartridge 114, the ejector indexing ring 190 being disposed against an inner surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155, and the upper body section 156 to provide guidance for movement of the ejector 140.

In addition, the detent plunger 146 is disposed substantially perpendicular to the longitudinal axis of the cartridge 114 and is connected near the second end of the cartridge 114 to provide lateral pressure to the circumferential groove 134 of the cartridge 114 to maintain the cartridge 114 in position along the vertical Y-axis and counteract the opposing force applied by tension to the cartridge 114 by the ejector 140, the ejector spring 142, and the ejector spring pin 144. The ejector 140 is disposed within the cosmetic dispenser 100 and is connected to an ejector spring 142 that can move substantially parallel to the cartridge 114 and is further connected to the ejector spring pin 144. When the cartridge 114 is inserted into the cosmetic dispenser 100, an edge of the ejector 140 contacts an edge near the first end of the cartridge 114. The ejector 140 exerts pressure on the cartridge 114 as the ejector spring 142 expands with an increasing distance between the stationary ejector spring pin 144 and the ejector 140 and the ejector 140 moves further into the cosmetic dispenser 100 with the cartridge 114. When the cartridge 114 is inserted to the point where the first end of the detent plunger 146 contacts the circumferential groove 134 of the cartridge 114, movement of the cartridge 114 along the Y axis is restricted holding the cartridge 114 in place.

The detent plunger 146 is a mechanism for holding the cartridge 114 in place. The detent plunger 146 moves along an axis substantially perpendicular to the axis of the main shaft of the cartridge 114. The first end of the detent plunger 146 is disposed to contact the cartridge 114. The second end is connected to the first end of the detent spring 152, the second end of the detent spring 152, and contacts the inner surface of at least one of the dispenser body 106, the lower body section 154, the middle body section 155, the upper body section 156, or other internal structure. When the cartridge 114 is inserted into the cosmetic dispenser 100, the detent plunger 146 is displaced against the detent spring 152, compressing the detent spring 152. Because the contour of the cartridge 114 varies over the length of the cartridge 114, the detent plunger 146 and detent spring 152 are displaced by an amount that varies depending on the position of the cartridge 114 relative to the cosmetic dispenser 100. At the point where the detent plunger 146 contacts the circumferential groove 134 of the cartridge 114, the first end of the detent plunger 146 can lock the cartridge 114 in place due to the pressure of the detent spring 152 and the geometric relationship between the detent plunger 146 and the circumferential groove 134.

Additionally, the cartridge 114 is inserted into the cosmetic dispenser 100 through a cartridge through hole 172 in the bottom plate 166. The cartridge through hole 172 has a base key cutout 165 (FIG. 7A) shaped to correspond to the base key 164 such that when the base key 164 and the base key cutout 165 contact, the cartridge 114 cannot rotate relative to the bottom plate 166. The cartridge 114 is also shaped to fit the bottom plate 166 and the cartridge gear 116 in a specific orientation. When the cartridge 114 is fully inserted into the cosmetic dispenser 100 and locked in place by the detent plunger 146, the cartridge 114 seats against the cartridge gear 116. In addition, the cartridge gear 116 has a collar 168 portion rotatably connected to a gear housing 170, which limits the movement of the cartridge gear 116 so that the cartridge gear 116 can rotate about the longitudinal axis but not, or may not, move axially, and supports the respective positions of the cartridge gear 116 and the motor gear 124. Similarly, the motor gear 124 has a motor gear collar 169 portion rotatably connected to a gear housing 170, which limits the movement of the motor gear 124 so that the motor gear 124 can rotate about the longitudinal axis but not, or may not, move axially, and maintains the relationship between the cartridge gear 116 and the motor gear 124 so that the rotational movement of the motor gear 124 results in the rotational movement of the cartridge gear 116 in a fixed ratio.

As illustrated by FIG. 4B, the motor gear 124 can be a spur gear that includes a key cutout 163 (FIG. 6) that fits the cartridge key 162 of the cartridge 114.

5 is a perspective view of the cartridge 114 according to one embodiment. The cartridge 114 has a circular, cylindrical body and a nozzle 160 at a first end. The nozzle 160 is further disposed near a cartridge key 162. The cartridge key 162 fits inside an opening in the cartridge gear 116 and corresponds to the shape of a key cut 163 of the cartridge gear 116 to lock the rotational movement of the portion near the first end of the cartridge 114 with the rotational movement of the cartridge gear 116. When the cartridge gear 116 is driven by the motor gear 124 and the motor 112. The second end of the cartridge 114 includes a base key 164. The base key 164 fits inside a base key cut 165 of a bottom plate 166 to secure the second end of the cartridge 114 to the bottom plate 166 and prevent rotational movement of the second end of the cartridge 114 relative to the bottom plate 166. Because the first end of the cartridge 114 is fixed to the motion of the cartridge gear 116, actuation of the motor 112 rotates the motor gear 124, driving the cartridge gear 116, thereby opening and closing the nozzle 160 of the cartridge 114. The first and second ends of the cartridge 114 can rotate relative to one another.

The cartridge 114 contains and dispenses a quantity of cosmetic material into the compact 108 as needed (further explained with reference to FIG. 9). The cartridge 114 dispenses the cosmetic material by rotation of a cartridge gear 116, while the cartridge 114 remains in a predetermined position substantially vertically along the Y-axis. The cartridge gear 116 is driven by a motor gear 124 which is turned by the rotation of the motor 112. The magnitude of rotation of the motor 112 is controlled by a controller 150.

A quantity of cosmetic material is released from the cartridge 114 through the nozzle 160 by a first rotational movement of the first end relative to the second end of the cartridge 114. Rotational movement of the first end of the cartridge 114 in a second direction opposite the first rotational movement may close the nozzle 160 of the cartridge 114.

The cartridge gear 116 actuates the nozzle 160 of the cartridge 114, which is attached to a hollow cartridge lead screw 202 in the cartridge 114. Rotation of the cartridge lead screw 202 proportionally displaces the cartridge piston 200, which extrudes a quantity of cosmetic material through the cartridge lead screw 202 and out of the nozzle 160 of the cartridge 114. The amount of cosmetic material expelled during the opening and closing of the nozzle 160 is a function of the displacement of the cartridge lead screw 202, which in turn is dependent on the rotational displacement of the cartridge gear 116. Rotation of the motor 112 rotates the respective motor gear 124 and the cartridge gear 116. The controller 150 detects the relative motion of the cartridge gear 116 using an optical encoder 192 and counts the number of cartridge gear slots 148 that pass the optical encoder 192 as the cartridge gear 116 rotates, as well as the direction of rotation of the cartridge gear 116. A specific unit of measure for the cosmetic material is the dosage unit 118.

In one embodiment, the pitch of the cartridge lead screw 202 is approximately 1 mm, and one rotation of the cartridge lead screw 202 dispenses approximately 1 mL of cosmetic material from the cartridge 114.

In another embodiment, depending on the shape of the cartridge key 162 of the cartridge 114, the circumferential groove 134 may be a notch or groove centered on a portion of the circumference of the cartridge 114, rather than extending completely around the circumference of the cartridge 114 and securing the cartridge 114 to the detent plunger 146 in substantially the same manner.

6 is a perspective view of the cartridge gear 116, according to one embodiment. The cartridge gear 116 may be a spur gear including a key cut 163 that corresponds to the shape of the cartridge key 162 of the cartridge 114. The cartridge gear 116 may further include a collar 168 that rotatably connects to an inner surface of a gear housing 170 to align and support the position of the cartridge gear 116 and corresponding motor gear 124. The cartridge gear 116 may include a plurality of cartridge gear slots 148 for use with an optical encoder 192 to detect the angular position of the cartridge gear 116 and cartridge lead screw 202.

7A is a perspective view of a bottom plate 166 according to one embodiment. The bottom plate 166 is connected to the dispenser body 106 and/or the lower body section 154 to restrain a plurality of cartridges 114 disposed inside the cosmetic dispenser 100 and to connect the cosmetic dispenser 100 to an induction plate 176 disposed below the bottom plate 166.

The bottom plate 166 has a plurality of cartridge through holes 172 to allow for the insertion, removal, and fixation of a plurality of cartridges 114. Each cartridge through hole 172 includes a base key cutout 165, the shape of which corresponds to the shape of the base key 164 of each cartridge 114 to prevent rotational movement of the second end of the cartridge 114, the portion that contacts the bottom plate 166, when the cartridge 114 is installed in the cosmetic dispenser 100.

Additionally, the bottom plate 166 has contact pins 174 (shown in FIG. 7B) that contact the induction plate to provide electricity to the bottom plate 166 and allow the cosmetic dispenser 100 to charge multiple batteries 126 through contact or induction.

7B is a perspective view of a bottom plate 166 from the bottom, according to one embodiment. The bottom plate 166 includes three cartridge through holes 172 disposed therein, and contact pins 174. When the bottom plate 166 is disposed in the cosmetic dispenser and on the base 102, the contact pins 174 can conduct electricity from the base 102 to the bottom plate 166. The bottom plate 166 can then inductively charge a plurality of batteries 126 disposed on the bottom plate 166.

8 is a perspective view of the base 102, according to one embodiment. A power cord 104 is connected at a first end to the base 102. The power cord 104 is connected at a second end to a power source (not shown) to provide power for operation of the cosmetic dispenser 100 and for charging the plurality of batteries 126. The base 102 includes a base recess 128 for placing an induction plate 176 and other parts of the cosmetic dispenser 100. The base recess 128 may have the ability to inductively charge the plurality of batteries 126 using power provided by the power cord 104. Additionally, the cosmetic dispenser 100 may also be filled through a contact pin 174 disposed on the inside of the bottom plate 166 when the bottom plate 166 is disposed within the base recess 128.

9A is an exploded perspective view of a compact 108 disposed on a manifold 130, according to one embodiment. The compact 108 includes a top lid 180, a compact base 182, and a bottom lid 184. The top lid 180 is disposed on the compact base 182, which is disposed on or within the bottom lid 184. The top lid 180 is secured to the compact base 182 by a magnet, as further illustrated by FIG. 9B. The compact base 182 includes a plurality of compact base through holes 138. In this embodiment, there is one compact base through hole 138 for each cartridge 114 in the cosmetic dispenser 100. A bottom lid 184 having a plurality of bottom lid through holes 136 is disposed below the compact base 182. In this embodiment, there is one bottom lid through hole 136 for each cartridge 114 in the cosmetic dispenser 100, and the bottom lid 184 is arranged such that each bottom lid through hole 136 corresponds to and connects to a compact base through hole 138 in the compact base 182.

The compact 108 is connected to the manifold 130, which is connected to and disposed on the gear housing 170 and further disposed within the dispenser body 106 of the cosmetic dispenser 100, and the compact 108 is disposed on both the manifold 130 and the dispenser body 106. The manifold 130 includes one manifold through hole 132 for each cartridge 114 in the cosmetic dispenser 100, and the manifold 130 is disposed such that each manifold through hole 132 corresponds to and is connected to a compact base through hole 136 in the bottom lid 184. Furthermore, each manifold through hole 132 of the manifold 130 corresponds to and is disposed on the gear housing cartridge hole 178 in the gear housing 170, providing a passageway through which cosmetic material can be dispensed from the nozzle 160 of each cartridge 114 through the manifold 130, the bottom lid 184, and into the compact base 182.

The compact 108 may have a configuration such that there is only one orientation in which the compact 108 can be connected to the cosmetic dispenser 100. In another embodiment, the configuration of the compact 108 may allow the compact 108 to be connected in two or more orientations.

Additionally, cosmetic materials dispensed into the compact 108 can be prevented from flowing back through the use of one-way duckbill valves 194 (not shown) disposed within each of the compact base through-holes 136 in the bottom lid 184 of the compact 108.

9B is a perspective view of compact 108 in an open position, according to one embodiment. Compact 108 includes top lid 180, compact base 182, bottom lid 184, a number of hinge magnets 186a, 186b, 186c, and 186d, a number of lid magnets 188a, 188b, 188c, and 188d, and a number of mounting magnets 196a, 196b, and 196c.

In one embodiment, the compact base 182, the plurality of mounting magnets 196a-196c, the front half of the plurality of lid magnets 188b and 188d, and the front half of the plurality of hinge magnets 186b and 186d are disposed within the bottom lid 184 with the compact base 182 disposed thereon. The plurality of mounting magnets 196a-196c are disposed to magnetically connect the compact 108 to the cosmetic dispensing device 100, for example, by connecting to the manifold 130 (FIG. 9A). The manifold 130, or a portion of a surface of the manifold 130, may be formed of a ferrous material or may contain corresponding magnets for magnetically attaching to the plurality of mounting magnets 196a-196c.

The rear half of the plurality of lid magnets 188a and 188c are disposed within the side of the top lid 180, and the rear half of the plurality of hinge magnets 186a and 186c are disposed within the side of the top lid 180. The hinge magnets 186b and 186d are disposed within the side of the bottom lid 184 so that they can contact the corresponding hinge magnets 186a and 186c in at least two planes depending on the relative position between the top lid 180 and the bottom lid 184. The hinge magnets 186a and 186b have opposite magnetic polarity, as do the respective pairs of hinge magnets 186c and 186d, lid magnets 188a and 188b, and lid magnets 188c and 188d.

The plurality of 196 and the plurality of lid magnets 188a-188d may be arranged such that the plurality of bottom lid through-holes 138 disposed in the compact base 182 are unobstructed to allow cosmetic material to flow from each of the cartridges 114 to the compact 108 as the cosmetic material is dispensed.

When the compact 108 is in the open position, the top lid 180 and the bottom lid 184 are positioned in a substantially vertical plane, and the hinge magnets 186a and 186c are magnetically connected to the hinge magnets 186b and 186d, respectively. The magnetic force between each pair of hinge magnets 186a and 186b and 186c and 186d is sufficient to hold the top lid 180 in place relative to the bottom lid 184.

When the compact 108 is in the closed position, the top lid 180 and the bottom lid 184 are positioned in substantially parallel planes, the hinge magnets 186a and 186c, which are magnetically connected to the hinge magnets 186b and 186d, respectively, and the lid magnets 188a and 188c are disposed in corresponding positions and are magnetically connected to the lid magnets 188b and 188d, respectively, and the magnetic connections between the pair of the hinge magnets 186a and 186b and the pair of the hinge magnets 186c and 186d, the pair of the lid magnets 188a and 188b, and the pair of the lid magnets 188c and 188d are sufficient to keep the top lid 180 connected to the bottom lid 184 in the closed position.

Because the top lid 180 is magnetically connected to the bottom lid 184, the top lid 180 can be completely removed from the bottom lid 184. Furthermore, depending on the arrangement of the multiple hinge magnets 186a-186d and lid magnets 188a-188d in the top lid 180 and bottom lid 184, it may be possible to connect with the bottom lid 184 in the closed position in more than one orientation about the x-z plane. Furthermore, the top lid 180 may be able to open or close about the bottom lid 184, or vice versa, about more than one axis, such as about the x-axis or z-axis.

Alternatively, the multiple mounting magnets 196a-196c may be replaced by a single mounting magnet 196 of sufficient strength to secure the compact 108 to the cosmetic dispensing device 100.

Alternatively, the multiple hinge magnets 186a-186d may be replaced by a single hinge magnet 186a of sufficient strength in the top lid 180 and a single hinge magnet 186b of sufficient strength in the bottom lid 184 to secure one side of the top lid 180 to the bottom lid 184 with the compact 108 in either the open or closed position.

Alternatively, the multiple lid magnets 188a-188d may be replaced by one lid magnet 188a of sufficient strength in the top lid 180 and one lid magnet 188b of sufficient strength in the bottom lid 184 to secure one side of the top lid 180 to the bottom lid 184 with the compact 108 in the closed position.

10 is a diagram depicting an example sequence of a primary process of a cosmetic blending method 900 according to one embodiment. Although the examples provided herein each have three cartridges, the same process can be used by a cosmetic dispenser 100 with any number of cartridges 114. The cosmetic blending method 900 includes a detection process S920, a selection process S940, and a dispensing process S960. An additional mixing process S980 can be performed by a user. As described in FIGS. 3 and 4, the detection process S920, the selection process S940, and the dispensing process S960 are performed by the cosmetic device 100 based on commands received from the controller 150, which transmits data to and receives input from the user via the smart device 300 or by indicators on the cosmetic device 100 itself.

11 is a process diagram illustrating an example of a process for detecting cosmetic material in the cosmetic dispenser 100, according to one embodiment. S920 illustrates a process for detecting cosmetic material. The process S920 may include at least one of the steps of: detecting removal and installation of the cartridge 114 in step 921; detecting at least one material characteristic of the cartridge 114 in step 922; detecting an amount of cosmetic material in the cartridge 114 in step 923; and calculating an estimated wear of the cartridge after a future dispensing operation has been performed in step 924.

The optional step 923 of detecting the amount of material in each of the plurality of cartridges 114 may include, for example, step 923a of detecting the amount of material in cartridge A, step 923b of detecting the amount of material in cartridge B, and step 923c of detecting the amount of material in cartridge C based, for example, on the total net displacement (rotations) of the cartridge gear 116 detected by the optical encoder 192 since installation of each cartridge 114.

Optional step 924 of detecting at least one material characteristic in each of the plurality of cartridges 114 may include, for example, step 924a of detecting at least one material characteristic of cartridge A, step 924b of detecting at least one material characteristic of cartridge B, and step 924c of detecting at least one material characteristic of cartridge C. The material characteristics may include at least one from the set consisting of color, texture, gloss, moisture, nutrient content, and chemical formula. This detection may be performed based on a near-field sensor disposed in the dispenser 100 detecting an RFID tag on the cartridge that stores information of the cartridge contents according to methods well understood in the art. Alternative detection methods may be used, such as barcode detection of a barcode printed on the cartridge, or detection using methods well understood in the art. The step of detecting at least one material characteristic in each of the cartridges may be performed before the optional step of detecting the amount of cosmetic material in each cartridge.

Further, process S920 may include an optional step 926 for reporting information that may be derived from historical usage data aggregated across a user or group of users, such as which cartridge 114 in the cosmetic dispenser 100 is expected to run out of cosmetic material first and by when.

12A is a process diagram illustrating an example of a process S940 for selecting a cosmetic formulation, according to one embodiment. S940 includes a process for selecting a cosmetic formulation. The process S940 includes identifying possible cosmetic formulation combinations based on the types and amounts of cosmetic materials present in the cosmetic dispenser 100, as established by the detection process S920.

Step 942d may be based on the user selecting from a set of possible cosmetic formulations for the types and amounts of cosmetic materials present in the cosmetic dispenser 100, or step 942c allows the user to select from a larger set of possible cosmetic material inventory 204 for the types and amounts of cosmetic materials that the cosmetic dispenser 100 can use.

In another example, step 943 of process S940 includes allowing a user to select a desired dosage unit 118. Varying the dosage unit 118 can change the set of cosmetic formulations available from within the cosmetic dispenser 100 if a greater amount of one or more cosmetic ingredients is required for a particular cosmetic formulation than is available to dispense a particular amount of dosage unit 118.

For example, if cartridge A contains yellow cosmetic material, cartridge B contains red cosmetic material, and cartridge C contains green cosmetic material, and only one dosage unit 118 remains in cartridge A, the user cannot select to dispense any combination of dosage unit 118 and cosmetic formulation that requires two or more dosage units 118 of yellow cosmetic material.

Further, process S940 may include step 942a for the user to select a cosmetic formula based on photo matching, step 942b for the user to select a cosmetic formula based on a recommendation, or step 942b for the user to select a cosmetic formula based on another process. U.S. Patent No. 8,634,640 describes a method for selecting colors from an image or photo in a camera or electronic device and substantially matching the colors using color reference data, and is incorporated herein by reference in its entirety.

In another embodiment, a skin diagnosis (sometimes referred to herein as a skin profile) may be performed to provide a recommended plurality of predefined colors for a user to select based on an analysis of the user's skin characteristics. The skin diagnosis determines the appropriate color for the user based on an imaging operation performed on the user's face. Examples of skin diagnosis tools known in the art are Lancome Diagnos ABS, HR Skinscope, Biotherm Bluesmart, Kiehl's Skinprofiler V. 0, CA Dermanalyzer, and Vichy Vichyconsult.

For cosmetic formulations that are possible but not available based on the results of the detection process S920, the cosmetic dispenser 100 may communicate to the user what cosmetic ingredients are needed to dispense such cosmetic formulation.

In one embodiment, in step 944, the user selects a dosage unit 118 of a cosmetic formulation that is not currently available. Step 944 may determine what cosmetic materials, e.g., what type of cartridge 114, are needed to mix and dispense the selected cosmetic formulation.

In another example, step 944 may determine what additional cosmetic formulations may become available if a particular cartridge 114 is replaced with a complete but otherwise identical cartridge 114.

In another example, step 944 may determine what additional cosmetic formulations may become available if the cartridge 114 is replaced with another cartridge 114 containing different cosmetic ingredients.

Step 945, based on the results of step 944, determines whether to prompt the user for confirmation and proceed to step 947 to proceed with dispensing the cosmetic formulation, or to step 946 to report which cartridge or cartridges 114 are required to dispense the desired cosmetic formulation.

FIG. 12B illustrates an optional process S940b that is performed solely by the dispenser apparatus 100 after a cosmetic formulation has been previously received and currently stored in the dispenser apparatus 100 in step 948. The remaining steps 943-947 of S940b are identical to those of S940 described in FIG. 12A. The process of FIG. 12B may be performed without an existing connection being established between the dispenser apparatus 100 and the device 300.

13 is a process diagram illustrating an example of a process S960 for dispensing cosmetic materials into a cosmetic dispenser 100, according to one embodiment. Step 961 represents a step for dispensing at least one dosage unit of a cosmetic formulation. Process S960 includes steps 962a-c of ejecting a requested amount of cosmetic materials from at least one cartridge 114 to generate the cosmetic formulation selected by the user in process S940, so that the cosmetic formulation may be applied, transported in a container, or otherwise available to a user. Process S960 includes optional steps 963a-c of detecting the remaining amount of cosmetic materials in each of the cartridges, and optional step 964 of recording the result in the memory of the dispenser.

After the dispensing process S960 is completed, the user may perform process S980 to manually mix the released cosmetic materials to produce the requested cosmetic formulation.

14 is a diagram depicting an example of a connected cosmetic dispensing system, according to one embodiment. A system 400 implementing the cosmetic dispenser 100 described above includes at least the cosmetic dispenser 100 and a connected device 300. Optionally, the system may further include one or more external servers 410 implemented as part of a cloud computing environment. Additionally, the system may optionally include a cosmetic material inventory 204, which is an inventory of potential cosmetic materials that may be inserted into the cosmetic device 100.

The connected device 300 may be a personal computer (PC), a laptop computer, a PDA (personal digital assistant), a smartphone, a tablet device, a UMPC (ultra-mobile personal computer), a netbook, or a notebook personal computer. In the following examples, it is assumed that the connected device 300 is a tablet device, such as an Apple iPad.

The connected devices 300 can perform wireless communication with the cosmetic dispenser 100 via a wireless communication interface circuit 774 on the cosmetic dispenser 100. However, the connected devices 300 can also have a wired connection to the cosmetic dispenser 100 via a USB interface 776 on the device 100. In addition, each device, including the cosmetic dispenser 100, can communicate with each other and with one or more external devices through an Internet connection via an 802.11 wireless connection to a wireless Internet access point, or through a physical connection to an Internet access point, for example through an Ethernet interface. Each connected device 300 can perform wireless communication with other devices, such as through a Bluetooth connection or other wireless means.

The connected device 300 is configured to receive information from a user for use in generating a cosmetic formulation that is used by the cosmetic dispenser 100 to dispense cosmetic materials into the compact 108.

15 is a block diagram illustrating the controller 150 and the circuitry of the cosmetic dispenser 100, according to one embodiment. A central processing unit (CPU) 710 provides primary control over the separate circuit components included in the device, such as the dispenser control circuitry 740 (which may include control circuitry for the motor 112, circuitry for the optical encoder 192, and inductive sensor circuitry). The CPU 710 may also control optional input/output devices 772 (such as a keyboard or mouse), memory 780, wireless communication interface circuitry 774, a universal serial bus (USB) controller 776, an LED driver 778, and a display module 780. The LED driver 778 controls the pulsing of one or more indicator lights 122.

In some embodiments, the circuitry may include one or more computing devices, such as a processor (e.g., a microprocessor, a quantum processor, a qubit processor, etc.), a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or any combination thereof, and may include discrete digital or analog circuit elements or electronics, or any combination thereof.

In one embodiment, the module includes one or more ASICs having multiple predefined logic components.

In one embodiment, the module includes one or more FPGAs, each having multiple programmable logic components.

In some embodiments, a circuit includes one or more components operably coupled (e.g., communicatively, electromagnetically, magnetically, ultrasonically, optically, inductively, electrically, capacitively coupled, wirelessly coupled, etc.) to one another.

In some embodiments, the circuit includes one or more remotely located components.

In some embodiments, the remotely located components are operatively coupled via wireless communication, such as with a connected device 300.

In some embodiments, the remotely located components are operatively coupled, for example, via one or more communication modules, receivers, transmitters, transceivers, etc.

In some embodiments, any of the CPU 710 or other components shown in FIG. 15 may be replaced with alternative circuit elements. Examples of circuitry include, for example, memory for storing instructions or information. Non-limiting examples of memory include volatile memory (e.g., random access memory (RAM), dynamic random access memory (DRAM), etc.), non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), compact disc read only memory (CD-ROM), etc.), persistent memory, etc. Further non-limiting examples of memory include erasable programmable read only memory (EPROM), flash memory, etc.

In some embodiments, the memory is coupled to one or more computing devices, for example by one or more instruction, information, or power buses.

In some embodiments, the circuitry includes one or more computer-readable media drives, interface sockets, Universal Serial Bus (USB) ports, memory card slots, etc., and one or more input/output components, such as a graphical user interface, display, keyboard, keypad, trackball, joystick, touch screen, mouse, switches, dials, etc., and any other peripheral devices.

In one embodiment, the module includes one or more user input/output components operably coupled to at least one computing device configured to control (electrical, electromechanical, software-implemented, firmware-implemented, or other control, or a combination thereof) at least one parameter associated with determining one or more tissue thermal properties in response to a detected shift in, for example, the turned-on voltage.

In some embodiments, the circuitry includes a computer-readable medium drive or memory slot configured to receive a signal transmission medium (e.g., a computer-readable memory medium, a computer-readable recording medium, etc.).

In one embodiment, a program for causing the system to execute any of the disclosed methods can be stored, for example, on a computer-readable recording medium, a signal transmission medium, etc. Non-limiting examples of signal-bearing media include recordable type media such as magnetic tape, floppy disks, hard disk drives, compact disks (CDs), digital video disks (DVDs), Blu-ray disks, digital tape, computer memory, and the like, as well as transmission type media such as digital or analog communication media (e.g., fiber optic cables, wave guides, wired communication links, wireless communication links (e.g., receivers, transmitters, transceivers, transmit logic, receive logic, and the like). Further non-limiting examples of signal-bearing media include, but are not limited to, DVD-ROM, DVD-RAM, DVD+RW, DVD-RW, DVD-R, DVD+R, CD-ROM, Super Audio CD, CD-R, CD+R, CD+RW, CD-RW, video compact disk, super video disk, flash memory, magnetic tape, magneto-optical disk, MINIDISC, non-volatile memory card, EEPROM, optical disk, optical storage, RAM, ROM, system memory, web server, and the like.

In some embodiments, the circuit includes an acoustic transducer, an electroacoustic transducer, an electrochemical transducer, an electromagnetic transducer, an electromechanical transducer, an electrostatic transducer, a photoelectric transducer, a wireless acoustic transducer, a thermoelectric transducer, or an ultrasonic transducer.

In some embodiments, the circuitry includes electrical circuitry operably coupled to a transducer (e.g., an actuator, a motor, a piezoelectric crystal, a microelectromechanical system (MEMS), etc.).

In some embodiments, the circuit includes an electrical circuit having at least one separate electrical circuit, an electrical circuit having at least one integrated circuit, or an electrical circuit having at least one application specific integrated circuit.

In some embodiments, the circuitry includes electrical circuitry forming a general-purpose computing device configured by a computer program (e.g., a general-purpose computer configured by a computer program to at least partially execute the processes and/or devices described herein, or a microprocessor configured by a computer program to at least partially execute the processes and/or devices described herein), a memory device (e.g., a form of memory (e.g., random access, flash, read-only, etc.)), an electrical circuit forming a communications device (e.g., a modem, a communications switch, an optical-electrical device, etc.), and/or any non-electrical analog thereof, such as optical or other analog.

[Personalized cosmetics ecosystem]
16 shows components of the ecosystem 1600 that are common to each type of product. The ecosystem includes a dispenser 1610, a user smartphone device 1620, and a cloud platform 1630. The smartphone is shown to include two functional blocks: smartphone application ("app") setup 1621 and smartphone application usage 1622. Smartphone application setup 1621 is described in detail below with respect to different personalization examples, and it involves establishing initial setup information for configuring a user's user profile. The setup information can then be utilized when the smartphone application is being used, which can also be transmitted to the cloud platform 1630 for use in transmitting associated appearance selections for the user.

The use of the smartphone application itself involves the user actually making the selections that lead to the color decision, transmitting the recipe to the dispenser, and performing interactive communication with the dispenser, such as tracking the status of the dispenser (such as inventory and remaining cartridges in the dispenser). The smartphone application also performs interactive communication with the cloud platform. For example, the smartphone application can receive the relevant appearance selections mentioned above, and it can also provide direct user feedback from the user regarding the previously transmitted cloud platform appearances, which can inform the cloud platform regarding the color and recipe actually selected by the user and dispensed by the dispenser. Such feedback can provide a form of machine learning to the cloud platform to improve the algorithms used by the cloud platform.

[A personalized lipstick ecosystem]
FIG. 17 shows the above ecosystem (1700) built on suggesting trending lipstick colors to consumers after analyzing social media trends, combining favorite shades, geographical location, favorite influencers, past choices, etc. It gives consumers the opportunity to choose colors based on their appearance, try them on virtually, adjust if necessary, and finally generate the formula on the spot with a connected dispenser. It is also possible to suggest colors based on the user's outfit, digitized in a selfie. Consumers can save their most favorite colors and share them with the virtual community.

17 shows that the user smartphone ultimately delivers the recipe to the dispensing device via a smartphone application ("app"). The smartphone app interacts with both the connected dispenser and the cloud platform. Before the user can perform normal operations (use) of the smartphone app, the app needs to be set up (1710) with setup information to configure the user profile. App setup can be based on the following setup inputs:
- Onboarding survey (favorite color, etc.)
Social media credentials (Instagram, Twitter, Facebook, etc.)
- Your favorite influencers to follow for colors - Geographic location based on local fashion - Environmental data (UV index, pollution, humidity, pollen)

The setup inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device connected via the internet.

Actual use of the smartphone app (1720) includes selecting a mode for lipstick selection. In this example, the modes include a mode for selecting social media trend recommendations from an algorithm (discussed in more detail below) running on a cloud platform. Another mode allows the user to create their own lipstick color using a wide variety of color options.

Another mode may allow the user to match a lipstick color to their "look" based on a selfie. In this example, suggested photo shade and finish choices are extracted. The user can virtually try on the lipstick in real time and the user can adjust the suggested color. Once the user is happy with the color, the user can touch a button displayed in the app to dispense the formula and an internal neural network breaks down the requested color into different color cartridge doses. After sending the recipe to the dispenser and dispensing the lipstick shades, the user can apply the lipstick.

After using the lipstick, users can use the app to provide feedback, whether they liked the rendering or not. Users can also save their favorite looks and colors for later reuse, and users can share looks and colors on the web via social media platforms.

The cloud platform implements the functionality shown in 1730, such as the remote algorithm workflow and improvement process.

In a workflow performed by the cloud platform, personal accounts of social media networks (influencers, most trending looks) may be scraped for data related to lipstick colors. The cloud platform may perform an analysis of one or more collected images to extract an average makeup color (lips, foundation, hair color) by segmenting the lip finish of the makeup using deep learning algorithms. For example, the cloud platform may achieve this by first detecting lips in multiple images using techniques known in the art (such as those described in U.S. Pat. No. 5,805,745, which is incorporated herein by reference). The cloud platform may then perform a comparison of the extracted colors with the colors most liked by one or more communities of users, also taking into account the user's setup inputs received from the user's smartphone device. Taking into account all of the collected data, the final step is for the cloud platform to send the results of the analysis to the user in the form of a selection of related looks as described above.

In an improvement process carried out by the cloud platform and smartphone app, users can save their favorite looks and "like" popular colors to enrich the scraping algorithm for later relevant recommendations. The cloud platform can further aggregate all of the users' feedback, and the platform can send the most trending areas per localization to new users.

The dispenser operations in block 1740 have already been described in detail above, but they are summarized below: The dispenser receives a command to dispense a specific percentage of each cartridge. The dispenser dispenses the top portion, which the user can mix to obtain the desired color. The dispenser sends the remaining inventory of the formula back to the consumer app, ensuring that only dispenseable colors are available in the UI when the user makes a selection.

FIG. 18A illustrates an example flow of operations in the above ecosystem for dispensing a personalized lipstick shade from an app perspective. In step 1810, the user may select a "mode" as discussed above, which may be a mode for selecting social media trend recommendations by a cloud-running algorithm, allowing the user to create a unique lipstick color using a wide variety of color options, or allowing the user to match a lipstick color to their "look" based on a selfie.

Step 1820 shows an example of a display when a mode is selected to select the appearance of trends driven by the cloud platform's AI algorithms. Step 1820 also shows that a menu is provided at the bottom of the interface to allow the user to switch between the above-mentioned modes.

Step 1830 shows an example display when a user can select a potential shade and adjust the shade using a suitable adjustment mechanism, such as a color palette or slider. The shade may be displayed on the user's selfie image.

Step 1840 shows that after a color is finally selected by the user, the color is resolved into a combination of available colors contained in the cartridge of the dispensing device, and then the recipe is transmitted to the dispensing device for dispensing.

FIG. 18B shows an additional flow chart of how a smartphone app algorithm in a lipstick ecosystem may allow a user to see the shade of lipstick on the user's selfie image. Recipe prediction module 1860 ("Module 2") may receive as input the device dispensing capabilities, which is the set of three lipstick ingredient cartridges currently inside the dispensing device. Another input may be the masstone color of the diluted mixture, which represents the actual color value that may be produced by the ingredients in the cartridges. The output from Module 2 is a list of recipes (actual dispensed amounts from each cartridge) and the corresponding RGB predicted masstone color resulting from each recipe. Module 1 (1870) may then perform a projection of how the lipstick will look on the actual lips based on the RGB masstone colors in the recipes and the user's lip color (lip tone), which results in a list of recipes and the corresponding RGB applied colors. The relationship between the masstone colors and the applied colors based on the user's lip tone may be pre-determined and stored. Thus, what may be presented to the user on the display is a gamut-based palette of RGB colors, such as that shown in 1890.

Figure 18C further illustrates how a particular set of cartridges can provide different shade areas for presentation to a user.

18D illustrates how the "Match My Look" mode may operate in a lipstick ecosystem app. In state 1881, a user may input a selfie image including the user's outfit. Recommendations may be generated in different ways based on recognition of the colors in the image and/or the type of outfit. For example, a first approach ("Approach 1") in 1882 may aim to form a specific type of relationship between the lipstick shade and the outfit color based on the color wheel relationship as exemplified in Approach 1, using the seven rules of color and harmony science. Alternatively, in state 1883, a pre-determined palette may be presented based on the makeup artist's recommendation, taking into account the seasonal style of the outfit combined with the outfit color.

18E shows in more detail how the lipstick recommendation engine works based on a selfie of the user's outfit. In state 1891, the probes may be set by the user at different points in the outfit where a single probe may be preferred. In state 1892, a different color palette may be assigned to each probe based on the makeup artist's recommended palette, or it may be based on a predefined color wheel relationship as shown in FIG. 18D. As seen in state 1893, the output may recommend colors based on the set of cartridges installed in the dispensing device and based on the number and priority of probes the user has decided to use. If desired, the user may also swipe to view options available on other color wheels if other sets of cartridges have been used. This may prompt the user to purchase a new set of cartridges.

[Personalized Skin Care Ecosystem]
Figure 19 shows the above ecosystem (1900) built on suggesting to the user the skin care formula that is most efficient for them based on their geographic location, environmental factors, UV cumulative exposure, and clinical indications evaluated on their smartphone or by a dermatologist. The system adjusts the ratio of actives to obtain the most efficient recipe on a daily basis. Users can save their most favorite colors and share them with the virtual community.

19 shows that the user smartphone ultimately delivers the recipe to the dispensing device via a smartphone application ("app"). The smartphone app interacts with both the connected dispenser and the cloud platform. Before the user can perform normal operations (use) of the smartphone app, the app needs to be set up (1910) with setup information to configure the user profile. App setup can be based on the following setup inputs:
- Onboarding survey (favorite color, etc.)
Skin care analysis by dermatologists or AI algorithms using selfies Geographic location based on smartphone location detection Environmental data (UV index, pollution, humidity, pollen)

The setup inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device connected via the internet.

The actual use of the smartphone app (1920) involves collecting environmental data based on geographic location and combining it with smartphone diagnostics that evaluate clinical signs (wrinkles, dark spots, firmness, pores, fine lines, dullness).

The user can also collect UV sensor data, such as the wearable UV sensor described in U.S. Pat. No. 10,060,787, incorporated herein by reference, which provides an accurate measurement of cumulative UV exposure actually received. Based on the historical data of skin assessment and environmental factors, the app processes the ideal formula to combat and prevent signs of skin aging from the environment. Once the user is satisfied with the formula, the user can touch a button displayed in the app to dispense the formula, and an internal neural network breaks down the requested formula into different cartridge components. After the recipe is sent to the dispenser and the formula is dispensed, the user can apply the formula. The user can provide feedback on their favorite formulas over a specific period of time.

The cloud platform implements the functionality shown in 1930, such as the remote algorithm workflow and refinement process. The cloud platform executes the workflow where specific notifications are sent to the app user and recipes are adjusted based on environmental predictions for UV, pollen, pollution, and temperature. For example, there is a known correlation between environmental conditions and skin aging (see "Assessing the impact of anaerial chronic urban pollution (UP) on some facial signs of differentially-aged Chinese men" at www.researchgate.net and "The skin aging exposure" at www.jdsjournal.com). Additionally, a determination of air quality can be provided using tools such as Breezometer™ and local UV index predictions (or UV exposure can be obtained based on the UV sensors described above). By providing input of the user's geographic location, the cloud platform can adjust the recipe to address environmental factors such as UV exposure and air quality. For example, FIG. 20B below shows a sample combination of environmental factors and how they correlate with the ingredients in the cartridge.

With the refinement process run by a cloud platform and smartphone app, users can save their favorite recipes that are most effective over time or feel best on their skin. Users can also share their recipes with the community.

The cloud platform can further aggregate all the user feedback and the platform can send the most trending combination areas per localization to new users.

The dispenser operations in block 1940 have already been described in detail above, but they are summarized below: The dispenser receives a command to dispense a specific percentage of each cartridge. The dispenser dispenses the top portion, which the user can mix to obtain the desired color. The dispenser sends the remaining inventory of the formula back to the consumer app, ensuring that only dispenseable ingredients are available in the UI when the user selects them.

20A illustrates an exemplary flow of operations in the above ecosystem for dispensing a personalized skin care formulation from the perspective of an app. In step 2010, the user may perform a skin care diagnostic as discussed above, which may be performed by taking a 360° selfie or a series of photos at different angles using the smartphone's camera function. In step 2020, the app performs an analysis of the user's skin to detect skin features such as dark spots, wrinkle firmness, pores, fine lines, dullness, etc. Methods for performing deep learning to train and perform this type of detection are discussed in more detail below. Alternative known methods may also be used, such as those described in U.S. Pat. Nos. 10,325,146 and 9,760,935, both of which are incorporated herein by reference.

Step 2030 presents the analysis results for one or more of the analyzed skin features. The results may be presented as a score, which may be relevant for people within the user's age range. For example, each of the skin features may be presented on a five-point scale, and features representing a worse than average score may be highlighted as the user's priority, while features that are better than average may be presented as strength.

Step 2040 shows that the app may present recommended skin care formulations ("blends") that address the user's priority skin care concerns while taking into account current environmental conditions. After the formulation is finally selected by the user, the formulation is broken down into available color combinations contained in the cartridges of the dispensing device, and the recipe is then transmitted to the dispensing device for dispensing in step 2050.

Figure 20B shows an example of how a combination of different environmental factors determined to be present for a user can result in different doses from three different cartridges. In this example, the cartridges each contain ingredients for deep damage repair, cell renewal, and daily skin aggressor protection (which may include SPF ingredients and pollution protection ingredients), directors. In this example, a fixed dose of cartridge 1 can always be used for efficacy, while the percentage of the remaining cartridges can vary based on the level of UV or pollution present.

[Personalized Foundation Ecosystem]
FIG. 21 shows an ecosystem 2100 used to dispense personalized foundation for a user. The ecosystem 2100 uses deep learning algorithms to measure the user's skin tone with a smartphone. Combined with environmental information or makeup tutorials, the system can adjust throughout the year to always provide the consumer with the best foundation color that matches their tan level/skin tone variation. Based on weather forecasts and UV exposure, the device can also increase skin care actives or SPF.

21 shows that the user smartphone ultimately delivers the recipe to the dispensing device via a smartphone application ("app"). The smartphone app interacts with both the connected dispenser and the cloud platform. Before the user can perform normal operations (use) of the smartphone app, the app needs to be set up (2110) with setup information to configure the user profile. App setup can be based on the following setup inputs:
- Onboarding survey (favorite color, etc.)
- 360° video and skin tone algorithms to detect user skin tone - Geographic location based on smartphone location detection - Environmental data (UV index, pollution, humidity, pollen)

The setup inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device connected via the internet.

The actual use of the smartphone app (2120) involves collecting environmental data based on geographic location and combining it with smartphone diagnostics to evaluate the user's skin tone. Although methods for determining the user's skin tone to match a foundation are known in the art, the following methods related to deep learning methods are considered in detail. Depending on the user's skin condition, when the environmental conditions are not optimal, the app may decide to mix skin care actives such as SPF with the foundation. The app makes decisions based on the time of the year and the person's tan level to slightly adjust the foundation color according to the evolution of the skin tone. If the color is not perfecting the matching process, the user can send feedback to the cloud to improve the algorithm remotely. In some cases, the user may want to use the device to adjust the primer color and achieve a specific makeup strategy by layering different colors.

The cloud platform implements the functionality shown in 2130, such as the remote algorithm workflow and refinement process. The cloud platform executes the workflow where specific notifications are sent to the app user to add SPF and adjust the recipe based on environmental predictions for UV, pollen, pollution, and temperature. The cloud platform may shift the master skin tone formula for the user that is sent when the consumer's tan level differs from the initial diagnosis.

With the improvement process carried out by the cloud platform and smartphone app, users can save their favorite recipes that are the most effective over time or feel the best on the skin. Users can also share their recipes with the community. The cloud platform can further aggregate all the users' feedback and the platform can send the most trending formulas per localization to new users.

The dispenser operations in block 2140 have already been described in detail above, but they are summarized below: The dispenser receives a command to dispense a specific percentage of each cartridge. The dispenser dispenses the top portion, which the user can mix to obtain the desired color. The dispenser sends the remaining inventory of the formula back to the consumer app, ensuring that only dispenseable ingredients are available in the UI when the user selects them.

Figure 22A shows an example flow of operations in the above ecosystem for dispensing personalized foundation from the perspective of an app. At step 2210, the user may perform a skin tone diagnostic as discussed above, which may be performed by taking a 360° selfie or a series of photos at different angles using the smartphone's camera functionality. At step 2220, the app performs an analysis of the user's skin to detect skin tone and shade.

In step 2230, the app may present a recommended foundation ("blend") that matches the user's skin tone while taking into account the current environmental conditions. After the foundation is finally selected by the user, it is broken down into a combination of available ingredients contained in the cartridge of the dispensing device, and then in step 2240 the recipe is transmitted to the dispensing device for dispensing.

FIG. 22B provides further details of how to perform the above skin tone diagnostic. In step 2211, the user performs a video recording of himself/herself until face detection is achieved by the smartphone app. In step 2212, face detection is performed according to known methods. If no face is detected, an error message may be displayed to the user, requesting a change in the camera angle or position relative to the user until face detection is achieved. Once face detection is performed, pre-processing is performed on the 10 frames of video data, where a normalization process and a zoom process are performed to evaluate the specific features of the user's face. Normalization is the process of matching all frames according to the same resolution, orientation width, lighting, etc. Normalization is intended to make the frames comparable to each other and ensure that the main algorithm works in the validated operating conditions/range and avoid outlier data points. Next, a skin tone prediction model is performed in step 2213 based on the median skin tone detected in the 10 frames used for prediction. In addition, a prediction noise assessment is performed using a median approach to filter/average noise. If the noise prediction is low, the LAB values of the skin tones are used to determine the blends used to create the foundation in the dispensing device. However, if the noise level is high, a safety net backup questionnaire is triggered in step 2214 that queries previous foundations the user has used. The previous foundation colors are then mapped to stored LAB values that are used to determine the blends used to create the foundation in the dispensing device.

22C-D show additional details on how deep learning is performed to allow a smartphone app (or cloud platform) to estimate skin tone in an image. The same process can also be used to allow a device to estimate skin care conditions in an image. In FIG. 22C, training is performed on a deep learning model. Input is provided at stage 2221, where a photo (which may be a 360 video selfie or a photo selfie) is input along with metadata associated with the input photo and external metadata. The metadata associated with the photo may include date and time (and/or season), along with an optional GPS location and an indication of whether the photo is taken inside or outside. The external metadata may be historical climate data. At stage 2222, pre-processing is performed on the input image, which may include face detection, centering and scaling, face recognition (depending on library availability), and lighting condition correction. At stage 2223, the deep learning model is trained on the photo by learning features for skin tone estimation. The deep learning model may also perform frame selection to determine a scalar weight of importance of selected frames based on groups of images from the same user. The output of the deep learning model (2224) provides a weighted average of skin color from the selected frames and weights from frame selection and post-processing. To calibrate the accuracy of the model, measured skin colors are input into the system for actual users in the images to train the deep learning model.

Figure 22D shows the use of a deep learning model after training has reached an adequate level. This is called "inference time" because skin tone (or skin condition) is inferred from images without being able to perform a true measurement on the user's actual skin. It can be seen that the stages in Figure 22D are the same except that there is no measurement of the user's skin color in the final stage.

[Smart replaceable cartridge system]
The dispensing device allows replacing consumable cartridges in a smart and efficient manner. The cartridges (consumables) used in the dispensing device are preferably managed in sets (such as a set of three cartridges). For example, there may be separate sets of cartridges for each of the lipstick, skin care, and foundation applications. In the system, the consumable sets are equipped with smart chips or electronic devices (such as NFC, RFID, or contact chips) configured to perform data storage and transmission/reception. In the following description, NFC (near field communication) tags are mentioned, but the claims are not limited to this example. Each cartridge has different cosmetic attributes and a unique formulation identifier that can identify attributes such as shade/finish, texture, and skin/hair benefits. The attributes are stored in an integrated circuit at production time and signed with an asymmetric cryptographic algorithm.

As will be considered in detail below, the NFC tag applied to the cartridge ensures the management of the user's color space, multi-device use cases, and traceability. The tag has two memory zones: one for production data (encoded during the filling process) and one for usage where the device encodes the usage and follow-up amounts. Furthermore, the following security mechanisms are implemented: (i) ensuring non-modification of the production data, i.e. the sector edition is password protected (secret password); (ii) ensuring no duplication of cartridge data in case of diversion, i.e. adding a signature mechanism using UIID (unique ID of the tag, encoded data, secret key of the production). The app reading the cartridge using the device then verifies that the signature is from the manufacturing entity before allowing the dispense.

Figure 23 shows the structure of cartridge 2300, similar to the cartridge above, but further including area 2310, an area where metallization is not allowed, and an NFC tag (smart chip) 2320 that is glued flat and edgeless to the bottom of the cartridge.

Figure 24 shows the data format for the data stored in the NFC tag on the cartridge. The "OFF" column is for the "offset," which is the hex coded coordinate of the data. A "page" represents a contiguous array block of data, since the system can only read and write one full page at a time. It can be seen that the format includes a tag identifier (tag ID) and several fields. In this non-limiting example, the data size of the data contained in the NFC tag is 56 bytes, but it could be more or less. The data format shows that there are information fields that are directed to production information and other fields that are directed to usage tracking.

Figure 25 shows a table with self explanatory descriptions of the various fields contained in the NFC tag data format. Furthermore, "Base Type" means the type of data, e.g. u8 means 8 bits of an unsigned integer. "Ule16" means 16 bits of an unsigned integer. "Length" and "Page" are the coordinates and allocation required in the memory page of the NFC tag. For example, "u8" is an unsigned integer coded in 8 bits, which requires 8 bits of memory space in the page 0 location.

Figure 26 shows the structure of a dispensing device 2600 equipped for a smart replaceable cartridge system. It can be seen that the dispensing device 2600 includes a contact/Hall effect sensor 2610 that detects and counts lid open/close cycles to trigger consumable reading and change detection operations. The device further includes a communication interface 2620, in this case a specific NFC antenna, for each cartridge tube that can read and write information to the cartridge's NFC tag at each dispense.

FIG. 27 illustrates a handshake between the dispensing device 2600 and a user smartphone device 2710. Various triggers for initiating communication between the dispensing device and the smartphone may include a connection being established between the devices (such as Bluetooth pairing), the dispensing device lid being opened, a dispense command from a smartphone app (such as one of the apps described above), or a dispense command entered directly into the dispensing device. In response to the trigger, the handshake includes, in step 1, reading the consumable status of the cartridge stored in the dispensing device and sending that status to the smartphone. At the same time, the user experience is updated and sent to the smartphone. "User experience" refers to the context of the device with respect to the user seeing a particular interface that displays a popup to the user when the lid is open, when the cartridge is empty, or when the color wheel has the correct color available. In step 2, the smartphone may transmit or adjust a dispense command to the dispensing device. In step 3, the dispensing device may transmit the actual dispense feedback to the smartphone. In step 4, the smartphone may transmit instructions to update the NFC tag on the cartridge when the dispensing session is complete.

Figure 28 shows a consumer app state machine illustrating the process from the app's perspective of priming cartridges prior to using the dispensing device. In an initial priming step 2810, several recipes may be dispensed in a predefined sequence and/or simultaneously from each cartridge to verify that dispensing may be performed from each cartridge. In an additional priming step 2820, the user may practice clicking on the displayed colors to control individual dispenses on command. This may be performed to ensure that the correct colors are found in the correct tubes in the device so that the recipe may be automatically assigned to the correct tubes. Step 2830 shows a display of the status of the cartridges in the dispensing device when priming is complete.

The priming process can therefore detect when a new cartridge has been installed and allows for proper engagement of the plunger of the dispensing device and the formulation contained in the cartridge so that the proper dose can be dispensed when the actual blend is being created.

Furthermore, by detecting the exact cartridges that are installed, the set of cartridges (e.g., a set of three cartridges) can be determined and the color attributes (or skin care attributes) possible for the current set are automatically updated in the app.

The app can also perform consumables management by suggesting or automatically performing pipe cleaning when a cartridge is changed. The app can further adapt the mixing area of the user interface functionality depending on the type of set of cartridges installed.

Furthermore, the app's state machine can detect inconsistent or missing sets of cartridges and suggest purchasing missing sets to reach the outcome. It can automatically detect the expiration date of any cartridge. Also, because safety information is stored on the cartridge, each separate user's smartphone will independently detect the information on the cartridge, naturally enabling multi-user and multi-device functionality.

During priming, the cartridge can also be authenticated. A 32-bit hash code is generated at production time using the manufacturer's private key, and the code is encoded onto the cartridge's NFC tag. The smartphone contains a hard-coded private key, which may be included in a software developer kit (SDK), and the hash code is verified when reading data from the NFC tag transmitted from the dispensing device. If possible, the smartphone can also be hard-coded with the private key. A unique item identification (UIID) tag can also be physically added to the cartridge or NFC tag (e.g., in the form of a barcode) and read by the dispensing device. If the cartridge authentication process fails, the dispensing device can transmit a notification to the smartphone.

In some rare cases, the user may encounter a cartridge whose NFC tag cannot be read by the machine (encoding error, tag destruction, device out of range, other defects). In this case, the user should still be able to dispense the formulation and use the device as normally as possible. To ensure this acceptable default mode, a recovery cartridge mode takes over, requiring the user to enter the cartridge's information. The SDK dependent application then creates a virtual cartridge to continue the dispensing algorithm. This auto-triggered recovery mode is turned off when a new cartridge is inserted or the NFC is in range again.

Figure 29 shows how to manage a bad cartridge NFC tag in the aforementioned scenario. If there is an error in the read data from the NFC tag, the process starts in step 2910, where the SDK installed on the smartphone activates a recovery mode for a particular tube in the dispensing device. In step 2911, the SDK attempts to write a new production sequence on the tag (by transmitting it via the dispensing device to the tag) based on the last read value. In step 2912a, if the tag is successfully written, the process ends. However, in step 2912b, if rewriting the tag fails, the process proceeds to step 2940. In step 2913, the app displays a message asking the user to verify that the cartridge is in the right channel (tube), and the dispensing device automatically opens the lid in step 2914. In other words, if the problem was that the cartridge was not inserted, this step remedies this possibility. In step 2915, the user verifies that the cartridge is in the channel. If reading is still not possible, in step 2916 the user is asked to select a cartridge color that matches the sticker on the cartridge. In step 2917 the user is asked to enter the cartridge batch ID and serial number to verify if the cartridge is new. In step 2918 the SDK creates a virtual cartridge for the channel number. The dispense operation can proceed based on the virtual cartridge being used as a proxy to properly read the NFC tag on the real cartridge. In step 2919 the virtual cartridge is stopped if the cartridge suddenly becomes readable for a predetermined number of consecutive dispense operations or if the entire set of cartridges is changed.

[Dispensing and automatic cleaning system]
Because the above system involves many different types of swapping cartridges, a special cleaning mechanism was developed that integrates with the structure of the removable compact to provide a unique cleaning capability for an enhanced user experience.

Figure 30 shows a simplified side view of an embodiment of a dispensing device 3000 showing that the dispensing device includes a retractable plate 3010 having a hole 3020 to accommodate the dispensing end of a cartridge 3030. The device includes a spring 3040 that hides the retractable plate and cartridge nozzle in a "stable raised position" when the spring is not compressed. The stable raised position also hides the nozzle tip and reduces dust or contamination in the nozzle.

It can be seen that the retractable plate includes sides that are bent at approximately 90 degrees relative to the top surface, allowing the plate to move downwardly into the slide groove 3050 in the body of the dispensing device.

Figure 31A shows that when force is applied to the retractable plate, the spring is compressed and the retractable plate is in the "down position."

Figure 31B then shows that when the removable compact/cup 3110 is placed on top of the retractable plate, the "down position" causes the cartridge nozzle to be flush with the compact/cup's dispensing surface 3120, allowing the dispensed formulation 3130 to be smoothly dispensed onto the dispensing surface.

With the retractable plate mechanism in place, a method for cleaning the surface of the compact is described with reference to FIG. 32.

FIG. 32 shows that a cleaning formulation reservoir 3250 is disposed between the body of the dispensing device and the retractable plate. In the "stable lowered position" in state 3210, the dispensing end of the cleaning reservoir is below the opening of the retractable plate. When additional force is applied to the retractable plate in state 3220, the dispensing end of the cleaning reservoir becomes flush with the surface of the compact and compression at the reservoir causes the cleaning formulation to be dispensed onto the surface of the compact as shown in state 3230.

Examples of cleaning formulations include soap, alcohol, or other known cleaning fluids.

Each of the above positions may be achieved by manual force provided by a user. Alternatively, each of the positions may be achieved by electromechanical means, such as an electrically actuated actuator device, as understood in the art. The cleaning formulation may be manually wiped, spread, and/or brushed off by a user.

FIG. 33 illustrates an alternative use of the retractable plate described above to provide a method (shown as 3350 in state 3310) of flushing the cartridge of any remaining ingredients or residue. In state 3310, the dispensing device is shown in a stable lowered position. In state 3320, when the compact is pressed down, the downward motion can translate into actuation of the cartridge's piston. This can allow the user to use/flush the last remaining ingredients in the cartridge if desired.

[Smart personalized compartment system]
Figures 34A-C show a smart personalized compartment system for use with the dispensing system described above. As mentioned above, the dispensing device in the above embodiments dispenses the cosmetic formulation into a top-located compact having (in the current example) three cartridge outlets or more. The compact can be removable or non-removable. In the following embodiments, the dispensing surface (tray) containing the compartments partitioned within the compact can either be integrated within the compact or removable (placed by the user on top of the compact in alignment with the cartridge outlets).

If the tray is removable, this allows the user to selectively choose or customize the compartments, such as selecting the number of compartments and outlets per compartment). Different compartments are possible based on product category, such as skin care, foundation, lipstick, eye shadow, etc. Different compartments are possible for the same product category, i.e. skin care (different compartments for specific zones of the face), foundation (different compartments for highlight and contour).

In one embodiment, the tray is circular and can be rotated to accommodate different combinations of products within the compartments without swapping cartridges in the dispensing device. The type of compartmented tray is stored in the companion mobile application to provide personalized recommendations based on the compartment selected.

34D and 34E illustrate mechanisms that allow detection of the tray and compartment location to be transmitted to the user's mobile device. FIG. 34D shows an embodiment of a tray that includes an NFC tag 3411 embedded in the tray or on the underside of the tray at a predefined location. When the tray is placed on the dispensing device, such that the divider 3412 creates a compartment that surrounds the outlet 3413 on the dispensing device in a specific way. An NFC reader in the dispensing device can detect the NFC tag to obtain information indicating to the user what type of tray is there (2 compartments, 3 compartments, etc.). The exact location of the NFC tag or another object embedded in the tray can be detected to determine the exact location of the compartment relative to the outlet. This can be based on the time of flight between the NFC reader and the NFC tag, or based on the weight of one or more other objects embedded in the NFC tag or tray, which can be detected using one or more Hall sensors. Also, a magnetic sensor embedded in the divider 3413 itself can be used to detect the exact location of the tray. With the information about the type of tray and the tray location detected as described above, information can be transmitted to the user's mobile device. When the additional information of the exact cartridge in the dispensing device is also transmitted to the user's mobile device, the user's mobile application can provide instructions to the dispensing device regarding cosmetic formulation based on the current state of the dispensing device.

In an alternative embodiment of the tray shown in FIG. 34D, FIG. 34E shows a method of detecting the type of tray and/or the tray position without the use of an NFC tag or other object. The tray may have a visible code 3421 (such as a QR code shown in the example of FIG. 34E). The code is provided at a predefined position on the tray. The user can then take a picture of the tray and a mobile application on the user's smartphone can detect the QR code and the position of the QR code in the image. The information in the QR code itself can be used to indicate the type of tray being used (two compartments, three compartments, etc.). At the same time, the position of the QR code can indicate the rotation of the tray relative to the outlet. Similar to the above example of FIG. 34D, using the information obtained from the QR code, the user's mobile application can provide instructions regarding cosmetic formulation to the dispensing device based on the current state of the dispensing device.

Figure 35 shows how the user can provide a final customized topping in any one of the compartments in the tray. Adding a customized topping provides benefits that cannot be achieved by the dispensing action alone, such as providing a shade coverage that has an antagonistic effect to the visibility of the pearl. For example, in a matte makeup architecture, the visibility of the pearl is hidden by the pigment. This topping technique provides an optical advantage by increasing the visibility of the pearl effect on the surface without the problems of instability or viscosity incompatibility. The use of high concentrations of pearl or large particle pearls is not possible with conventional formulations, as it leads to flakes, settling and stability issues. Customization of the final makeup product can also be done based on another desired texture/finish/effect.

Figure 35A shows that following the dispensing action at step 3501, final toppings such as pearls, glitter, stars, etc. can be added at step 3502 to customize the makeup dispensed in the compact. Alternatively or additionally, texture modifiers may be added at step 3502 to modify the final texture/finish of the makeup dispensed in the compact (i.e., changing a matte lipstick to a glossy lipstick, changing a matte foundation to a glow foundation). At step 3503, the toppings can be mixed with the dispensed formulation using an applicator.

As shown in FIG. 35B, to facilitate adding toppings when the tray is compartmentalized as shown in FIG. 33 above, lids 3510 may be provided that match the shape of a particular compartment so that toppings are not inadvertently applied to the wrong compartment in step 3502 above.

[Remote consultation]
36 illustrates a system 3600 that allows a user to send a dispensing formula to a dispensing device as described above based on the results of a digital beauty consultation with a beauty advisor (BA). The system includes a BA device 3610 that performs communication with a consumer (or "user") device 3620. Both devices are shown as smartphone devices, but they can be any type of computing device, such as a personal computer, laptop, tablet, etc.

Communication between the BA device 3610 and the consumer device 3620 can be in the form of a call, a chat session, or a video conference.

The BA device 3610 executes a remote application 3611 while communicating with the consumer device 3620. The remote application 3611 performs functions related to collecting and displaying BA consumer data and receiving input recommendations and settings from the BA.

The consumer device 3620 runs a user interface (app UI) 3621 application that enables the consumer to trigger communication with the BA, receive input to form consumer data, and perform communication with the dispensing device 3630.

The dispensing device 3630 is configured to dispense the cosmetic formulation based on instructions received from the consumer device 3620.

The dispensing device can be used for various cosmetic applications already discussed above. Further dispensing operations may be performed in connection with dispensing nail polish directly onto the user's nails, with an ultraviolet (UV) lamp provided to accelerate drying of the nail polish. Other types of cosmetic formulations may be provided, such as liquid eye shadow, dry makeup, and hair, skin, body, and sunscreen products. This list is not limiting and all categories of make-up may be used with the above system.

The workflow of a beauty consultation session between a consumer and a BA is shown in FIG. 37. In step 1, the consumer connects to the BA based on a request sent from the consumer device 3602. The request may be combined with input information from the user regarding the type of cosmetic formulation the user is seeking. The request may be directed to a server (not shown) that can determine available BAs in the system and then notify the BA device 3601 of a pending request from the consumer for a consultation. The appropriate BA for notifying the request may be pre-determined based on the BA's specialty and the type of cosmetic formulation the user is seeking. Multiple BAs may be notified of the request simultaneously, and the first BA that accepts the request may be used to determine which BA to use for the consultation. Alternatively, the consumer may select a specific BA from the app 3621.

In step 2, consumer data is collected. Figure 38 shows examples of all types of consumer data that may be collected during a consultation session. It can be seen that there may be four types of data collected: diagnostic data, biological/environmental data, and social network shared data.

The diagnostic data may be collected based on images captured by the consumer device's camera (discussed in more detail below) or may be direct responses to questions from the BA. Questions may include questionnaires, a rating of the user's priorities, or may include status questions about hormone cycles, allergies, medical conditions, etc.

The biological data can be actual biological samples provided by the user or described by the user, such as protein samples, microbiome samples, hair, skin, nail samples, and sebum, dandruff, and sweat samples. Biological samples can be collected, for example, by using a specific adhesive tape that collects stratum corneum skin/scalp cells for protein extraction and analysis (ELISA process). Microbiome samples can be collected, for example, by using absorbent paper/Q-tips specifically placed on the user's skin surface for a few seconds to collect sebum, sweat, and lipid hydrogen films. Hair samples can be collected as a strand of hair cut by the user, or several hairs with roots pulled by the user. Nail samples can be cut by the user. These samples can be collected using a sampling kit sent to the user's home and sent back to the required laboratory for analysis. Data results from the analysis are stored using a unique identifier (UI) and transmitted to a remote server.

Environmental data may include information specific to a user's area or habits. Such data may include indoor/outdoor pollution information, water quality, screen time, and commuting habits (such as car, bicycle, motorcycle use). This information may be collected based on questions or publicly available information.

Social network sharing data may be obtained from monitoring consumer interests on social media platforms. This data may include lifestyle, travel, dining, and activity interests. This data may be obtained from the BA remote application 3611 or from an external server after receiving input from users on their internet links to their social media platforms.

Returning to FIG. 37, steps 2-4 show an example of a consultation session involving collecting diagnostic data using a smartphone camera when a consumer seeks a facial skin care formulation. In step 2, a "selfie" image or video of the user is captured on the consumer device. In step 3, a 3D transformation is performed on the selfie image or video to obtain a 3D replica of the consumer's face and features. If possible, the 3D information may be obtained using a time-of-flight or LIDAR sensor. In step 4, a surface analysis is performed on the 3D image to detect facial features such as wrinkles, acne, blackheads, or others. Based on this analysis, an initial diagnostic output of which conditions need to be treated may be generated. In step 5, a facial map may be generated that performs a cross-sectional cut of the user's 3D image, and treatment goals may be determined at this point. These treatment goals may be determined and highlighted automatically or manually by the BA. Depending on the location and nature of the treatment goals, different cosmetic formulations (recipes) may be determined and displayed to the user in step 6. The face map may include a color legend below the face map that indicates recipes used in areas on the face map that are displayed in a particular color.

Different types of skin care ingredients may be dispensed into different compartments of the removable compact device, as described above, with the possibility that multiple amounts of treatment may be used based on the user's skin condition.

Figure 39 shows a different example of a consultation session where a consumer is interested in hair care products. Following the connection with the BA in step 1, steps 2 and 3 are similar to steps 2-5 of Figure 37 described above. However, instead of a 3D surface analysis of the face, a 3D surface analysis is performed on the user's hair. Although not shown, after the surface analysis, a hair map can be generated based on cross-sectional cuts similar to step 5 of Figure 37 and treatment targets can be determined. As a final output, different cosmetic formulas (recipes) for the user's hair can be determined and displayed to the user, similar to step 6 of Figure 37.

Figure 40 shows yet another example of a consultation session where a consumer is interested in a nail gel product dispensed from a dispensing device. The type of dispensing device shown in Figure 40 allows a user to insert a finger into the dispensing device, nail gel is dispensed onto the user's fingernails, and a UV lamp is used to cure the nail gel. Following connection with the BA in step 1, step 2 is similar to step 2 in Figure 37 above. However, instead of a 3D surface analysis of the face, in step 3, consumer data is analyzed for the shape, surface, and color of the user's nails. Based on the user's preferences, a color palette may be displayed to the user in step 4 along with the type of product for the user to choose from. In step 5, program settings for the dispensing device are determined prior to the dispensing operation.

Figure 41 shows an example of the type of dispensing device settings that may be determined during the remote consultation illustrated in Figures 37, 39, and 40. For dispensing formulations, multiple types of viscosities may be determined for liquids, gels, creams, balms, or waxes. All routine step formulations may be determined for formulations related to hair care, nail color (gel and traditional nail polish), liquid eye shadow, skin care, body care, or sun care. Different types of formulation possibilities may be determined, including oxidation sensitive cosmetics, fresh cosmetics, or dry cosmetics. Steps to achieve the correct volume are determined, including dispensing the correct volume/area, dispensing in the correct application order, and dispensing at the correct speed for a more aesthetic result.

Additional features such as UV lamp settings as described in the nail gel example above may be determined during the consultation. The automatic cleaning and priming steps mentioned above may also be determined.

Thus, the foregoing discussion merely discloses and describes exemplary embodiments of the present invention. As will be understood by those skilled in the art, the present invention may be embodied in other specific forms without departing from its spirit or essential characteristics. Thus, the disclosure of the present invention is intended to be illustrative, but not limiting of the scope of the present invention, as well as the scope of the other claims. This disclosure, including any readily identifiable variations of the teachings herein, defines in part the scope of the terms of the preceding claims, so that the subject matter of the invention is not dedicated to the public.

Claims (10)

1. An apparatus for dispensing cosmetic materials, comprising:
a dispensing device configured to receive a plurality of cartridges, each containing a cosmetic material, and to dispense a designated amount of the cosmetic material from each cartridge through a respective outlet corresponding to each cartridge and onto a dispensing surface;
the dispensing surface includes at least one partition that divides the dispensing surface into a plurality of sections, each section corresponding to an area surrounding at least one of the respective outlets;
the apparatus is configured to transmit information regarding the plurality of partitions to an external device;
The apparatus, wherein the dispensing surface includes a visible code disposed at a predetermined location on the dispensing surface, the visible code configured to have information encoded thereon about the plurality of compartments, and the external device configured to read the visible code via an image captured by an image capture device and detect specific current locations of the plurality of compartments based on the current location of the visible code detected in the captured image. The device of claim 1, wherein each compartment of the plurality of compartments corresponds to a distinct type of cosmetic material. The device of claim 1, wherein the dispensing surface, including the at least one partition, is removable. The device of claim 1, wherein at least one compartment corresponds to an area surrounding at least two respective outlets. The device of claim 1, wherein the dispensing surface is configured to rotate while the cartridge remains in a fixed position. The device of claim 1 , wherein at least one of the compartments is made of a hydrophilic or hydrophobic material . The apparatus of claim 6, wherein the dispensing surface includes an embedded object configured to be sensed by a detection device included in the dispensing device, and the dispensing device is configured to transmit the information regarding the plurality of compartments and specific current locations of the plurality of compartments to the external device based on the sensed embedded object. The apparatus of claim 7 , wherein the embedded object is a Near Field Communication (NFC) tag and the detection device is an NFC reader. The device of claim 1, wherein at least one of the compartments is configured to receive a lid. 1. A method carried out by an apparatus for dispensing cosmetic materials, comprising:
receiving, via a dispensing device, a number of cartridges each containing a cosmetic material, and dispensing a designated amount of the cosmetic material from each cartridge through a respective outlet corresponding to each cartridge onto a dispensing surface, the dispensing surface including at least one partition dividing the dispensing surface into a number of compartments each corresponding to an area surrounding at least one of the respective outlets, the method further comprising:
transmitting information about the plurality of partitions to an external device;
The method, wherein the dispensing surface includes a visible code disposed at a predetermined location on the dispensing surface, the visible code configured to have information encoded thereon about the plurality of compartments, and the external device is configured to read the visible code via an image captured by an image capture device and detect specific current locations of the plurality of compartments based on the current location of the visible code detected in the captured image.

Images