Two-piece gift with $65 orders Shop now Free standard shipping on all US ordersShop all

SHOP
EXPLORE

Shade Finder Virtual Try-On

How Our Tech-Powered App Finds Your Perfect Concealer Shade

Education

Just a few short years ago, dipping into an in-store tester of makeup to find the right concealer shade was the only option for matching one's complexion. And now? It's just one option. Thankfully, online shopping trends were already driving AI tech to help people find the perfect shade of makeup virtually, long before the pandemic made in-store testing less appealing. Using a combination of machine learning (in this case, feeding a machine a massive catalog of images of different skin tones so it can “learn” to identify real-life complexions) and AI, companies like Beauty Labs have figured out how to take swatching your makeup virtual — and with highly accurate results.

Rose Inc’s version of this is called Shade Finder. It’s a tool that helps online and in-app shoppers find ideal makeup shades in seconds flat. No swatching on skin and no lengthy quizzes, just the right shade of makeup, right now. It’s easy. Snap a photo, answer a couple of questions and get matched with your best makeup shade. But how does it work? Ahead, see how the latest in machine-learning tech is making buying makeup online easier than ever.

FOUNDATION MATCHING THROUGH MACHINE LEARNING AND ATA POINTS, NOT SWATCHING

Oftentimes, our best bet in blind-buying foundation online has meant relying on categories of shades, like “deep golden” or “medium neutral,” to suss out what colors might be right for us. But by running a photo of our face against machine-learning technology — or an ever-growing database of photos from which a machine is able to compare data points and your skin — best matches for tone are found in milliseconds. What’s more, casting such a wide net helps the tool avoid the kind of color bias that plagues some human-made recommendations. Because ShadeFinder continues to be shown such an exhaustive set of skin images, it only gets more and more precise.

“Like with anything machine learning, the more data you give it, the more it learns and the quicker it can identify things correctly,” says Jessica Smith, a project manager with the tool’s maker, Beauty Labs. “We are looking at male, female, young, old and that full range of skin types so that it can really identify as absolutely everyone in the spectrum. It’s constantly improving.”

Rewriting the rules for taking your best selfie

Forget bouncy hair and the perfect smile; this selfie only requires the clearest read of your facial features and skin. That means holding your head in a central position, pulling your hair back, ditching glasses, hats and anything else that might cast a shadow, and stepping into natural light. “This will give the most even sort of analysis of your face,” says Smith.

Expert tips, without the YouTube video

One of the perks of buying makeup IRL (or falling down a rabbit hole of YouTube tutorials) is being able to glean application and usage tips from experts — and the engineers behind ShadeFinder know this. So in addition to creating a tool that matches you with your best product, they’ve created a more prescriptive service: After answering a few questions about your aesthetic goals, and being matched by ShadeFinder with your optimum shades, shoppers are given targeted tips for how to use the product. (Think: how to de-emphasise dark circles, use the right brushes to blend for a no-makeup look, or use a concealer in a few ways to achieve different outcomes.) This can be particularly helpful with first-to-market formulations that may work a little differently than conventional formulas might.

Save the filters for TikTok

When taking your picture with ShadeFinder, you’ll notice virtual nodes splashed across your face. These detection keypoints help better render a true facial analysis — and as 3D modeling experts work to exponentially grow these key points, expect to see lipstick, eyeshadow and other color cosmetic virtual try-on tools that show the products as they would actually sit on the lips, cheeks, brows and eyes rather than how they might be painted atop a bot. The result is a true-to-life rendering of what a particular shade — or 12 — might look like on you, without having to swipe a single bullet. “With everything we do, we try to make sure that the experience is one against you, not a filter,” Smith says.

What’s next: swifter skin health analysis

Just like data science experts made selecting a makeup shade virtual and simple, the same is being done to help shoppers address skin concerns. As you read this story, these experts are showing machines hundreds of thousands of images of acne, wrinkles, hyperpigmentation and other common skin conditions across a wide spectrum of tones and ages to teach them how to recognize cystic zits from whiteheads andblackheads, smile lines from forehead creases, and more. The outcome will be tools that not only guide appropriate skin care purchases for a current skin concern, but also use AI to track one’s changing skincare needs over time. “I think AI is going to be quite useful in overcoming our sense of self awareness with some of these [skin] conditions,” Smith says, adding she also expects future digital tools to also help provide expertise when a consultation with a skincare professional is either too cost prohibitive or not accessible.

Collections

Product Type

Filter

Collections

Product Type

Filter

TRY BEFORE YOU BUY

Top Sellers

Softlight Skin-Smoothing Liquid Foundation

Skin Enhance Luminous Tinted Serum

Cream Blush Refillable Cheek & Lip Color

Softlight Luminous Hydrating Concealer

Solar Infusion Soft-Focus Cream Bronzer

Lip Cream Weightless Matte Color

Solar Radiance Hydrating Cream Highlighter

Lip Treatment Hydrating Lip Balm

Cream Blush Refillable Cheek & Lip Color Refill

Satin & Shimmer Duet Eyeshadow

Satin Lip Color Rich Refillable Lipstick

Number 3 Foundation Brush

Radiant Reveal Brightening Serum

Solar Power Luminous SPF 30 Serum

Ultra-Black Lash Lift Serum Mascara

Number 2 Blush Brush

Lip Sculpt Amplifying Lip Color

Hydration Replenish Microencapsulated Moisturizer

Eye Revival Brightening Eye Cream

Number 4 Dual-Ended Concealer Brush

About US

Editorial

Search By Category

Popular Searches

Softlight Skin-Smoothing Liquid Foundation

Softlight Skin-Smoothing Liquid Foundation

Skin Enhance Luminous Tinted Serum

Skin Enhance Luminous Tinted Serum

Cream Blush Refillable Cheek &

Cream Blush Refillable Cheek & Lip Color

Softlight Luminous Hydrating Concealer

Softlight Luminous Hydrating Concealer

Search By Category

Popular Products

Softlight Skin-Smoothing Liquid Foundation

$54

Skin Enhance Luminous Tinted Serum

$49

Cream Blush Refillable Cheek & Lip Color

$32

Categories

How Our Tech-Powered App Finds Your Perfect Concealer Shade

FOUNDATION MATCHING THROUGH MACHINE LEARNING AND ATA POINTS, NOT SWATCHING

Rewriting the rules for taking your best selfie

Expert tips, without the YouTube video

Save the filters for TikTok

What’s next: swifter skin health analysis

Skin Enhance Luminous Tinted Serum

Skin Enhance Luminous Tinted Serum

Softlight Luminous Hydrating Concealer

Softlight Luminous Hydrating Concealer

Number 4 Dual-Ended Concealer Brush

Number 4 Dual-Ended Concealer Brush

Related Stories

Your Bag 0

Choose Free Samples

Sample: Skin Enhance Luminous Tinted Serum

Sample: Eye Revival Brightening Eye Cream Sachet

Sample: Reusable Cosmetic Rounds (2 Pads)

Sample: Radiant Reveal Brightening Serum Sachet

Recommended

The Satin Lip Trio

The Satin Lip Trio

Cream Blush Refillable Cheek &