Virtual Try-On Beauty Store with AI Skin Analysis

A direct beauty storefront that previews selected shades on-camera and turns an optional cosmetic skin scan into reviewable product suggestions.

EcommerceBeauty & FashionMargin on beauty product sales; no separate charge for the initial try-on or cosmetic analysis.
MVP time8-12 weeks
DifficultyHard
Infra cost$12-$165
RevenueMargin on beauty product sales; no separate charge for the initial try-on or cosmetic analysis.
Review the decision summary
8,502 views
Updated August 2, 2026

Decision snapshot

Is this worth validating?

Build this if

A beauty brand can supply accurate shade assets, product attributes, and a cosmetic-only recommendation policy that shoppers understand.

Avoid this if

The product must diagnose skin conditions, guarantee treatment results, or deliver photorealistic AR across unsupported devices in the first release.

Validate first

Test 100 guided sessions on supported devices and verify that shoppers understand the non-medical boundary, can reject suggestions, and can reach a product detail from a usable result.

Problem and target customer

Why this exists

Customer problem

Online beauty shoppers cannot test shade appearance and receive generic skincare recommendations, increasing uncertainty while exposing brands to risky claims if image analysis is presented as diagnosis.

Who pays

Direct-to-consumer beauty brands with a defined cosmetic catalog and shoppers willing to use camera or image input for non-medical guidance.

Business model

Direct product sales through the brand storefront, with the try-on and analysis experience supporting conversion rather than a separate subscription.

Editorial note

The MVP combines two different trust problems: whether an overlay feels useful and whether image-based guidance stays safely cosmetic. Keeping video local and making every recommendation dismissible gives the shopper meaningful control.

Do not market a vision model as a dermatologist. The first release should cover a small, well-prepared shade catalog and a conservative observation vocabulary, then measure usability and comprehension rather than promising skin outcomes.

Choose your next step

What do you need next?

Evaluate the operating tradeoffs quickly, or inspect how to build the MVP.

Evaluation preview

What would it take to run?

Directional infrastructure estimates for the current 1,000 guided try-on sessions assumption. Open the full calculator when you are ready to change it.

Open full cost and deployment
ManagedSelected
$23-$70/ month

App, database, backups, and logs for catalog browsing, temporary cosmetic analysis, and recommendation review with minimal platform operations.

Lowest operating effort
Lean self-hosted
$10-$35/ month

A small cloud server runs catalog browsing, temporary cosmetic analysis, and recommendation review, PostgreSQL, and scheduled backups.

Lowest baseline cost
More control
$43-$165/ month

Separate web, data, and background capacity for catalog browsing, temporary cosmetic analysis, and recommendation review when operational isolation matters.

Most separation and control

Build blueprint

Build the first paid use case

Product goal

Who it serves and what it must change

Target user
Beauty shoppers choosing cosmetics or skincare products from a direct brand catalog.
Problem
Shoppers cannot assess shade appearance and receive broad advice that lacks visible limits or product-specific reasoning.
Measurable outcome
On a supported device, a shopper can preview a shade or opt into cosmetic analysis, understand its limits, reject suggestions, and open a matching product variant.

MVP scope

What ships now and what waits

Included

  • Catalog and variants
  • Camera capability and consent
  • Landmark shade overlay
  • Still-image cosmetic analysis
  • Attributed recommendation cards
  • Checkout handoff

Excluded

  • Diagnosis
  • Persistent biometric gallery
  • 3D try-on
  • Custom vision training
  • Treatment guarantees

UX and user flow

Screens, actions, and states

Beauty Goal

Explain available experiences, permissions, and cosmetic-only limits.

Choose try-onChoose analysisContinue without camera
Try-On Studio

Preview supported shades with clear capture and device states.

Allow cameraChange shadePause preview
Recommendation Review

Show editable suggestions with reasons, uncertainty, and product variants.

Reject suggestionCompare productAdd variant to cart

Primary flow

  1. Shopper selects experience and consent
  2. Capability check chooses camera or fallback
  3. Client renders overlay or server analyzes one still
  4. Policy filter validates output
  5. Shopper reviews suggestions and opens product
  6. Hosted checkout handles payment

Loading, empty, and error states

  • Device: checking, supported, unsupported, denied
  • Analysis: consent_pending, processing, ready, blocked, failed
  • Suggestion: proposed, dismissed, selected

Core entity outline

Entities and business rules

ProductVariant

Defines purchasable shade, formula attributes, price, and inventory status.

Fields
product_id, shade_code, finish, attributes, price, available
Relations
Belongs to Product, Referenced by Recommendation
AnalysisSession

Tracks consent, processing state, expiry, and structured cosmetic observations without retaining the image by default.

Fields
session_token, consent_at, status, observation_json, expires_at
Relations
Has many Recommendations
Recommendation

Maps an allowed observation or selected goal to a catalog variant with a visible reason.

Fields
analysis_session_id, variant_id, reason_code, confidence_band, dismissed_at
Relations
Belongs to AnalysisSession, References ProductVariant

Business rules

  • No image leaves the device before explicit analysis consent
  • Camera frames are not stored
  • Output containing diagnostic language is blocked
  • Only available variants can be recommended or purchased
  • An expired analysis session cannot be retrieved

Architecture and data flow

Components, integrations, and controls

Browser try-on

Check capability and render supported overlays locally from facial landmarks.

Cosmetic analysis gateway

Accept one consented still, request structured observations, apply safety rules, and discard input.

Catalog matcher

Map allowed attributes to available variants through deterministic rules.

Integrations

  • MediaPipe browser runtime
  • OpenAI Responses API with image input
  • Stripe hosted checkout

Data flow

  1. Catalog supplies approved shade assets
  2. Camera preview stays in browser
  3. Consented still reaches analysis gateway
  4. Validated observations map to catalog attributes
  5. Selected variant enters checkout

Failure handling

  • Offer catalog browsing when camera is denied or unsupported
  • Delete temporary input after timeout or completion
  • Block unsafe model output and show a neutral retry message
  • Preserve cart if analysis fails

Security

  • Short-lived analysis token
  • No face image in logs or analytics
  • Content-type and size validation
  • Server-side catalog price lookup

Rate limits

  • Limit analysis attempts per session and IP
  • Cap image dimensions
  • Set model spend limits
  • Throttle checkout creation

Deliverables and acceptance

Definition of done for the MVP

Deliverables

  • Responsive storefront
  • Device and consent flow
  • Landmark shade overlay
  • Structured analysis gateway
  • Recommendation policy
  • Checkout handoff and privacy test plan

Acceptance criteria

  • Denied camera permission leaves catalog usable
  • No frame is uploaded during try-on
  • Diagnostic model text never reaches the shopper
  • Temporary image data is removed after processing
  • Unavailable variants cannot enter checkout

Recommended stack

Enough technology for the first version

Storefront

Next.js and TypeScript

Combines catalog, device checks, try-on, analysis consent, and checkout handoff.

Try-on

MediaPipe Face Landmarker

Runs landmark-based overlays in the browser for a controlled shade set without uploading video.

Analysis

OpenAI vision-capable Responses API

Produces structured cosmetic observations and catalog attributes under a strict non-diagnostic prompt.

Commerce

PostgreSQL and Stripe Checkout

Keeps product variants authoritative and delegates card handling to hosted checkout.

Why this is sufficient

Client-side landmarks keep the first try-on bounded and privacy-conscious. Model output is treated as uncertain cosmetic guidance, mapped through explicit product attributes, and never allowed to name a condition.

Not required for the MVP

Face image archiveCustom-trained vision modelDermatology records3D asset pipelineNative mobile app
Next stepTurn the blueprint into an execution plan

Copy the build prompt, model the operating cost, and choose where to deploy.

Build and ship

Execution

Build, price, and deploy the MVP

Once the blueprint is clear, use the prompt, cost model, and deployment options to start building.

Build prompt

Copy this into a builder

Use a TypeScript storefront with client-side landmark rendering and a server-side structured vision call; validate devices and safety copy before expanding product coverage.

Build prompt

Your build prompt is ready

Open the prompt pack whenever you are ready to take this blueprint into your builder.

Based on the blueprintReady for your builderFollow-up steps included

Cost calculator

Model the MVP operating cost

A technical run-cost estimate for the first production version. Team, acquisition, payment fees, and business COGS are excluded.

Estimated monthly total$23-$70

$12-$35 per 500 guided try-on sessions

Guided try-on sessions / month1,000 guided try-on sessions
Selected pathEasiest
Pricing checkedAug 2, 2026

Usage assumptions

Use beta workload metrics when available.

Infrastructure approach
App, database, backups, and logs for catalog browsing, temporary cosmetic analysis, and recommendation review with minimal platform operations.
Cost breakdown

$23-$70 per month

Low and high values allow for usage variance and plan headroom.

Managed Railway deployment

App, database, backups, and logs for catalog browsing, temporary cosmetic analysis, and recommendation review with minimal platform operations.

50K guided try-on sessions included, then $8-$20 per 50K guided try-on sessions
$20-$65
Model inference (GPT-5.4 mini)

Processes an expressly accepted still image into structured, non-medical cosmetic observations and product attributes.

1K guided try-on sessions x 2.5K input + 500 output tokens
$3.09-$5.16

Included

  • Storefront and database hosting
  • Vision-model inference
  • Client-side try-on runtime
  • Backups and monitoring

Not included

  • Percentage-based payment fees
  • Product inventory and fulfillment
  • Custom AR assets
  • Clinical validation
  • Marketing and returns

Pricing basis

The estimate combines the selected infrastructure path, required operating modules, selected optional modules, and usage above included monthly allowances. Taxes and regional uplifts are excluded.

Deployment options

Pick the operational tradeoff

Choose based on operating preference, not only the headline price.

EasiestRecommended

Railway

Deploy the beauty catalog, analysis gateway, and checkout service with managed services, environment variables, logs, and a short path from prototype to beta.

$20-65/month at beta scale before workflow add-ons

Good fit

  • Fast deployment
  • Managed database
  • Simple previews

Limitation

Usage-based compute needs budget alerts as activity grows.

Cheapest

Vultr

Run the app, worker, and database on one small Vultr VPS with Docker Compose and explicit backups.

$7-30/month before workflow add-ons

Good fit

  • Low baseline
  • Portable Docker setup
  • Predictable capacity

Limitation

The operator owns database maintenance and incident response.

More control

DigitalOcean

Separate application, worker, data, storage, and backup responsibilities as the workload grows.

$40-160/month before workflow add-ons

Good fit

  • Separated services
  • Capacity headroom
  • AWS ecosystem

Limitation

More moving parts increase setup and observability work.