AI Retail Experience for Allbirds: case study

Project brief

Use AI to extend Point of Sale (POS) beyond checkout to inventory, fit and sales support for Allbirds stores.

Solution

AI extends POS beyond checkout

  • Scans products Computer vision
  • Measures feet Computer vision
  • Improves the customer experience LLMs + predictive models

Strategy

Extend POS beyond checkout with three kinds of AI

Scans shoes and measures feet through the kiosk camera.

  • Product scan
  • Foot measurement
  • Inventory count

POS Allbirds AI

Diagram highlights: Allbirds + AI: in-store experience

Customer flow

AI handles four steps, so customers shop without waiting for staff.

AI-powered step

START
  • Attract screen
  • Tap to begin
SCAN A SHOE Computer vision
  • Hold a shoe to the camera
  • Matches style and color
PRODUCT DETAILS LLMs
  • Price, sizes, colors
  • Auto-written description
CHECKOUT
  • Pay at the kiosk
  • Email receipt
FIND MY FIT
  • Choose men’s or women’s
MEASURE Computer vision
  • Stand on the mat
  • Length and width
PREFERENCES
  • Activity, feel, color
YOUR MATCHES Predictive models
  • Top picks and size
  • Fit confidence
TRY ON
  • Request a pair
  • Ticket for pickup

Customer Mode · Interactive prototype

Open full screen (opens in a new tab)

Staff flow

AI handles inventory, product entry and insights.

AI-powered step

  1. DASHBOARD Total sales, top products, sales growth, sales by employee
  2. Path 1 INVENTORY Computer vision Quantity, reorder level, supplier, location, batch, condition
  3. PRODUCT DETAILS LLMs Name, price, size, color, category, SKU, images
  4. Path 2 SEARCH Brand, keyword, category
  5. SEARCH RESULTS Filter by price, rating, availability, reviews
  6. Both paths PRODUCT PAGE
  7. CHECKOUT Name, email, phone, address, payment, shipping
  8. Path 3 PERFORMANCE Predictive models Sales insights from every sale
DASHBOARD INVENTORY PRODUCT DETAILS PRODUCT PAGE CHECKOUT SEARCH SEARCH RESULTS PERFORMANCE Computer vision LLMs Predictive models SALE Delivery Date Reorder Level Quantity / Stock Supplier / Vendor Expiration Date Location / Storage Batch / Lot Number Condition / Status Size Price Color / Variants Product Name Category / Type Description SKU / Product ID Images / Media Name Price Email Phone Address Product Payment Method Shipping Option Brand Keyword Category Price Rating Shipping Options Availability (In Stock / Out Of Stock) Customer Reviews Total Sales Top Products Sales Growth Sales By Employee Search Entry Filters

The steps are also listed as text before the diagram.

Staff flow diagram, enlarged

Staff Mode · Interactive prototype

Open full screen (opens in a new tab)

Outcomes

A north star for AI in retail stores

  1. Vision setting

    AI as an extension of POS, not a separate tool.

  2. North star prototype

    Customer and staff modes, ready to test.

  3. Alignment

    One reference for product, engineering and retail.

Allbirds kiosk prototype start screen
  • Faster product entry for staff
  • More in-store use of POS beyond checkout
  • Better staff retention
  • Fewer returns through better fit