← docs

HeatSync

The world's first end-to-end AI-assisted surf competition platform. Competition management, wearable telemetry, computer vision, and judge assistance — unified in a single stack.

The Problem

Surf competition technology is fragmented. Competition management, AI vision, wearable telemetry, and judge assistance are spread across separate providers with no integration between them. No single platform combines all five capabilities.

ProviderDoesDoesn't
LiveHeatsCompetition management, live resultsAI, vision, telemetry
Flowstate AIComputer vision, maneuver detectionOcean competitions, comp management
Refresh TechnologyLegacy scoring hardware, judge replayCloud, AI, modern UI
WSL/AWSApple Watch telemetry, broadcast AIJudge assistance, open platform
STACTGeneric event managementAI, surf-specific features

The Platform

HeatSync is built in six layers — three production, three in development.

1
Competition Management
PRODUCTION
  • Full ISA-compliant event lifecycle: registration → seeding → draw → heats → scoring → results → season points
  • 5-judge blind scoring with drop high/low
  • Priority management with ISA establishment phase
  • Interference handling (half penalty on 2nd-best wave, double = DQ)
  • Head judge panel with outlier detection and score overrides
  • Auto-advancement with snake seeding
  • Public live results, admin dashboard, print heat sheets, tabulation
2
Apple Watch Priority Display
PRODUCTION
  • Real-time priority position on surfer's wrist via Apple Watch Ultra
  • WebSocket relay server (Supabase Realtime → Node.js → watchOS)
  • Zero-typing connect flow — surfer taps heat, taps name
  • Score updates, interference alerts, countdown timer
  • Haptic feedback — priority change, interference, 30-second warning
  • 50 reconnect attempts with exponential backoff for WiFi range drops
  • ISA-compliant: displays only publicly available data
3
Livestream and Broadcast
PRODUCTION
  • Cloudflare Stream integration with HLS player
  • Score overlay API for OBS — real-time athlete data, positions, DQ status
  • VOD library for replays
4
Watch Telemetry
ROADMAP
  • Extend existing watch infrastructure to capture accelerometer, gyroscope, GPS
  • Wave detection from motion patterns (paddle → popup → ride → kickout)
  • Auto-count waves without manual input from head judge
  • Per-wave metrics: ride duration, speed, G-force on turns
  • Stream sensor data alongside priority via existing relay
5
Computer Vision
ROADMAP
  • Process standard broadcast and drone feeds — no proprietary hardware
  • Jersey color detection for surfer identification
  • Maneuver classification: bottom turn, cutback, snap, aerial, barrel, floater
  • Wave quality metrics: wave size, section length, tube time
  • Spray height measurement via computer vision
  • Edge AI on standard camera feeds
6
Judge Co-Pilot
ROADMAP
  • Real-time objective data overlay on judge's iPad
  • AI score range suggestion based on CV + telemetry analysis
  • Consistency alerts when judge diverges from panel average
  • Historical comparison with similar waves from past events
  • Post-heat audit report for head judge review
  • Positioned as "Judging Aid" — assists, never replaces human judgment

Capability Matrix

CapabilityHeatSyncWSL/AWSFlowstateLiveHeatsRefresh
Competition managementPartial
ISA blind judging (5-panel)
Priority + interference
Apple Watch for athletes
Computer vision (ocean)PlannedRoadmapPools only
AI maneuver detectionPlanned✅*
AI judge assistancePlanned
Wearable telemetryPlanned
Livestream overlay
Real-time WebSocket
Cloud-native

*Flowstate AI operates in surf parks only (controlled cameras, consistent waves). Not built for ocean competition.

Architecture

┌──────────────────────────────────────────────────────────┐
│                    HEATSYNC PLATFORM                     │
├──────────┬──────────┬──────────┬──────────┬──────────────┤
│  JUDGE   │  WATCH   │  CAMERA  │ BROADCAST│  ADMIN /     │
│  iPad    │  Ultra   │  FEED    │  OBS     │  PUBLIC      │
├──────────┴──────────┴──────────┴──────────┴──────────────┤
│                   PROCESSING LAYER                        │
│  CV Engine · Telemetry · Wave Detection · Maneuver ID    │
├──────────────────────────────────────────────────────────┤
│                  SUPABASE (CLOUD)                         │
│  Scores · Priority · Telemetry · CV Results · Realtime   │
├──────────────────────────────────────────────────────────┤
│                WEBSOCKET RELAY SERVER                     │
│          Supabase Realtime → Watches / Clients           │
├──────────────────────────────────────────────────────────┤
│                  DELIVERY LAYER                           │
│  Judge Co-Pilot · Watch Priority · Live Results · OBS    │
└──────────────────────────────────────────────────────────┘

ISA Compliance

HeatSync is built for full compliance with the International Surfing Association rulebook (April 2025) and ISA Judging Manual. Key compliance points:

RequirementImplementation
5-judge panel mandatedFull 5-panel support with drop high/low averaging
Human-in-the-loopPriority and interference calls by judges only. AI is advisory, never autonomous
AI cannot autonomously scoreAI classified as "Judging Aid" (same as Refresh replay system). Suggests, never decides
Electronic coaching rulesWatch displays only publicly available data — priority, time, published scores
Blind judgingJudges see only their own scores. No cross-judge visibility
Head judge authorityHead judge can override any score (with logged reason), certify heats, manage priority
Protest window15-minute window after certification. Scores locked.

Training Data Flywheel

Every competition event generates labeled training data that improves the AI:

Video (multiple angles)
  + Human judge scores (ground truth)
  + Watch telemetry (motion data)
  = Labeled training examples per wave

Market Context

MetricValue
Global surfing population35 million
Surf equipment and tech market$4.59B (2024)
Sports technology market$26.79B (2024), 23.2% CAGR
AI in sports market$8.92B (2024) → $60.78B by 2034
ISA member federations100+ countries

Technology Stack

ComponentTechnologyPurpose
Web AppNext.js 16 + SupabaseScoring, admin, live results, APIs
Real-timeSupabase Realtime + WebSocketLive score updates to all clients
WatchSwiftUI + CoreMotion (50Hz)Telemetry capture, priority display
CV: DetectionYOLO26 (Ultralytics)Real-time surfer detection (<50ms)
CV: SegmentationSAM 3 (Meta)Text-prompted surfer segmentation + tracking
CV: TrackingSupervision (Roboflow)ByteTrack multi-object tracking, annotation
CV: AnalysisGemini 3 FlashManeuver classification (1-3s per frame)
CV: Deep AnalysisGemini 3.1 ProFull wave analysis with ISA scoring criteria
Co-Pilot API/api/copilotTelemetry + CV overlay for judge iPads
DeployVercel + Cloudflare StreamWeb hosting + livestream

API Reference

EndpointPurpose
/api/judge/score-v2Blind score submission + wave averaging
/api/judge/head-panelAll scores, overrides, certification
/api/judge/priorityPriority state machine (start, wave_ridden, suspend, etc.)
/api/judge/interferenceInterference calls + penalty application
/api/telemetryWatch telemetry data + wave events
/api/copilotJudge Co-Pilot — telemetry + CV overlay + consistency alerts
/api/stream/active-heatOBS overlay data with telemetry
/api/compete/season-pointsSeason point calculation

Risk Mitigation

RiskMitigation
ISA rejects AIPositioned as "Judging Aid" (same classification as Refresh replay). Never claims autonomous scoring
CV accuracy insufficientStart as supplementary data for judges. Improve with training data flywheel over time
Beach WiFi unreliableApple Watch Ultra has LTE fallback. 50 reconnect attempts. System degrades gracefully
Ocean CV harder than poolsStart with jersey detection and wave detection (solvable). Complex maneuver classification iterates over time

HeatSync is developed by the Barbados Surfing Association. For partnership inquiries and federation pilots, contact bsa.surf.