#1414th of 16 in Voice and realtime

openai-realtime-solar-system

Next.js demo: talk to a 3D solar system via OpenAI Realtime

Stars
515
License
MIT
Last commit
Mar 2026
Language
TypeScript

Overview

A Next.js app that connects the browser to the OpenAI Realtime API over WebRTC and lets you control a Spline 3D solar system by voice. The model calls functions to focus planets, show moons, draw bar or pie charts, fetch the ISS position and switch to an orbit view. Tools, instructions and voice are defined in lib/config.ts, and the scene URL in components/scene.tsx.

Who it is for: Developers learning Realtime API function calling with WebRTC

Strengths

  • Working example of Realtime API function calls driving UI and Spline animations
  • Small codebase: tools and prompt in lib/config.ts, scene hooks in components/scene.tsx
  • MIT license, runs with npm install and an OPENAI_API_KEY
  • Planets also respond to clicks and keyboard shortcuts, not only voice

Weaknesses

  • Requires an OpenAI API key; no other model providers supported
  • Demo, not a template: no auth, persistence or deployment config
  • Echo or background noise can interrupt the model, per the README
  • Custom scenes need Spline event setup; first scene load is heavy

What it needs

  • TypeScript, OpenAI Realtime
  • Needs OpenAI Realtime API, Spline

Also in Voice and realtime

See all 16
Also in Voice and realtime
RankProjectScore
1agent-starter-reactNext.js voice assistant frontend for LiveKit Agents948 stars, MIT51 out of 100
2agent-starter-pythonPython voice agent on LiveKit Agents with turn detection and simulations264 stars, MIT50 out of 100
3agent-starter-nodeNode.js voice agent on LiveKit Agents with turn detection and simulations114 stars, MIT50 out of 100
#4voice-ui-kitReact components and templates for Pipecat voice agent frontends419 stars, BSD-2-Clause45 out of 100
#5pipecat-examplesRunnable Pipecat voice agent examples for phone, web and deployment395 stars, BSD-2-Clause41 out of 100