AI & Needle Engine

Needle Engine integrates with popular AI tools so you can get help, write components, and inspect live scenes — all without leaving your workflow.

Code with AI

The Needle Engine skill gives your AI coding assistant deep knowledge of the entire engine — so it can write components, debug issues, and answer questions with full context.

Install

npx skills add needle-tools/ai

Works with Claude Code, Cursor, GitHub Copilot, Codex, Gemini CLI, Windsurf, and many more.

Automatic Setup

If you're already using @needle-tools/engine, the skill installs automatically via the Vite plugin — no manual setup needed.

What the Skill Knows

The skill provides your AI assistant with comprehensive context about:

  • Components & Lifecycle — creating components, start(), update(), onEnable(), serialization, decorators
  • Physics — Rapier integration, rigidbodies, colliders, raycasting, triggers, character controllers
  • Networking & Multiplayer — state sync, RPC calls, room management, custom server setup
  • WebXR (VR & AR) — session management, controllers, hand tracking, spatial UI, Everywhere Actions
  • Animation — Animator, PlayableDirector, timeline control, blending
  • UI — canvas rendering, text, buttons, layout, responsive design
  • Deployment — Vite configuration, optimization, compression, hosting platforms
  • Editor Integration — Unity/Blender workflows, export pipeline, glTF extensions

How It Works

The skill bundles curated documentation and API references into a format that AI assistants understand natively. When you ask your AI to "add a physics-based interaction" or "set up multiplayer sync", it already has the full picture — no manual context needed.

The skill is open source. Contributions are welcome.

Connect AI to your live scenes

The Needle MCP Server lets AI tools talk directly to your running 3D projects via the Needle Inspector. Works with Claude Desktop, Cursor, VS Code Copilot, Windsurf, and more.

What it can do:

  • Search all Needle documentation with semantic search
  • Inspect scene hierarchies, materials, and properties in real time
  • Edit objects and settings through natural language
  • Debug and optimize live scenes

Set up the MCP Server →

Use Needle docs with any AI

Every documentation page is available as plain markdown — just change .html to .md in the URL.

For local models (Ollama, etc.) or tools that accept a context file:

Ask questions

Needle Forum AI — Ask publicly. Searches all Needle docs, forum posts, and community content. Answers are visible to the community.

Needle Cloud AI — Ask privately. Same knowledge base, private to your team.