Creator SDK

Authoring and runtime SDK for XR medical-training simulations.

Index:

Creator SDKRuntime SDKDynamic View: Creator SDK - Runtime SDKConversation loop between a trainee and an in-scene embodiment agent during a running simulation.TraineeJARIASpeech BackendJARIA ClientAzure SpeechTraineeJARIASpeech BackendJARIA ClientAzure SpeechTraineeJARIASpeech BackendJARIA ClientAzure Speech1: Speaks to the in-scene character2: Transcribes the voice (speech-to-text)3: Asks the agent for a response4: Synthesises the spoken reply (text-to-speech)[Azure Speech SDK]5: Speaks and animates the response
Dynamic View: Creator SDK - Runtime SDK
Conversation loop between a trainee and an in-scene embodiment agent during a running simulation.
LegendUser cardExternalAI moduleRelationship
Creator SDKEditor ToolingDynamic View: Creator SDK - Editor ToolingHow an AI assistant authors SceneGraph content through the Creator MCP tools.Content AuthorAI Authoring AssistantUnity AI MCP HostMCP SceneGraph ToolsMCP InfrastructureSceneGraph EditorContent AuthorAI Authoring AssistantUnity AI MCP HostMCP SceneGraph ToolsMCP InfrastructureSceneGraph EditorContent AuthorAI Authoring AssistantUnity AI MCP HostMCP SceneGraph ToolsMCP InfrastructureSceneGraph Editor1: Describes the training scenario to build2: Calls a Creator MCP tool[MCP (stdio / HTTP)]3: Invokes the requested [McpTool] method4: Resolves scene objects + the loaded SceneGraph5: Creates + connects actions on the authored graph
Dynamic View: Creator SDK - Editor Tooling
How an AI assistant authors SceneGraph content through the Creator MCP tools.
LegendUser cardDefault componentExternalAI moduleRelationship