Creator SDK

Authoring and runtime SDK for XR medical-training simulations.

Component View: Creator SDK - Runtime SDKTrainee speaks to an in-scene AI character; identity, language model, and voice services participate in the loop.Creator SDK[Software System]Runtime SDK[Container: Unity / C# (.NET) — Runtime asmdefs from core, experimental, and omen packages]CoreExtraJARIA Client[Component: C# — MAGES.JARIA.Runtime] Sends conversation turns to theJARIA language model.Speech Backend[Component: C# —MAGES.Experimental.EmbodimentJARIA.MicrosoftCognitiveServices.Runtime] Pluggable speech-to-text andtext-to-speech provider.Microphone[Component: C# —MAGES.Hub.{Web,NonWeb}Microphone] Provides the audio input stream;build target selects animplementation.User Authentication[Component: C# —MAGES.UserAuthentication.Runtime] Authenticates the trainee andvalidates their license at runtime.SceneGraph[Component: C# — MAGES.SceneGraph.Runtime] Runs the authored proceduralsimulation and broadcasts actionprogress.JARIA[Component: C# —MAGES.Experimental.EmbodimentJARIA.Runtime] Drives in-scene AI characters:listens, consults the LM, speaks theresponse.Trainee Performs a medical-training scenario inthe simulator.ORamaVR Cloud[Software System] ORamaVR's hosted backend: identityat login.oramavr.com, AI agentplatform at api.oramavr.com,content portal atportal.oramavr.com, and analytics atanalytics.api.oramavr.com.Azure Speech[Software System] Cloud speech-to-text andtext-to-speech.JARIA → SceneGraph — Serialises current action to JSON payloadSerialises current action to JSON payloadJARIA → JARIAClient — Sends EmbodiedAIRequest / JariaRequestSends EmbodiedAIRequest / JariaRequestJARIA → SpeechBackend — STT/TTS via speech handler interfacesSTT/TTS via speech handler interfacesJARIA → Microphone — Captures the microphone audio streamCaptures the microphone audio streamJARIAClient → UserAuthentication — Reads userId via UserAuthenticationModuleReads userId via UserAuthenticationModuleTrainee → JARIA — Speaks; receives voice + subtitles + animationsSpeaks; receives voice + subtitles + animationsJARIAClient → ORamaVRCloud — Sends conversation turns [HTTPS / JSON]Sends conversation turns[HTTPS / JSON]JARIA → ORamaVRCloud — Reads tenant token budget [HTTPS / JSON]Reads tenant token budget[HTTPS / JSON]UserAuthentication → ORamaVRCloud — Authenticates the user session and validates access [HTTPS / OIDC]Authenticates the user session and validates access[HTTPS / OIDC]SpeechBackend → AzureSpeech — Speech-to-text + text-to-speech [Azure Speech SDK]Speech-to-text + text-to-speech[Azure Speech SDK]
Component View: Creator SDK - Runtime SDK
Trainee speaks to an in-scene AI character; identity, language model, and voice services participate in the loop.
LegendUser cardSoftware systemExternalCore moduleAI moduleRelationship