Open Innovation THE ASTRO MINDSSubmitted August 1, 2026

UltroX

An MCP app on the Model Context Protocol built by THE ASTRO MINDS at the SRMIST NitroStack × MCP To The Moon hackathon and deployed on NitroStack.

About this project

# Ultro **Touch nothing. Control everything.** ## The problem Touchscreens assume you can always reach out and tap — not true in an OR, a busy kitchen, a cleanroom, or for anyone with limited hand dexterity. Most gesture demos are flashy toys that spin a 3D object for fun. We wanted gesture control that does real work. ## What it does Ultro is a touchless control hub: a living plasma orb rendered in WebGL, driven entirely by bare-hand gestures over a webcam. Pinch and move to navigate, two-hand pinch to zoom, open palm to select, point to target a control. Behind the orb sit three panels: - **Data** — live system metrics you browse without touching a screen - **Devices** — smart-device toggles fired by gesture, with instant visual + audio confirmation - **Activity** — a log of every action taken Every interaction has a distinct sound, not just a visual pulse — so the interface stays usable when you can't watch the screen closely. A full keyboard fallback covers anyone without a webcam. ## How we built it Three.js renders a 50,000-point additive particle orb with a custom GLSL shader (radial gradient, breathing animation, cursor-driven repel field), composited through multi-pass bloom post-processing. MediaPipe Hands drives real-time landmark tracking with hysteresis-based pinch detection and a small gesture classifier (pinch, palm, fist, point). Web Audio API generates context-aware feedback tied to actions and live data. Next.js powers the app shell. ## Built with Next.js · Three.js · WebGL/GLSL · MediaPipe Hands · Web Audio API · TypeScript

Open Innovation track

Solve any real-world problem with AI, regardless of industry or domain.

Live MCP appSource code

Team THE ASTRO MINDS

  • Aakash TSLead

  • R Vasantha rajan

  • V ROHITH GOMEZ

  • THARUNRAJ R

← All SRMIST projects

Frequently asked questions

What does UltroX do?
# Ultro **Touch nothing. Control everything.** ## The problem Touchscreens assume you can always reach out and tap — not true in an OR, a busy kitchen, a cleanroom, or for anyone with limited hand dexterity. Most gesture demos are flashy toys that spin a 3D object for fun. We wanted gesture control that does real work. ## What it does Ultro is a touchless control hub: a living plasma orb rendered in WebGL, driven entirely by bare-hand gestures over a webcam. Pinch and move to navigate, two-hand pinch to zoom, open palm to select, point to target a control. Behind the orb sit three panels: - **Data** — live system metrics you browse without touching a screen - **Devices** — smart-device toggles fired by gesture, with instant visual + audio confirmation - **Activity** — a log of every action taken Every interaction has a distinct sound, not just a visual pulse — so the interface stays usable when you can't watch the screen closely. A full keyboard fallback covers anyone without a webcam. ## How we built it Three.js renders a 50,000-point additive particle orb with a custom GLSL shader (radial gradient, breathing animation, cursor-driven repel field), composited through multi-pass bloom post-processing. MediaPipe Hands drives real-time landmark tracking with hysteresis-based pinch detection and a small gesture classifier (pinch, palm, fist, point). Web Audio API generates context-aware feedback tied to actions and live data. Next.js powers the app shell. ## Built with Next.js · Three.js · WebGL/GLSL · MediaPipe Hands · Web Audio API · TypeScript
Who built UltroX?
UltroX was built by team THE ASTRO MINDS at the SRMIST NitroStack × MCP To The Moon hackathon, in the Open Innovation track.
What is an MCP app and how is it built?
An MCP app is an application built on the Model Context Protocol — an open standard that lets AI agents connect to tools, data, and APIs. This project exposes MCP tools and resources that agentic AI systems can call. It was built and deployed on NitroStack, the full-stack platform for shipping MCP apps and servers.