Heya - I'm the author. Glass is a cross-platform MCP server that gives an agent a way to see and interact with GUI apps. I don't
like building UI. Agents can code it, but can't verify or debug it.
Glass exists to close that loop.
Glass is purpose-built for software development, and aims to enable headless, parallelized agent work while
the user continues to use the machine unhindered[0]. It minimizes token usage, increases consistency, and just goes faster
by preferring to interact with an app's accessibility tree, before taking the screenshot route (which glass also fully supports).
Glass is cross-platform and the code is Apache-2.0 licensed. We release builds for Linux, Windows, and macOS hosts.
Glass supports development targeting the three above host platforms, Android (all hosts) and iOS[1] (macOS hosts). The
internal API is backend-agnostic, and new platforms can be added in the future pretty easily.
Feedback is very welcome, either here or at github. If it breaks on your app, I am especially interested in
knowing about that. I hope you build great things.
[0] Due to the license enforcement on Windows and macOS, isolated headless development targeting those
platforms requires a VM. It will otherwise interact directly with the desktop.
Android and iOS development on those platforms can still be done headlessly via the emulators.
[1] The iOS backend does not currently support multi-touch gestures.
Heya - I'm the author. Glass is a cross-platform MCP server that gives an agent a way to see and interact with GUI apps. I don't like building UI. Agents can code it, but can't verify or debug it. Glass exists to close that loop.
Glass is purpose-built for software development, and aims to enable headless, parallelized agent work while the user continues to use the machine unhindered[0]. It minimizes token usage, increases consistency, and just goes faster by preferring to interact with an app's accessibility tree, before taking the screenshot route (which glass also fully supports).
Glass is cross-platform and the code is Apache-2.0 licensed. We release builds for Linux, Windows, and macOS hosts. Glass supports development targeting the three above host platforms, Android (all hosts) and iOS[1] (macOS hosts). The internal API is backend-agnostic, and new platforms can be added in the future pretty easily.
Feedback is very welcome, either here or at github. If it breaks on your app, I am especially interested in knowing about that. I hope you build great things.
[0] Due to the license enforcement on Windows and macOS, isolated headless development targeting those platforms requires a VM. It will otherwise interact directly with the desktop. Android and iOS development on those platforms can still be done headlessly via the emulators.
[1] The iOS backend does not currently support multi-touch gestures.