Material Model

Real-worlding with AI

AGI/ASI is coming. But the physical world doesn't look very AI-able.

Recent developments have laid the foundations for AI to sense and act upon the world.

  • General-purpose LLMs with good visual understanding (Gemini-2.5-pro) released circa March 2025
  • Anthropic, OpenAI, and Google consolidating around a unified protocol to connect agents with external data and tools (MCP) circa April 2025

So let's build a world agent.

Think of us as the protocol layer between silicon and concrete. When intelligence outgrows the screen, it will need a body. Material Model is already stitching one together.

World Agent Architecture

 +----------------+ +----------------+ +---------------+
 |  Camera, other | | Digital Data   | | Smart Sensors,|
 | Passive Sensors| |   Sources      | | Drone, Robots |
 +----------------+ +----------------+ +---------------+
         \                 |            /           ^
          \                |           /            |
           \               |          /             |
            +------------------------+              |
            |  User-Chosen Triggers  |              |
            +------------------------+              |
                           |                        |
                           v                        |
   +--------------------------------------------+   |
   | Command Center ft. general-purpose agents  |   |
   |      with strong visualcapabilities        |   |
   +--------------------------------------------+   |
           /               |             \          |
          v                v              v         |
      +-------+        +-------+       +-------+    |
      |  MCP  |        |  MCP  |       |  MCP  |    |
      +-------+        +-------+       +-------+    |
         |                 |              |         |
         v                 v              v         |
  +-------------+  +---------------+  +-----------+ |
  | Send email, |  | Smart devices |  |  Feedback |-+
  |   text, etc |  |               |  |           |
  +-------------+  +---------------+  +-----------+
                

We build the command center, UI, and initial integrations open-source. Workflows and MCP connections can be arbitrarily made by the user or chosen from our marketplace.