Baraklabs

Nemotron Omni + OpenClaw: Build an Omni-Modal Telegram Bot

One model to rule them all — Text, Images, Video, and Audio in a single unified loop. 🚀

What is Nemotron 3 Nano Omni?

NVIDIA recently released Nemotron 3 Nano Omni, an omni-modal reasoning model. Unlike traditional setups that stitch different models together for vision and text, everything here runs in one unified loop.

Built on a hybrid Mixture-of-Experts (MoE) architecture, it features 30 billion parameters, but only 3 billion are active at any time. This results in high reasoning performance with significantly lower compute costs.

Unified Multimodal Context

📸 Computer Vision

Verify deliveries, read documents, or analyze order photos at drive-thrus.

🎙️ Audio & Video

Summarize long clips, add captions, or search inside videos automatically.

📄 Document Mastery

Explain complex contracts, research papers, and financial reports in simple terms.

🤖 Autonomous Agents

Let AI operate apps like a human—handling support tickets and searching the web.

Hardware & Input Specs

To run Nemotron Omni locally via Ollama, you need at least 28GB of RAM and a context window of 128k.

Input TypeFormatLimit
Videomp4Up to 2 min (256 frames)
Audiowav, mp3Up to 1 hour
TextUp to 131K context

Step 1: Install OpenClaw

Requires Node.js 22+ (v24 Recommended).

Install via NPM

npm install -g openclaw@latest

Onboard the Model

openclaw onboard --install-daemon

Step 2: Connect OpenRouter & Telegram

  1. Choose OpenRouter during onboarding.
  2. Generate an API Key at openrouter.ai and paste it into OpenClaw.
  3. Search for Nemotron-3-nano-omni-30b in the model browser.
  4. Open Telegram and message @BotFather to create a new bot and get your Bot Token.

⚠️ Important: Image Upload Fix

If you experience issues uploading images via Telegram in version 2026.5.3, you need to downgrade OpenClaw to a stable version for media handling.

# Stop OpenClaw first, then run:
npm install -g openclaw@2026.3.24

Check version: openclaw --version

Testing Your Omni Bot

Launch the gateway and open your Telegram bot. Use the /model command to verify it’s using Nemotron Omni.

Prompt: "[Upload the image] How many penguins are in the image?"
Result: "There are 3 penguins in the image."

By using one model for all media types, you eliminate the need for separate vision and transcription tools, streamlining your entire AI workflow.

Recommended Blogs