Baraklabs

Nemotron Omni + OpenClaw: Build an Omni-Modal Telegram Bot

One model to rule them all โ€” Text, Images, Video, and Audio in a single unified loop. ๐Ÿš€

What is Nemotron 3 Nano Omni?

NVIDIA recently released Nemotron 3 Nano Omni, an omni-modal reasoning model. Unlike traditional setups that stitch different models together for vision and text, everything here runs in one unified loop.

Built on a hybrid Mixture-of-Experts (MoE) architecture, it features 30 billion parameters, but only 3 billion are active at any time. This results in high reasoning performance with significantly lower compute costs.

Unified Multimodal Context

๐Ÿ“ธ Computer Vision

Verify deliveries, read documents, or analyze order photos at drive-thrus.

๐ŸŽ™๏ธ Audio & Video

Summarize long clips, add captions, or search inside videos automatically.

๐Ÿ“„ Document Mastery

Explain complex contracts, research papers, and financial reports in simple terms.

๐Ÿค– Autonomous Agents

Let AI operate apps like a humanโ€”handling support tickets and searching the web.

Hardware & Input Specs

To run Nemotron Omni locally via Ollama, you need at least 28GB of RAM and a context window of 128k.

Input TypeFormatLimit
Videomp4Up to 2 min (256 frames)
Audiowav, mp3Up to 1 hour
Textโ€”Up to 131K context

Step 1: Install OpenClaw

Requires Node.js 22+ (v24 Recommended).

Install via NPM

npm install -g openclaw@latest

Onboard the Model

openclaw onboard --install-daemon

Step 2: Connect OpenRouter & Telegram

  1. Choose OpenRouter during onboarding.
  2. Generate an API Key at openrouter.ai and paste it into OpenClaw.
  3. Search for Nemotron-3-nano-omni-30b in the model browser.
  4. Open Telegram and message @BotFather to create a new bot and get your Bot Token.

โš ๏ธ Important: Image Upload Fix

If you experience issues uploading images via Telegram in version 2026.5.3, you need to downgrade OpenClaw to a stable version for media handling.

# Stop OpenClaw first, then run:
npm install -g openclaw@2026.3.24

Check version: openclaw --version

Testing Your Omni Bot

Launch the gateway and open your Telegram bot. Use the /model command to verify itโ€™s using Nemotron Omni.

Prompt: "[Upload the image] How many penguins are in the image?"
Result: "There are 3 penguins in the image."

By using one model for all media types, you eliminate the need for separate vision and transcription tools, streamlining your entire AI workflow.

Recommended Blogs