Baidu ERNIE Bot User Agents

ERNIE Bot Crawler

Mozilla/5.0 (compatible; ERNIEBot/1.0; +https://yiyan.baidu.com/bot)

Primary user agent for ERNIE Bot's AI-specific crawling operations.

Baiduspider (Traditional Crawler)

Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Baidu's traditional search crawler, also used for ERNIE Bot content indexing.

JavaScript Detection

// Detect Baidu ERNIE user agents
const isERNIE = /ERNIEBot|ERNIE-Bot|YiyanBot|Baiduspider|Baidu-YunGuanCe/i.test(navigator.userAgent);

if (isERNIE) {
  console.log('Baidu ERNIE crawler detected');
  // Track visit, customize content for Chinese market
}

Server-Side Detection (Node.js)

// Express.js middleware
app.use((req, res, next) => {
  const userAgent = req.headers['user-agent'] || '';
  const isErnieBot = /ERNIEBot|ERNIE-Bot|YiyanBot|Baidu-YunGuanCe/i.test(userAgent);
  const isBaiduspider = /Baiduspider/i.test(userAgent);
  
  if (isErnieBot || isBaiduspider) {
    console.log('Baidu AI crawler detected:', userAgent);
    req.isBaiduAI = true;
  }
  next();
});

Block All Baidu AI Crawlers

To completely prevent Baidu's AI crawlers from accessing your website:

# Block all Baidu AI/ERNIE crawlers
User-agent: Baiduspider
User-agent: ERNIEBot
User-agent: ERNIE-Bot
User-agent: YiyanBot
User-agent: Baidu-YunGuanCe
Disallow: /

⚠️ Warning: Blocking Baiduspider will affect your Baidu Search rankings in China!

Block Only AI Features (Recommended)

Allow traditional search crawling but block AI-specific features:

# Block AI features but allow search indexing
User-agent: ERNIEBot
User-agent: ERNIE-Bot
User-agent: YiyanBot
User-agent: Baidu-YunGuanCe
Disallow: /

# Allow Baiduspider for search indexing
User-agent: Baiduspider
Allow: /

Selective Access

Allow public content while protecting sensitive areas:

# Selective blocking for Baidu AI
User-agent: Baiduspider
User-agent: ERNIEBot
User-agent: YiyanBot
Disallow: /admin/
Disallow: /private/
Disallow: /user/
Disallow: /api/
Allow: /blog/
Allow: /products/
Allow: /docs/

API Configuration

// ERNIE Bot API endpoint
const API_ENDPOINT = 'https://aip.baidubce.com/rpc/2.0/ai_custom/v1';

// Available models
const MODELS = {
  'ernie-bot-4': 'ERNIE Bot 4.0',      // Latest flagship
  'ernie-bot-3.5': 'ERNIE Bot 3.5',    // Balanced performance
  'ernie-speed': 'ERNIE Speed',        // Fast responses
  'ernie-lite': 'ERNIE Lite'           // Lightweight
};

// Get access token first
const getAccessToken = async () => {
  const response = await fetch(
    `https://aip.baidubce.com/oauth/2.0/token?grant_type=client_credentials&client_id=${API_KEY}&client_secret=${SECRET_KEY}`
  );
  const data = await response.json();
  return data.access_token;
};

// Example API call
const callERNIE = async (message) => {
  const accessToken = await getAccessToken();
  
  const response = await fetch(
    `${API_ENDPOINT}/wenxinworkshop/chat/ernie-bot-4?access_token=${accessToken}`,
    {
      method: 'POST',
      headers: { 'Content-Type': 'application/json' },
      body: JSON.stringify({
        messages: [{ role: 'user', content: message }]
      })
    }
  );
  
  return await response.json();
};