ByteDance Doubao User Agents

Doubao Bot

Mozilla/5.0 (compatible; Doubaobot/1.0; +https://www.doubao.com/bot)

Primary user agent for Doubao's AI crawling operations.

ByteSpider (Main Crawler)

Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; +https://zhanzhang.toutiao.com/)

ByteDance's general web crawler used across all services.

JavaScript Detection

// Detect ByteDance/Doubao user agents
const isDoubao = /Doubaobot|ByteDance-AI|ByteBot|Bytespider|TikTokSpider/i.test(navigator.userAgent);

if (isDoubao) {
  console.log('ByteDance crawler detected');
  // Track visit, optimize for content platforms
}

Block All ByteDance Crawlers

# Block all ByteDance/Doubao crawlers
User-agent: Doubaobot
User-agent: Bytespider
User-agent: TikTokSpider
User-agent: ByteDance-AI
User-agent: ByteBot
Disallow: /

⚠️ Note: Blocking Bytespider may affect your visibility in ByteDance's content ecosystem including Toutiao.

Allow Public Content

# Allow public content, block private areas
User-agent: Bytespider
User-agent: Doubaobot
Disallow: /admin/
Disallow: /private/
Disallow: /api/
Allow: /blog/
Allow: /videos/
Allow: /articles/

API Configuration

// Doubao API endpoint (via Volcano Engine)
const API_ENDPOINT = 'https://ark.cn-beijing.volces.com/api/v3';

// Available models
const MODELS = {
  'doubao-pro-32k': 'Doubao Pro 32K',
  'doubao-lite-32k': 'Doubao Lite 32K',
  'doubao-character': 'Doubao Character',  // Character creation
};

// Example API call
const callDoubao = async (message) => {
  const response = await fetch(
    `${API_ENDPOINT}/chat/completions`,
    {
      method: 'POST',
      headers: {
        'Authorization': `Bearer ${VOLCANO_API_KEY}`,
        'Content-Type': 'application/json'
      },
      body: JSON.stringify({
        model: 'doubao-pro-32k',
        messages: [
          { role: 'user', content: message }
        ]
      })
    }
  );
  
  return await response.json();
};