Overview

The X-AnyLabeling Chatbot is an AI assistant integrated into the annotation workflow. It supports natural-language conversations, batch image-question answering, and importing or exporting single-turn and multi-turn multimodal data in ShareGPT format for frameworks such as LLaMA-Factory.

Getting Started

Accessing the Chatbot

To open the Chatbot, click the Chatbot icon in the left toolbar of X-AnyLabeling or use the following keyboard shortcut to quickly launch the Chatbot interface:

• Windows/Linux: Ctrl + 1
• macOS: ⌘ + 1

Initial Setup

On the first launch, you need to configure the necessary API credentials and models in the right panel of the Chatbot window.

User Interface

The Chatbot features a three-panel interface designed for streamlined interaction.

Left Panel - Model Providers

Provider	API Key	API Docs	Model Docs
Anthropic	Link	Link	Link
DeepSeek	Link	Link	Link
Google AI	Link	Link	Link
Ollama	-	Link	Link
OpenAI	Link	Link	Link
OpenRouter	Link	Link	Link
Qwen	Link	Link	Link

Note

The Custom provider supports configuring any custom endpoint that is compatible with the OpenAI API format. After selecting a provider, the model list will only display relevant models and favorites for the current provider.

Middle Panel - Chat Interface

• Chat Window: View your conversation history with the AI. Supports copy, edit, delete, and rerun functions.
• Message Input: Enter your questions or instructions. Includes a one-click option to clear the current conversation history.
• Special Command: After importing an image, use the @image prompt to include the current image in your query.

Right Panel - Image Preview and Settings

• Image Preview: Displays the current image.
• Function Components:
  • Image Navigation: Switch between the previous and next images.
  • Image Import: Import a single image file or an entire directory.
  • Data Export: Export annotation results.
  • Batch Processing: Run processing tasks on multiple images.
• Backend Settings: Configure API endpoints, keys, and select models.
• Generation Parameters: Input system prompts, temperature settings, and maximum output length.

Key Features

Visual Question Answering (VQA)

Ask questions about the current image to efficiently generate single-turn or multi-turn image-text dialogues:

@image Please describe this image.

Batch Image Processing

Process multiple images with the same prompt to speed up your workflow:

1. Load an image folder.
2. Click the "Run All Images" button.
3. Enter the prompt to apply to all images.
4. You can set the concurrency level to control processing speed (default is 80% of CPU cores, maximum is 95%).

Dataset Import/Export

Supports one-click export of multimodal image data in the ShareGPT format.

Other

Configuration Files

The Chatbot stores its configuration in the following directory:

~/xanylabeling_data/chatbot/

This directory contains:

• models.json: Contains user preferences and model configurations.
• providers.json: API provider settings.