Introduction
The Labellerr MCP Connector enables autonomous multi-step labeling workflows through conversational prompts. Claude chains all 23 tools intelligently: creating datasets, establishing label templates, deploying projects, checking annotations, monitoring live progress, and exporting ground truth.All workflows below use the Hosted Connector. Ensure you have connected Labellerr in Claude settings: see Overview & Setup.
Full Workflow: Bucket to Export
You can execute a complete end-to-end computer vision pipeline through Claude in a single conversational thread:Complete Pipeline
1
Step 1: Connect your cloud storage
Prompt
connect_cloud_source. You save the bucket connection securely in the Labellerr web app, then tell Claude when finished. (See Connect Cloud Storage).2
Step 2: Import data as a dataset
Prompt
list_connections, retrieves the connection ID, invokes dataset_create, and tracks the job with get_job_status until the dataset is ready.3
Step 3: Set up the project in one step
Prompt
project_setup, creating both the label schema and the annotation project together.4
Step 4: Load pre-annotations (with dry-run validation)
Prompt
upload_preannotations (or upload_preannotations_async) and monitors the import.5
Step 5: Label and review in Labellerr
Annotators, quality auditors, and reviewers complete labeling and review tasks in the Labellerr web interface as normal. You can ask Claude “What is the progress on project Vehicle Detection?” to inspect completion rates via
monitor_project_progress.6
Step 6: Export annotations
Prompt
export_annotations, tracks completion with get_job_status, and delivers a signed download link via download_export.Finding Your Work
Quickly survey your assets across projects, datasets, templates, and storage connections:Prompt Examples
One-Step Project Setup from Label List
The fastest way to configure a project. Simply specify label names and the dataset; Claude handles the rest.Prompt
project_setup call:
project_setup Payload
- Output: Returns
project_idandtemplate_id. The project is immediately visible in the Labellerr web app with all three label classes configured.
The target dataset must be in
ready status and contain files. If you do not yet have a dataset, Claude will prompt you to import one first.Projects with Advanced Question Types
For projects requiring multi-class classification, radio buttons, dropdown menus, boolean flags, or freeform text inputs, configure the template explicitly:Prompt
- Calls
template_createwith the structured question schema. - Calls
project_createlinking the newtemplate_idtoVehicles Nov. - Configures
review_rotation_count: 2.
Pre-Annotations & AI Pre-Labeling
Accelerate labeling by seeding projects with model predictions or Claude-assisted pre-labels.1. Upload COCO Pre-annotations
Prompt
- Send payload:
upload_preannotations(orupload_preannotations_asyncfor large datasets) sends the COCO JSON and receives ajob_id. - Backend processing: Labellerr matches each image entry in the COCO file against dataset filenames.
- Status & audit:
get_job_statusreturnssucceededalongside an audit report of any unmatched files or unmapped categories.
2. COCO Dry Run Validation Available
Verify a COCO JSON file against your project before committing annotations:Prompt
- Identifies exact filename matches and warns of case mismatches (
frame_01.PNGvsframe_01.png). - Flags categories present in the COCO file that are missing from the project template.
- Detects bounding box coordinates that exceed image dimensions.
- Presents a summary report for your approval before writing any data.
3. Claude-Assisted Pre-Labeling with Review Available
Let Claude propose initial bounding boxes and preview them for human review:Prompt
- Claude inspects sample images using Claude Vision.
- Claude predicts bounding boxes matching the project’s label schema.
- Claude presents the proposed boxes visually or as structured coordinates for your inspection.
- Upon your confirmation (“Looks good, apply to the project”), Claude uploads the annotations as pre-labels for human annotators to refine.
Live Progress & Analytics Monitoring Available
Monitor project metrics and annotator throughput in real time:Prompt
monitor_project_progress and query_project_statistics:
- Total files vs completed vs review stages
- Completion percentage and audit status
- Distribution across bounding box classes and categories
Google Drive Import Workflow Available
Import image batches directly from shared Google Drive folders:Prompt
dataset_createwith the Google Drive link (supports up to 2,500 images and 2.5 GB).- Monitors import completion with
get_job_status. - Immediately invokes
project_setuponce the dataset is ready.
Exporting Annotations
Export finished annotations for model training or downstream analytics:Prompt
Resuming Long Tasks Across Sessions
Dataset imports, large pre-annotation uploads, and complex exports run asynchronously on Labellerr servers. If you close your browser or Claude chat, your tasks continue uninterrupted. Every asynchronous operation returns ajob_id:
- Dataset imports:
ds:<dataset_id> - Pre-annotation uploads:
pre:<project_id>:<job_id> - Exports:
exp:<project_id>:<export_id>
Prompt
get_job_status and returns the current status, completion timestamp, or download link.
Related Documentation
MCP Tools Reference
Detailed specifications for all 23 tools and parameters.
Connect Cloud Storage
Secure AWS S3, GCS, and Google Drive integrations.
Upload Pre-annotations (SDK)
COCO format standards and Python SDK pre-annotation methods.
Create Exports (SDK)
Explore export formats and metadata structures in detail.

