Clarifai Guide
Clarifai Home
v6.9
v6.9
  • Welcome
  • Getting Started
    • Quick Start
    • Applications
      • Create an Application
      • Base Workflows
      • Application Settings
      • Collaboration
    • Authentication
      • App-Specific API Keys
      • Personal Access Tokens
      • Scopes
      • Authorize
      • SSO
      • 2FA
    • Glossary
  • API Guide
    • API overview
      • API Clients
      • Status Codes
      • Pagination
      • Patching
    • Data
      • Supported Formats
      • Create, Get, Update, Delete
      • Collectors
        • Collectors
    • Concepts
      • Create, Get, Update
      • Languages
      • Search by Concept
      • Knowledge Graph
    • Annotate
      • Annotations
      • Training Data
      • Positive and Negative Annotations
      • Tasks
      • Task Annotations
    • Model
      • Clarifai Models
      • Model Types
      • Create, Get, Update, Delete
      • Deep Training
      • Evaluate
        • Interpreting Evaluations
        • Improving Your Model
    • Workflows
      • Create, Get, Update, Delete
      • Input Nodes
      • Workflow Predict
    • Predict
      • Images
      • Video
      • Prediction Parameters
      • Multilingual Classification
    • Search
      • Index Images for Search
      • Search
        • Combine or Negate
        • Filter
        • Rank
      • Legacy Search
        • Combine or Negate
        • Filter
        • Rank
        • Saved Searches
    • Walkthroughs
      • Custom Models
      • Custom Text Model
      • Custom KNN Face Classifier Workflow
      • Batch Predict CSV on Custom Text Model
      • Auto Annotation
      • Visual Text Recognition
  • Portal Guide
    • Portal Overview
    • Data
      • Supported Formats
      • CSV and TSV
      • Collectors
        • Collectors
    • Concepts
      • Create, Get, Update, Delete
      • Knowledge Graph
      • Languages
    • Labeler
      • Create a Task
      • Label Types
      • Labeling Tools
      • Workforce Management
      • Training Data
      • Positive and Negative Annotations
    • Model
      • Clarifai Models
      • Model Types
      • Deep Training
      • Evaluate
        • Interpreting Evaluations
        • Improving Your Model
    • Workflows
      • Input Nodes
    • Predict
    • Search
      • Rank
      • Filter
      • Combine or Negate
      • Saved Searches
      • Visual Search
    • Walkthroughs
      • Custom Models
      • Auto Annotation
      • Text Classification
      • Visual Text Recognition
  • Data Labeling Services
    • Data Labeling Services
  • Product Updates
    • Upcoming API Changes
    • Changelog
      • Release 6.9
      • Release 6.8
      • Release 6.7
      • Release 6.6
      • Release 6.5
      • Release 6.4
      • Release 6.3
      • Release 6.2
      • Release 6.1
      • Release 6.0
      • Release 5.11
      • Release 5.10
Powered by GitBook
On this page
  • Task Name and Instructions
  • Task Types
  • Applicable Concepts
  • Input Sources
  • Workers
  • Worker Strategy
  • Review Strategy
  • None
  • Manual
  • Consensus (Coming soon!)
  • Sample Size to Select for Manual Review
  • Reviewers
  • Enable AI Assist
  • Video FPS

Was this helpful?

  1. Portal Guide
  2. Labeler

Create a Task

PreviousLabelerNextLabel Types

Last updated 4 years ago

Was this helpful?

Tasks enable you delegate labeling jobs to your team.

Task Name and Instructions

Provide your task with a descriptive name and provide instructions for your labelers. You can even provide you labelers with a "visual dictionary" by including sample image URLs.

Task Types

Choose the type of label that you would like your worker to add to your images or video. You can choose classification, bounding box detection, polygon detection label types.

Please note that if you want to create a detection labeling task, you will need to select a detection model as the base workflow in your app.

Applicable Concepts

Concepts are the words that you are labeling your data with. Concepts can be anything you can think of, and can be written in the language of your choice. You can create concepts in Portal, or you can create them when assigning tasks. Check the "Select all concepts" box to automatically add all available concepts to your app.

Input Sources

By saving your searches, you can slice and dice your dataset, and configure dynamic and static types of datasets. You can also create highly customized filters to your data, by adding metadata and searching by metadata filtering.

Workers

You can assign work to a worker, or group of workers. Simply add the worker email addresses and workers will receive an email notification and a new task will be added to their "Assigned to Me" tab.

Worker Strategy

Manually assign work to a specific person, or have work randomly assigned to workers from a group of collaborators. By selecting "Full", all inputs will be assigned to each worker. By selecting "Partition" you will be able to break up your labeling task amongst your workers.

Review Strategy

None

All labels will be automatically marked with a "Success" status and can be immediately used to train your new model.

Manual

Labels will be marked with a "Pending Review" status until the assigned reviewer approves them. These labels cannot be used to train new models until approved.

Consensus (Coming soon!)

Consensus review will mark labels with "Success" status in cases where multiple reviewers provide the same label.

Sample Size to Select for Manual Review

You can choose to review all or part of a workers labels. Simply adjust the slider, and you will review a random subset of their labeled images. For example, if a worker is labeling 10,000 images, you might choose to review 1% of them for quality control.

Reviewers

You assign reviewers by adding their email. Assigned review tasks will show up in the "For Review" tab.

Enable AI Assist

Enable AI-assisted workflow predictions in your labeling project. You must first create a workflow with a custom model to enable predictions.

Video FPS

Select your preferred video sample rate. This is the integer value that represents the number of frames that we can capture per second. We do not currently sample video at fractional frame rates.

You can choose "All inputs", which will include all inputs from your dataset, or you can choose any one of your .

Saved Searches
Clarifai Labeler: Creating Tasks