Deep Training
(Beta) Train the entire graph for your custom model.
Last updated
Was this helpful?
(Beta) Train the entire graph for your custom model.
Last updated
Was this helpful?
Clarifai offers a variety of prebuilt models that are designed to help you build AI solutions quickly and efficiently. Clarifai Models are the recommended starting point for many users because they offer incredibly fast training times when you customize them using the "Context-Based Classifier" type in Portal's Model Mode.
But there are many cases where accuracy and the ability to carefully target solutions takes priority over speed and ease of use. Additionally, you may need a model to learn new features not recognized by existing Clarifai Models. For these cases, it is possible to "deep train" your custom models and integrate them directly within your workflows.
You might consider deep training if you have:
A custom tailored dataset
Accurate labels
Expertise and time to fine tune models
Deep training is in early access preview. To request access, .
You can take advantage of a variety of templates when building your deep trained models. Templates give you the control to choose the specific architecture used by your neural network, and also define a set of hyperparameters that you can use to fine-tune the way that your model learns.
Classification templates let you classify what is in your images or videos.
Detection templates make it easy to build models that can identify objects within a region of your images or videos. Detection models return concepts and bounding boxes.
Embedding models can be useful in their own right (for applications like clustering and visual search), or as an input to a machine learning model for a supervised task. In effect, embedding templates enable you to create your own "base models" that you can then use in your workflows.
Deep training gives you the power to tune the hyperparameters that affect “how” your model learns. Model Mode dynamically changes the available hyperparameters based on the template selected.
average_horizontal_flips Provides basic data augmentation for your dataset. If set to true, there is a 0.5 probability that current image and associated ground truth will flip horizontally.
base_gradient_multiplier This sets the learning rate of the pre-initialized base (also sometimes called "backbone") model that generates embeddings. Learning rate controls how the weights of our network are adjusted with respect to the loss gradient. The lower the value, the slower the trip along the downward slope. A low learning rate can help ensure that local minima are not missed, but can take a long time to converge — especially if the model gets stuck on a plateau region.
batch_size The number of images used to make updates to the model. Increased batch size allows for a better approximation of gradient over those samples. Batches allow for stochastic gradient descent, by choosing a random set of X images for each training update. You may want to increase batch size if the model is large and taking a long time to train. You also may want to increase the batch size if your total number of model concepts is larger than the batch size (you may want to increase to around 2x the category count).
detection_score_threshold Only bounding boxes with a detection score above this threshold will be returned.
image_size The size of images used for training. Images are scaled for efficient processing, and a lower number will take up less memory and run faster. A higher number will have more pixel information to train on and will increase accuracy.
init_epochs The initial number of epochs before the first step/change in the lrate.
logreg Choose either "Logistic Regression" or "Softmax" as the activation function of the output layer. The default setting, 1, corresponds to Logistic Regression and will allow for multiple True concepts (i.e. P > 0.5) to be predicted for a given input. Conversely, specify a value of 0 to implement Softmax if your concepts should be treated as "mutually exclusive" (i.e. only one concept could be correctly assigned to a given input). This will result in each prediction output representing a discrete probability distribution (i.e. all predicted values sum to 1).
lrate The learning rate is a tuning parameter in an optimization algorithm that determines the step size at each iteration while moving toward a minimum of a loss function.
num_epochs An epoch is defined as one-pass over the entire dataset. If you increase it, it will take longer to train but it could make the model more robust.
num_items_per_epoch The number of training examples per "epoch". An epoch would be defined as one-pass over this amount of examples.
per_128_lrate Total change in lrate after 128 images processed. This is calculated as lrate = per_128_lrate * (batch_size / 128).
per_item_lrate The rate that model weights are changed per item.
step_epochs The number of epochs between applications of the step/change in lrate scheduler.
test_freq The number of epochs should you run before evaluation of the test set. Increased frequency can allow for more granular testing but will extend processing time.
use_perclass_regression Enables box coordinate local regression on a per-class basis. When set to True there will be num_classes sets of regressors for each anchor location, when set to False, there will be one coordinate regressor for each anchor location.
Creating and working with deep trained models is very similar to working with Clarifai Models.
Get started by creating your app and uploading your inputs.
In general, deep trained models need more data than ones trained on top of Clarifai Models. For most applications you’ll need at least 1000 training inputs, but it could be much more than this depending on your specific use case.
The process of creating concepts and labeling inputs is the same for deep trained models and Clarifai Models.
Click the "four squares" icon on the lefthand sidebar to enter Model Mode.
Click the blue Create Custom Model button at the top righthand corner of the screen and select Visual Classifier, Visual Embedder, or Visual Detector.
When you choose your your deep training template you will see the hyperparameters that are available within that template populated with default values. Adjust these values as desired and then click "Create Model".
Deep training can take much longer than custom training a model. Many hours are required to deep train models with large numbers of inputs and complex taxonomies. You can view the progress bar in the model details view to monitor your model training as it progresses.
Once you have created your new model you can add it to your so that you can use it in your app.
You can cancel a deep training job at any time by deleting the model that you are training. Deep training is billed at an hourly rate and for cancelled jobs, you will charged for the time that you have used to train your model.
