Changelog

Changelog 6.5

New Feature

Improvement

Bug Fix

Enterprise Only

Applications

Status

Details

Can't Access Main Apps Page with invalid collaborators. Fixed.

Unable to create new Application (General Detection). Fixed.

application_sharing scopes field should be json instead of jsonb. Fixed.

Inputs

Status

Details

Pasting long text makes Uploader unusable due to lack of scrolling. Fixed.

Support uploading text containing emojis.

Annotate

Status

Details

Integrate and Implement task deletion using new endpoints.

Implement /tasks CRUD in API.

Allow annotation writer model to set the task_id in annotation_info.

Make polygons a separate task type.

Add empty CRUD endpoints for tasks.

Model

Status

Details

vocab_id doesn't appear in the returned object for demographics model. Fixed.

segment-concept model types are no longer returning the segmentation mask. Fixed.

NLP text input does not scroll when longer than viewport height. Fixed.

Clear text inputs after upload.

Improve the "TextFile" React Component for NLP.

Make existing model details view configurable by model type.

Edit model should only contain the fields related to the selected model. Fixed

NLP frontend text input is covered entirely blue when selected. Fixed.

Enforce fields in post/patch models to adhere to model types. Fixed.

Predict

Status

Details

Fixed fps issue for video predictions.

Validate stat_value_agg_type.

Status

Details

Dropdown Search Help Menu no longer displays in the search bar. Fixed.

Video thumbs have relevant timestamp in search.

Added adjustable search results threshold.

Search over multi-embed workflows.

Added search on input level.

Improved search query by using multi join.

Fixed panic in list saved searches endpoint.

Input metadata search from table not working. Fixed.

Portal

Status

Details

"Return to Log in " doesn't redirect to login page. Fixed.

Clicking on image, or Explorer Mode with images that contain geo coordinates crashed the app.

Portal model predicts use hosted URL when available instead of normal URL.

When selecting a concept and going to the next image the concept checkbox won't stay selected. Fixed

Allow multi-select from explorer grid view and add metadata.

Integrate and utilize new CRUD endpoints in Portal.

Allow for pasted text to keep formatting in the text box.

Prediction threshold slider custom model predicts without base workflow annotations. Fixed

Strings without spacing format properly in Explorer's Asset Grid View

annotation_info should be a valid JSON in Model Mode. Fixed.

Workflow

Status

Details

Hide the "add text" section of the add inputs modal for non text workflows.

Validate that all nodes in workflows list their inputs based on type.

Add NLP to Workflows List

Generalize the iterations over regions/frames in workflow code.

Add ability to "make a copy" of public_workflows.

Allow indexing embedding from detect -> crop -> embed style workflows.

Allow setting input nodes for all users, not just @clarifai.com users.

Allow non-internal users setting input node when creating workflows.

Create/Patch workflow uncaught exception.

Clients

Status

Details

Update docs.clarifai.com to reflect our current API clients including grpc clients.

Changelog 6.4

New Feature

Improvement

Bug Fix

Enterprise Only

Applications

Status

Details

Improved responsiveness of collaborations tab in /apps

Enabled list collaborators to list deleted collaborators

Login Form breaks app. Fixed

Deleting an app no longer redirects to /apps

Can’t create models in new app. Fixed

Inputs

Status

Details

Fixed .webp files not working when sent as base64

Annotate

Status

Details

MVP of labeler single image view functionality

Support detection tasks

Detection Labeler: Color Coded Concepts

Add workflow_id to task creation and show AI predictions to verify in labeler mode

Split tasks admin view into tabs

Add visual sections to task form

Add default queries for "all inputs" and "all unlabelled inputs" in task create view

Autocomplete annotation user

Implement Classification Task Review Logic

Implement Review Process into tasks

Introduce stats collection APIs for worker stats

Implement APIs for polygon region support

Incorporate image filters for labelling

Update image tool icons

Ability to zoom in on images

Remove ‘alt’ from hotkeys, just use letters and arrows

Label to draw box in video frame using frame bytes

Display videos in labeler

Add video fps field for tasks

Draw Bounding Boxes in Labeler Detection Videos

Add video controls for video in labeler

Fix Classification Annotation

Video annotation deletion. Fixed

AI Assist Predictions did not show for General workflow classification task. Fixed

Fix Classification video annotation

Display video in classification tasks

Fix Labeler input urls

Fix Annotation creation for video

Fix Labeler post calls

Detection Labeler: fix zoom

Fixed image cropper task description

Fix concept threshold creation

Set annotation status ‘success’

Restrict tasks to only the assigned users

Add validation to TaskForm’s concept field

Display human tags for human box as child

Model

Status

Details

Convert Deep Trained Model to Embedding Model for Use as "Base Workflow"

Classification predictions for AI assistance

Merge this detection and custom model prediction sections for detection models

Video labelling UI for classification.

Remove the non-creatable types from model mode

Improve the create classifier / detector view options in model mode

Add deep training options in model mode

Update random sampling model to have a slider

Predict

Status

Details

Fixed public concept rank

Search

Status

Details

Support detection evaluations in PostAnnotationSearchMetrics

Support nlp search (only filtering)

Add evaluations between two saved search label sets

Fix labeler search amount

Error: "Cannot search over annotations" when clicking a general app. Fixed

Model name and details is not populated upon model creation in model mode

Fix annotation search when accessing the LabelerPage

Search by annotation_info should not return the embed annotation. Fixed

Search for metadata in detection apps doesn't work. Fixed

Portal

Status

Details

Create Dual Range Slider

Enable patching the default workflow from Portal and error if needs reindex

Allow drawing bounding boxes on paused video frames

Add scopes for collaborators and metrics to Portal

Allow up to 15-20x zoom level for really large images.

Allow selection the embed_model_version_id from Portal when creating a model

Fix inconsistent fps between uploading video and predicting video

Missing frame time. Fixed

Model annotations not appearing in Explorer. Fixed

When creating the auto annotation workflow editing the workflow crashes Portal

Fix image tools state

Workflow

Status

Details

CreateWorkflow model improvements

Allow custom concept models in the default app workflows

Add a "Make a Copy" or "Copy to New Workflow" button for each workflow

Allow patching the default workflow in Portal

Show the default workflow in the list of workflows for the app

Validate patching of default workflow is compatible in backend

Large workflow name causes overlap in app details view. Fixed

Portal crashes if page reloads during workflow add/edit. Fixed

Detection workflow recompute also predict detect-concept

Allow detect-concept models to be added to workflows

Patch workflow create worker

Fix validation of inputs in workflows

Fix workflow embed_join_annotation_id issue

Clients

Status

Details

Clean up private API client repos

Remove public workflows from Python client

Changelog 6.3

New Feature

Improvement

Bug Fix

Enterprise Only

Applications

Status

Details

Send collaborator emails asynchronously

NLP bug fixes for non-text apps

Inputs

Status

Details

Consolidated input related status codes

Add frame.id to API as well as region.track_id

Granted select permission to clarifairead

Annotate

Status

Details

Added list annotations filter status

Added concept selection for tasks

Post/Patch annotations request now allow setting status

Changed task form options

Set annotation status to awaiting for review if the authorized user is not app owner

Return only input_level annotation in input.data

Drawing annotations: wrong embed model version id. Fixed

Eliminated error if no annotation to be deleted

Create one annotation for each bbox

Model

Status

Details

Added support for adding and training on text in the platform

Created a NLP mock prediction endpoint

Created test set to evaluate quick trained models or k-fold if no test search is specified

Added vocab_id for demographics model concepts

Fixed sorting of A.G.E. concepts in golang for demographics model so we don't chop off sets of them

Deprecated Face from javascript Client

Deprecated Face from Java Client

Confusion matrix predicted/true are swapped in evaluation results. Fixed

Explorer Image/Text Joint embedding

Fixed selectEmbedModelVersionId in detection apps

Fixed generalModel imports and optimized video click handlers with useCallback hooks

Search

Status

Details

Persisted the saved search used in train a model version

Created log for annotation/search request/response

Region Searches within Search Bar still use crop coordinates instead of base64 bytes. Fixed

Portal

Status

Details

Created new Single Image View and Image Tools

Enabled Display Text Thumbnails in App Grid View and App Details View

Text Thumbnails display in Portal/Search Bar disabled

Enabled View Text Assets in Portal's Image View

Added Text Inputs To Explorer Apps

Imported new icons for Labeler Image Tools into the style guide

Added login tracking to analytics package in Portal

Allowed pasting into the add inputs text area and clear the text box after clicking submit

Search bar not visible. Fixed

Removed all instances of worker_id from Explorer

Fixed popover left/right overflow

Disabled all search by click handlers in Portal for Text Apps

Click Search button icons on Thumbs not working for localized search. Fixed

Fixed details page header missing description

Fixed demo font syntax

Workflow

Status

Details

Added a Range Slider to filter Workflow Predictions by Value

Updated Face workflow to include the detect faces as concepts for search

Changelog 6.2

New Feature

Improvement

Bug Fix

Enterprise Only

Accounts

Status

Details

Updated Privacy Policy URL

Fixed panic error in Signup

Applications

Status

Details

Ensured collectors are deleted when apps are deleted

View In Explorer button missing in app details. Fixed

Fixed failed to generate thumbnail

Fixed app duplication error when getting worker

Deleted collaborator should also mark application_worker to deleted. Fixed

Inputs

Status

Details

Inputs count stuck at > 0 after delete all, with all inputs seemingly deleted

Label

Status

Details

Task view UI for workers

Create task manager page and task creation page

New Icon for Task Manager/Task Viewer

Fixed POST annotations call on frontend to use correct embed model

Post annotations should include embed_model_version_id. Fixed

Model

Status

Details

Added Apparel Detection to Demo App

Created UI for creating knowledge graph concept relations relations

Create annotation writer model to write annotations to DB

Pass and use test and train data queries to trainer

Added migration to upgrade old model_type in DB

Depredated Face from Python client

Unified the TypeExt and Type fields in model object.

Deprecated facedetect* model types.

Unified FaceEmbedModel and DetectEmbedModel

Converted face.Identity responses to concepts like other detection models to be consistent

Fixed demo font syntax

Video Timeline does not display on the demo app

Fixed Range Slider Value/Text in Apparel Detection Demo

Fixed demographics model to return embeddings and work with auto-annotate

Adding collaborator model counter-intuitively requires ENTER in order to enable the submit button. Fixed

Predict

Status

Details

Validated that concept relation doesn't already exist on POST relations

Prediction requests are being fired too frequently instead of using cache. Fixed

postModelOutputs is not called for newly labeled assets without a manual refresh

Search

Status

Details

Return annotations posted by user in search results

Search by region not working for face detection. Fixed

Make “save” search button internal only

Saved Searches in Portal use the incorrect user ID

Fix crop search from single image view for faces/detections

Portal

Status

Details

UI for collector crud

Deprecate Face from Portal

Improve tabs UI

Video Predictions are failing in Portal

Fixed broken font syntax

Workflow

Status

Details

Video detection workflow prediction support

Public general v1.5 workflow

Allow Patching to existing public workflow

Can not train LOPQ if app base workflow is face. Fixed

Changelog 6.1

New Feature

Improvement

Bug Fix

Enterprise Only

Clients

Status

Details

Remove Feedback endpoints from Python client

Remove Feedback endpoints from Java client

Remove Feedback endpoints from Javascript client

Remove Feedback endpoints from Portal/demo

Remove image.crop field from Python API client

Remove image.crop field from Java API client

Remove image.crop field from Javascript API client

Model

Status

Details

Added detection evaluation in platform

Introduce concept mapping model that uses the knowledge graph relations, creating a path for users to eventually benefit from pool of networked data

Fix a bug that caused the new face predictions to have a huge performance drop

Train and eval worker didn't invalidate model related cache. Fixed

Fix bug in deleting a concept relation by ID

Portal

Status

Details

Bulk labelling can now be done from Explorer mode grid view.

Show Check/X on custom detection model predictions in Portal

Allow multi concepts per bbox

Negative tags not visible in Portal. Fixed

Predict

Status

Details

Remove extra round trip to storage in predict pathway

Remove the image.crop argument during predict and POST /inputs calls to simplify the API

Add region predictions from custom models to detections in videos

Search

Status

Details

Implement search by annotation.status in backend

Connect saved searches and annotation status

Changelog 6.0

New Feature

Improvement

Bug Fix

Enterprise Only

Accounts

Status

Details

Remove country field from signup form, simplifying new customer signups

Essential Plan User can't add collaborators. Fixed

API

Status

Details

Introduce new Python gRPC API client, enabling new features and performance enhancements across API

Introduce new Java gRPC API client, enabling new features and performance enhancements across API

Update API key type for "app_specific" for app-specific keys to be more clear to users

Applications

Status

Details

Allow Personal Access Tokens when calling /users/me (GetUsers)

[Frontend] Enable "Copy Application" from collaborated apps, making it easy to duplicate and build upon existing applications

Program to clean internal apps crashing. Fixed

Data Management

Status

Details

Added the ability to accept b64 Gifs

Functionality to upload pre-tagged images missing. Fixed

Images pre-tagged with concepts do not successfully upload into Clarifai UI On doing bulk uploads (>20-30 urls). Fixed

Bulk image upload issue. Fixed

"Download Failed" error when uploading images. Fixed

Issue with post inputs key being a PAT in a collector. Fixed

Annotate

Status

Details

Skip aligning landmarks if landmark points are out of range to avoid errors and unexpected behavior

Bounding Boxes and Cropped Regions aren't displaying on Videos with default runtime config. Fixed

Insert annotations and related data in batch to improve performance

Model

Status

Details

Evaluate new face embedding model workflow end to end for optimal performance

Validate that concept.app_id shouldn't be set when creating/patching models

Add new predicate to knowledge graph for "relates_to" to represent synonyms

Model training lag. Fixed

Model has missing inputs. Fixed

Submitted models becoming stuck in queue. Fixed

Custom training models when uploaded images are not fully pre-processed. Fixed

Custom facial recognition bboxes do not correspond with detection boxes/ Custom facial recognition prediction interval for video is still 1000ms for apps supporting 100ms runtime config. Fixed

frame_info time off by a factor of 10 for general detection model. Fixed

Detection Models throw error at end of video due to invalid index lookup. Fixed

Workflow

Status

Details

Deleting a workflow should clear or update localStorage. Fixed

Portal

Status

Details

Clean up app overflow UI, improving user experience

Improve Error boundary screen, improving user experience

Add sentry error Id to Error Screen

Images not loading. Fixed

Label and prediction on the right side under Custom Model Predictions section no longer shows up automatically. Fixed

Provide a way for user.metadata to be updated from portal when there are failing apps stuck in there. Fixed

Predictions for a detection model don't show properly in portal. Fixed

Custom facial recognition Predict Boxes not displaying. Fixed

Adding inputs in explorer redirects to explorer view with flashing images. Fixed

Predict

Status

Details

Run prediction by ID in small batch, improving performance

Custom model predictions not displaying. Fixed

Custom model detections not displaying. Fixed

Search

Status

Details

Add file upload input button to explorer search bar, simplifying the UX for file uploads

Filter custom facial recognition bboxes using a sliding bar, adding easy thresholding to custom facial recognition models

Search Bar allows file upload

Remove Explorer App Overflow Menu for improved UX

Changelog 5.11

New Feature

Improvement

Bug Fix

Enterprise Only

Accounts

Status

Details

Create a UI for personal access tokens making it easier for users to access their own apps and any apps where they have been added as collaborators

Updated /keys to work with PATs so that app-specific keys can be created programmatically.

Login (user/PW) has no rate limit/max attempts. Fixed

Remove all instances of worker_id from explorer

When email link to verify my email address clicked, still see "verify your email" banner. Fixed

API services do not function once Queue goes down and comes back up. Fixed. This makes on premise deployments more resilient to power failures.

Applications

Status

Details

Add apps and keys scopes so they can be created with personal access tokens

Copy app count and last_inputs added in app duplication

Fixed demo font syntax

Fixed details page header missing description

Added favicon for Portal

Unable to copy an app that has been shared via Collaborators. Fixed

Setting useCustomConfig isn't checked at login. Fixed

Collaboration apps have race condition where wrong user id is used

Stopped loading of collaborations for search demo/logged-out users

Return “All” scopes when listing available scopes so that you have that option when creating new keys.

Collaborators can not see workers. Fixed

Missing Apps_Get scope in session token auth caused creation of keys to fail temporarily. Fixed

List of missing scopes is not correct in error messages. Fixed

Data Management

Status

Details

Optimize video detection frame rate on Front end

Improve JSON serialization performance in our servers by using an optimized third party library

Able to overwrite default max conn for Citus

Rewrite input counting in the API to be more scalable and robust

Allow RegionInfo from SpireDetectEmbedResponse to contain Point when saving to DB

Unable to upload same file(s) through browse files. Fixed

ffmpeg can produce no frames for very short videos

Add Inputs/View Explorer does not display in new app anymore. Fixed

Clicking video thumbs in detail view does not reload a video. Fixed

Keyboard navigation in image details view highlights incorrect thumb

No Prompt when uploading an image to Explorer through URL. Fixed

Properly return error if AddAssets failed to insert into database

Annotate

Status

Details

Remove classification/detection toggle in image details view

Improved adding negatives to regions

Create one annotation for each bbox

Log capability added for annotation/search request/response

Eliminated error if no annotation to be deleted

Last concept used for bounding boxes is retained between apps. Fixed

The Add Positives / Add Negatives buttons on a Concept details view breaks portal

Custom facial recognition bboxes on grid view do not correlate. Fixed

Model

Status

Details

Ability to keep concepts sorted by alpha in Portal

Implement image crop model to make it possible to work in subregions of an image

Implement random sample model type, adding to fixed function feature set

Update training templates to have more straightforward names and more friendly defaults

Fix the WorkflowInput field name in proto to workflow_input

Allow models that need outputs from previous nodes in a workflow to have access to those outputs to support chaining complex graphs of models

Confusion matrix predicted/true are swapped in evaluation results. Fixed

Fixed generalModel imports and optimize video click handlers with useCallback hooks

Fix for selectEmbedModelVersionId in detection apps

Drawing annotations: wrong embed model version id

Made custom training evaluations for large models stable.

Training progress is saved too frequently, causing very slow training

Return friendlier errors for incorrect parameters passed to templates

Fixed a bug in tracing setup for custom trainer and evaluator

Some models were operating slowly because of lack of resources. Fixed

Training System failed to train some layers. Fixed

Prevent users from evaluating models that are not trainable

Fixed node ID validation logic in Bug in workflows

Predict

Status

Details

Add colors to differentiate region results

Cannot view workflow results in a face app. Fixed

Video spire tests are not running correctly. Fixed

Video processing fails with 'caseids' error. fixed

Search

Status

Details

Add click to search metadata attributes in image details sidebar

Implement visual search in another app as a model type you can add to a workflow

Search bar missing in some cases. Fixed

Region Searches within Search Bar still use crop coordinates instead of base64 bytes. Fixed

Click Search button icons on Thumbs not working for localized search. Fixed

Disable all search by click handlers in Portal for Text Apps

Disable "hide all positively labeled" inputs button for NLP until search works

Scroll active thumb into view in image details carousel

Render Video Assets in Search Bar

Editing geo/json search items no longer work after adding the search bar tooltip. Fixed

TypeError: Cannot read 'get' of undefined when clicking image thumbnails in Explorer search bar. Fixed

Explorer Visibility in small resolution screen improved

Changelog 5.10

New Feature

Improvement

Bug Fix

Enterprise Only

Accounts

Status

Details

Create delete email endpoints in v2 to finally get off old internal endpoints to streamline operations

Create Patch, Delete, Get CreditCards endpoint in v2 APIs to finally get off old internal endpoints to streamline operations

Improved billing for collaborators

PostVerifyEmail error causing some issues not being able to verify their email addresses upon sign-up. Fixed

Fixed flaky email verification integration test to provide more stability to sign-up process

Fixed a link to a non-public version of our API used for development purposes which led to a lot of login issues for users who landed there

Applications

Status

Details

Created display for scopes on collaborator invitations, allowing users to easily understand and control the scope of access allowed for app collaborators

Introduced Collaborators and Collaborations endpoints in API and UIs in Portal

Add ability to upload inputs from App Details screen in Portal

Created collaboration tab in Portal, making it easy to add collaborators to apps

Created display to show the user who invited you to collaborate on an app

Update email phrases for collaborator invitations. After successful sign-up, the user is now redirected to the app's dashboard in Portal

Fixed issue with concept counts in some apps

Clicking pencil icon to edit an API Key in Portal crashed apps. Fixed

Data Management

Status

Details

PATCH /inputs needs to check status of asset before patching

Removed sync DELETE /inputs after runtime config tested

Changed POST /inputs to be async always to simplify processing of workflows after API client tests updated

Added pagination to clusters making for easier data management

Sporadic inability to delete any inputs via Portal or in bulk via the API

Numerous third party security fixes under the hood during ongoing upgrades

Fix 40012 status caused by parallel deletes and adds having a race condition

Update status_changed_at when deleting inputs so we can better track changes

Cache the input counts so that apps can display them in Portal efficiently

Handle killing URL downloading if it is processing for more than 60s. This will make URL processing much more reliable

Return an error if a user sends YouTube video URL as that is not a valid URL to a video we can download

Prevent PostInputs from creating inputs with a user-provided Input.ID that contains a colon

Video calls failed if URLs contain parameters after the file type. Fixed

Failed to resolve DNS MX record in URL down-loader which effected some downloads. Fixed

Investigate why some re-hosted s3 links are no longer working

Getting input counts was broken in some apps, reporting zero, which caused Portal to add an input view to display always

Debug UnicodeErrors in URL downloading to fix URLs with Unicode characters

Fix the poor handling of video too large error message

Unable to batch delete inputs from time to time has been fixed

Media processor video handling was having errors with decoding some videos

Delete Image Button doesn't work in some scenarios

Fixed support for webp image format so it is available again

Annotate

Status

Details

Deploy General Detection Beta Model to recognize multiple objects with bounding boxes.

Deployed new face detector for improved face detection performance over images and video

Created custom training enhancements that handle negatives better for improved model performance

Created evaluation metrics for custom facial recognition in backend for improved facial recognition performance

Topological sort for workflows for scheduling a sequence based on dependencies

Cleaned up duplicate models in workflow model list

Deployed clarifai/main general v1.5 in concept model

Create Pixel Training Hyperparameter Help Guide

Improved accuracy of annotation counts, improving the user experience when annotating inputs

If an image is tagged with a concept that is not in the model, training fails due to KeyError, this is fixed

Fix detection labeling bug where previous images image ratio is used which would cause display issues

We have updated Portal to scale to a large number of concepts with much lower resource usage

Investigate face bounding box probabilities consistency to improve user experience

Bounding box creation canvas in Portal was breaking on resize of the window

Model

Cleaned up duplicate models in the workflow model list, so that you no longer see two General models

Unintended behavior for private model version IDs for certain customers has been fixed

Models referencing deleted backends should be marked as deleted

The latest version of our general model wasn't always default, now it is

Fixed a bug with face recognition evaluations.

Deleted Concepts Persisted in face recognition models. Not anymore!

Inability to see whether a large model is training and making progress, or hung has been addressed to better support our customers

Model won't train in some apps with no positive examples issue has been resolved

Fixed issues with color models failing for a short period of time

Fixed list of models available to workflows to only show a single General model

Predict

Status

Details

Return custom detection evaluations through the GO API

Improved cluster page performance

Investigate health checks killing a prediction backend service, which could affect some predictions in the API

Workflow predict sometimes was failing with 98012 status code. Many fixes here should reduce that

Workflow Predict called the wrong model sometimes. Not any more!

Video playback out of sync with detections in our demos

Fixed issues with regions predicted on inputs would be carried over between inputs in Portal

Fixed the flaky face recognition tests to ensure stability of our face recognition product

Face Detection backends were running out of memory for some predictions, this has been resolved

Return more descriptive error msg for post metric endpoint

Search

Status

Details

Added helper text/suggestions to improve Portal user experience

Header Search return app_owner's user info in collaboration endpoints

Explorer Search Bar - Clicking the green/red circle icons didn't reliably detect click, now it does!

Portal not showing the correct number of results in concept search. Fixed.

Left/right arrows in single image view don't switch between images with regions. Fixed

Fixed carousel thumbnail clicks wiping query params / trigger new search

Last updated