Changelog
Changelog 6.1
New Feature | Improvement | Bug Fix | Enterprise Only |
Clients
Status | Details |
Remove Feedback endpoints from Python client | |
Remove Feedback endpoints from Java client | |
Remove Feedback endpoints from Javascript client | |
Remove Feedback endpoints from Portal/demo | |
Remove image.crop field from Python API client | |
Remove image.crop field from Java API client | |
Remove image.crop field from Javascript API client |
Model
Status | Details |
Added detection evaluation in platform | |
Introduce concept mapping model that uses the knowledge graph relations, creating a path for users to eventually benefit from pool of networked data | |
Fix a bug that caused the new face predictions to have a huge performance drop | |
Train and eval worker didn't invalidate model related cache. Fixed | |
Fix bug in deleting a concept relation by ID |
Portal
Status | Details |
Bulk labelling can now be done from Explorer mode grid view. | |
Show Check/X on custom detection model predictions in Portal | |
Allow multi concepts per bbox | |
Negative tags not visible in Portal. Fixed |
Predict
Status | Details |
Remove extra round trip to storage in predict pathway | |
Remove the image.crop argument during predict and POST /inputs calls to simplify the API | |
Add region predictions from custom models to detections in videos |
Search
Status | Details |
Implement search by annotation.status in backend | |
Connect saved searches and annotation status |
Changelog 6.0
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Remove country field from signup form, simplifying new customer signups | |
Essential Plan User can't add collaborators. Fixed |
API
Status | Details |
Introduce new Python gRPC API client, enabling new features and performance enhancements across API | |
Introduce new Java gRPC API client, enabling new features and performance enhancements across API | |
Update API key type for "app_specific" for app-specific keys to be more clear to users |
Applications
Status | Details |
Allow Personal Access Tokens when calling /users/me (GetUsers) | |
[Frontend] Enable "Copy Application" from collaborated apps, making it easy to duplicate and build upon existing applications | |
Program to clean internal apps crashing. Fixed |
Data Management
Status | Details |
Added the ability to accept b64 Gifs | |
Functionality to upload pre-tagged images missing. Fixed | |
Images pre-tagged with concepts do not successfully upload into Clarifai UI On doing bulk uploads (>20-30 urls). Fixed | |
Bulk image upload issue. Fixed | |
"Download Failed" error when uploading images. Fixed | |
Issue with post inputs key being a PAT in a collector. Fixed |
Annotate
Status | Details |
Skip aligning landmarks if landmark points are out of range to avoid errors and unexpected behavior | |
Bounding Boxes and Cropped Regions aren't displaying on Videos with default runtime config. Fixed | |
Insert annotations and related data in batch to improve performance |
Model
Status | Details |
Evaluate new face embedding model workflow end to end for optimal performance | |
Validate that concept.app_id shouldn't be set when creating/patching models | |
Add new predicate to knowledge graph for "relates_to" to represent synonyms | |
Model training lag. Fixed | |
Model has missing inputs. Fixed | |
Submitted models becoming stuck in queue. Fixed | |
Custom training models when uploaded images are not fully pre-processed. Fixed | |
Custom facial recognition bboxes do not correspond with detection boxes/ Custom facial recognition prediction interval for video is still 1000ms for apps supporting 100ms runtime config. Fixed | |
frame_info time off by a factor of 10 for general detection model. Fixed | |
Detection Models throw error at end of video due to invalid index lookup. Fixed |
Workflow
Status | Details |
Deleting a workflow should clear or update localStorage. Fixed |
Portal
Status | Details |
Clean up app overflow UI, improving user experience | |
Improve Error boundary screen, improving user experience | |
Add sentry error Id to Error Screen | |
Images not loading. Fixed | |
Label and prediction on the right side under Custom Model Predictions section no longer shows up automatically. Fixed | |
Provide a way for user.metadata to be updated from portal when there are failing apps stuck in there. Fixed | |
Predictions for a detection model don't show properly in portal. Fixed | |
Custom facial recognition Predict Boxes not displaying. Fixed | |
Adding inputs in explorer redirects to explorer view with flashing images. Fixed |
Predict
Status | Details |
Run prediction by ID in small batch, improving performance | |
Custom model predictions not displaying. Fixed | |
Custom model detections not displaying. Fixed |
Search
Status | Details |
Add file upload input button to explorer search bar, simplifying the UX for file uploads | |
Filter custom facial recognition bboxes using a sliding bar, adding easy thresholding to custom facial recognition models | |
Search Bar allows file upload | |
Remove Explorer App Overflow Menu for improved UX |
Changelog 5.11
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Create a UI for personal access tokens making it easier for users to access their own apps and any apps where they have been added as collaborators | |
Updated /keys to work with PATs so that app-specific keys can be created programmatically. | |
Login (user/PW) has no rate limit/max attempts. Fixed | |
Remove all instances of worker_id from explorer | |
When email link to verify my email address clicked, still see "verify your email" banner. Fixed | |
API services do not function once Queue goes down and comes back up. Fixed. This makes on premise deployments more resilient to power failures. |
Applications
Status | Details |
Add apps and keys scopes so they can be created with personal access tokens | |
Copy app count and last_inputs added in app duplication | |
Fixed demo font syntax | |
Fixed details page header missing description | |
Added favicon for Portal | |
Unable to copy an app that has been shared via Collaborators. Fixed | |
Setting useCustomConfig isn't checked at login. Fixed | |
Collaboration apps have race condition where wrong user id is used | |
Stopped loading of collaborations for search demo/logged-out users | |
Return “All” scopes when listing available scopes so that you have that option when creating new keys. | |
Collaborators can not see workers. Fixed | |
Missing | |
List of missing scopes is not correct in error messages. Fixed |
Data Management
Status | Details |
Optimize video detection frame rate on Front end | |
Improve JSON serialization performance in our servers by using an optimized third party library | |
Able to overwrite default max conn for Citus | |
Rewrite input counting in the API to be more scalable and robust | |
Allow RegionInfo from SpireDetectEmbedResponse to contain Point when saving to DB | |
Unable to upload same file(s) through browse files. Fixed | |
ffmpeg can produce no frames for very short videos | |
Add Inputs/View Explorer does not display in new app anymore. Fixed | |
Clicking video thumbs in detail view does not reload a video. Fixed | |
Keyboard navigation in image details view highlights incorrect thumb | |
No Prompt when uploading an image to Explorer through URL. Fixed | |
Properly return error if |
Annotate
Status | Details |
Remove classification/detection toggle in image details view | |
Improved adding negatives to regions | |
Create one annotation for each bbox | |
Log capability added for annotation/search request/response | |
Eliminated error if no annotation to be deleted | |
Last concept used for bounding boxes is retained between apps. Fixed | |
The Add Positives / Add Negatives buttons on a Concept details view breaks portal | |
Custom facial recognition bboxes on grid view do not correlate. Fixed |
Model
Status | Details |
Ability to keep concepts sorted by alpha in Portal | |
Implement image crop model to make it possible to work in subregions of an image | |
Implement random sample model type, adding to fixed function feature set | |
Update training templates to have more straightforward names and more friendly defaults | |
Fix the WorkflowInput field name in proto to workflow_input | |
Allow models that need outputs from previous nodes in a workflow to have access to those outputs to support chaining complex graphs of models | |
Confusion matrix predicted/true are swapped in evaluation results. Fixed | |
Fixed generalModel imports and optimize video click handlers with useCallback hooks | |
Fix for selectEmbedModelVersionId in detection apps | |
Drawing annotations: wrong embed model version id | |
Made custom training evaluations for large models stable. | |
Training progress is saved too frequently, causing very slow training | |
Return friendlier errors for incorrect parameters passed to templates | |
Fixed a bug in tracing setup for custom trainer and evaluator | |
Some models were operating slowly because of lack of resources. Fixed | |
Training System failed to train some layers. Fixed | |
Prevent users from evaluating models that are not trainable | |
Fixed node ID validation logic in Bug in workflows |
Predict
Status | Details |
Add colors to differentiate region results | |
Cannot view workflow results in a face app. Fixed | |
Video spire tests are not running correctly. Fixed | |
Video processing fails with 'caseids' error. fixed |
Search
Status | Details |
Add click to search metadata attributes in image details sidebar | |
Implement visual search in another app as a model type you can add to a workflow | |
Search bar missing in some cases. Fixed | |
Region Searches within Search Bar still use crop coordinates instead of base64 bytes. Fixed | |
Click Search button icons on Thumbs not working for localized search. Fixed | |
Disable all search by click handlers in Portal for Text Apps | |
Disable "hide all positively labeled" inputs button for NLP until search works | |
Scroll active thumb into view in image details carousel | |
Render Video Assets in Search Bar | |
Editing geo/json search items no longer work after adding the search bar tooltip. Fixed | |
TypeError: Cannot read 'get' of undefined when clicking image thumbnails in Explorer search bar. Fixed | |
Explorer Visibility in small resolution screen improved |
Changelog 5.10
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Create delete email endpoints in v2 to finally get off old internal endpoints to streamline operations | |
Create Patch, Delete, Get CreditCards endpoint in v2 APIs to finally get off old internal endpoints to streamline operations | |
Improved billing for collaborators | |
PostVerifyEmail error causing some issues not being able to verify their email addresses upon sign-up. Fixed | |
Fixed flaky email verification integration test to provide more stability to sign-up process | |
Fixed a link to a non-public version of our API used for development purposes which led to a lot of login issues for users who landed there |
Applications
Status | Details |
Created display for scopes on collaborator invitations, allowing users to easily understand and control the scope of access allowed for app collaborators | |
Introduced Collaborators and Collaborations endpoints in API and UIs in Portal | |
Add ability to upload inputs from App Details screen in Portal | |
Created collaboration tab in Portal, making it easy to add collaborators to apps | |
Created display to show the user who invited you to collaborate on an app | |
Update email phrases for collaborator invitations. After successful sign-up, the user is now redirected to the app's dashboard in Portal | |
Fixed issue with concept counts in some apps | |
Clicking pencil icon to edit an API Key in Portal crashed apps. Fixed |
Data Management
Status | Details |
PATCH /inputs needs to check status of asset before patching | |
Removed sync DELETE /inputs after runtime config tested | |
Changed POST /inputs to be async always to simplify processing of workflows after API client tests updated | |
Added pagination to clusters making for easier data management | |
Sporadic inability to delete any inputs via Portal or in bulk via the API | |
Numerous third party security fixes under the hood during ongoing upgrades | |
Fix 40012 status caused by parallel deletes and adds having a race condition | |
Update status_changed_at when deleting inputs so we can better track changes | |
Cache the input counts so that apps can display them in Portal efficiently | |
Handle killing URL downloading if it is processing for more than 60s. This will make URL processing much more reliable | |
Return an error if a user sends YouTube video URL as that is not a valid URL to a video we can download | |
Prevent PostInputs from creating inputs with a user-provided Input.ID that contains a colon | |
Video calls failed if URLs contain parameters after the file type. Fixed | |
Failed to resolve DNS MX record in URL down-loader which effected some downloads. Fixed | |
Investigate why some re-hosted s3 links are no longer working | |
Getting input counts was broken in some apps, reporting zero, which caused Portal to add an input view to display always | |
Debug UnicodeErrors in URL downloading to fix URLs with Unicode characters | |
Fix the poor handling of video too large error message | |
Unable to batch delete inputs from time to time has been fixed | |
Media processor video handling was having errors with decoding some videos | |
Delete Image Button doesn't work in some scenarios | |
Fixed support for webp image format so it is available again |
Annotate
Status | Details |
Deploy General Detection Beta Model to recognize multiple objects with bounding boxes. | |
Deployed new face detector for improved face detection performance over images and video | |
Created custom training enhancements that handle negatives better for improved model performance | |
Created evaluation metrics for custom facial recognition in backend for improved facial recognition performance | |
Topological sort for workflows for scheduling a sequence based on dependencies | |
Cleaned up duplicate models in workflow model list | |
Deployed clarifai/main general v1.5 in concept model | |
Create Pixel Training Hyperparameter Help Guide | |
Improved accuracy of annotation counts, improving the user experience when annotating inputs | |
If an image is tagged with a concept that is not in the model, training fails due to KeyError, this is fixed | |
Fix detection labeling bug where previous images image ratio is used which would cause display issues | |
We have updated Portal to scale to a large number of concepts with much lower resource usage | |
Investigate face bounding box probabilities consistency to improve user experience | |
Bounding box creation canvas in Portal was breaking on resize of the window | |
Model | |
Cleaned up duplicate models in the workflow model list, so that you no longer see two General models | |
Unintended behavior for private model version IDs for certain customers has been fixed | |
Models referencing deleted backends should be marked as deleted | |
The latest version of our general model wasn't always default, now it is | |
Fixed a bug with face recognition evaluations. | |
Deleted Concepts Persisted in face recognition models. Not anymore! | |
Inability to see whether a large model is training and making progress, or hung has been addressed to better support our customers | |
Model won't train in some apps with no positive examples issue has been resolved | |
Fixed issues with color models failing for a short period of time | |
Fixed list of models available to workflows to only show a single General model |
Predict
Status | Details |
Return custom detection evaluations through the GO API | |
Improved cluster page performance | |
Investigate health checks killing a prediction backend service, which could affect some predictions in the API | |
Workflow predict sometimes was failing with 98012 status code. Many fixes here should reduce that | |
Workflow Predict called the wrong model sometimes. Not any more! | |
Video playback out of sync with detections in our demos | |
Fixed issues with regions predicted on inputs would be carried over between inputs in Portal | |
Fixed the flaky face recognition tests to ensure stability of our face recognition product | |
Face Detection backends were running out of memory for some predictions, this has been resolved | |
Return more descriptive error msg for post metric endpoint |
Search
Status | Details |
Added helper text/suggestions to improve Portal user experience | |
Header Search return app_owner's user info in collaboration endpoints | |
Explorer Search Bar - Clicking the green/red circle icons didn't reliably detect click, now it does! | |
Portal not showing the correct number of results in concept search. Fixed. | |
Left/right arrows in single image view don't switch between images with regions. Fixed | |
Fixed carousel thumbnail clicks wiping query params / trigger new search |
Last updated
