Changelog
Changelog
Changelog 6.7
New Feature | Improvement | Bug Fix | Enterprise Only |
API
Status | Details |
Don't allow updating task workers | |
Don't create duplicated task annotations | |
Fix detection evals showing and too many metrics calls | |
Fix pillow installs for webp | |
Add enum for embed model version id field type. | |
Don't show model types for backends that aren't responding. | |
Clean up output_info.data path | |
Add model_type_id to Model protos. | |
Add /models/types/{model_type_id} endpoint | |
Prevent models_versions.is_public from every being null. | |
model mode types that are internal only are being returned. | |
Create Labeling Order Object and send email to datalabeling@clarifai.com each time backend receives an Labeling Order Object & makes datalabeling a super user | |
App reindex | |
Patchable multi-embed workflows with re-index |
Model
Status | Details |
Demographics model is now broken in model gallery. | |
Deprecate model.type from model mode | |
Update model gallery design | |
embed_model_version_id should be a dropdown |
Portal
Status | Details |
Add versioning to repo, redux, on screen | |
Allow reviewer to modify annotations during review process. | |
Store entire canvas state in redux/context, and drive canvas updates by central store | |
batch v2 shape events by only 1 PATCH/DELETE request | |
Delete functionality v2 | |
Completely detach labeler rendering from server syncing process to enable background syncing | |
Input navigating functionality in v2 | |
Set new regionId as "selected" shape if user has selected a transient shape during async updates | |
Region edit + delete API sync | |
Fix annotation denormalizer to rehydrate actual concept value | |
Create new region in labeler v2 | |
Logic to reduce batched drawing events to least number of API operations | |
Implement new selectors for regions in v2 | |
Normalize Annotations & Regions data for redux storage | |
Nest labelerTasks reducer inside labeler reducer | |
Konva: Concept Region drawing implementation | |
Konva: Implement Rect Transformation | |
Implement a futureproof schema for labeler interaction events | |
Move to event-driven design & have the ability to batch updates using custom logic | |
Create a single Sidebar component for all Labeling types, make children configurable | |
Remove all props unnecessarily passed from LabelerPage to deep children and make components get props from Redux only | |
Remove all logic from components to sagas for higher level orchestration of features | |
Video selector improvements & test updation | |
Can only save 50 annotations on an image {Usability} | |
Konva: resizing BBox below minimum size and "crossing over" makes things awry | |
LabelerPage complete re-render of all components on mouseHover, mousMove (img attached) | |
Cypress script doesn't terminate webpack-dev-server child process | |
Cypress pre-run script doesn't check if dev server is already running | |
Create Unit+Integration testing framework | |
Integrate headless Cypress with build testing | |
Switch to react-konva for performant canvas rendering | |
Add task id to task list | |
Panning functionality improvements | |
Lock video playback and interpolation to fps | |
Annotations created with interpolation seem to have incorrect frame indices | |
Bounding Boxes and Concepts inconsistent during video playback {Usability} | |
While annotating video, interpolation freezes and all annotations disappear | |
Boxes/Interpolation objects are not saving after task submission | |
Display task instructions to workers in labeler mode | |
Add infinite scroll loading to labeler carousel | |
Not incrementing onNext and onPrev pages in Labeler Carousel | |
Display only minimal log in Portal react app | |
Update Model mode to use the GET /models/types endpoint | |
Add list/grid toggle in model mode on all view | |
Collectors UI should use the layout similar to ModellingMode/LabellerMode | |
Bulk add concepts to region annotations in app with multi-embed base workflow | |
Profile page crashes on load | |
Model mode array of concepts should be unique | |
Model creation/edit bugs | |
New Collector page not scrollable | |
App Workflows - Unable to update model version for custom models | |
Display Created At Date in App Grid View | |
Support .txt files from local file browser | |
Support uploading of multiple video assets as well as image and video assets within the same CSV file | |
Add better user feedback for uploading text assets | |
Upload Text by CSV for NLP | |
Final NLP MVP Feature Changes | |
Remove 0 area detection filtering from frontend code | |
Modify accepted CSV upload format so every column corresponds to a network request field | |
Resolve final bugs with bounding box indexes | |
Prevent uploading image and video asset types to Text apps | |
No Visual Feedback for Text input Upload | |
Support Uploading Files through the OS File Browser for NLP | |
Custom Model Prediction Bounding Boxes are misaligned from the Detections Bar | |
Workflow Tab should display and load on initial view for text apps | |
Unable to navigate between text assets within explorer's asset detail view | |
CSV uploads not parsing metadata and concepts | |
Explorer's Advanced Search does not support searching by concepts | |
Training a classification model no longer display anything within the Custom Model Predictions tab | |
create annotation CUD sagas for labeler v2 | |
Don't create task annotations in frontend | |
Form: Input Source showing auto complete options from other apps | |
Rich text instructions icon bugs | |
Task create form doesnt force you to set a reviewer if you specify manual review | |
TypeError: val.add is not a function | |
Fix autocomplete when user selects "All inputs" for selecting inputs in task creation | |
Error pops up when collaborator tries to edit task | |
When I attempt to edit an existing labeling task t... | |
Page not responding [Usability] | |
[Explorer] concept thumbnails aren't displaying from model details view | |
Concept Detail View displays incorrect assets | |
Add all concepts button to model mode forms | |
Concept Autocomplete in Model Mode doesn't always display |
Workflows
Status | Details |
Allow run workflow and search embedding from embed model in workflow |
Applications
Status | Details |
Metadata Namespacing for Clarifai Apps | |
App details page should send a user to models page to create models rather than using modal |
Changelog
Changelog 6.6
New Feature | Improvement | Bug Fix | Enterprise Only |
API
Status | Details |
Integrate Python functions service with API | |
List available model types through API |
Model
Status | Details |
Fix video error from new face cluster model in staging env | |
21312 Ground truth data caseids must be nonempty and unique. Fixed | |
Update deep training to list the ModelTypes | |
Move model_metadata to better place in protos. | |
Generalize the domex-visual-searcher model type | |
List available model types from backend services that provide models. |
Portal
Status | Details |
Fixed bug in submitting finished Labeler Task | |
Select all concepts checkbox can be de-synced from actual concepts badges. Fixed | |
Disable Create Task button if not app owner | |
Search by task_id returns incorrect data | |
Removed model creation from concept creation action in portal | |
Video scrubber cannot be moved. Fixed | |
Fixed ability to delete interpolation tracks (you can only delete frames at this time). | |
Worker ids used instead of names in report overview in stats view. Fixed | |
Y-axis on labels created stats page is wrong. Fixed | |
In task creation, adding concepts should be simple to click all the options right away. Fixed | |
Toggling concept visibility doesn't affect previously hidden child region. Fixed | |
Leftover | |
If reviewer is not a collaborator, UI sends empty reviewer id back instead of raising error. Fixed | |
Bounding box disappears on resizing. Fixed | |
While adjusting bounding box, it creates an additional bounding box over no object. Fixed | |
Using Play button brings up "Oops" page. Fixed | |
Error on opening Video Labeler. Fixed | |
Labeler sidebar interaction bugs and unresponsiveness (due to lack of optimistic UI). Fixed | |
Newly drawn object disappears from canvas after drawing, and reappears after API response. Fixed | |
Infinite loading in Labeler Mode for app without any inputs. Fixed | |
Use name field for tasks in Labeler admin. Fixed | |
Clicking labeler icon crashes. Fixed | |
Moving bounding box around repeatedly creates a race condition, shows error notification and duplicate box. Fixed | |
Explorer inputs stale state. Fixed | |
Diagnose issues affecting overall hanging/speed/performance of Labeler | |
Carousel thumbnails not showing up in Labeler. Fixed | |
Not able to create overlapping bounding boxes. Fixed | |
When user adds mass metadata in Explorer, the UI says success but metadata does not persist. Fixed | |
Create annotations while creating task. Fixed | |
Labeler board showing wrong task type. Fixed | |
Polygon annotations break Explorer. Fixed | |
Concept autocomplete in Labeler task creation is showing clarifai/main concepts. Fixed | |
Should not be allowed to create a task with no concepts if my app has no concepts. Fixed | |
Fixed image tools state | |
Restricted tasks to only the assigned users | |
Add validation to TaskForm’s concept field | |
Removed all instances of worker_id from Explorer | |
Create one annotation for each bbox | |
98011 panic on ListTasks. Fixed | |
App names no longer display in Explorer. Fixed | |
Empty Annotations are not displaying after drawing a new bounding box until after refreshing the page. Fixed | |
Drawing a new bounding box in Explorer after previously labeling a region display an error. Fixed | |
Video search results do not play at the most relevant video time. Fixed | |
Change text upload UI to support moderation workflow | |
Change object key lookup in boundingBoxContainer to use lodash/get | |
Submitting Task for Review break Portal. Fixed | |
Labeling a region on an asset with multiple detected regions will put the child annotation in the wrong group in Explorer's sidebar. Fixed | |
ConvertToBoundingBoxRegion function breaks Explorer when annotation information has not loaded at time of render. Fixed | |
Video Frame Annotating in Explorer throws errors. Fixed | |
When drawing a new bounding box, Base64 string for video annotations shows the wrong regions. Fixed | |
Fixe 10MB issue with video uploads | |
Detection Regions and Indexes are thrown off on video assets. Fixed | |
Video Search Results still on showing Inputs. Fixed | |
DetailsPageHeader adds 2.25rem margin to the DetailsPageBody. Fixed | |
Video Interpolation in Labeler breaks dev. Fixed | |
Redux is no longer calculating the sample_ms rate, preventing bounding boxes from rendering. Fixed | |
Fixed video pause error when navigating between videos | |
ImagePile in Labeler Task View does not display image thumbs due to extraneous object nesting. Fixed | |
Remove warning error from console for immutable passed in props to SearchGrid.js | |
Post annotation to detection region should use region id in portal. Fixed | |
Delete app button in app details takes you to blank page. Fixed | |
Incorrect bbox/label numbers displayed in image. Fixed | |
Multiple video thumbs selected in search results when selecting one thumb. Fixed | |
Improve Labeler mode window resizing. | |
W and E hotkeys for image labelling to go left/right. | |
Polygon annotations break Explorer. Fixed. | |
Polygons regions don’t appear when panning and zooming. Fixed. | |
Allow users to create concepts on task create view. | |
Fixed task list item count query. | |
Utilising new task endpoints to Create tasks and integrate to show tasks in Portal. | |
LabelerPage refresh error. Fixed. | |
Should not be allowed to create a task with no concepts if my app has no concepts. Fixed. | |
Unknown page Error. Complete interpolation of an object doesn't show bbox. Complete tracking of a box will disappear from the video. Fixed. | |
Fixed carousel padding. | |
Labeler board showing wrong task type. Fixed. | |
Integrate worker/reviewer side of Labeler. | |
Add 'name' field to new Tasks. | |
Create annotations while creating task. | |
Carousel thumbnails not showing up in Labeler. Fixed. | |
No image clearing/loading indicator in Labeler. Fixed. | |
Use name field for tasks in Labeler administration. | |
Bulk labeling value does not update in store upon labeling. Fixed. | |
Record time per annotation and per input to /stats/values in Labeler mode of Portal. | |
Query and display stats across workers per task for time and count of annotations. | |
Concept autocomplete in Labeler task creation is showing clarifai/main concepts. Fixed. | |
Implement polygon task type in Labeler. | |
Applying filters in Portal breaks bulk labeling / unlabeling. Fixed. | |
Unable to bulk-label annotations. Fixed. | |
Change submit to "Complete Task" in Labeler page and add progress bar as it's working. | |
Allow Patching region annotations in Labeler mode. | |
Add AI assist thresholding. | |
Add ability to set annotation_info in the annotation writer | |
| |
Upgrade gulp and node to latest version for testing-library support | |
Write PropType declarations for componens/ConceptListTable | |
Enable collapse behavior in sidebar concepts | |
Create atomic reusable sidebar components | |
Integrate React Testing Library | |
Konva: Image centering, zooming, panning | |
Move toolbar logic to react context | |
Refactor TaskForm related thunks to sagas | |
[Rearch]Scaffold Labeler Redux in a new nested state slice & Implement Sagas | |
[P2] Task id is used in dropdown of stats tasks rather than task.name | |
[P0]Show taskId at task list | |
Move region visibility state to its own React Context | |
Get sidebar list data directly from redux | |
[P1] Don't hide task form if error occurs | |
Remove delay of annotation request | |
Remove animation for showing concepts on right side | |
Perf: only fetch input predictions/annotations if user stays on image, not while navigating | |
Get Labeler internal features ready for internal users | |
Offload annotation creation to backend | |
allow reviewers update annotations | |
No image clearing/loading indicator in Labeler | |
Controls for resizing bounding boxes need to be more visible | |
Fabric rendering to be real-time; sync from API in background | |
make tasks endpoint public | |
list task by worker id/reviewer id | |
Add 'name' field to new Tasks | |
Integrate worker/reviewer side of labeller | |
Integrate and Implement task deletion using new endpoints | |
Utilising new task endpoints to Create tasks and integrate to show tasks at portal | |
Integrate and utilise new CRUD endpoints in portal | |
Allow users to create concepts on task create view | |
Add empty CRUD endpoints for tasks | |
Make polygons a separate task type | |
Add AI assist thresholding | |
W and E hotkeys for image labelling to go left/right. | |
Improve labeler mode window resizing. | |
Allow Patching region annotations in labeler mode. | |
crank up internal message size to handle larger videos with more outputs | |
Introduce stats collection APIs for worker stats. | |
Implement /tasks CRUD in API. | |
Add frame.id to API as well as track id. | |
Remove ‘alt’ from hotkeys, just use letters and arrows straight up | |
Update image tool icons | |
Add support for fields under ENUM values during model creation | |
Implement Dynamic model types | |
Ungrouped Annotations/New Annotation Regions should display at the top of Explorer's Detections List | |
Change explorer to use sample_ms instead from network response instead of deducing the value | |
Hide Workflow List Elements if below Range Slider value | |
Modify Annotating from Custom Model Predictions to post new annotations. | |
Update model mode with new designs | |
Refactor ImageUtils.js file to individual functions instead of one object | |
Added threshold search result in Portal | |
Update media player icons | |
Display timestamp bar in Explorer grid view for video results | |
Concept relation should autocomplete concept name | |
Send email to workers when they are added to task | |
Assigning a worker or reviewer to a task sends an email | |
Apps with empty workflow should allow all task types (concepts, bounding box, polygon) during task creation | |
Edit Task feature | |
Support consensus review settings | |
Support detection tasks | |
Create new Single Image View and Image Tools | |
Task view UI for workers | |
Introduce AWAITING_REVIEW status for annotations | |
Split tasks admin view into tabs | |
Test out idea behind tasks as saved searches and POST /annotations iterations | |
Implement search by annotation.status in backend | |
Search by images or video type in the right hand side bar of explorer's grid view | |
Video Crop Region Search | |
video thumbs display relevant frame in search |
Workflows
Status | Details |
Display workflow detection predictions on the main/large image in Portal |
Changelog
Changelog 6.5
New Feature | Improvement | Bug Fix | Enterprise Only |
Applications
Status | Details |
Can't Access Main Apps Page with invalid collaborators. Fixed. | |
Unable to create new Application (General Detection). Fixed. | |
|
Inputs
Status | Details |
Pasting long text makes Uploader unusable due to lack of scrolling. Fixed. | |
Support uploading text containing emojis. |
Annotate
Status | Details |
Integrate and Implement task deletion using new endpoints. | |
Implement /tasks CRUD in API. | |
Allow annotation writer model to set the | |
Make polygons a separate task type. | |
Add empty CRUD endpoints for tasks. |
Model
Status | Details |
| |
| |
NLP text input does not scroll when longer than viewport height. Fixed. | |
Clear text inputs after upload. | |
Improve the "TextFile" React Component for NLP. | |
Make existing model details view configurable by model type. | |
Edit model should only contain the fields related to the selected model. Fixed | |
NLP frontend text input is covered entirely blue when selected. Fixed. | |
Enforce fields in post/patch models to adhere to model types. Fixed. |
Predict
Status | Details |
Fixed fps issue for video predictions. | |
Validate |
Search
Status | Details |
Dropdown Search Help Menu no longer displays in the search bar. Fixed. | |
Video thumbs have relevant timestamp in search. | |
Added adjustable search results threshold. | |
Search over multi-embed workflows. | |
Added search on input level. | |
Improved search query by using multi join. | |
Fixed panic in list saved searches endpoint. | |
Input metadata search from table not working. Fixed. |
Portal
Status | Details |
"Return to Log in " doesn't redirect to login page. Fixed. | |
Clicking on image, or Explorer Mode with images that contain geo coordinates crashed the app. | |
Portal model predicts use hosted URL when available instead of normal URL. | |
When selecting a concept and going to the next image the concept checkbox won't stay selected. Fixed | |
Allow multi-select from explorer grid view and add metadata. | |
Integrate and utilize new CRUD endpoints in Portal. | |
Allow for pasted text to keep formatting in the text box. | |
Prediction threshold slider custom model predicts without base workflow annotations. Fixed | |
Strings without spacing format properly in Explorer's Asset Grid View | |
|
Workflow
Status | Details |
Hide the "add text" section of the add inputs modal for non text workflows. | |
Validate that all nodes in workflows list their inputs based on type. | |
Add NLP to Workflows List | |
Generalize the iterations over regions/frames in workflow code. | |
Add ability to "make a copy" of public_workflows. | |
Allow indexing embedding from detect -> crop -> embed style workflows. | |
Allow setting input nodes for all users, not just @clarifai.com users. | |
Allow non-internal users setting input node when creating workflows. | |
Create/Patch workflow uncaught exception. |
Clients
Status | Details |
Update docs.clarifai.com to reflect our current API clients including grpc clients. |
Changelog 6.4
New Feature | Improvement | Bug Fix | Enterprise Only |
Applications
Status | Details |
Improved responsiveness of collaborations tab in /apps | |
Enabled list collaborators to list deleted collaborators | |
Login Form breaks app. Fixed | |
Deleting an app no longer redirects to /apps | |
Can’t create models in new app. Fixed |
Inputs
Status | Details |
Fixed .webp files not working when sent as base64 |
Annotate
Status | Details |
MVP of labeler single image view functionality | |
Support detection tasks | |
Detection Labeler: Color Coded Concepts | |
Add workflow_id to task creation and show AI predictions to verify in labeler mode | |
Split tasks admin view into tabs | |
Add visual sections to task form | |
Add default queries for "all inputs" and "all unlabelled inputs" in task create view | |
Autocomplete annotation user | |
Implement Classification Task Review Logic | |
Implement Review Process into tasks | |
Introduce stats collection APIs for worker stats | |
Implement APIs for polygon region support | |
Incorporate image filters for labelling | |
Update image tool icons | |
Ability to zoom in on images | |
Remove ‘alt’ from hotkeys, just use letters and arrows | |
Label to draw box in video frame using frame bytes | |
Display videos in labeler | |
Add video fps field for tasks | |
Draw Bounding Boxes in Labeler Detection Videos | |
Add video controls for video in labeler | |
Fix Classification Annotation | |
Video annotation deletion. Fixed | |
AI Assist Predictions did not show for General workflow classification task. Fixed | |
Fix Classification video annotation | |
Display video in classification tasks | |
Fix Labeler input urls | |
Fix Annotation creation for video | |
Fix Labeler post calls | |
Detection Labeler: fix zoom | |
Fixed image cropper task description | |
Fix concept threshold creation | |
Set annotation status ‘success’ | |
Restrict tasks to only the assigned users | |
Add validation to TaskForm’s concept field | |
Display human tags for human box as child |
Model
Status | Details |
Convert Deep Trained Model to Embedding Model for Use as "Base Workflow" | |
Classification predictions for AI assistance | |
Merge this detection and custom model prediction sections for detection models | |
Video labelling UI for classification. | |
Remove the non-creatable types from model mode | |
Improve the create classifier / detector view options in model mode | |
Add deep training options in model mode | |
Update random sampling model to have a slider |
Predict
Status | Details |
Fixed public concept rank |
Search
Status | Details |
Support detection evaluations in PostAnnotationSearchMetrics | |
Support nlp search (only filtering) | |
Add evaluations between two saved search label sets | |
Fix labeler search amount | |
Error: "Cannot search over | |
Model name and details is not populated upon model creation in model mode | |
Fix annotation search when accessing the LabelerPage | |
Search by annotation_info should not return the embed annotation. Fixed | |
Search for metadata in detection apps doesn't work. Fixed |
Portal
Status | Details |
Create Dual Range Slider | |
Enable patching the default workflow from Portal and error if needs reindex | |
Allow drawing bounding boxes on paused video frames | |
Add scopes for collaborators and metrics to Portal | |
Allow up to 15-20x zoom level for really large images. | |
Allow selection the embed_model_version_id from Portal when creating a model | |
Fix inconsistent fps between uploading video and predicting video | |
Missing frame time. Fixed | |
Model annotations not appearing in Explorer. Fixed | |
When creating the auto annotation workflow editing the workflow crashes Portal | |
Fix image tools state |
Workflow
Status | Details |
CreateWorkflow model improvements | |
Allow custom concept models in the default app workflows | |
Add a "Make a Copy" or "Copy to New Workflow" button for each workflow | |
Allow patching the default workflow in Portal | |
Show the default workflow in the list of workflows for the app | |
Validate patching of default workflow is compatible in backend | |
Large workflow name causes overlap in app details view. Fixed | |
Portal crashes if page reloads during workflow add/edit. Fixed | |
Detection workflow recompute also predict detect-concept | |
Allow detect-concept models to be added to workflows | |
Patch workflow create worker | |
Fix validation of inputs in workflows | |
Fix workflow embed_join_annotation_id issue |
Clients
Status | Details |
Clean up private API client repos | |
Remove public workflows from Python client |
Changelog 6.3
New Feature | Improvement | Bug Fix | Enterprise Only |
Applications
Status | Details |
Send collaborator emails asynchronously | |
NLP bug fixes for non-text apps |
Inputs
Status | Details |
Consolidated input related status codes | |
Add frame.id to API as well as region.track_id | |
Granted select permission to clarifairead |
Annotate
Status | Details |
Added list annotations filter status | |
Added concept selection for tasks | |
Post/Patch annotations request now allow setting status | |
Changed task form options | |
Set annotation status to awaiting for review if the authorized user is not app owner | |
Return only input_level annotation in input.data | |
Drawing annotations: wrong embed model version id. Fixed | |
Eliminated error if no annotation to be deleted | |
Create one annotation for each bbox |
Model
Status | Details |
Added support for adding and training on text in the platform | |
Created a NLP mock prediction endpoint | |
Created test set to evaluate quick trained models or k-fold if no test search is specified | |
Added vocab_id for demographics model concepts | |
Fixed sorting of A.G.E. concepts in golang for demographics model so we don't chop off sets of them | |
Deprecated Face from javascript Client | |
Deprecated Face from Java Client | |
Confusion matrix predicted/true are swapped in evaluation results. Fixed | |
Explorer Image/Text Joint embedding | |
Fixed selectEmbedModelVersionId in detection apps | |
Fixed generalModel imports and optimized video click handlers with useCallback hooks |
Search
Status | Details |
Persisted the saved search used in train a model version | |
Created log for annotation/search request/response | |
Region Searches within Search Bar still use crop coordinates instead of base64 bytes. Fixed |
Portal
Status | Details |
Created new Single Image View and Image Tools | |
Enabled Display Text Thumbnails in App Grid View and App Details View | |
Text Thumbnails display in Portal/Search Bar disabled | |
Enabled View Text Assets in Portal's Image View | |
Added Text Inputs To Explorer Apps | |
Imported new icons for Labeler Image Tools into the style guide | |
Added login tracking to analytics package in Portal | |
Allowed pasting into the add inputs text area and clear the text box after clicking submit | |
Search bar not visible. Fixed | |
Removed all instances of worker_id from Explorer | |
Fixed popover left/right overflow | |
Disabled all search by click handlers in Portal for Text Apps | |
Click Search button icons on Thumbs not working for localized search. Fixed | |
Fixed details page header missing description | |
Fixed demo font syntax |
Workflow
Status | Details |
Added a Range Slider to filter Workflow Predictions by Value | |
Updated Face workflow to include the detect faces as concepts for search |
Changelog 6.2
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Updated Privacy Policy URL | |
Fixed panic error in Signup |
Applications
Status | Details |
Ensured collectors are deleted when apps are deleted | |
View In Explorer button missing in app details. Fixed | |
Fixed failed to generate thumbnail | |
Fixed app duplication error when getting worker | |
Deleted collaborator should also mark application_worker to deleted. Fixed |
Inputs
Status | Details |
Inputs count stuck at > 0 after delete all, with all inputs seemingly deleted |
Label
Status | Details |
Task view UI for workers | |
Create task manager page and task creation page | |
New Icon for Task Manager/Task Viewer | |
Fixed POST annotations call on frontend to use correct embed model | |
Post annotations should include embed_model_version_id. Fixed |
Model
Status | Details |
Added Apparel Detection to Demo App | |
Created UI for creating knowledge graph concept relations relations | |
Create annotation writer model to write annotations to DB | |
Pass and use test and train data queries to trainer | |
Added migration to upgrade old model_type in DB | |
Depredated Face from Python client | |
Unified the TypeExt and Type fields in model object. | |
Deprecated facedetect* model types. | |
Unified FaceEmbedModel and DetectEmbedModel | |
Converted face.Identity responses to concepts like other detection models to be consistent | |
Fixed demo font syntax | |
Video Timeline does not display on the demo app | |
Fixed Range Slider Value/Text in Apparel Detection Demo | |
Fixed demographics model to return embeddings and work with auto-annotate | |
Adding collaborator model counter-intuitively requires ENTER in order to enable the submit button. Fixed |
Predict
Status | Details |
Validated that concept relation doesn't already exist on POST relations | |
Prediction requests are being fired too frequently instead of using cache. Fixed | |
postModelOutputs is not called for newly labeled assets without a manual refresh |
Search
Status | Details |
Return annotations posted by user in search results | |
Search by region not working for face detection. Fixed | |
Make “save” search button internal only | |
Saved Searches in Portal use the incorrect user ID | |
Fix crop search from single image view for faces/detections |
Portal
Status | Details |
UI for collector crud | |
Deprecate Face from Portal | |
Improve tabs UI | |
Video Predictions are failing in Portal | |
Fixed broken font syntax |
Workflow
Status | Details |
Video detection workflow prediction support | |
Public general v1.5 workflow | |
Allow Patching to existing public workflow | |
Can not train LOPQ if app base workflow is face. Fixed |
Changelog 6.1
New Feature | Improvement | Bug Fix | Enterprise Only |
Clients
Status | Details |
Remove Feedback endpoints from Python client | |
Remove Feedback endpoints from Java client | |
Remove Feedback endpoints from Javascript client | |
Remove Feedback endpoints from Portal/demo | |
Remove image.crop field from Python API client | |
Remove image.crop field from Java API client | |
Remove image.crop field from Javascript API client |
Model
Status | Details |
Added detection evaluation in platform | |
Introduce concept mapping model that uses the knowledge graph relations, creating a path for users to eventually benefit from pool of networked data | |
Fix a bug that caused the new face predictions to have a huge performance drop | |
Train and eval worker didn't invalidate model related cache. Fixed | |
Fix bug in deleting a concept relation by ID |
Portal
Status | Details |
Bulk labelling can now be done from Explorer mode grid view. | |
Show Check/X on custom detection model predictions in Portal | |
Allow multi concepts per bbox | |
Negative tags not visible in Portal. Fixed |
Predict
Status | Details |
Remove extra round trip to storage in predict pathway | |
Remove the image.crop argument during predict and POST /inputs calls to simplify the API | |
Add region predictions from custom models to detections in videos |
Search
Status | Details |
Implement search by annotation.status in backend | |
Connect saved searches and annotation status |
Changelog 6.0
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Remove country field from signup form, simplifying new customer signups | |
Essential Plan User can't add collaborators. Fixed |
API
Status | Details |
Introduce new Python gRPC API client, enabling new features and performance enhancements across API | |
Introduce new Java gRPC API client, enabling new features and performance enhancements across API | |
Update API key type for "app_specific" for app-specific keys to be more clear to users |
Applications
Status | Details |
Allow Personal Access Tokens when calling /users/me (GetUsers) | |
[Frontend] Enable "Copy Application" from collaborated apps, making it easy to duplicate and build upon existing applications | |
Program to clean internal apps crashing. Fixed |
Data Management
Status | Details |
Added the ability to accept b64 Gifs | |
Functionality to upload pre-tagged images missing. Fixed | |
Images pre-tagged with concepts do not successfully upload into Clarifai UI On doing bulk uploads (>20-30 urls). Fixed | |
Bulk image upload issue. Fixed | |
"Download Failed" error when uploading images. Fixed | |
Issue with post inputs key being a PAT in a collector. Fixed |
Annotate
Status | Details |
Skip aligning landmarks if landmark points are out of range to avoid errors and unexpected behavior | |
Bounding Boxes and Cropped Regions aren't displaying on Videos with default runtime config. Fixed | |
Insert annotations and related data in batch to improve performance |
Model
Status | Details |
Evaluate new face embedding model workflow end to end for optimal performance | |
Validate that concept.app_id shouldn't be set when creating/patching models | |
Add new predicate to knowledge graph for "relates_to" to represent synonyms | |
Model training lag. Fixed | |
Model has missing inputs. Fixed | |
Submitted models becoming stuck in queue. Fixed | |
Custom training models when uploaded images are not fully pre-processed. Fixed | |
Custom facial recognition bboxes do not correspond with detection boxes/ Custom facial recognition prediction interval for video is still 1000ms for apps supporting 100ms runtime config. Fixed | |
frame_info time off by a factor of 10 for general detection model. Fixed | |
Detection Models throw error at end of video due to invalid index lookup. Fixed |
Workflow
Status | Details |
Deleting a workflow should clear or update localStorage. Fixed |
Portal
Status | Details |
Clean up app overflow UI, improving user experience | |
Improve Error boundary screen, improving user experience | |
Add sentry error Id to Error Screen | |
Images not loading. Fixed | |
Label and prediction on the right side under Custom Model Predictions section no longer shows up automatically. Fixed | |
Provide a way for user.metadata to be updated from portal when there are failing apps stuck in there. Fixed | |
Predictions for a detection model don't show properly in portal. Fixed | |
Custom facial recognition Predict Boxes not displaying. Fixed | |
Adding inputs in explorer redirects to explorer view with flashing images. Fixed |
Predict
Status | Details |
Run prediction by ID in small batch, improving performance | |
Custom model predictions not displaying. Fixed | |
Custom model detections not displaying. Fixed |
Search
Status | Details |
Add file upload input button to explorer search bar, simplifying the UX for file uploads | |
Filter custom facial recognition bboxes using a sliding bar, adding easy thresholding to custom facial recognition models | |
Search Bar allows file upload | |
Remove Explorer App Overflow Menu for improved UX |
Changelog 5.11
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Create a UI for personal access tokens making it easier for users to access their own apps and any apps where they have been added as collaborators | |
Updated /keys to work with PATs so that app-specific keys can be created programmatically. | |
Login (user/PW) has no rate limit/max attempts. Fixed | |
Remove all instances of worker_id from explorer | |
When email link to verify my email address clicked, still see "verify your email" banner. Fixed | |
API services do not function once Queue goes down and comes back up. Fixed. This makes on premise deployments more resilient to power failures. |
Applications
Status | Details |
Add apps and keys scopes so they can be created with personal access tokens | |
Copy app count and last_inputs added in app duplication | |
Fixed demo font syntax | |
Fixed details page header missing description | |
Added favicon for Portal | |
Unable to copy an app that has been shared via Collaborators. Fixed | |
Setting useCustomConfig isn't checked at login. Fixed | |
Collaboration apps have race condition where wrong user id is used | |
Stopped loading of collaborations for search demo/logged-out users | |
Return “All” scopes when listing available scopes so that you have that option when creating new keys. | |
Collaborators can not see workers. Fixed | |
Missing | |
List of missing scopes is not correct in error messages. Fixed |
Data Management
Status | Details |
Optimize video detection frame rate on Front end | |
Improve JSON serialization performance in our servers by using an optimized third party library | |
Able to overwrite default max conn for Citus | |
Rewrite input counting in the API to be more scalable and robust | |
Allow RegionInfo from SpireDetectEmbedResponse to contain Point when saving to DB | |
Unable to upload same file(s) through browse files. Fixed | |
ffmpeg can produce no frames for very short videos | |
Add Inputs/View Explorer does not display in new app anymore. Fixed | |
Clicking video thumbs in detail view does not reload a video. Fixed | |
Keyboard navigation in image details view highlights incorrect thumb | |
No Prompt when uploading an image to Explorer through URL. Fixed | |
Properly return error if |
Annotate
Status | Details |
Remove classification/detection toggle in image details view | |
Improved adding negatives to regions | |
Create one annotation for each bbox | |
Log capability added for annotation/search request/response | |
Eliminated error if no annotation to be deleted | |
Last concept used for bounding boxes is retained between apps. Fixed | |
The Add Positives / Add Negatives buttons on a Concept details view breaks portal | |
Custom facial recognition bboxes on grid view do not correlate. Fixed |
Model
Status | Details |
Ability to keep concepts sorted by alpha in Portal | |
Implement image crop model to make it possible to work in subregions of an image | |
Implement random sample model type, adding to fixed function feature set | |
Update training templates to have more straightforward names and more friendly defaults | |
Fix the WorkflowInput field name in proto to workflow_input | |
Allow models that need outputs from previous nodes in a workflow to have access to those outputs to support chaining complex graphs of models | |
Confusion matrix predicted/true are swapped in evaluation results. Fixed | |
Fixed generalModel imports and optimize video click handlers with useCallback hooks | |
Fix for selectEmbedModelVersionId in detection apps | |
Drawing annotations: wrong embed model version id | |
Made custom training evaluations for large models stable. | |
Training progress is saved too frequently, causing very slow training | |
Return friendlier errors for incorrect parameters passed to templates | |
Fixed a bug in tracing setup for custom trainer and evaluator | |
Some models were operating slowly because of lack of resources. Fixed | |
Training System failed to train some layers. Fixed | |
Prevent users from evaluating models that are not trainable | |
Fixed node ID validation logic in Bug in workflows |
Predict
Status | Details |
Add colors to differentiate region results | |
Cannot view workflow results in a face app. Fixed | |
Video spire tests are not running correctly. Fixed | |
Video processing fails with 'caseids' error. fixed |
Search
Status | Details |
Add click to search metadata attributes in image details sidebar | |
Implement visual search in another app as a model type you can add to a workflow | |
Search bar missing in some cases. Fixed | |
Region Searches within Search Bar still use crop coordinates instead of base64 bytes. Fixed | |
Click Search button icons on Thumbs not working for localized search. Fixed | |
Disable all search by click handlers in Portal for Text Apps | |
Disable "hide all positively labeled" inputs button for NLP until search works | |
Scroll active thumb into view in image details carousel | |
Render Video Assets in Search Bar | |
Editing geo/json search items no longer work after adding the search bar tooltip. Fixed | |
TypeError: Cannot read 'get' of undefined when clicking image thumbnails in Explorer search bar. Fixed | |
Explorer Visibility in small resolution screen improved |
Changelog 5.10
New Feature | Improvement | Bug Fix | Enterprise Only |
Accounts
Status | Details |
Create delete email endpoints in v2 to finally get off old internal endpoints to streamline operations | |
Create Patch, Delete, Get CreditCards endpoint in v2 APIs to finally get off old internal endpoints to streamline operations | |
Improved billing for collaborators | |
PostVerifyEmail error causing some issues not being able to verify their email addresses upon sign-up. Fixed | |
Fixed flaky email verification integration test to provide more stability to sign-up process | |
Fixed a link to a non-public version of our API used for development purposes which led to a lot of login issues for users who landed there |
Applications
Status | Details |
Created display for scopes on collaborator invitations, allowing users to easily understand and control the scope of access allowed for app collaborators | |
Introduced Collaborators and Collaborations endpoints in API and UIs in Portal | |
Add ability to upload inputs from App Details screen in Portal | |
Created collaboration tab in Portal, making it easy to add collaborators to apps | |
Created display to show the user who invited you to collaborate on an app | |
Update email phrases for collaborator invitations. After successful sign-up, the user is now redirected to the app's dashboard in Portal | |
Fixed issue with concept counts in some apps | |
Clicking pencil icon to edit an API Key in Portal crashed apps. Fixed |
Data Management
Status | Details |
PATCH /inputs needs to check status of asset before patching | |
Removed sync DELETE /inputs after runtime config tested | |
Changed POST /inputs to be async always to simplify processing of workflows after API client tests updated | |
Added pagination to clusters making for easier data management | |
Sporadic inability to delete any inputs via Portal or in bulk via the API | |
Numerous third party security fixes under the hood during ongoing upgrades | |
Fix 40012 status caused by parallel deletes and adds having a race condition | |
Update status_changed_at when deleting inputs so we can better track changes | |
Cache the input counts so that apps can display them in Portal efficiently | |
Handle killing URL downloading if it is processing for more than 60s. This will make URL processing much more reliable | |
Return an error if a user sends YouTube video URL as that is not a valid URL to a video we can download | |
Prevent PostInputs from creating inputs with a user-provided Input.ID that contains a colon | |
Video calls failed if URLs contain parameters after the file type. Fixed | |
Failed to resolve DNS MX record in URL down-loader which effected some downloads. Fixed | |
Investigate why some re-hosted s3 links are no longer working | |
Getting input counts was broken in some apps, reporting zero, which caused Portal to add an input view to display always | |
Debug UnicodeErrors in URL downloading to fix URLs with Unicode characters | |
Fix the poor handling of video too large error message | |
Unable to batch delete inputs from time to time has been fixed | |
Media processor video handling was having errors with decoding some videos | |
Delete Image Button doesn't work in some scenarios | |
Fixed support for webp image format so it is available again |
Annotate
Status | Details |
Deploy General Detection Beta Model to recognize multiple objects with bounding boxes. | |
Deployed new face detector for improved face detection performance over images and video | |
Created custom training enhancements that handle negatives better for improved model performance | |
Created evaluation metrics for custom facial recognition in backend for improved facial recognition performance | |
Topological sort for workflows for scheduling a sequence based on dependencies | |
Cleaned up duplicate models in workflow model list | |
Deployed clarifai/main general v1.5 in concept model | |
Create Pixel Training Hyperparameter Help Guide | |
Improved accuracy of annotation counts, improving the user experience when annotating inputs | |
If an image is tagged with a concept that is not in the model, training fails due to KeyError, this is fixed | |
Fix detection labeling bug where previous images image ratio is used which would cause display issues | |
We have updated Portal to scale to a large number of concepts with much lower resource usage | |
Investigate face bounding box probabilities consistency to improve user experience | |
Bounding box creation canvas in Portal was breaking on resize of the window | |
Model | |
Cleaned up duplicate models in the workflow model list, so that you no longer see two General models | |
Unintended behavior for private model version IDs for certain customers has been fixed | |
Models referencing deleted backends should be marked as deleted | |
The latest version of our general model wasn't always default, now it is | |
Fixed a bug with face recognition evaluations. | |
Deleted Concepts Persisted in face recognition models. Not anymore! | |
Inability to see whether a large model is training and making progress, or hung has been addressed to better support our customers | |
Model won't train in some apps with no positive examples issue has been resolved | |
Fixed issues with color models failing for a short period of time | |
Fixed list of models available to workflows to only show a single General model |
Predict
Status | Details |
Return custom detection evaluations through the GO API | |
Improved cluster page performance | |
Investigate health checks killing a prediction backend service, which could affect some predictions in the API | |
Workflow predict sometimes was failing with 98012 status code. Many fixes here should reduce that | |
Workflow Predict called the wrong model sometimes. Not any more! | |
Video playback out of sync with detections in our demos | |
Fixed issues with regions predicted on inputs would be carried over between inputs in Portal | |
Fixed the flaky face recognition tests to ensure stability of our face recognition product | |
Face Detection backends were running out of memory for some predictions, this has been resolved | |
Return more descriptive error msg for post metric endpoint |
Search
Status | Details |
Added helper text/suggestions to improve Portal user experience | |
Header Search return app_owner's user info in collaboration endpoints | |
Explorer Search Bar - Clicking the green/red circle icons didn't reliably detect click, now it does! | |
Portal not showing the correct number of results in concept search. Fixed. | |
Left/right arrows in single image view don't switch between images with regions. Fixed | |
Fixed carousel thumbnail clicks wiping query params / trigger new search |
Last updated
