We are pleased to announce October 2025 release of Data Engine.
This Release includes new enhancements to Data Flows module - checkpoints that allow faster work processes and debugging, the option to convert/migrate legacy Fusions and Merges to Data Flows and 2 new connectors: Monday and Microsoft Graph.
Additional updates have been brought to Data Streams, API and Navigation. This version also comes with a couple of issue fixes.
Data Flows
(NEW) Checkpoints
Checkpoints allow faster work processes and debugging.
The user can pre-process a subset or all rows up to any node to generate faster previews.
Key aspects:
Checkpoints can be generated for any node.
Multiple checkpoints can exist within a single Data Flow.
Checkpoints can process either 50 rows or the entire dataset.
Processed data counts toward storage quota while the Data Flow editor remains open.
Processed data is deleted when the Data Flow editor is closed.
Checkpoints can be regenerated when the Data Flow editor is reopened.
To create a checkpoint, select the node requiring data processing, then click the checkpoint icon in the toolbar.
Processing can be limited to a subset (50 rows) or applied to all data. Depending on subsequent transformations and nodes (filtering, grouping, pivoting), processing the entire dataset may be necessary.
Clicking 'Save' initiates processing and creates a temporary table for data processed up to the selected node. Any preview of node output at or after this checkpoint uses the temporary table as its basis. When the Data Flow editor is closed, the temporary table is deleted and storage usage is updated.
Checkpoints persist on specified nodes. When reopening the Data Flow editor, existing checkpoints can be rebuilt or removed. The checkpoint node must be selected to rebuild or remove it. These actions can be executed for multiple checkpoints simultaneously.
When a node is modified, removed, or a new node is added before an existing checkpoint, that checkpoint becomes outdated. A warning icon indicates outdated status. Depending on the scenario, rebuilding the checkpoint may or may not be necessary.
Nodes
Multi-column selection is now available in Standardize, Fix Data, and Find & Replace nodes for improved user experience.
Import legacy Fusions and Merges
Legacy Fusions and Merges objects can now be imported into Data Flows, where they become Fusion Tables and Merge Tables respectively.
Since input tables must bring in data for processing, only Fusions and Merges based on tables (not Views or other Merges and Fusions) can be imported directly. To convert a View, create a snapshot and transform it into a table.
Views cannot yet be imported at this time.
To add a legacy Fusion or Merge to a Data Flow:
Select the Fusion or Merge object from the list of tables.
Click the dropdown menu next to the object.
Choose "Add to" --> "Data Flow".
An existing Data Flow can be selected, or a new Data Flow can be created. The selected Fusion or Merge is then added as a Fusion Input Table or Merge Input Table.
Fusions and Merges can also be imported using the import button. Multiple objects can be imported simultaneously.
Data
Data Streams
Added Parquet as a file output format.
File compression can now use GZIP compression.
New destinations: the user can send and update Tables to Azure SQL Database.
Connectors Updates
NEW – Monday.
Tables
GZIP compressed files are now supported by all connectors to import data.
API
The new API version "2025.03" now aligns all data types with the types used in the app and offers additional parameters to define constraints and format.
2 new endpoints to manage schema changes:
PUT /table/{table_id}/schema
GET /table/{table_id}/schema
Various
Navigation
Change ownership of multiple objects in bulk in any explorer.
Contextual menus in explorers have been standardized across the app.
Additional improvements and bugs fixed
Unable to access IP whitelist tab Databases properties.
Usage Tab from dataClones has been removed.
Data Flow - Display all refresh modes on Output Table.
Get rows endpoint issues.
Dataflow - Unexpected Increase in Output Table Column Size.
Web Service - 'Could not create SSL/TLS secure channel' Error.
Admin API - Ability to disable password auth when adding an auth method.
Schema - 'Connection Name' column automatically removed when query is adjusted.
DataFlow - Filters in the Preview always display no data.
DataFlow - Filter options disappear after using "is Null".
Data Flow – Disabled AI Nodes still trigger credit consumption warning.
Schedule - Validation not always triggered in task settings.
Web Service - 'Could not create SSL/TLS secure channel' Error.
Display the name of the table in the Schema Editor header.
Data Flow - Unable to copy preview values.
Schedule History - Refresh and selection issues.
How this version will be made available |
The release will be automatically made available.
|