Datacoral Version 1.27.0
Datacoral policy updates
- datacoral-roles changes
- Datacoral Batch role has permission to describe batch jobs, for capturing logs
- datacoral-roles changes
Webapp
- Enable reprocessing of connector loadunit for a selected timelabel (with some guard rails)
- Enable reprocessing of all supported type of materialized-views (with some guard rails)
- Materialized-view run logs are available for failed timelabels
- Batch Compute transformation run logs are available for all timelabels
- Batch Compute now support user defined custom parameters for each transformation
- Bug fixes and other improvements
Collect Slices
- MySQL
- Added support for destination warehouse schema at loadunit level
- Added error handler to support retry in case of failure for CDC
- Postgres
- Added support to allow timelabel to be supplantable in extraction query
- Added support for extraction query when paginate is false
- Fountain
- Fixed applicant_transition loadunit to pull all transitions of applicants
- S3
- Added support for incremental mode to work with fileFilter
- Mux
- Modified video_views loadunit to pull additional details.
- Added error handler to support retry in case of failure
- MySQL
- Organize Slices
- Athena
- Support BigInt datatype for athena MVs.
- Batch Compute
- Option to provide custom parameters while creating MVs
- Added
__dc_timelabel
column to all batch compute MVs
- Redshift
- Handle matview create if queries have comments at the end
- Snowflake
- Improvements to allow more connectors to be able to load data into Snowflake
- Athena