Datacoral Version 1.27.0

  • Datacoral policy updates

    • datacoral-roles changes
      • Datacoral Batch role has permission to describe batch jobs, for capturing logs
  • Webapp

    • Enable reprocessing of connector loadunit for a selected timelabel (with some guard rails)
    • Enable reprocessing of all supported type of materialized-views (with some guard rails)
    • Materialized-view run logs are available for failed timelabels
    • Batch Compute transformation run logs are available for all timelabels
    • Batch Compute now support user defined custom parameters for each transformation
    • Bug fixes and other improvements
  • Collect Slices

    • MySQL
      • Added support for destination warehouse schema at loadunit level
      • Added error handler to support retry in case of failure for CDC
    • Postgres
      • Added support to allow timelabel to be supplantable in extraction query
      • Added support for extraction query when paginate is false
    • Fountain
      • Fixed applicant_transition loadunit to pull all transitions of applicants
    • S3
      • Added support for incremental mode to work with fileFilter
    • Mux
      • Modified video_views loadunit to pull additional details.
      • Added error handler to support retry in case of failure
  • Organize Slices
    • Athena
      • Support BigInt datatype for athena MVs.
    • Batch Compute
      • Option to provide custom parameters while creating MVs
      • Added __dc_timelabel column to all batch compute MVs
    • Redshift
      • Handle matview create if queries have comments at the end
    • Snowflake
      • Improvements to allow more connectors to be able to load data into Snowflake