Datacoral Version 1.46.0

Web Application :

  • Self-serve sign-up now GA with support for Datacoral-hosted (SaaS) as well as Customer-hosted (Cloud On-Prem) models
  • Audit logs for all operations performed on connectors available
  • New system logs view to provide details of all steps in the pipeline for each loadunit and materialized view
  • Design refresh of configuration screens

CLI :

  • CLI support for updating newer connectors
  • CLI support for generating data quality check pipelines automatically for CDC connectors

Connectors :

  • PostgreSQL CDC
    • Support for partial historical sync to recover from temporary failures for a specific time window as well as for a list of primary keys
    • Support for PostgreSQL Publication based logical replication in addition to wal2json based replication.
  • MySQL CDC:
    • Support for partial historical sync to recover from temporary failures for a specific time window as well as for a list of primary keys
  • Workday:
    • New connector to read from Workday's Reporting-as-a-Service.
  • 360 Learning:
    • New connector to read from 360 Learning, a platform that empowers learning and development teams to drive culture and growth through collaborative learning.
  • Greenhouse:
    • Refreshed connector to read from Greenhouse, an applicant tracking system and recruiting software, is designed to help make companies great at hiring, improving the process for everyone.

System Improvements :

  • Orchestration improvements:
    • Short circuit snapshot loadunit and replace materialized view processing in case of delays in the pipeline
    • Speed up orchestration throughput by optimizing the storage of the pipeline DAG