Datacoral Version 1.13.0

  • Datacoral policy updates

    • Cross-account role changes
      • Added new permissions to allow a Datacoral cross-account role to restore a table from a Redshift snapshot
    • Datacoral role changes
      • Batch Roles: Added new permissions to invoke the Datacoral lambda functions and describe Datacoral cloud formation stacks
      • Lambda Roles: Added new permission to invoke any Datacoral lambda functions from another lambda function

  • Webapp

    • The Materialized View details page now shows a complete visualization of the Materialized View dependencies DAG
    • Backfill workflow visualization allows you to track the status of each step in the backfill workflow

  • CLI

    • New commands:
      • List workflows types
      • Describe a given workflow type
      • Trigger backfill workflow of a collect loadunit
      • List all workflows
      • Get status of a given workflow
      • Create two new types of MVs (regular append/upsert)
    • Deprecated commands:
      • --aws-resources option in collect describe command
    • Bug fixes for collect check-connection command
    • Collect list now lists the slices in alphabetical order

  • Collect Slices

    • Announcing the availability of the following slices:
      • Asana - Asana is the work management platform teams use to stay focused on the goals, projects, and daily tasks that grow business
      • Datadog - Datadog is a monitoring and analytics platform made to be gain full visibility into modern applications
      • Hubspot - HubSpot offers a full stack of software for marketing, sales, and customer service, with a completely free CRM at its core
      • NetSuite - NetSuite ERP supports back office operations which includes financial, human resources, procurement, orders, inventory, shipping and billing.
      • Outreach.io - Outreach allows you to close more deals by personalizing, prioritizing and analyzing sales activities
    • Support composite keys in snapshot paginate mode for Postgres datasource
    • Support supplant-able select queries in Postgres datasource
    • Clean up any associated actions on collect slice remove
    • Fixes for stl load errors in agent loadunit in zendesk slice
    • Added support in pglogicaldecoding slice add operation to create certain alarms needed to monitor the slice.
    • Fixes for enabling zendesk ticket_audits loadunit for backfill

  • Harness Slices

    • Harness slice loadunits will now be dependency aware and publish when the upstream dependencies are complete.

  • System improvements

    • Upgraded the platform to Nodejs 8.10 from Nodejs 6.10.3
    • Improved debuggability for collect loadunits and MV's by including AWS request data in errors
    • Fixed MV update issue due to incorrect intervalInMinutes which was being set to a minute less than what user specified in some scenarios.
    • Fixed internal tracker errors in CLI
    • Our documentation site has now moved to https:/docs.datacoral.com/