Datacoral Version 1.14.0

  • Datacoral policy updates
    • Cross-account role changes
      • Added the following permissions to the cross account role in order for elastic beanstalk applications to look up the right solution stacks based on the node version.
        • elasticbeanstalk:DescribePlatformVersion
    • Datacoral role changes
      • Batch Role: Added the following permissions in order to create job definitions and job repository (For MySQL CDC support).
        • ecr:BatchCheckLayerAvailability
        • ecr:CompleteLayerUpload
        • ecr:DescribeRepositories
        • ecr:UploadLayerPart
        • ecr:InitiateLayerUpload
        • ecr:PutImage
        • ecr:GetAuthorizationToken
        • ecr:CreateRepository
        • batch:RegisterJobDefinition
        • iam:PassRole
      • Expanded permissions for the batch role to fetch from datacoral-install- s3 buckets and DataCoralDeployParams dynamodb table.
      • Lambda role: Added the following permissions to the lambda role in order to remove job definitions and job repository
        • ecr:DeleteRepository
        • batch:DeregisterJobDefinition
  • Webapp
    • Loadunit details now in the UI for events slices
    • Dependency graphs added for harness publish units
    • Added a slice catalog page with a list of supported slices in collect/organize/harness categories
  • CLI
    • matview-describe command can now output dpl file
  • Collect Slices
    • Announcing the availability of the following slices:
      • MySQL CDC - Support for Change Data Capture (CDC) for MySQL databases
      • Github - GitHub brings together the world's largest community of developers to discover, share, and build better software.
      • Greenhouse - Greenhouse is an applicant tracking system and recruiting software designed to help businesses find suitable candidates, conduct focused interviews and optimize their recruiting process
      • Pingdom - Pingdom allows you to monitor your website's availability and performance.
      • Phabricator - Phabricator (pronounced like the word fabricator) is a suite of web applications which make it easier to build software, particularly when working with teams.
    • Added support to ingest kixie events in events slice with passthrough transformer
    • Added zstd compression for MySQL slice tables in Redshift
    • Bug fixes for s3 publisher slice to handle quotes in the publisher queries
    • Added support to store data layouts for MySQL and Salesforce slices. Other slices
  • Materialized Views
    • Filter out dependency based actions from the list of MVs seen using the UI or CLI
  • Harness Slices
    • Announcing the availability of the following slices:
      • Zendesk publisher slice to create and update Zendesk objects including User, Organizations and Tickets based on data in a warehouse.