Datacoral Version 1.20.0

  • Webapp

    • On addition or update of a slice, Webapp to show bootstrap logs and/or errors
    • On update or deletion of a slice / connector, users will be warned about any affected downstream dependency
    • On deleting of a mv, additional warning shown that data (underlying table) will be deleted too
    • Materialized view creation now available in Webapp!
    • Materialized views in athena supports self-referential MV's
    • DPL file can be downloaded from Webapp before creating a Materialized View
    • Add Collect slice using new JSON editor along with existing form based slice addition
    • Collect slice update is now available to all customers as a beta feature
    • Onboarding via Webapp for snowflake warehouse
  • CLI

    • Standardizing Transformation (Materialized View) options across warehouses (updateMode and tableTypes)
    • Ability to reprocess a materialized view for one timelabel directly in the CLI (as against using JSON reprocess file)
    • Collect Slice deploy params can be downloaded (similar to download-dpl)!
  • Collect Slices

    • MongoDB:
      • Support for all warehouses
    • Intercom:
      • Support for all loadunits specified here
    • S3
      • Incremental mode is now supported which enables syncing files that have been created/modified within the last time range
      • Records count when reading from S3 now displayed in UI
    • Zendesk:
      • New loadunit called ticket_events_comments now available
      • Fixes for some custom field issues
    • Zuora:
      • Pagination Fix
    • Launchdarkly:
      • Fix for API failures in the users loadunit
    • Hubspot:
      • New fields available in contacts loadunit
    • Stripe:
      • Speedup for invoices and subscription_events loadunits
    • Github:
      • Varchar sizes increased for certain fields in pulls and issues loadunits
    • Exposing collect slice bootstrap logs on UI
    • Fixed collect slice framework to
      • Handle certain AWS internal failures gracefully
      • Avoid data duplication due to internal retries in a small number of cases
  • Organize Slices

    • Redshift
      • Fixed matview create to handle queries with late binding views
  • Docs

    • Creating WLM for existing redshift clusters