Hosted By You - Setup Guide

Here is a quick guide to sign-up with Datacoral. Click on free trial on the Datacoral website

note
  • You will need AWS admin access to create the Datacoral installation in your AWS account.
  • The supported destination warehouses are: Snowflake, Amazon Redshift and Athena.

Step 1: Activate your Datacoral account

Invite email: On entering your name, email address, and company name, you will receive an email with a link to create an account. Note that this link expires in 7 days.

set datacoral password

Set password: On clicking Get Started button, you will be redirected to the Datacoral web application where you can set the password and activate your free account. On activating, you will receive a confirmation email.

The account will be available for 30 days

Step 2: Choose your installation type

The first step to set up your installation is to provide a team name.

note
  • Going forward you will need the team name to login into your account. The team name is unique and cannot be changed after initial setup.
  • Datacoral uses the team name to create AWS resources in your installation. Due to restrictions on AWS resource names, the team name has to meet the requirements below:
    • Team name can take in alpha-numeric lowercase characters
    • The first character should be an alphabet.
    • Team name should not exceed 20 characters.

  • Select Hosted By You

Step 3: Select location of Installation

  • Target AWS Region: Select the AWS regions from the dropdown menu.
  • The "Create a new VPC" is a default option, uncheck it if you would like us to configure in your existing VPC. For more information click here
  • Click on Next

Step 4: Select destination warehouse

  • Choose the destination warehouse and click on Next

Step 5: Launch cloudformation

Review the configuration and click on Launch cloudformation

Step 6: Prepare your AWS account

A new browser tab will have redirected you to the AWS CloudFormation Create Stack page. If you are not already logged in, you will be required to login to your AWS account as an Admin user.

The Create Stack page is pre-filled with the supplied options from the previous steps. Select the checkboxes at the bottom of the page before clicking “Create Stack”.

note

Please don't change any configurations that have been pre-set for you.

The Webapp will keep track of stack updates and correspondingly update its status. Once all the stacks are successfully created, you will be redirected to Network Setup

Here are the steps to clean Datacoral Cloudformation

Step 7: Network Setup

Datacoral works with your existing network configuration or we can set up a new network configuration during installation. We recommend creating a new network configuration with a new VPC for isolation of Datacoral resources and for better auditing, access management of the entire data pipeline. The Datacoral installation process can create a new VPC in your AWS account to house all the network addressable resources that Datacoral creates and manages.

  • Create and configure new VPC In order for us to create a new VPC, you would need to provide a CIDR block. Please select a non-overlapping CIDR block relative to your existing network configuration to allow for peering between the VPCs. Please make sure that you are providing 16 bits in the prefix of the CIDR block(a /16 CIDR block); for example, 10.0.0.1/16. For more information click here

info

See configure a new VPC to set up a new configuration with Datacoral.

  • Configure existing VPC In the case that "Create a new VPC" wasn't checked at the start of onboarding (this is the case when you have an existing Redshift cluster), you'll need to create and set up a new VPC.

info

See existing network configuration on setting up your networking to work with Datacoral.

Step 8: Warehouse Setup

You have a choice of initializing Datacoral with the appropriate data warehouse and/or data lake. The supported configurations with Datacoral are:

  • Amazon Redshift (create new cluster or use existing cluster)
  • Snowflake

For Amazon Redshift, Datacoral can instantiate a new cluster and manage it as part of the Datacoral installation or connect to an existing Redshift cluster.

Amazon Redshift Datacoral can create a new Redshift cluster as part of the installation or connection to an existing redshift cluster

Snowflake To utilize an existing Snowflake warehouse with the Datacoral installation: Please follow the steps here to get database name, user name, password, role, etc. You will need to provide these while adding the Snowflake warehouse to your installation as shown in the screen below. For more information click here

info

Here is the setup guide for An existing Snowflake cluster

For snowflake warehouse, step 9 will precede step 8

Step 9: Review and Install

Review the installation configuration and click on Install.

The below screenshot is for a New Redshift warehouse with Datacoral created VPC

The last step is to initialize the installation in your Redshift or Snowflake warehouse. This step will take about an hour to complete. Once completed, you can click on Log In button that will take you to the datacoral webapp

Troubleshooting Guide

In case of an issue and you see an error screen

  • Please go back and re-check the entered details and try again
  • Contact signup@datacoral.co if the issue persists

Step 10: Add a connector

On clicking the log-in button you will be directed to the add connector screen

Next steps

Questions? Interested?

If you have questions or feedback, feel free to reach out at hello@datacoral.co or Request a demo