Here is a quick guide to sign-up with Datacoral. Click on free trial on the Datacoral website
- You will need AWS admin access to create the Datacoral installation in your AWS account.
- The supported destination warehouses are: Snowflake, Amazon Redshift and Athena.
Step 1: Activate your Datacoral account
Invite email: On entering your name, email address, and company name, you will receive an email with a link to create an account. Note that this link expires in 7 days.
Set password: On clicking Get Started button, you will be redirected to the Datacoral web application where you can set the password and activate your free account. On activating, you will receive a confirmation email.
The account will be available for 30 days
Step 2: Choose your installation type
The first step to set up your installation is to provide a team name.
- Going forward you will need the team name to login into your account. The team name is unique and cannot be changed after initial setup.
- Datacoral uses the team name to create AWS resources in your installation. Due to restrictions on AWS resource names, the team name has to meet the requirements below:
- Team name can take in alpha-numeric lowercase characters
- The first character should be an alphabet.
- Team name should not exceed 20 characters.
- Select Hosted By You
Step 3: Select location of Installation
- Target AWS Region: Select the AWS regions from the dropdown menu.
- The "Create a new VPC" is a default option, uncheck it if you would like us to configure in your existing VPC. For more information click here
- Click on Next
Step 4: Select destination warehouse
- Choose the destination warehouse and click on Next
Step 5: Launch cloudformation
Review the configuration and click on Launch cloudformation
Step 6: Prepare your AWS account
A new browser tab will have redirected you to the AWS CloudFormation Create Stack page. If you are not already logged in, you will be required to login to your AWS account as an Admin user.
The Create Stack page is pre-filled with the supplied options from the previous steps. Select the checkboxes at the bottom of the page before clicking “Create Stack”.
Please don't change any configurations that have been pre-set for you.
The Webapp will keep track of stack updates and correspondingly update its status. Once all the stacks are successfully created, you will be redirected to Network Setup
Here are the steps to clean Datacoral Cloudformation
Step 7: Network Setup
Datacoral works with your existing network configuration or we can set up a new network configuration during installation. We recommend creating a new network configuration with a new VPC for isolation of Datacoral resources and for better auditing, access management of the entire data pipeline. The Datacoral installation process can create a new VPC in your AWS account to house all the network addressable resources that Datacoral creates and manages.
- Create and configure new VPC In order for us to create a new VPC, you would need to provide a CIDR block. Please select a non-overlapping CIDR block relative to your existing network configuration to allow for peering between the VPCs. Please make sure that you are providing 16 bits in the prefix of the CIDR block(a /16 CIDR block); for example, 10.0.0.1/16. For more information click here
See configure a new VPC to set up a new configuration with Datacoral.
- Configure existing VPC In the case that "Create a new VPC" wasn't checked at the start of onboarding (this is the case when you have an existing Redshift cluster), you'll need to create and set up a new VPC.
See existing network configuration on setting up your networking to work with Datacoral.
Step 8: Warehouse Setup
You have a choice of initializing Datacoral with the appropriate data warehouse and/or data lake. The supported configurations with Datacoral are:
- Amazon Redshift (create new cluster or use existing cluster)
For Amazon Redshift, Datacoral can instantiate a new cluster and manage it as part of the Datacoral installation or connect to an existing Redshift cluster.
Amazon Redshift Datacoral can create a new Redshift cluster as part of the installation or connection to an existing redshift cluster
Snowflake To utilize an existing Snowflake warehouse with the Datacoral installation: Please follow the steps here to get database name, user name, password, role, etc. You will need to provide these while adding the Snowflake warehouse to your installation as shown in the screen below. For more information click here
Here is the setup guide for An existing Snowflake cluster
For snowflake warehouse, step 9 will precede step 8
Step 9: Review and Install
Review the installation configuration and click on Install.
The below screenshot is for a New Redshift warehouse with Datacoral created VPC
The last step is to initialize the installation in your Redshift or Snowflake warehouse. This step will take about an hour to complete. Once completed, you can click on Log In button that will take you to the datacoral webapp
In case of an issue and you see an error screen
- Please go back and re-check the entered details and try again
- Contact firstname.lastname@example.org if the issue persists
Step 10: Add a connector
On clicking the log-in button you will be directed to the add connector screen