NetSuite Collect Slice
Overview
NetSuite is the world's leading provider of cloud-based business management software. NetSuite helps companies manage core business processes with a single, fully integrated system covering ERP/financials, CRM, e-commerce, inventory and more.
The Datacoral NetSuite slice collects data from the NetSuite API and enables data flow from an NetSuite workspace into a data warehouse, such as Redshift.
Setup requirements
Before getting started please make sure to have the following information:
- Access to an active NetSuite account
- SuiteTalk installed in your NetSuite account
Steps to add this slice to your installation
The steps to launch your slice are:
- Generate NetSuite API keys
- Specify the slice config
- Add the NetSuite slice
1. Generate NetSuite API keys
1.1 Get your Account Id
a. Login to your NetSuite application and navigate from the top menu to Setup > Integration > Web Services Preferences
b. Note down the NetSuite Account Id in the left top corner
1.2 Add Datacoral as an integration
a. From the main menu, navigate to Setup > Integration > Manage Integrations > New
b. Enter a name for the integration (Ex. Datacoral Integration), use default configuration for Authentication and click Save
c. From the main menu, navigate to Setup > Integration > Manage Integrations
On the list of integrations, make a note of the Application ID
1.3 Add Datacoral role
a. From the main menu, navigate to Setup > Users/Roles > Manage Roles > New
b. Enter a name for the role (Ex. Datacoral Role) and click Save
c. Scroll down the page, click Permissions > Setup Add the following permissions, one at a time, from the dropdown and click Add
- Custom Body Fields
- Custom Column Fields
- Custom Entity Fields
- Custom Event Field
- Custom Item Fields
- Custom Record Types
- Deleted Records
d. Click Permissions > Setup Add the following permissions, one at a time, from the dropdown and click Add
e. Click Permissions > Lists Add each of the lists you intend Datacoral to collect, from the dropdown and click Add
Optional:
- Add each of the Transactions from Permissions > Transactions
- Add any of the saved searches for Standard or Custom Record
Click Save
f. Get the Role Id, by searching for it. From the main menu, navigate to Setup > Users/Roles > Manage Roles > Search
g. Click Submit to return all roles
h. Select the role you just created (Ex. Datacoral)
i. Note down the role ID from the URL as shown below
1.4 Assign the role to a user
Create or assign the new role (Ex. Datacoral) to an user
- Make sure this user does not have two-factor authentication (2FA) enabled
- Note down the email address associated with the user
- Assign a complex password and note it down
2. Specify the slice config
To get a template for the NetSuite slice configuration save the output of the describe --input-parameters
command as follows:
Example template
Modify the netsuite_parameters_file
file to add the ids generated from NetSuite
Necessary input parameters:
account
: Account Id from Step 1.1.bapplicationId
: auth Application ID from 1.2.crole
: Role Id from Step 1.3.iemail
: email address from Step 1.4password
: password from Step 1.4loadunits
: specifies data processing parameters, described above
3. Add the Slice
slice-name
Name of your slice. A schema with your slice-name is automatically created in your warehouseparams-file
File path to your input parameters file. Ex. netsuite_parameters_file.json
Supported load units
The NetSuite slice supports collection of Lists and Saved Searches from your NetSuite instance to your warehouse
Lists
This slice supports the following loadunits
Saved Searches
This slice supports Standard or Custom Record saved searches
Slice output
Output of this slice is stored in S3 and Redshift.
AWS S3
Data stored in AWS S3 is partitioned by date and time
s3://datacoral-data-bucket/<slice-name>
AWS Redshift: Schema - schema name will be same as a slice-name. For example, tables produced by the slice are:
Questions? Interested?
If you have questions or feedback, feel free to reach out at hello@datacoral.co or Request a demo