addadd-thickarrow-downaxebreadcrumb dividercameracc-compulsarychatclosecontactdata-usersdebugdevelopersdismissdocumentserrorglossaryinfolinkpublisherssearchselect-dropdownsuccesstableswarning

Import Data

  1. Home
  2. Import Data
  3. Connect to an Amazon S3 data source (CloudFormation Template method)

Connect to an Amazon S3 data source (CloudFormation Template method)

In this guide, we explain how to import data to your Koordinates data service from an Amazon S3 data source (otherwise known as an S3 'bucket'). 

This method involves using a CloudFormation Template generated by Koordinates, and is the recommended method for less experienced users of Amazon S3. For more advanced users, we have also documented how to import data using the AWS Web Console Wizard. 

Read documentation from Amazon explaining CloudFormation in more detail

How it works

Instead of providing Koordinates with usernames, passwords or other sensitive credentials, you will create an AWS 'Role', and grant Koordinates permission to use that role. You control the role, and so you have absolute control over what resources Koordinates can access through it.

1

Select 'New Admin' from the Admin menu

2

Select 'Manage Sources'

3

Click 'Add a Source' and select 'Amazon S3'

4

Enter the name of your S3 bucket

5

Click 'Download Template' and save the JSON file. 

You'll be using this JSON file later as a 'Stack Template' to connect your AWS S3 account.

6

Open a new tab, and navigate to AWS CloudFormation Console

7

Create a Stack on your Console

Do so following these instructions from AWS. After you have started the Create Stack wizard in AWS, you'll be given the option of uploading a Stack Template.

8

Select 'Upload a Template to Amazon S3' and attach your JSON file from step 4. 

9

Name your stack (this can be anything you want)

Other than the name, you don't need to edit any of the default settings on this page. 

10

Accept the disclaimer and click Create

11

Navigate to your newly created Stack in the AWS Management Console

12

Select the 'Outputs' tab and copy the Role ARN Value

13

Return to 'Connect an Amazon S3 Source' and paste the Role ARN value

You can also stipulate a directory for us to scan. This prefix tells Koordinates which parts of your S3 bucket to scan, and which parts to ignore.

Leave this blank if you want Koordinates to scan the entire S3 bucket.


14

Add a title and owning-group, and then click Connect