How to Ingest Salesforce in 7 Steps

STEP 2: GETTING DATA FROM SALESFORCE You then need to define your data access style. Your API based options are: Option 1: REST API for Single Record integration with applications Option 2: Bulk API for Traditional ETL Operations Option 3: Streaming API for Event based data handling Make sure to keep your API limits in check! When you decide your method of getting the data you need to stage them.

STEP 3: STAGING SALESFORCE DATA IN S3 (DATA VAULT STYLE)

You may want to find a way to not use a relational stage to avoid all its caveats and reengineering cost. The current recommendation to keep it simple would be an object store like S3 and simple staging scripts (e.g. in Python) or the usage of Data Vault Automation Tools. (TODO Link Wheres- cape? Reference for Salesforce?)

STEP 4: METADATA DEFINITION

As your data is staged and ready to be loaded to your Data Vault, you need to think about the meta data and your derived data model. What Business Objects are relevant for your first sprint arti- fact?