Integrating with a FTP to import data

Blank 20/9/2021 06:05 - 20/9/2021 06:05
Integrations

Kademi's integration application can be used to import data on a schedule from a File Transfer Protocol (FTP) server.

We will show you an example of an integration to import sales data on a daily basis.

First we need to create a template for the mapping that will be used to import the data.

1 Go to Data, then Table Uploaders and select the relevant uploader, which in this example is the Sales Data Uploader.

2 Upload a sample file of sales data that matches the file that will be accessed via FTP, and step through the sales data uploader.

On the Map columns page, once you have mapped the columns, click Save Configuration and give the configuration a name. You can then exit the upload wizard.

Now we will set up the integration.

3 Install KIntegration in your website.

4 Go to Data, then Integration.

5 Select the Endpoints tab, and click Add Table Uploader.

6 Enter a name for the integration, and select the relevant table uploader, select the mapping that we saved, and select the file input type, which in this example will be FTP/S.

7 Set up the FTP configuration by entering the FTP address and path, the name of the file that contains the relevant data, the FTP credentials, and security settings.

8 If the import should run regularly, tick to select Add Schedule, and select the frequency, e.g. once per day, and the start date, then click Create.

9 Refresh the page, and on the Schedules tab you'll be able to see when the import is due to run next.

Exporting Data

You can use a query to export data via FTP.

Learn how to create a query with the following tutorial:

Using the query builder

Integration Services

To learn more about setting up integrations in Kademi, please see the following developer tutorials:

Getting started with Integration Services

Importing sales data - working example

Handling large data with map reduce