Skip to main content

Flat File - Automated File Ingestion

Set up automated flat file ingestion to import client, contact, revenue, NPS, and usage data into ClientSuccess via Google Cloud or SFTP.

Written by ClientSuccess

ClientSuccess can support the import of aggregate Client, Contact, Revenue, and NPS data of your customers from "flat file".

The intended use case for a flat file import is to support Customers that are not able to integrate via the native integrations or push data via the General API.

The frequency of ingesting this file is approximately every hour, though may not be at the exact same time every hour.

Required Steps from Customer side

  1. Folder has been set up and is available via Google Cloud Files or SFTP

  2. Username/password has been provided (if SFTP) to support@clientsuccess.com

  3. Folder that will be used has been created and is in place

  4. At least 1 production-ready sample file is in place - this file could represent real data or a few events for a ‘test’ event that can be discarded later

  5. File has been validated for format (Date format including time, Org ID and Org Name are required. When applicable, user fields are required in header but can be blank, value is provided (not empty) for at least 1 event.

  6. Metric or Custom Field columns must have a numeric value i.e. "0" and cannot be left blank. Do not send files with empty metric columns. This will cause the file to fail to process.

  7. ClientSuccess support will then respond to validate that file ingestion process was successfully configured and initial file was successfully ingested.

File Format

The required file format is a CSV with the fields identified in the example below. It is expected that proper escaping of string literals will be applied and that the first row is always the column header.

Click here to download an example for Contact and Client Specific templates.

Required Formatting:

1.) Please provide empty columns for user columns where user-level information is not in use with no values/blanks. Do not provide empty strings ("").

2.) Please ensure columns are listed in proper order/sequence starting with event.time, org.id, etc. as described below.

3.) File size is limited to 50,000 events. Anything exceeding this amount should be separated into different files.

*Note: An event does NOT represent a single row of data in the flat file. Each row could (and usually do) contain more than one event. Blank cells do not count as an event.

File Naming:

It is recommended that files be named according to a convention that includes the date that the file contains data for.

Example: 2018-01-01-ClientSuccess-Usage.csv

Note: This example is referring to the date that the flat file would be sent. It does not indicated that a daily flat file should be submitted. We suggest a cadence of no more than weekly if you are going to submit a flat file for usage tracking.

Transport Options

Google Cloud Storage

Provide access to the clientsuccess-api-bot IAM user to your bucket.

Secured FTP folder

Provide access with a specific user credentials to ClientSuccess for auto ingestion of the flat file.

Note: Files can be automatically pulled from the SFTP server 4 to 6 times a day, or whenever the file is successfully updated.

For additional questions, please contact support@clientsuccess.com.

Did this answer your question?