Signals Gateway: File Upload

The File Upload feature allows Signals Gateway users to ingest events that are in a CSV file. This feature supports uploading events that are compatible with Meta servers, including website, offline (such as in-store) app and CRM events. There are two methods for uploading events: automatic uploads using S3 integration, or manually uploading files within the Signals Gateway by setup file data source. The automatic method is recommended as it eliminates the need for human intervention and runs seamlessly in the background without disrupting instance usage.

While creating first party pipeline, choose “File upload” as data source.

Add a name for this source:

The file source will then be created:

After finishing the pipeline creation, you can start using the “File Upload” features manually or further config for automation upload as described below. Events can be viewed by clicking on the File events icon at pipeline detail page:

To set up automatic uploads, find the setting through Account settings -> Automatic file uploads.

You will be redirected to the page that provides an overview of automatic uploading (shown below), click Start setup to continue.

A modal will pop up, which provides resources and guidance on creating an S3 bucket with ease. Click Continue when you’ve finished set up process:

Provide necessary information for S3 and IAM user created in previous step:

When the setup is finished, you’ll be provided with a sample file for reference.

Now you can go back to the same setup page from the Overview page to monitor the job run, and to modify connection information by clicking the “...” button.

Below is a detailed header definition table to use when formatting your data files. Follow the format closely to help ensure the best results. You can also view this table on the Settings page.

﹡Automatic uploads can handle top-level custom data, but the feature does not currently support nested objects. The header of the CSV column should be labeled as "custom_data.<data-key>", where <data-key> is the name of the custom data field you wish to send, for example "custom_data.CustomField".

Test Automatic Upload: To verify the S3 integration, upload some sample files to the connected S3 bucket and check if the job finished successfully. For non-App Runner instances, you can trigger an instant job by clicking the refresh button on the settings page; otherwise, the job will run automatically in an hour.

Click the file event data source from Pipeline to start using the manually upload feature.

Then locate the action menu from the popup modal and click Upload event data.

Event data manually uploaded to a data source must contain a set of parameters, some mandatory and some optional. The CSV file headers use JSONPath format to define the payload keys Check the detailed payload parameters here. Use the template available by clicking the sample file link to format your events data.

Once uploaded, the name of the CSV file will appear and the number of Uploaded or Excluded events will be shown.