Data feeds
A data feed is an automated daily transfer of bulk data from your community that you can download from the CSRconnect Admin Portal or set up to deliver to an SFTP.
For example, consider using data feeds when you want to:
-
program certain data to pull from the SFTP folder to manipulate it in an internal system.
-
regularly access bulk transactional data without building an export in CSRconnect.
-
Admin Roles: Employee data for every user tied to a CSRconnect Admin Role (not legacy Admin roles)
Pulls the all-time load - date datapoint is not needed
-
Board Membership: Details for any active board membership or present board member positions
Pulls the all-time load - date datapoint is not needed
-
Custom Questions: Details related to custom questions and answers
Contains a date datapoint (custom_question_response_date) that determines if there is new data to include
-
Donations (formerly All Giving): Donation and matches
Contains a date datapoint (updated_date) that determines if there is new data to include
-
Employees: Employee data and registration detail; includes non-HR user information
Pulls the all-time load - date datapoint is not needed
-
Events: Details and event attributes for all events entered into the CSRconnect platform
Contains a date datapoint (event_updated_date) that determines if there is new data to include
-
Groups: Groups and member detail
Pulls the all-time load - date datapoint is not needed
-
Incentives: Details related to Incentive requests
Contains a date datapoint (incentive_updated_date) that determines if there is new data to include
-
Payments: Details related to disbursals
Contains a date datapoint (payment_updated_date) that determines if there is new data to include
-
Pledges: Active and inactive payroll pledges
Contains a date datapoint (pledge_updated_date) that determines if there is new data to include
-
SDG: Details related to Sustainable Development Goals
Pulls the all-time load - date datapoint is not needed
-
Volunteer (formerly New Volunteer): Volunteer Manager transactional detail
Contains a date datapoint (volunteer_participation_updated_date) that determines if there is new data to include
-
VTO: details related to Volunteer Time Off requests
Note: We will not adjust the column order - this is so that you can reliably build upon the fields. The only exception is that we may add columns to the end of the list as new functionality is built in CSRconnect. Clients are updated as columns are added.
The Load Type Settings configure the data included in SFTP deliveries and data feed downloads from the CSRconnect Admin Portal.
-
Starting year: Includes data from the start of the selected year through yesterday. This option with the current year selected is the default setting.
-
Incremental: On the day after selecting this load type, includes an initial pull of all data. On all subsequent days, includes only new or modified data.
-
Full: Includes all data.
Changes to Load Type Settings will take effect the following day.
Admin Roles, Board Membership, Employees, Groups, and SDG data feeds will always use the full load type.
To activate data feeds, simply notify your designated Customer Success Manager (CSM) or Implementation Manager. They will create a task for the team to activate the data feeds in the CSRconnect Admin Portal. Additional activation through SFTP can take up to four weeks. There is no additional cost for the setup or support of the feeds.
Each night, the system generates a file for each of your enabled data feeds that are stored securely at YourCause. You can access and download each file from the CSRconnect Admin Portal. The process starts at 12:30a CT and completes by 8:00a CT.
Alternatively, the system can deliver your data feeds to an SFTP. This must be to your SFTP (which is the same SFTP used for HR and payroll files). From the chosen SFTP and any specific folder drops setup, your team downloads the data or writes scripts to pull data from the folder(s). The file names follow this format (using “04/12/2019” as the example date):
-
Donations: /downloads/donations/04122019/df-04122019.gz
-
Pledges: /downloads/pledges/04122019/df-04122019.gz
-
New Volunteer: /downloads/vols/04122019/df-04122019.gz
-
Groups: /downloads/groups/04122019/df-04122019.gz
When using the SFTP delivery functionality, PGP encryption is required due to the sensitive nature of this data. A private PGP key will need to be added in the settings when setting up the SFTP delivery options. Clients can provide their own private PGP key or YourCause can use its private key and provide the public PGP key to use for decryption.
Note: When receiving encrypted data feed files, they are in a zipped .gz format. Teams must decrypt the files first and then unzip the files.
SFTP
Your Implementation Manager (for launching clients) or Customer Success Manager (CSM - for clients who have launched) will work with you to set up your SFTP credentials; there is typically an exchange of credentials needed.
-
There is currently no process for removing your files, so it is important for you to maintain and remove files once they have been downloaded.
-
It is also critical to protect your SFTP access credentials and to only share with proper internal team members.
CSRconnect Admin Portal
If you’re not using SFTP delivery, the data feed files are available to download from the CSRconnect Admin Portal.
These files:
-
are stored using the Amazon S3 storage and Server Side Encryption (SSE-S3) for the data at rest.
-
will only be available for five days. After a file has existed for five days, the system will automatically remove it from the folder.
To ensure you are taking advantage of the best reporting offering, we recommend visiting the CSRconnnect Reporting Guide.
See the attached files for more Data Feed resources: