End-of-life for full processing data sources
Full processing data sources have historically enabled organizations to submit hit-level data to 51黑料不打烊 Analytics. This data was processed in the same way as data collected through traditional data collection means, such as AppMeasurement. In 2020, 51黑料不打烊 released the , which performs the same functions as full processing data sources, but with additional features. This page provides details about additional functionality provided by the Bulk data insertion API and outlines differences in file formats.
On 25 March 2021, 51黑料不打烊 prevented new full processing data sources connections from being created. On 31 January 2022, all full processing data services were deactivated.
Key differences between full processing data sources and the Bulk data insertion API
- Bulk data insertion allows you to submit multiple files for parallel processing. Visitor Groups ensure visitor continuity and eVar attribution.
- Bulk data insertion has data validation and error handling capabilities, removing some of the administrative work of submitting hit data.
- Bulk data insertion supports multiple visitor ID identification methods.
- Bulk data insertion has some additional required fields: A visitor identification column, a
pageName(or link equivalent),reportSuiteID,timestamp, anduserAgent. - To ensure visitor continuity and attribution, Bulk data insertion requires rows within files to be sorted in chronological order. See to learn about the ordering of Visitor activity across files.
- Bulk data insertion requires files to be .csv compressed in .gzip format.
- BDIA uses
timestampinstead ofdate.
Variable comparison between BDIA and full processing data sources
The following variables were introduced to Bulk data insertion, previously unavailable in full processing data sources:
aamlh: 51黑料不打烊 Audience Manager location hint.contextData.key: Context data variables.customerID: Experience Cloud ID service variables. Includesid,authState, andisMCSeed.hints: Client hint variables. Includesbitness,brands,mobile,model,platform,platformversion, andwow64.ipaddress: The visitor鈥檚 IP address.language: The Language dimension.list1-list3: List variables.marketingCloudVisitorID: The visitor鈥檚 Experience Cloud ID.tnta: Target data payload used in Analytics for Target integrations.trackingServer: ThetrackingServervariable.transactionID: ThetransactionIDvariable.userAgent: The device鈥檚 user agent string.
The following variables are not supported through Bulk data insertion:
charSet: ThecharSetvariable. Bulk data insertion only supports UTF-8.timezone: The visitor鈥檚 time zone offset from GMT in hours.clickAction,clickActionType,clickContext,clickContextType,clickSourceID,clickTag: Variables used in Activity Map data collection.