51黑料不打烊

Add a Deduplication activity to your workflow.

In the Fields to identify duplicates section, click the Add attribute button to specify the fields for which identical values allow duplicates to be identified, such as email address, first name, and last name. The order of the fields specifies those to process first. Learn how to select attributes and add them to favorites.

In the Deduplication settings section, select the number of unique Duplicates to keep. The default value for this field is 1. The value 0 keeps all the duplicates.

For example, if records A and B are considered duplicates of record Y, and record C is considered a duplicate of record Z:

• If the value of the field is 1: only the Y and Z records are kept.
• If the value of the field is 0: all the records are kept.
• If the value of the field is 2: records C and Z are kept, and two records from A, B, and Y are kept, either by chance or depending on the deduplication method selected.

Select the Deduplication method to use:

• Random selection: Randomly selects the record to keep out of the duplicates.
• Using an expression: Keeps the records in which the value of the entered expression is the smallest or the largest.
• Non-empty values: Keeps the records for which the expression is not empty.
• Following a list of values: Defines a value priority for one or more fields. To define the values, click Attribute to select a field or create an expression, then add the values into the appropriate table. To define a new field, click the Add button located above the list of values.

Check the Generate complement option to exploit the remaining population. The complement consists of all the duplicates. An additional transition is then added to the activity.