Remove Duplicates
Remove duplicates from a list. Preserves input order.
Remove duplicate values in a list.
Parameters
| Name | Description | Accepted Values | Default | Required |
|---|---|---|---|---|
| I/O | ||||
input | Name of the input column. | string, integer, array | — | Yes |
output | Name of the output column. | string, array, null | null | No |
| Options | ||||
ignore_case | Ignore case when removing duplicates. | boolean | false | No |
| Conditions | ||||
if | Condition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. | string | — | No |
where | Filter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. | string | — | No |
where_params | Values used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. | array, object | — | No |
Examples
wrangles:
- format.remove_duplicates:
input: Attack of the Clones
output: Commander
where: Rank = Commander
| Rank | Attack of the Clones |
|---|---|
| Commander | ['Cody', 'Cody', 'Cody'] |
| Captain | ['Rex', 'Rex', 'Rex'] |
| Commander |
|---|
| ['Cody'] |
Access
| Requirement | Value |
|---|---|
| AI-powered | No |
| Requires WrangleWorks account | No |
| Requires subscription | No |
| Requires external API key | No |
Technical details
| Field | Value |
|---|---|
| Catalog ID | 35 |
| Catalog key | format.remove_duplicates |
| Recipe key | format.remove_duplicates |
| Catalog status | active |
| Lifecycle status | active |
| Recipe Writer eligible | Yes |
| Namespace | format |
| Documentation group | format |
| Aliases | None |
| Runtime symbol | wrangles.recipe_wrangles.format.remove_duplicates |
| Legacy UUID | 283b9e78-b2b2-43d0-844f-9842c33120aa |
Sources