Skip to main content

Standardize Clean

Repair common encoding, Unicode, HTML character reference, control character, and whitespace problems locally.

Behavior​

Repair common encoding, Unicode, HTML character reference, control character, and whitespace problems locally.

This guidance was derived from the callable signature and its embedded Python schema docstring.

Parameters​

NameDescriptionAccepted ValuesDefaultRequired
I/O
inputName or list of input columns.string, integer, array—Yes
outputName or list of output columns. Defaults to overwriting input.string, integer, array, nullnullNo
Options
fix_encodingRepair mojibake and other reversible encoding errors.booleantrueNo
unescape_htmlDecode HTML character references. Auto avoids decoding text that appears to contain HTML markup.boolean or string; one of:
  • auto
"auto"No
normalizationUnicode normalization form.string; one of:
  • NFC
  • NFKC
  • NFD
  • NFKD
  • null
"NFC"No
fix_character_widthNormalize fullwidth and halfwidth characters.booleantrueNo
uncurl_quotesReplace typographic quotes with straight quotes.booleantrueNo
remove_control_charsRemove C0 and C1 control characters.booleantrueNo
collapse_whitespaceCollapse runs of Unicode whitespace.booleantrueNo
preserve_line_breaksPreserve line breaks while collapsing other whitespace.booleanfalseNo
trimRemove leading and trailing whitespace.booleantrueNo
Formatting
separatorText used to join multiple input columns into one output.string" "No
Conditions
ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}.string—No
whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'.string—No
where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name.array, object—No
Access
RequirementValue
AI-poweredNo
Requires WrangleWorks accountNo
Requires subscriptionNo
Requires external API keyNo
Technical details
FieldValue
Catalog ID67
Catalog keystandardize.clean
Recipe keystandardize.clean
Catalog statusactive
Lifecycle statusactive
Recipe Writer eligibleYes
Namespacestandardize
Documentation groupstandardize
AliasesNone
Runtime symbolwrangles.recipe_wrangles.standardize.clean
Legacy UUIDNone

Sources