Skip to main content

Log

Log the current status of the dataframe.

Print the current status of the dataframe. Only a sample of rows is logged.

Parameters​

NameDescriptionAccepted ValuesDefaultRequired
I/O
columns(Optional, default all columns) List of specific columns to log.array, nullnullNo
Options
write(Optional) Allows for an intermediate output to a file/dataframe/database etc.array, nullnullNo
warningLog a warning to the console.string, nullnullNo
infoLog info to the console.string, nullnullNo
log_dataWhether to log a sample of the contents of the dataframe. Default True if not logging to a write, error, warning or info. Default False otherwise.boolean, nullnullNo
errorLog an error to the console.string—No
Conditions
ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}.string—No
whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'.string—No
where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name.array, object—No

Examples​

wrangles:
- log: {}

Logging side-effect; no tabular input sample.

Logs a sample of rows or status information to the configured destination.

wrangles:
- log:
columns:
- column1
- column2

Logging side-effect; no tabular input sample.

Logs a sample of rows or status information to the configured destination.

wrangles:
- log:
write:
- file:
name: output/filepath
columns:
- column 1
- column 2

Logging side-effect; no tabular input sample.

Logs a sample of rows or status information to the configured destination.

VariableFunction
${column_count}Number of columns.
${columns}List of all columns.
${df}Current dataframe.
${row_count}Number of visible rows processed in each batch.
Access
RequirementValue
AI-poweredNo
Requires WrangleWorks accountNo
Requires subscriptionNo
Requires external API keyNo
Technical details
FieldValue
Catalog ID80
Catalog keylog
Recipe keylog
Catalog statusactive
Lifecycle statusactive
Recipe Writer eligibleNo
Recipe Writer exclusionOperational logging steps are not authored in the baseline.
NamespaceRoot-level
Documentation grouputility
AliasesNone
Runtime symbolwrangles.recipe_wrangles.main.log
Legacy UUID6177808e-aa2d-4d0b-8385-858b16948a5d

Sources