Select wrangles, with recipe examples, parameters, and behavior.
Drop | drop
Drop (Delete) selected column(s).
Drop (Delete) selected column(s)
Parameters
Name Description Accepted Values Default Required I/O columnsName of the column(s) to drop. string, array — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No
Examples
wrangles : - drop : columns : - Material
Product Data SKF ball bearing bearing seal
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 76Catalog key dropRecipe key dropCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace Root-level Documentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.pandas.dropLegacy UUID 363bffbf-397e-4975-8382-e9efa5e9eed6
Sources
Filter | filter
Filter the dataframe based on the contents. If multiple filters are specified, all must be correct. For complex filters, use the where parameter.
Filter the dataframe based on the contents.
Parameters
Name Description Accepted Values Default Required I/O inputName of the column to filter on. If multiple are provided, all must match the criteria. string, integer, array []No Options equalSelect rows where the values equal a given value. string, array, null nullNo not_equalSelect rows where the values do not equal a given value. string, array, null nullNo is_inSelect rows where the values are in a given list. string, array, null nullNo not_inSelect rows where the values are not in a given list. string, array, null nullNo greater_thanSelect rows where the values are greater than a specified value. Does include the value itself. integer, number, null nullNo greater_than_equal_toSelect rows where the values are greater than a specified value. Does include the value itself. integer, number, null nullNo less_thanSelect rows where the values are less than a specified value. Does not include the value itself. integer, number, null nullNo less_than_equal_toSelect rows where the values are less than a specified value. Does include the value itself. integer, number, null nullNo betweenValue or list of values to filter that are in between two parameter values. array, null nullNo containsSelect rows where the input contains the value. Allows regular expressions. string, null nullNo not_containsSelect rows where the input does not contain the value. Allows regular expressions. string, null nullNo is_nullIf true, select all rows where the value is NULL. If false, where is not NULL. boolean, null nullNo Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - filter : input : Color equal : - red
Color Fruit red Apple red Strawberry
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 78Catalog key filterRecipe key filterCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace Root-level Documentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.main.filterLegacy UUID e3242acf-d204-433f-8373-205b77481131
Sources
Columns | select.columns
Select columns from the dataframe.
Select columns from the dataframe
Parameters
Name Description Accepted Values Default Required I/O inputName of the column(s) to select. string, integer, array — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.columns : input : Manufacturer
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 49Catalog key select.columnsRecipe key select.columnsCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.columnsLegacy UUID bca12c60-3957-4dc5-83f7-5ee460df2a11
Sources
Dictionary Element | select.dictionary_element
Select one or more element of a dictionary.
Parameters
Name Description Accepted Values Default Required I/O inputName of the input column. string, integer, array — Yes outputName of the output column. If omitted, the input column will be replaced. string, array, null nullNo Options elementThe key or keys from the dictionary to select. If a single key is provided, the value will be returned If a lists of keys are selected, the result will be a new dictionary. string — Yes Errors defaultSet the default value to return if the specified element doesn't exist. If selecting multiple elements, a dict of defaults can be set. string, number, array, object, boolean, null ""No Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.dictionary_element : input : Properties output : Shapes element : shapes default : square where : Part Number = 1234
wrangles : - select.dictionary_element : input : Properties element : - shapes - materials
Properties {'shapes': 'round', 'materials': 'tungsten'} {'shapes': 'square', 'materials': 'tungsten'}
wrangles : - select.dictionary_element : input : Properties output : Output Dict element : - Col*
Column Output Dict {'Col1': 'A', 'Col2': 'B', 'Col3': 'C'} {'Col1': 'A', 'Col2': 'B'}
wrangles : - select.dictionary_element : input : Properties output : Output Dict element : - "regex: .*2"
wrangles : - select.dictionary_element : input : Properties output : Output Dict element : - Col1 : Column 1 - Col2 : Column 2
Output Dict {'Column 1': 'A', 'Column 2': 'B'}
wrangles : - select.dictionary_element : input : Properties output : Output Dict element : - Col1 - Col3 default : Col1 : Z Col3 : Y
Output Dict {'Col1': 'A', 'Col3': 'C'} {'Col1': 'D', 'Col3': 'Y'}
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 50Catalog key select.dictionary_elementRecipe key select.dictionary_elementCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.dictionary_elementLegacy UUID 5adaeada-6da8-464f-84cb-9fb5ecc17e48
Sources
Element | select.element
Select elements of lists or dicts using python syntax like col[0]['key'].
Select elements of lists or dictionaries using Python syntax like col[1:3]['key'].
Parameters
Name Description Accepted Values Default Required I/O inputName of the input column and sub elements This permits by index for lists or dict and by key for dicts e.g. col[0]['key'] // [{"key":"val"}] -> "val". string, integer, array — Yes outputName of the output column(s). string, array, null nullNo Errors defaultSet the default value to return if the specified element doesn't exist. string, number, array, object, boolean, null nullNo Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.element : input : Column A [ 0 ] output : First Element
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 51Catalog key select.elementRecipe key select.elementCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.elementLegacy UUID 223d2f4e-3247-4189-8b6c-e73fe44c4266
Sources
Group By | select.group_by
Group and aggregate the data.
Group and aggregate the data
Parameters
Name Description Accepted Values Default Required I/O byList of the input columns to group on. string, array []No Options listGroup and return all values for these column(s) as a list. string, array — No firstThe first value for these column(s). string, array — No lastThe last value for these column(s). string, array — No minThe minimum value for these column(s). string, array — No maxThe maximum value for these column(s). string, array — No meanThe mean (average) value for these column(s). string, array — No medianThe median value for these column(s). string, array — No nuniqueThe count of unique values for these column(s). string, array — No countThe count of values for these column(s). string, array — No countsReturn a dictionary containing the count of each distinct value for these column(s). Keys are converted to JSON-safe strings; missing values use the key "null" and booleans use lowercase "true"/"false". string, array — No stdThe standard deviation of values for these column(s). string, array — No sumThe total of values for these column(s). string, array — No anyReturn true if any of the values for these column(s) are true. string, array — No allReturn true if all of the values for these column(s) are true. string, array — No p75Get a percentile. Note, you can use any integer here for the corresponding percentile. string, array — No custom.*Placeholder for custom functions. Replace 'placeholder' with the name of the function. string, array — No Formatting auto_rename_columnsIf true (default), aggregated column names include the operation as a suffix (e.g. Value.sum). If false, column names are left as-is; use a dictionary entry to supply a custom output name (e.g. - Value: Total). boolean trueNo Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.group_by : by : - Product Type sum : Quantity mean : Price ($)
Product Type Quantity.sum Price ($).mean Hand Tools 15 9.99 Power Tools 9 39.99
wrangles : - select.group_by : by : Category custom.sum_times_two : Quantity
Category Quantity.sum_times_two Hand Tools 12 Power Tools 4
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 52Catalog key select.group_byRecipe key select.group_byCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.group_byLegacy UUID c0af10b1-423a-416c-8cb5-7e7fe1164964
Sources
Head | select.head
Return the first n rows.
Return the first n rows
Parameters
Name Description Accepted Values Default Required Options nNumber of rows to return. integer — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.head : n : 2
Product Manufacturer Ball Bearing SKF Bearing Race Timken
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 53Catalog key select.headRecipe key select.headCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.headLegacy UUID 237af1ec-db7d-415a-88b7-70586a2191fb
Sources
Highest Confidence | select.highest_confidence
Select the option with the highest confidence from multiple columns. Inputs are expected to be of the form [<<value>>, <<confidence_score>>].
Select the option with the highest confidence from multiple columns. Inputs are expected to be of the form [value, confidence_score].
Parameters
Name Description Accepted Values Default Required I/O inputList of the input columns to select from. array — Yes outputIf two columns; the result and confidence. If one column; [result, confidence]. string, array — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.highest_confidence : input : - Col1 - Col2 - Col3 output : Highest Confidence
Highest Confidence ['C', 0.99]
wrangles : - select.highest_confidence : input : - Col1 - Col2 - Col3 output : - Item - Confidence
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 54Catalog key select.highest_confidenceRecipe key select.highest_confidenceCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.highest_confidenceLegacy UUID 00aad85d-8cc8-42e5-86f3-e4ff916e8ac2
Sources
Left | select.left
Return characters from the left of text. Strings shorter than the length defined will be unaffected.
Select characters from the left of the input. Using a negative length reverses the side of selection, selecting from the right.
Parameters
Name Description Accepted Values Default Required I/O inputName of the column(s) to edit. string, integer, array — Yes outputName of the output column(s). string, array, null nullNo Options lengthNumber of characters to include from the left. If negative, this will remove the specified number of characters from the left. May not equal 0. integer — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.left : input : Column output : Result length : 3
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 55Catalog key select.leftRecipe key select.leftCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.leftLegacy UUID 5cdd9857-0c77-43bf-80d7-d0a8cb6f980b
Sources
Length | select.length
Calculate the lengths of data in a column. The length depends on the data type e.g. text will be the length of the text, lists will be the number of elements in the list.
Parameters
Name Description Accepted Values Default Required I/O inputName of the input column(s). string, integer, array — Yes outputName of the output column(s). string, array, null nullNo Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.length : input : Part Code output : Part Code Length
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 56Catalog key select.lengthRecipe key select.lengthCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.lengthLegacy UUID 4d7a5f66-0a4a-40e0-8298-d5c55754423d
Sources
List Element | select.list_element
Select a numbered element of a list (zero indexed).
Parameters
Name Description Accepted Values Default Required I/O inputName of the input column. string, integer, array — Yes outputName of the output column. string, array, null nullNo Options elementThe numbered element of the list to select. Starts from zero. This may use python slicing syntax to select a subset of the list. integer 0No Errors defaultSet the default value to return if the specified element doesn't exist. string, number, array, object, boolean, null ""No Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.list_element : input : Col1 output : Second Element element : 2 default : F
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 57Catalog key select.list_elementRecipe key select.list_elementCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.list_elementLegacy UUID ec40495d-d29a-4f62-86dd-eafa43cf388a
Sources
Right | select.right
Return characters from the right of text. Strings shorter than the length defined will be unaffected.
Select characters from the right of the input. Using a negative length reverses the side of selection, selecting from the left.
Parameters
Name Description Accepted Values Default Required I/O inputName of the column(s) to edit. string, integer, array — Yes outputName of the output column(s). string, array, null nullNo Options lengthNumber of characters to include from the right. If negative, this will remove the specified number of characters from the right. May not equal 0. integer — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.right : input : Column output : Result length : 3
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 58Catalog key select.rightRecipe key select.rightCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.rightLegacy UUID 89ee82ec-3bc5-4bfa-899b-7a1260ef9bdb
Sources
Sample | select.sample
Return a random sample of the rows.
Return a random sample of the rows
Parameters
Name Description Accepted Values Default Required Options rowsIf a whole number, will select that number of rows. If a decimal between 0 and 1 will select that fraction of the rows e.g. 0.1 => 10% of rows will be returned. integer, number — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.sample : rows : 2
Product Manufacturer Ball Bearing SKF Needle Bearing Acme Bearings
wrangles : - select.sample : rows : .25
Product Manufacturer Needle Bearing Acme Bearings
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 59Catalog key select.sampleRecipe key select.sampleCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.sampleLegacy UUID 95a84ab6-a66e-450f-8a4a-7a87e3a77932
Sources
Substring | select.substring
Return characters from the middle of text.
Parameters
Name Description Accepted Values Default Required I/O inputName of the column(s) to edit. string, integer, array — Yes outputName of the output column(s). string, array, null nullNo Options startThe position of the first character to select. If ommited will start from the beginning and length must be provided. integer, null nullNo lengthThe length of the string to select. If ommited will select to the end of the string and start must be provided. integer, null nullNo Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.substring : input : Column output : Result start : 2 length : 3
wrangles : - select.substring : input : Column output : Result start : 2
wrangles : - select.substring : input : Column output : Result length : 3
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 60Catalog key select.substringRecipe key select.substringCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.substringLegacy UUID 8befddf8-602e-4fa9-8f16-4c547210ebec
Sources
Tail | select.tail
Return the last n rows.
Return the last n rows
Parameters
Name Description Accepted Values Default Required Options nNumber of rows to return. integer — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.tail : n : 2
Product Manufacturer Needle Bearing Acme Bearings Roller Bearing General Bearing Co.
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 61Catalog key select.tailRecipe key select.tailCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.tailLegacy UUID 60853759-c160-49a4-87eb-036516a9d823
Sources
Threshold | select.threshold
Select the first option if it exceeds a given threshold, else the second option.
Parameters
Name Description Accepted Values Default Required I/O inputList of the input columns to select from. array — Yes outputName of the output column. string — Yes Options thresholdThreshold above which to choose the first option, otherwise the second. number — Yes Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - select.threshold : input : - Col1 - Col2 output : Result threshold : .77
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 62Catalog key select.thresholdRecipe key select.thresholdCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace selectDocumentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.select.thresholdLegacy UUID af2a5dcc-0ec0-48d7-8fb4-f58d9c5391d2
Sources
Sort | sort
Sort the data.
Sort the data
Parameters
Name Description Accepted Values Default Required I/O byName or list of the column(s) to sort by. string, array — Yes Options ascendingSort ascending vs. descending. Specify a list to sort multiple columns in different orders. If this is a list of bools then it must match the length of the by. boolean, array — No Formatting ignore_indexIgnore Index value accepted by the runtime. boolean trueNo Conditions ifCondition that determines whether the wrangle runs as a whole. Recipe variables may be referenced with ${variable}. string — No whereFilter rows before applying the wrangle using SQL-like criteria, such as column1 = 123 OR column2 = 'abc'. string — No where_paramsValues used with where for parameterized criteria. Uses SQLite placeholder syntax such as ? or :name. array, object — No
Examples
wrangles : - sort : by : Price ascending : true
Item Price Chisel 4.99 Wrench 6.99 Hammer 11.99 Saw 13.99 Drill 29.99
Access Requirement Value AI-powered No Requires WrangleWorks account No Requires subscription No Requires external API key No
Technical details Field Value Catalog ID 93Catalog key sortRecipe key sortCatalog status active Lifecycle status active Recipe Writer eligible Yes Namespace Root-level Documentation group selectAliases None Runtime symbol wrangles.recipe_wrangles.pandas.sortLegacy UUID 1dcf06ad-898a-4d83-862c-4774be37a687
Sources