We are expanding the operational functions that can be applied to data sets on the platform. This week we pushed out another product release incorporating some new functions that are helping us standardize data streams. Over the next few weeks we will continue to broaden out the data engineering capabilities of the platform. Below is a description of what each function does to data files.
We have also completed Exavault and AWS S3 integrations - we can know upload to as well as download from these two cloud providers.
Key Word | Description |
---|---|
@MAPPING | Map this var value to this new var value |
@FILTER | Keep rows where this var equals this value |
@ADVERTISED LIST | Specify date + item combinations |
@GROUP | Create a group of stores, items, countries |
@COLUMN REDUCE | Keep only these columns |
@REPLACE | Replace this unicode character with this value. |
@RELABEL | Change the name of a column from this to that. |
@COLUMN ORDER | Put columns into this order prior to merge. |
@PRESENCE | Return list of unique values in this column. |
@SAMPLE | Keep between 0.1% and 99.9% of rows. |
@FUNCTION | Apply this function for each row. |
@FORMAT | Standardize format of this column |
@DYNAMIC DATA | Implement an API |
@MASK | Encrypt this var salted with a value |
@COLUMN MERGE | Combine these columns in to a new column |