I am scheduling a workflow that has new daily excel files. On day 1, there are fields A, B, C and D. I aggregate on these fields in the workflow. On day two, the workflow runs again but errors out because there are only fields A and B. If any fields (in this C and D) are not present it means there is no data for that field for that day.
How can I automate this so that, even if one of these four fields is not present, every field will appear in the workflow?
The most concise way to do this would be to use the Ensure Fields tool from the CReW Macros (available for download here: http://www.chaosreignswithin.com/p/macros.html).
This tool allows the user to put one field per line and it will check if the incoming data stream contains those fields. If it contains a field, it does nothing. If it doesn’t contain a field, then it adds that field with null values. You can also set the data type within the Ensure Fields tool.
See the below photos for an example.