I want to slice the blob based on month, year, day. I have files named as myblobcontainer/log_20151231_144229.csv which is clearly YYYYMMDD_HHMMSS.
I want to process files hourly, not re-process anything, and ideally not have to work around too much restructuring my blobs. How should I accomplish this scenario?
I have recently started working on Azure Data Factory and currently exploring the JSON structures of various objects in Data Factory. I'm currently looking at the JSON structure for defining the pipeline. Which of the following properties are non-mandatory in pipeline JSON definition?
Note: There can be multiple correct answers to this question.