Using a static dataset in multiple project runs

1

Hello,

I want to make an EasyMorph project where when i start te project for the first time it reads some data from a database and saves this in a dataset on the filesystem, and does some processing with that dataset. The second time (can be days later) i want the project to see the the dataset is available on the filesystem and import and uses that saved dataset for further processing, so no loading the data from the database. Is there a way a can do this in EasyMorph

2

I wonder whether you really want to read the data once or if you would like to update the dataset file sometimes.

Is it is really only one time reading, I would start with reading the dataset file. If it doesn’t exist yet, load the data and create the file. Id it already exists you can skip the load from database.

3

You can do it as follows:

  • List files in the directory where you expect the .dset file to appear
  • Filter the list to keep only the .dset file in question, make sure the filter returns no rows if the file isn't present
  • Do conditional branching
    • if the list is empty (i.e., file not present) then query the database
    • if the list is NOT empty, read the dset file