Is there a way to trigger an ADF pipeline from EasyMorph?
You should be able to trigger an ADF pipeline via a REST API call from EasyMorph:
- Configure the Web Location connector for OAuth2 authentication for a Microsoft account.
- Use the "Web Request" action to perform a POST request as described here: Triggers - Start - REST API (Azure Data Factory) | Microsoft Learn
PS. Note that you don't need to do anything extra for authorization or passing the bearer tokens. EasyMorph does it automatically under the hood.
Thank you! Looking into this now.
This solution worked perfectly. Thanks again!
1 Like
Yay! Thanks for letting us know 
Do you know of a way to connect EasyMorph to Databricks? I have an ADF/Databricks environment and am looking for a way to return verbose Databricks errors in an EM model? Iām able to connect to ADF and get status info thanks to your assistance. Speaking of this, what would be the best way to build a loop to get the pipeline status until it fails, succeeds, or is cancelled?
It depends on what you mean by "connecting to Databricks". Querying Databricks via SQL is supported out of the box - EasyMorph supports querying Databricks via ODBC.
Non-SQL capabilities, such as monitoring a pipeline status, can be done via API calls, just like you already did.
Polling (e.g. a job status) can be done in various ways. For instance, using the "Repeat" action to arrange a REPEAT...UNTIL type of loop in which you query the job status via an API call until it completes. The "Repeat" action is convenient but a bit mind-bending to learn, so I suggest checking out our examples (see the help article).
1 Like