How to call python file in repo in databricks from data factory outside DBFS?
1
vote
1
answer
2569
views
In Azure Databricks I have I have a repo cloned which contains python files, not notebooks.
In Azure Data Factory I want to configure a step to run a Databricks Python file. However when I enter the /Repos/..../myfile.py (which works for Databricks Notebooks) it gives me the error "
DBFS URI must starts with 'dbfs:'"
How can I reference a python file from a report which is not in dbfs?
NOTE I see a duplicate question here but the answer was just to wrap it in a Databricks Notebook - OK workaround but when I do it I get "No module named 'my_python_file'"
https://stackoverflow.com/questions/70096408/how-to-create-a-databricks-job-using-a-python-file-outside-of-dbfs

Asked by Brendan Hill
(301 rep)
Dec 1, 2021, 08:14 AM
Last activity: Jan 7, 2022, 07:51 AM
Last activity: Jan 7, 2022, 07:51 AM