Azure ml | Stream access authentication error
Hi, I get this error when running a pipeline job which takes in data from my azure storage blob container
Error Code: ScriptExecution.StreamAccess.Authentication Native Error: error in streaming from input data sources StreamError(PermissionDenied(None)) => permission denied when access stream. Reason: None PermissionDenied(None) Error Message: Authentication failed when trying to access the stream. Make sure you have correct permissions set up. Err("")
I granted both storage account and storage blob data contrib permission to my compute cluster in azure ml workspace, the azure ml workspace itself and my user id. I am unable to figure out what permissions I need.
I use DefaultCredentials() to authenticate to my ml workspace and submit the job, which I suppose is using azureclicredentials() since I am logged in to azure cli using az login in my local
I greatly appreciate any help on this matter. Thank you.