What kind of fabric capacity do I need to take the dp 600 exam?
Hi Microsoft Support Team, What kind of Fabric capacity is actually required to study for the DP-600 exam? I’ve spent several days trying to enable Microsoft Fabric Capacity across two accounts—my personal Gmail-based tenant (@gmail.com) and my work…
Azure Data Lake Analytics
Hey. Can we have streaming data from lake house to ware house in fabric ?
I am using database mirroring to bring data from SQL Server into Fabric. Then, using a Notebook, I bring that data into the Lakehouse. Up to this point, the data is streaming in real-time. Now, I want to bring streaming data from the Lakehouse to a…
Azure Data Lake Analytics
Recreating dynamics 365 synapse link tables got the error Msg 16588, Level 16, State 1, Line 305 Virtual or partition columns found in Delta external table.
I have got synapse link for dynamics 365 setup, entities from dynamics are being synchronised to data lake storage account in Azure, however I am trying to create a curated new database by scripting out the existing datalake database. On one of the…
Azure Data Lake Analytics
Is ADLA portal (extension on Azure Portal) available in Fairfax cloud
Is ADLA portal (extension on Azure Portal) available in Fairfax cloud? Thanks.
Azure Data Lake Analytics
Design Framework for Data Lake house solution in Azure.
I want to create a reusable framework (Azure “Ready” Framework) which I can reuse for building Data Pipeline for Batch And Streaming Datalakehouse solution in Azure. The Framework must include: - Build scalable, secure, governed landing zones Enable…
Azure Data Lake Analytics
Data not showing from datalake
I'm building a dataflow to process data in our data lake, which is populated via a Dataverse link from Dynamics 365 into our Azure environment. When I query the data directly in the data lake, I can see all records, including the most recent updates.…
Azure Data Lake Analytics
Better Architecture Solution On Azure Stack
Hello Techie, I am trying to build Data Lake House Solution as shown in diagram below. There are Multiple Source System like :- a. External Application- API based Connection b. Salesforce on Azure c. Separate Salesforce d. Adobe Analytics -…
Azure Data Lake Analytics
Azure Data Lake Analytics Retirement - Frequently Asked Questions
On 29 February 2024, we will retire Azure Data Lake Analytics and this service will no longer be available. Before that date, please migrate your services that were deployed using Azure Data Lake Analytics to another Azure data processing product of…
Azure Data Lake Storage
Azure Data Lake Analytics
Sharing connection in Microsoft Fabric inconsistent in dataflow
Hi, Regarding Microsoft Fabric, I couldn't find the right tag to ask this question. Issue We are having issues while establishing connections through "Manage connections and gateways." In the Dataflows of some workspaces, I am not able to view…
Azure Data Lake Analytics
Azure datalake and consistent data
Hi Friends, I am a bit perplexed by some of the datalake aspects which are : We have identified the large number of data sets that are of low to medium data range, the reason being optimizing transaction access patterns (fewer datasets the less I/O…
Azure Data Lake Analytics
Passing Parameters from ADF to ML Designer Pipeline
I have created an ML pipeline using Azure ML Designer, which includes an Execute Python Script component. This component is linked to a script bundle that processes a blob from Azure Blob Storage and saves the output back to the storage. The ML pipeline…
Azure Data Lake Analytics
can we add multiple containers in Microsoft Fabric Data Lake house?
I want to add one more container in Microsoft fabric lake house, as per my knowledge we can add only one container but i am curious to know can we add multiple containers in Microsoft fabric lake house
Azure Data Lake Storage
Azure Data Lake Analytics
Unable to connect scope linked service from ADF
Hi Team, I am attempting to use the scope task in ADF to run my scope scripts, but the connection is failing despite having all the necessary permissions for ADLA. I am using a System Assigned Managed Identity (SAMI) to connect to my ADLA with the…
Azure Data Factory
Azure Data Lake Analytics
Getting TokenNotFoundInConfigurationException error when uploading a Python wheel as workspace package in Synpase
Hello Everyone I'm using Azure Synapse to run my Spark pipelines. I've build my pipeline to use a custom library code from utils package of the same project to perform some operation. To access the utils.pipeline file, have packaged my entire project in…
Azure Data Lake Storage
Azure Synapse Analytics
Azure Data Lake Analytics
When generating a SAS token, specifying the path causes an authorization failure.
I use following code to generate SAS token, when path is null or empty string, it's working. String sasToken = new DataLakeSasImplUtil(signatureValues, container, path, true) .generateUserDelegationSas(userDelegationKey, accountName,…
Azure Data Lake Storage
Azure Data Lake Analytics
How to Use System-Assigned Managed Identity for Secure Access to Blob Storage in Synapse Notebook?
Hello Community, I'm currently working on a project in Azure Synapse Analytics and would like to enhance the security of my data access. My Python code in the Synapse notebook currently accesses Blob Storage using a connection string, but I want to…
Azure Storage
Azure Blob Storage
Azure Synapse Analytics
Azure Data Lake Analytics
Azure App Service
Workspace request validation failed
Can anyone solve this issue…
Azure Synapse Analytics
Azure Data Lake Analytics
Invalid api-version exception when submitting job to Data Lake Analytics using Azure Python SDK
I got below exception when I tried to submit a job to Azure Data Lake Analytics using Azure Python SDK. CloudError: Azure Error: InvalidArgument Message: Job type 'USql' is not supported by api-version '2017-09-01-preview'. First I have installed the…
Azure Data Lake Analytics
After using api to purge data from workspace the status stays on pending and logs are not removed.
After using api to purge data from workspace the status stays on pending and logs are not removed. While using the status endpoint the status keeps returning as 'pending'. The purge request is visible in activity logs of the workspace but just shows…
Azure Synapse Analytics
Azure Data Lake Analytics
Why is the activity log stored in the adls gen2 container not a valid json
Why is the activity log stored in the adls gen2 container not a valid json? It's line by line, and the outer layer is missing '[]' and comma separation