Skip to content

fabric

Photo by Negative Space: https://www.pexels.com/photo/grayscale-photo-of-computer-laptop-near-white-notebook-and-ceramic-mug-on-table-169573/

Yes, You Can Run C# Code in Microsoft Fabric Notebooks

As of today the Microsoft Fabric Notebooks supports following languages:

  • PySpark (Python)
  • Spark (Scala)
  • Spark SQL
  • SparkR

If you are coming to Fabric world with an OOP programming background (like I do), those aren’t the languages you have most likely used. Of course, Python is not that hard of a language to learn, and the dataframes are sooo good for data manipulation that you will probably want to learn it …

Photo by Pixabay: https://www.pexels.com/photo/purple-foot-bridge-220769/

Building Modern Applications on Microsoft Fabric

Modern applications demand seamless data integration, real-time responsiveness, and scalability (+ of course cool looking UI). Microsoft Fabric unifies data movement, processing and storage into a cohesive environment. As of now the end game for Microsoft Fabric has been the Power BI report. When that is done we are fine, but think about all the work, calculation power and storage usage that we are having just to provide a report. …

Image by Canva

Estimate Your Fabric Capacity Needs

Understanding the cost of Microsoft Fabric is crucial for using Fabric efficiently. Recently Microsoft published a new tool to help estimate how much Fabric capacity you really need. In this post, we’ll explore how to use the calculator effectively, what inputs matter most, and why estimating your Fabric usage is a critical part of managing budgets and avoiding surprises.

Capacity

First let’s talk a little bit about capacity in Fabric …

Photo by Pixabay: https://www.pexels.com/photo/wine-tank-room-434311/

Working with Fabric Warehouse Data in PySpark Notebooks

I noticed today that there are surprisingly few samples/blog posts/guides about how to write (and read) data into warehouse from Fabric notebook. You can find lot of information about doing it through T-SQL Notebook, but you can actually use it from Spark Notebook through the Spark connector. Let me show you how.

Spark Connector

The Spark connector for Fabric Data Warehouse allows Spark Notebooks to read data from warehouse and …

Part I: Use Microsoft Fabric GraphQL API with .NET App

Microsoft Fabric’s GraphQL API allows querying data stores in a flexible and efficient way. In this post I will walk through how you can integrate the Fabric GraphQL API into a .NET application, covering authentication, making queries, and handling responses. We are going to implement the solution by using service principal, but you can also use the interactive auth also if you want to.

Authentication

As shown in my …

Scientific azure private endpoint image that is generated with DALL-E

Fabric Security: How to Access Private Network Azure Resources

In Azure it is good practice (well I would say mandatory practice) to restrict database and Key Vault access by setting network restrictions for the Azure resource. Typically enterprises has their own virtual networks set and database/Key Vault access is restricted to those networks only. I recommend to disable the “Allow Azure services and resources to access this server” for SQL databases as it allows all Azure users …

DP-600: Microsoft Certified Fabric Analytics Engineer Associate

During early December, Microsoft held a Fabric certification challenge, which required participants to:

  1. Join the Fabric Community.
  2. Complete all modules in the Microsoft Learn Challenge | Ignite Edition: Fabric Challenge.
  3. Not already hold the Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) certification.
  4. Be confident that they could take and pass the DP-600 exam by December 31, 2024.

By completing these requirements, Microsoft would provide a free voucher for the DP-600 …

How to Securely Handle Secrets with Azure Key Vault in Microsoft Fabric Notebooks

Proper secret management is one of the security fundamentals in software development. You should never hardcode credentials, secrets or tokens into your Spark Notebooks, because it creates a security vulnerability and adds extra complexity. Hardcoding secrets into Notebooks means that if you need to update any of the secrets you have to go through all the notebooks.

Azure Key Vault is a centralized secret management system, which helps you to …

Microsoft Fabric REST API

Microsoft Fabric REST API is a tool, that can help you automate tasks in Fabric. By saying automate, I mean you can use it to automatically manage Fabric items, run notebooks, setup workspaces etc. The full API documentation can be found from this URL.

Getting Started with Fabric APIs

To use the Fabric API, you need a Microsoft Entra authentication token, as Fabric does not support API keys or …

Photo by Pixabay: https://www.pexels.com/photo/closed-door-and-lighted-light-sconce-277559/

Access Microsoft Fabric Data from Dotnet App

Microsoft Fabric is an excellent product for storing both structured and unstructured data for data analysis and AI workloads. It is built on top of Azure Blob Storage, making data storage relatively cheap and easy to access. Fabric offers many built-in tools for data manipulation, including Dataflow Gen 2, Data Pipelines, and Notebooks. However, sometimes you need to access the data from outside of Microsoft Fabric, which is the topic …