The start of something new

-

Well, it's happening at last. It's time to start to turn all the knowledge over the years back into something useful for the community.


So, what can you expect from this site? My aim is to build it into something helpful for all data engineers. Initially I'll focus on news, views, and opinions from the Microsoft space. I'll cover what new features mean in reality, provide my personal opinion of what I can talk about and the my view on what others are saying, and I'll share the best practices that I'm seeing developing.


Initially, the site will be very heavily focused on Microsoft Fabric (especially with Fabcon Europe coming up). But do expect some guest posts appearing as time goes on.


Onwards and upwards.

Comments

Post a Comment

Popular posts from this blog

Workspace topologies in Microsoft Fabric

-
Image
Since I first heard about Microsoft Fabric during private preview, I have spent many hours pondering the workspace topologies available to us. With this workspace based setup it gives us the power to spin up workspaces quickly and easily. But with that power comes great responsibility. But why is that? As time goes on I can see us struggling from workspace proliferation in exactly the same way that BI has suffered from KPI and report proliferation. That is multiple copies of the same workspace but designed for slightly different purposes. To counter that we need to carefully plan and curate our workspace creation, meaning that we need a set of topologies that we can follow to make our lives easier. But what is a workspace topology? The best way to think of it is a blueprint for how we're going to create workspaces and link them together. As I thought about this more and more, three clear topologies began to emerge. I've called these: Monolith warehouse Hub and Spoke Data Mesh M
Read more

Microsoft Fabric: semantic models, dynamic row level security, and DirectLake mode

-
Image
Some of you will be familiar with dynamic row level security (DRLS) in PowerBI. For those that aren't, DRLS allows us to use the email address of the user that is logged into the service via their Entra account. With this email address, and corresponding email address in our semantic model, we can dynamically filter the semantic model to only show the data that user could see. The result, we can use one report suite to serve the same content to country, region, and global teams whilst simultaneously providing the necessary security around sensitive data. Now back in the world of Power BI, that was really easy. We fired up Power BI desktop, went into manage security roles, and added the necessary DAX: Now in Fabric, that still works exactly the same way as it always has for import and DirectQuery semantic models. However, it's not so straight forward for DirectLake semantic models. Why? The challenge is that a number of features break DirectLake connections and force the model b
Read more