<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Microsoft Fabric Archives - AzureOps</title>
	<atom:link href="https://azureops.org/articles/category/microsoft-fabric/feed/" rel="self" type="application/rss+xml" />
	<link>https://azureops.org/articles/category/microsoft-fabric/</link>
	<description>Notable things about Cloud, Data and DevOps.</description>
	<lastBuildDate>Mon, 20 Apr 2026 18:27:18 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	

<image>
	<url>https://i0.wp.com/azureops.org/wp-content/uploads/2021/04/cropped-android-chrome-512x512-1.png?fit=32%2C32&#038;ssl=1</url>
	<title>Microsoft Fabric Archives - AzureOps</title>
	<link>https://azureops.org/articles/category/microsoft-fabric/</link>
	<width>32</width>
	<height>32</height>
</image> 
<site xmlns="com-wordpress:feed-additions:1">190208641</site>	<item>
		<title>DP-700 Certification Exam Preparation Guide</title>
		<link>https://azureops.org/articles/dp-700-exam-preparation-guide/</link>
		
		<dc:creator><![CDATA[Kunal Rathi]]></dc:creator>
		<pubDate>Fri, 17 Apr 2026 15:54:09 +0000</pubDate>
				<category><![CDATA[Certification]]></category>
		<category><![CDATA[Microsoft Fabric]]></category>
		<category><![CDATA[Fabric certification]]></category>
		<category><![CDATA[Microsoft Fabric data engineer certification]]></category>
		<guid isPermaLink="false">https://azureops.org/?p=9265</guid>

					<description><![CDATA[<p>Prepare for the DP-700 exam and master Microsoft Fabric for data engineering solutions and analytics with this guide.</p>
<p>The post <a href="https://azureops.org/articles/dp-700-exam-preparation-guide/">DP-700 Certification Exam Preparation Guide</a> appeared first on <a href="https://azureops.org">AzureOps</a>.</p>
]]></description>
										<content:encoded><![CDATA[
<p class="">The&nbsp;<strong>DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric</strong>&nbsp;is Microsoft&#8217;s certification for the&nbsp;<em>Fabric Data Engineer Associate</em>&nbsp;role. It validates your ability to design, implement, monitor, and optimize data engineering solutions inside Microsoft Fabric, Microsoft&#8217;s unified analytics platform that brings together data engineering, data science, real-time analytics, and Power BI under one roof.</p>



<p class="">If you&#8217;ve worked with Azure Synapse, Azure Data Factory, Spark, or SQL-based ETL pipelines before, you&#8217;ll find many of the core concepts familiar. The key shift is learning how those concepts translate into Fabric&#8217;s integrated, SaaS-style environment.</p>



<h2 class="wp-block-heading">Who Should Take This Exam?</h2>



<p class="">According to the&nbsp;<a href="https://learn.microsoft.com/en-us/credentials/certifications/resources/study-guides/dp-700" target="_blank" rel="noreferrer noopener">official Microsoft study guide</a>, you&#8217;re the right candidate if your day-to-day work involves:</p>



<ul class="wp-block-list">
<li class="">Ingesting and transforming data using SQL, PySpark, or KQL</li>



<li class="">Designing data architectures and orchestration workflows</li>



<li class="">Securing and managing analytics solutions</li>



<li class="">Monitoring, troubleshooting, and optimizing data pipelines</li>
</ul>



<p class="">This exam is particularly valuable if you&#8217;re transitioning from the retired&nbsp;<strong>DP-203 (Azure Data Engineer Associate)</strong>&nbsp;certification. The concepts are largely the same; ETL/ELT, data transformation, data warehouse design, but DP-700 tests them through the lens of Fabric&#8217;s unified toolset.</p>



<p class="has-pale-cyan-blue-background-color has-background"><strong>Note:</strong><br><strong>DP-700 vs DP-600:</strong>&nbsp;If you&#8217;re more focused on Power BI, DAX, and analytics engineering, look at DP-600 (Fabric Analytics Engineer). DP-700 is strictly the data engineering path; SQL, PySpark, KQL, pipelines, and lakehouses.</p>



<h2 class="wp-block-heading">Exam Format and Key Details</h2>



<figure class="wp-block-table"><table class="has-fixed-layout"><thead><tr><th>Detail</th><th>Info</th></tr></thead><tbody><tr><td>Exam Name</td><td>DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric</td></tr><tr><td>Certification</td><td>Microsoft Certified: Fabric Data Engineer Associate</td></tr><tr><td>Duration</td><td>~100 minutes</td></tr><tr><td>Passing Score</td><td>700 out of 1000</td></tr><tr><td>Exam Price</td><td>~$165 USD (varies by region)</td></tr><tr><td>Question Types</td><td>Multiple choice, scenario-based, simulation tasks</td></tr><tr><td>Validity</td><td>1 year (free annual renewal via Microsoft Learn)</td></tr><tr><td>Open Book?</td><td>Yes — you can access Microsoft Learn during the exam</td></tr></tbody></table></figure>



<p class="">One important note:&nbsp;<strong>the exam is open book</strong>. You can access Microsoft Learn docs during the test. This doesn&#8217;t mean you can wing it. Scenario-based questions require genuine understanding, not just Ctrl+F searching, but it does mean you should practice navigating the docs quickly, especially KQL/PySpark syntax pages.</p>



<h2 class="wp-block-heading">What Does the Exam Actually Test?</h2>



<p class="">The exam is divided into three equally weighted domains, each comprising roughly 30–35% of the total score:</p>



<h3 class="wp-block-heading">1. Implement and Manage an Analytics Solution (30–35%)</h3>



<p class="">This domain covers the foundational setup and governance layer of Fabric. Expect questions on:</p>



<ul class="wp-block-list">
<li class=""><strong>Workspace configuration:</strong>&nbsp;Spark settings, domain settings, OneLake settings</li>



<li class=""><strong>Lifecycle management:</strong>&nbsp;Git integration, deployment pipelines, database projects</li>



<li class=""><strong>Security and governance:</strong>&nbsp;Workspace-level and item-level access controls, row/column/object-level security, dynamic data masking, sensitivity labels</li>



<li class=""><strong>Orchestration:</strong>&nbsp;When to use Dataflow Gen2 vs. pipelines vs. notebooks; event-based triggers and scheduling</li>
</ul>



<h3 class="wp-block-heading">2. Ingest and Transform Data (30–35%)</h3>



<p class="">The core data engineering domain. You need solid understanding of both batch and streaming patterns:</p>



<ul class="wp-block-list">
<li class=""><strong>Loading patterns:</strong>&nbsp;Full loads vs. incremental loads, dimensional model preparation, streaming ingestion</li>



<li class=""><strong>Batch ingestion:</strong>&nbsp;Pipelines, shortcuts, mirroring, continuous integration from OneLake</li>



<li class=""><strong>Transformations:</strong>&nbsp;Power Query (M), PySpark, T-SQL, KQL — knowing which tool to use in which scenario is key</li>



<li class=""><strong>Data quality:</strong>&nbsp;Handling duplicates, missing values, late-arriving data, deduplication, aggregations</li>



<li class=""><strong>Streaming:</strong>&nbsp;Eventstreams, Spark Structured Streaming, KQL windowing functions, Eventhouse vs. Lakehouse decisions</li>
</ul>



<h3 class="wp-block-heading">3. Monitor and Optimize an Analytics Solution (30–35%)</h3>



<p class="">This domain tests operational maturity — what you do after the pipeline is built:</p>



<ul class="wp-block-list">
<li class=""><strong>Monitoring:</strong>&nbsp;Data ingestion, transformation, semantic model refresh, setting up alerts</li>



<li class=""><strong>Troubleshooting:</strong>&nbsp;Resolving errors in pipelines, dataflows, notebooks, Eventhouse, Eventstreams, T-SQL, and shortcuts</li>



<li class=""><strong>Optimization:</strong>&nbsp;Lakehouse table optimization, pipeline tuning, data warehouse query performance, Spark performance, KQL optimization</li>
</ul>



<h2 class="wp-block-heading">Best Study Resources for DP-700</h2>



<h3 class="wp-block-heading">1. Microsoft Learn Official Learning Path (Free)</h3>



<p class="">This is your&nbsp;<strong>single most important resource</strong>. Microsoft&#8217;s official learning path maps directly to the exam objectives and includes both reading modules and hands-on labs inside a real Fabric trial environment.</p>



<p class="">Start here:&nbsp;<a href="https://learn.microsoft.com/en-us/credentials/certifications/exams/dp-700" target="_blank" rel="noreferrer noopener">DP-700 Exam Page on Microsoft Learn</a></p>



<p class="">Key modules to complete:</p>



<ul class="wp-block-list">
<li class="">Get started with Microsoft Fabric</li>



<li class="">Implement a Lakehouse in Microsoft Fabric</li>



<li class="">Implement real-time intelligence with Microsoft Fabric</li>



<li class="">Implement a data warehouse in Microsoft Fabric</li>



<li class="">Monitor and optimize data solutions in Microsoft Fabric</li>
</ul>



<p class=""><strong>Pro tip:</strong>&nbsp;Since the exam is open book, actively practice navigating from the Learn homepage to Fabric docs, PySpark syntax references, and KQL documentation. Speed matters during the exam.</p>



<h3 class="wp-block-heading">2. Official Microsoft Study Guide (Free)</h3>



<p class="">Download the&nbsp;<a href="https://learn.microsoft.com/en-us/credentials/certifications/resources/study-guides/dp-700" target="_blank" rel="noreferrer noopener">DP-700 Study Guide</a>&nbsp;and use it as your checklist. Every bullet point in the &#8220;Skills Measured&#8221; section is a potential exam topic. Check each one off as you study it — this ensures you don&#8217;t have blind spots.</p>



<h3 class="wp-block-heading">3. Free Practice Assessment (Free)</h3>



<p class="">Microsoft offers a free official practice assessment on Microsoft Learn. It won&#8217;t give you the actual exam questions, but it accurately reflects the style, format, and difficulty. Take it early in your prep to identify weak areas, then again at the end to gauge readiness. This is an underused resource — don&#8217;t skip it.</p>



<h3 class="wp-block-heading"> 4. YouTube Free Full Course</h3>



<p class="">A solid free video course can help if you prefer watching over reading, <a href="https://youtu.be/tynojQxL9WM?si=07izCAlgM0FxP1nm">this free YouTube course by Adam Marczak</a> is a great option that cover the full exam syllabus, including Fabric architecture, lakehouse concepts, pipelines, notebooks, and real-time analytics. Watch the full video once, then revisit sections on topics where you feel less confident.</p>



<h3 class="wp-block-heading"> 5. Udemy Course Paid But Worth It</h3>



<p class="">For structured, in-depth coverage, Phillip Burton&#8217;s <a href="https://www.udemy.com/course/dp-700-implementing-data-engineering-solutions-using-fabric/">Microsoft DP-700 prep: Fabric Data Engineer Associate</a><strong> </strong>on Udemy is the top-rated option. It covers PySpark, SQL, KQL, and Fabric from scratch with no prior language experience required. Wait for a Udemy sale and you can get it for under $20..</p>



<h3 class="wp-block-heading"> 6. Microsoft Applied Skills Labs</h3>



<p class="">These are end-to-end scenario labs from Microsoft that simulate real Fabric workflows. Two are especially relevant:</p>



<ul class="wp-block-list">
<li class=""><a href="https://learn.microsoft.com/en-us/credentials/applied-skills/implement-a-real-time-intelligence-solution-with-microsoft-fabric/" target="_blank" rel="noreferrer noopener">APL-3008: Implement a Real-Time Intelligence solution with Microsoft Fabric</a></li>



<li class=""><a href="https://learn.microsoft.com/en-us/credentials/applied-skills/work-with-data-warehouses-using-microsoft-fabric/" target="_blank" rel="noreferrer noopener">APL-3010: Implement a data warehouse in Microsoft Fabric</a></li>
</ul>



<p class="">Completing these builds the hands-on confidence you need for simulation-style exam questions.</p>



<h2 class="wp-block-heading">How to Get a Free (or Discounted) DP-700 Voucher</h2>



<p class="">You can often secure a free or 50% discounted voucher by completing a <strong>Microsoft Cloud Skills Challenge</strong> (like &#8220;30 Days to Learn It&#8221;) or participating in the <strong>Fabric Community &#8220;Get Certified&#8221;</strong> program <a href="https://community.fabric.microsoft.com/t5/custom/page/page-id/campaign_form?campaignID=Q0FNUEFJR05fMTc2ODUyNjYwMzYzOQ==" target="_blank" rel="noreferrer noopener">here</a>. Additionally, check major events like Microsoft Ignite for limited-time free offers, or use the Enterprise Skills Initiative (ESI) portal if you work for a Microsoft Partner to see if your company covers the full cost.</p>



<figure class="is-style-default wp-block-image size-large is-resized"><a href="https://marketplace.visualstudio.com/items?itemName=AzureOps.ssiscatalogerpro&amp;ssr=false#overview" target="_blank" rel="noopener"><img data-recalc-dims="1" fetchpriority="high" decoding="async" width="1200" height="148" data-attachment-id="4839" data-permalink="https://azureops.org/articles/azure-data-studio-for-sql-developers/scmw-horizontal-ad/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?fit=1326%2C163&amp;ssl=1" data-orig-size="1326,163" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="SCMW-horizontal-ad" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?fit=1200%2C148&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=1200%2C148&#038;ssl=1" alt="" class="wp-image-4839" style="object-fit:cover;width:811px;height:99px" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=1200%2C148&amp;ssl=1 1200w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=450%2C55&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=600%2C74&amp;ssl=1 600w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=300%2C37&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=768%2C94&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?w=1326&amp;ssl=1 1326w" sizes="(max-width: 1200px) 100vw, 1200px" /></a></figure>



<h2 class="wp-block-heading">Key Topics to Master (With Practical Focus)</h2>



<h3 class="wp-block-heading">Fabric Architecture: Know What Lives Where</h3>



<p class="">You must clearly understand the purpose and appropriate use case for each Fabric item:</p>



<ul class="wp-block-list">
<li class=""><strong>OneLake</strong>&nbsp;— the single unified storage layer; think of it as Azure Data Lake built into Fabric</li>



<li class=""><strong>Lakehouse</strong>&nbsp;— Delta Lake-based storage for open-format files; use for big data, ML, and flexible analytical workloads</li>



<li class=""><strong>Warehouse</strong>&nbsp;— T-SQL-based, fully managed data warehouse; use for structured, enterprise-scale BI workloads</li>



<li class=""><strong>Eventhouse</strong>&nbsp;— time-series and streaming analytics using KQL; replaces the old ADX in Fabric</li>



<li class=""><strong>Eventstream</strong>&nbsp;— real-time data ingestion pipeline; routes streaming data to Eventhouse, Lakehouse, or other destinations</li>
</ul>



<figure class="wp-block-image size-large"><a href="https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?ssl=1"><img decoding="async" width="1268" height="606" data-attachment-id="9386" data-permalink="https://azureops.org/articles/dp-700-exam-preparation-guide/microsoft-fabric-architecture/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?fit=1268%2C606&amp;ssl=1" data-orig-size="1268,606" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="Microsoft Fabric Architecture" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?fit=1200%2C574&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?fit=1200%2C574&amp;ssl=1" alt="" class="wp-image-9386" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?w=1268&amp;ssl=1 1268w, https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?resize=300%2C143&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?resize=1200%2C574&amp;ssl=1 1200w, https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?resize=768%2C367&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?resize=450%2C215&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2026/04/Microsoft-Fabric-Architecture.png?resize=600%2C287&amp;ssl=1 600w" sizes="(max-width: 1268px) 100vw, 1268px" /></a></figure>



<h3 class="wp-block-heading">Lakehouse vs. Warehouse: The Most Common Exam Trap</h3>



<p class="">Many candidates stumble on scenario questions that ask them to choose between a Lakehouse and a Warehouse. The general rule:</p>



<ul class="wp-block-list">
<li class="">Use a&nbsp;<strong>Lakehouse</strong>&nbsp;when you need open format storage, machine learning access, or heterogeneous data (files + tables)</li>



<li class="">Use a&nbsp;<strong>Warehouse</strong>&nbsp;when the workload is primarily SQL-based, requires strong ACID transactions, or serves BI tools via a traditional SQL endpoint</li>
</ul>



<p class="">Also understand the&nbsp;<strong>medallion architecture</strong>&nbsp;(Bronze → Silver → Gold) and when to apply it inside a Lakehouse.</p>



<h3 class="wp-block-heading">Choosing the Right Transformation Tool</h3>



<p class="">A frequent question type presents a scenario and asks which tool to use for transformation. Here&#8217;s the mental model:</p>



<ul class="wp-block-list">
<li class=""><strong>Power Query (M) / Dataflow Gen2</strong>&nbsp;— best for low-code, analyst-friendly transformations; no coding required</li>



<li class=""><strong>PySpark / Notebooks</strong>&nbsp;— best for large-scale transformations, complex logic, ML pipelines</li>



<li class=""><strong>T-SQL</strong>&nbsp;— best for Warehouse-based transformations; familiar to SQL Server developers</li>



<li class=""><strong>KQL</strong>&nbsp;— best for time-series and streaming data in Eventhouse</li>
</ul>



<h3 class="wp-block-heading">Incremental Loads and Slowly Changing Dimensions</h3>



<p class="">The exam tests dimensional modeling knowledge more than most candidates expect. Make sure you understand:</p>



<ul class="wp-block-list">
<li class="">Full load vs. incremental load patterns</li>



<li class="">Slowly Changing Dimensions (SCD) Types 1, 2, and 3</li>



<li class="">Star schema design: facts, dimensions, surrogate keys</li>



<li class="">Handling late-arriving and duplicate data</li>
</ul>



<h3 class="wp-block-heading">Real-Time Intelligenc, Don&#8217;t Skip This</h3>



<p class="">Real-time analytics is a significant portion of the exam and is often under-studied. Focus on:</p>



<ul class="wp-block-list">
<li class="">KQL fundamentals: queries, window functions, aggregations</li>



<li class="">Eventhouse architecture and when to use it</li>



<li class="">Eventstream routing to different destinations</li>



<li class="">Spark Structured Streaming vs. KQL-based streaming, know the trade-offs</li>



<li class="">Accelerated shortcuts vs. non-accelerated shortcuts in Real-Time Intelligence</li>
</ul>



<h3 class="wp-block-heading">Security and Governance</h3>



<p class="">Security questions are common and straightforward if you study them. Know the difference between:</p>



<ul class="wp-block-list">
<li class="">Workspace-level vs. item-level access controls</li>



<li class="">Row-level security (RLS), column-level security (CLS), object-level security (OLS)</li>



<li class="">Dynamic data masking — how and when to apply it</li>



<li class="">Sensitivity labels and item endorsement</li>



<li class="">OneLake security configuration</li>
</ul>



<h2 class="wp-block-heading">Practical 3-Week Study Plan</h2>



<p class="">This plan assumes you have some prior experience with data engineering or Azure. Adjust the timeline based on your background.</p>



<h3 class="wp-block-heading">Week 1 : Build Foundations</h3>



<ul class="wp-block-list">
<li class="">Read through the DP-700 Study Guide and create a topic checklist</li>



<li class="">Watch a full YouTube course covering the exam syllabus</li>



<li class="">Sign up for a Microsoft Fabric trial and explore the interface</li>



<li class="">Take the Microsoft Learn free practice assessment to identify your weak areas</li>
</ul>



<h3 class="wp-block-heading">Week 2 : Go Deep with Microsoft Learn</h3>



<ul class="wp-block-list">
<li class="">Complete the official Microsoft Learn modules (don&#8217;t skip the hands-on labs)</li>



<li class="">Build a simple Lakehouse → pipeline → Warehouse workflow yourself</li>



<li class="">Practice writing basic KQL queries and PySpark transformations</li>



<li class="">Work through the APL-3008 and APL-3010 Applied Skills labs</li>
</ul>



<h3 class="wp-block-heading">Week 3 : Review, Practice, and Exam Prep</h3>



<ul class="wp-block-list">
<li class="">Revisit all weak areas identified in Week 1</li>



<li class="">Take the Microsoft practice assessment again; aim for 80%+ before booking the exam</li>



<li class="">Practice navigating Microsoft Learn docs quickly (for the open-book exam)</li>



<li class="">Save KQL/PySpark/T-SQL syntax pages as bookmarks for exam day</li>



<li class="">If you previously had DP-203, also take that practice test — there&#8217;s significant KQL and pipeline overlap</li>
</ul>



<h2 class="wp-block-heading">Exam Day Tips</h2>



<ul class="wp-block-list">
<li class=""><strong>Run the Pearson VUE hardware check a week before</strong>&nbsp;— don&#8217;t discover your webcam or network has issues on exam day</li>



<li class=""><strong>Bookmark key Microsoft Learn pages</strong>&nbsp;before the exam: PySpark syntax, KQL reference, T-SQL docs, Fabric pipeline documentation</li>



<li class=""><strong>Read every scenario question carefully</strong>&nbsp;— the &#8220;best&#8221; answer often hinges on one specific constraint mentioned in the scenario (cost, latency, existing tools, team skillset)</li>



<li class=""><strong>Don&#8217;t over-index on code syntax</strong>&nbsp;— the exam is more about choosing the right tool and architecture than writing perfect code</li>



<li class=""><strong>Flag and move on</strong>&nbsp;— if a question stumps you, flag it and come back; don&#8217;t burn 10 minutes on one question</li>



<li class=""><strong>DP-700 does NOT test Power BI or DAX</strong>&nbsp;— don&#8217;t waste study time on report building or visual design</li>
</ul>



<h2 class="wp-block-heading">Is DP-700 certification worth it in 2026?</h2>



<p class="">Yes, and the timing is good. Microsoft Fabric is seeing rapid enterprise adoption, with a significant portion of Fortune 500 companies already on the platform. As organizations migrate from fragmented Azure data services (Synapse, ADF, ADX) to the unified Fabric platform, demand for certified Fabric Data Engineers is growing across finance, healthcare, e-commerce, and logistics.</p>



<p class="">The certification is also&nbsp;<strong>low-risk to maintain</strong>: renewal is free via a short online assessment on Microsoft Learn, keeping your credential current as Fabric evolves (which it does — monthly).</p>



<h2 class="wp-block-heading">Final Thoughts</h2>



<p class="">DP-700 is a well-designed exam that rewards genuine understanding over rote memorization. The open-book format means you can look up syntax, but you still need to know which tool to reach for in each situation, and why.</p>



<p class="">The most effective preparation combines three things: the official Microsoft Learn modules for structured coverage, hands-on labs inside a real Fabric trial for muscle memory, and the free practice assessment to measure your readiness honestly. You don&#8217;t need expensive courses to pass, but you do need to actually build things in Fabric, not just read about them.</p>



<p class="">Good luck and once you pass, remember to bookmark the renewal reminder. The free annual renewal keeps your certification current and takes only a few hours. It&#8217;s worth doing.</p>



<h2 class="wp-block-heading">See more</h2>



<iframe width="700" height="394" src="https://www.youtube.com/embed/t2h6xNVFQkc" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>



<div class="wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex">
<div class="is-style-fill wp-block-button"><a class="wp-block-button__link has-white-color has-blush-light-purple-gradient-background has-text-color has-background has-link-color wp-element-button" href="https://azureops.org/product/ssis-catalog-migration-wizard-pro/" target="_blank" rel="noreferrer noopener">Download Now</a></div>
</div>
<p>The post <a href="https://azureops.org/articles/dp-700-exam-preparation-guide/">DP-700 Certification Exam Preparation Guide</a> appeared first on <a href="https://azureops.org">AzureOps</a>.</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">9265</post-id>	</item>
		<item>
		<title>Data Agent in Microsoft Fabric &#8211; Here&#8217;s How it Works</title>
		<link>https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/</link>
		
		<dc:creator><![CDATA[Kunal Rathi]]></dc:creator>
		<pubDate>Thu, 07 Aug 2025 16:15:51 +0000</pubDate>
				<category><![CDATA[AI]]></category>
		<category><![CDATA[Microsoft Fabric]]></category>
		<category><![CDATA[data agent]]></category>
		<category><![CDATA[data agent in ai foundry]]></category>
		<category><![CDATA[data agent in copilot]]></category>
		<guid isPermaLink="false">https://azureops.org/?p=8717</guid>

					<description><![CDATA[<p>In this post, I’ll walk you through how I built a Fabric Data Agent on top of the standard AdventureWorksDW dataset (via shortcuts), and how you can too — even if you’re a complete beginner.</p>
<p>The post <a href="https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/">Data Agent in Microsoft Fabric &#8211; Here&#8217;s How it Works</a> appeared first on <a href="https://azureops.org">AzureOps</a>.</p>
]]></description>
										<content:encoded><![CDATA[
<p class="">Ever wished you could just ask your data questions in plain English and get instant, intelligent answers?<br>With Microsoft Fabric’s new <strong>Data Agent</strong>, that’s not just possible, it’s powerful.</p>



<p class="">In this post, I’ll walk you through how I built a Fabric Data Agent on top of the standard AdventureWorksDW dataset, and how you can too, even if you’re a complete beginner.</p>



<h2 class="wp-block-heading">TL;DR</h2>



<p class="">Microsoft Fabric’s <strong>Data Agent</strong> lets you ask questions about your data in natural language; no SQL, DAX, or visuals required. Think of it like a chat-based analyst that already knows your data model and never sleeps. This article walks you through building a Data Agent on top of AdventureWorksDW, writing agent instructions, adding data sources, and exploring advanced use cases like AI Foundry and multi-agent systems. By the end, you&#8217;ll be able to create your own interactive AI analyst in under 30 minutes.</p>



<p class="has-pale-cyan-blue-background-color has-background"><strong>Prerequisites:</strong><br>1. You must have access to Microsoft Fabric Capacity specifically F2 or higher.<br>2. Only workspaces with Fabric-enabled capacity will show the &#8220;AI Agent&#8221; option in the &#8220;+ New&#8221; menu.<br>3.Your <strong>Fabric admin</strong> must enable the <strong>Data Agent preview</strong> in the <a href="https://learn.microsoft.com/en-us/fabric/data-science/data-agent-tenant-settings?utm_source=chatgpt.com">Tenant Settings</a> within the Microsoft Fabric Admin Portal. if you don&#8217;t have admin rights, contact your admin.</p>



<h2 class="wp-block-heading">How to Create a Data Agent in Microsoft Fabric</h2>



<p class="">If you’ve never done this before, don’t worry. Here’s a simple step-by-step guide.</p>



<h3 class="wp-block-heading">Step 1: Open the Microsoft Fabric Workspace</h3>



<ol class="wp-block-list">
<li class="">Go to <a class="" href="https://app.fabric.microsoft.com">https://app.fabric.microsoft.com</a>.</li>



<li class="">Select or create a new <strong>Workspace</strong> where your Lakehouse is located.</li>
</ol>



<h3 class="wp-block-heading">Step 2: Create a Lakehouse (if not already done)</h3>



<ol class="wp-block-list">
<li class="">Click <strong>New &gt; Lakehouse</strong> and give it a name (e.g., <code>demolakehouse</code>).</li>



<li class="">Add your data using <strong>Shortcuts</strong>:
<ul class="wp-block-list">
<li class="">Go to the <strong>Tables</strong> pane inside the Lakehouse.</li>



<li class="">Click <strong>Add Shortcut &gt; OneLake data</strong>.</li>



<li class="">Browse and select the relevant tables (e.g., from AdventureWorksDW).</li>
</ul>
</li>
</ol>



<p class="">I used the classic <strong>AdventureWorksDW</strong> dataset, the same one you’ve probably seen in BI demos. Instead of importing tables manually, I used <strong>OneLake Shortcuts</strong>, which connect existing data without duplicating it.</p>



<h3 class="wp-block-heading">Step 3: Create the Data Agent</h3>



<ol class="wp-block-list">
<li class="">In your workspace, click <strong>New &gt; Data agent</strong> <strong>(preview)</strong>.</li>



<li class="">Choose the <strong>Lakehouse</strong> where your data is stored. You can also choose semantic model in case you have created semantic model on top of your lakehouse.</li>



<li class="">Give your agent a name (e.g., <code>Sales Insights Agent</code>).</li>



<li class="">Click <strong>Create</strong> — this opens the agent configuration screen.</li>
</ol>



<figure class="wp-block-image size-large is-resized"><a href="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?ssl=1"><img decoding="async" width="1736" height="396" data-attachment-id="8742" data-permalink="https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/create-data-agent/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?fit=1736%2C396&amp;ssl=1" data-orig-size="1736,396" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="Create data agent" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?fit=1200%2C274&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?fit=1200%2C274&amp;ssl=1" alt="fabric data agent" class="wp-image-8742" style="width:1179px;height:auto" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?w=1736&amp;ssl=1 1736w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?resize=300%2C68&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?resize=1200%2C274&amp;ssl=1 1200w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?resize=768%2C175&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?resize=1536%2C350&amp;ssl=1 1536w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?resize=450%2C103&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Create-data-agent.png?resize=600%2C137&amp;ssl=1 600w" sizes="(max-width: 1709px) 100vw, 1709px" /></a></figure>



<h3 class="wp-block-heading">Step 4: Add a Data Source to the Data Agent</h3>



<p class="">Once the agent is created, you’ll need to give it instructions and connect it to your data.</p>



<ol class="wp-block-list">
<li class="">Inside the agent editor, go to the <strong>Data Sources</strong> tab.</li>



<li class="">Click <strong>+ Add data source</strong> and choose the <code>Lakehouse</code> as shown in the image below.</li>
</ol>



<h3 class="wp-block-heading">Step 5: Add the Agent Instructions</h3>



<figure class="wp-block-image size-large is-resized"><a href="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?ssl=1"><img loading="lazy" decoding="async" width="1615" height="876" data-attachment-id="8752" data-permalink="https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/data-agent-instructions-2/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?fit=1615%2C876&amp;ssl=1" data-orig-size="1615,876" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="data agent instructions" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?fit=1200%2C651&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?fit=1200%2C651&amp;ssl=1" alt="Data Agent in Microsoft Fabric - AI instructions" class="wp-image-8752" style="width:1525px;height:auto" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?w=1615&amp;ssl=1 1615w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=300%2C163&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=1200%2C651&amp;ssl=1 1200w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=1143%2C620&amp;ssl=1 1143w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=768%2C417&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=1536%2C833&amp;ssl=1 1536w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=450%2C244&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/data-agent-instructions-1.png?resize=600%2C325&amp;ssl=1 600w" sizes="(max-width: 1615px) 100vw, 1615px" /></a></figure>



<ol class="wp-block-list">
<li class="">Go to the <strong>Agent Instructions</strong> tab.</li>



<li class="">Provide instuctions for the data agent about it&#8217;s goal and responsibilities. </li>
</ol>



<pre class="wp-block-preformatted"><code>Goal:<br>Assist users in analyzing sales, customers, geography, and product performance.<br><br>Key Relationships:<br>- FactInternetSales ➡ ProductKey ➡ DimProduct ➡ Subcategory ➡ Category<br>- FactInternetSales ➡ CustomerKey ➡ DimCustomer ➡ Geography<br>- FactInternetSales ➡ OrderDateKey ➡ DimDate<br><br>Ask me things like:<br>- Top-selling categories last year?<br>- Sales trend in Q1 2024?<br>- Which cities had highest average order size?<br><br>Answer in charts, tables, or summaries where helpful.<br></code></pre>



<h3 class="wp-block-heading">Step 6: Add the Data Source Instructions</h3>



<ol class="wp-block-list">
<li class="">Add the data source instruction to let data agent understand your data model.</li>
</ol>



<pre class="wp-block-preformatted">yamlCopyEdit<code>name: AdventureWorksDW_Shortcut
type: Lakehouse
tables:
  - name: DimCustomer_shortcut
    description: Customer demographics and keys
  - name: DimDate_shortcut
    description: Calendar date dimension
  - name: DimProduct_shortcut
    description: Product attributes
  - name: DimProductCategory_shortcut
    description: Categories of products
  - name: DimProductSubcategory_shortcut
    description: Subcategories of products
  - name: DimGeography_shortcut
    description: Country, state, and city details
  - name: FactInternetSales_shortcut
    description: Sales facts including sales amount, quantity, and dates
</code></pre>



<figure class="is-style-default wp-block-image size-large is-resized"><a href="https://marketplace.visualstudio.com/items?itemName=AzureOps.ssiscatalogerpro&amp;ssr=false#overview" target="_blank" rel="noopener"><img data-recalc-dims="1" fetchpriority="high" decoding="async" width="1200" height="148" data-attachment-id="4839" data-permalink="https://azureops.org/articles/azure-data-studio-for-sql-developers/scmw-horizontal-ad/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?fit=1326%2C163&amp;ssl=1" data-orig-size="1326,163" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="SCMW-horizontal-ad" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?fit=1200%2C148&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=1200%2C148&#038;ssl=1" alt="" class="wp-image-4839" style="object-fit:cover;width:811px;height:99px" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=1200%2C148&amp;ssl=1 1200w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=450%2C55&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=600%2C74&amp;ssl=1 600w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=300%2C37&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?resize=768%2C94&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2023/01/SCMW-horizontal-ad.png?w=1326&amp;ssl=1 1326w" sizes="(max-width: 1200px) 100vw, 1200px" /></a></figure>



<h3 class="wp-block-heading">Step 7: Test the Agent and fine tunning</h3>



<p class="">Start asking questions to the agent like;</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="">1. List top 10 cities by internet sales in last available 12 months.</p>
</blockquote>



<figure class="wp-block-image size-large"><a href="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?ssl=1"><img loading="lazy" decoding="async" width="1594" height="792" data-attachment-id="8745" data-permalink="https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/sample-question-to-data-agent-2/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?fit=1594%2C792&amp;ssl=1" data-orig-size="1594,792" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="Sample question to data agent" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?fit=1200%2C596&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?fit=1200%2C596&amp;ssl=1" alt="fabric data agent demo" class="wp-image-8745" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?w=1594&amp;ssl=1 1594w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?resize=300%2C149&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?resize=1200%2C596&amp;ssl=1 1200w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?resize=768%2C382&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?resize=1536%2C763&amp;ssl=1 1536w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?resize=450%2C224&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-question-to-data-agent-1.png?resize=600%2C298&amp;ssl=1 600w" sizes="(max-width: 1594px) 100vw, 1594px" /></a></figure>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p class="">2. List top 5 customers who made the highest purchases in the latest available year:</p>
</blockquote>



<figure class="wp-block-image size-full"><a href="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?ssl=1"><img loading="lazy" decoding="async" width="989" height="714" data-attachment-id="8746" data-permalink="https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/sample-query-2-data-agent/" data-orig-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?fit=989%2C714&amp;ssl=1" data-orig-size="989,714" data-comments-opened="0" data-image-meta="{&quot;aperture&quot;:&quot;0&quot;,&quot;credit&quot;:&quot;&quot;,&quot;camera&quot;:&quot;&quot;,&quot;caption&quot;:&quot;&quot;,&quot;created_timestamp&quot;:&quot;0&quot;,&quot;copyright&quot;:&quot;&quot;,&quot;focal_length&quot;:&quot;0&quot;,&quot;iso&quot;:&quot;0&quot;,&quot;shutter_speed&quot;:&quot;0&quot;,&quot;title&quot;:&quot;&quot;,&quot;orientation&quot;:&quot;0&quot;}" data-image-title="Sample query 2 data agent" data-image-description="" data-image-caption="" data-large-file="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?fit=989%2C714&amp;ssl=1" src="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?fit=989%2C714&amp;ssl=1" alt="fabric data agent demo" class="wp-image-8746" srcset="https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?w=989&amp;ssl=1 989w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?resize=300%2C217&amp;ssl=1 300w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?resize=859%2C620&amp;ssl=1 859w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?resize=768%2C554&amp;ssl=1 768w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?resize=450%2C325&amp;ssl=1 450w, https://i0.wp.com/azureops.org/wp-content/uploads/2025/07/Sample-query-2-data-agent.png?resize=600%2C433&amp;ssl=1 600w" sizes="(max-width: 989px) 100vw, 989px" /></a></figure>



<p class="">Notice that it also provides the SQL query it has executed on the lakehouse to get the required output.</p>



<p class="">If the data source and instructions are set correctly, the agent should respond with meaningful tables or summaries. In case you observe issues in the responses, you may need to fine tune the AI instructions and test again.</p>



<h2 class="wp-block-heading">When Should You Use Data Agents?</h2>



<p class="">If you&#8217;re already using:</p>



<ul class="wp-block-list">
<li class="">A well-modeled star schema</li>



<li class="">Lakehouse tables or Delta format</li>



<li class="">Power BI reports or semantic models</li>



<li class="">Microsoft Fabric workspaces with clean relationships</li>
</ul>



<p class="">Then a Data Agent will act like a bridge between your data and your business users. No technical barrier — just questions and answers.</p>



<h2 class="wp-block-heading">Integrations and Advanced Use Cases</h2>



<p class="">What makes Fabric Data Agents truly powerful is not just that they can answer questions — but that they can <strong>plug into larger AI and data ecosystems</strong>. Here are a few ways to take your agent to the next level.</p>



<h3 class="wp-block-heading">1. Integration with Azure AI Foundry</h3>



<p class="">Microsoft Azure&#8217;s <a href="https://ai.azure.com/" target="_blank" rel="noreferrer noopener">AI Foundry</a> allows you to orchestrate LLM-driven pipelines, combine ML models with data operations, and deploy custom copilots. Your Data Agent can be used here in multiple ways:</p>



<ul class="wp-block-list">
<li class="">As a <strong>ready knowledge base</strong> within Foundry apps</li>



<li class="">To <strong>summarize and explain insights</strong> from streaming or batch pipelines</li>



<li class="">As a <strong>modular AI skill</strong> within a larger orchestrated flow</li>
</ul>



<p class="">For example, you could use the agent to automatically generate weekly sales summaries and send them via email to business users — no dashboards needed.</p>



<h3 class="wp-block-heading">2. Use in Multi-Agent Systems with Copilot Studio</h3>



<p class="">Microsoft recently <a href="https://blog.fabric.microsoft.com/en-us/blog/fabric-data-agents-microsoft-copilot-studio-a-new-era-of-multi-agent-orchestration" target="_blank" rel="noreferrer noopener">announced </a>integration of Fabric data agent with Copilot Studio. This means data agent also supports <strong>multi-agent</strong> patterns where different agents work together, each specializing in their role.</p>



<p class="">Your Data Agent can act as:</p>



<ul class="wp-block-list">
<li class="">A <strong>domain expert</strong> (e.g., Sales Agent, Inventory Agent)</li>



<li class="">A <strong>knowledge base</strong> that other agents query</li>



<li class="">A <strong>collaborative AI</strong> alongside others like a document reader, chatbot, or metric generator</li>
</ul>



<h4 class="wp-block-heading">Example: Multi-Agent Use Case</h4>



<p class="">Imagine a scenario where you’ve built:</p>



<ul class="wp-block-list">
<li class="">A <strong>&#8220;Sales Insights Agent&#8221;</strong> (based on the Sales model)</li>



<li class="">A <strong>&#8220;Customer Sentiment Agent&#8221;</strong> (that reads survey data or feedback documents)</li>



<li class="">A <strong>&#8220;Decision Support Agent&#8221;</strong> (that aggregates insights from both)</li>
</ul>



<p class="">Now, a user asks the Decision Support Agent:<br><strong>&#8220;Should we invest more in red-colored bikes for Q3 promotions?&#8221;</strong></p>



<p class="">Here’s what happens behind the scenes:</p>



<ol class="wp-block-list">
<li class="">The <strong>Sales Agent</strong> looks up sales trends for red bikes from your Data Agent.</li>



<li class="">The <strong>Sentiment Agent</strong> checks recent customer feedback about product quality or color preferences.</li>



<li class="">The <strong>Decision Agent</strong> combines both and generates a recommendation — backed by data and context.</li>
</ol>



<p class="">This makes your Data Agent a <strong>building block in a broader AI ecosystem</strong>, not just a standalone tool.</p>



<h2 class="wp-block-heading">Final Thoughts</h2>



<p class="">Data Agents in Fabric aren&#8217;t just experimental toys; they&#8217;re fully capable assistants for real business scenarios. Whether you&#8217;re a data engineer, analyst, or decision maker, you’ll find value in being able to converse with your data.</p>



<p class="">For me, this agent worked perfectly with the AdventureWorksDW model and started answering meaningful business questions within minutes,  no DAX, no Power BI visuals, no joins to write.</p>



<p class="">This service is currently in preview. It does not currently render charts. Hopefully, future updates will enable it to generate Power BI level visuals on the fly.</p>



<h2 class="wp-block-heading">See more</h2>



<iframe width="700" height="394" src="https://www.youtube.com/embed/t2h6xNVFQkc" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>



<div class="wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex">
<div class="is-style-fill wp-block-button"><a class="wp-block-button__link has-white-color has-blush-light-purple-gradient-background has-text-color has-background has-link-color wp-element-button" href="https://azureops.org/product/ssis-catalog-migration-wizard-pro/" target="_blank" rel="noreferrer noopener">Download Now</a></div>
</div>



<p class="has-background" style="background-color:#beefca"><strong>Pro tips:</strong><br>1. <a href="https://azureops.org/articles/ssms-21-copilot/" target="_blank" rel="noreferrer noopener">Learn </a>how to integrate Microsoft Copilot in SQL Server Management Studio 21.</p>
<p>The post <a href="https://azureops.org/articles/data-agent-in-microsoft-fabric-heres-how-it-works/">Data Agent in Microsoft Fabric &#8211; Here&#8217;s How it Works</a> appeared first on <a href="https://azureops.org">AzureOps</a>.</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">8717</post-id>	</item>
		<item>
		<title>How to Delete Stale Delta Files in Microsoft Fabric Lakehouse</title>
		<link>https://azureops.org/articles/delete-delta-files-from-fabric/</link>
		
		<dc:creator><![CDATA[Jagdish Wagh]]></dc:creator>
		<pubDate>Thu, 17 Apr 2025 07:07:14 +0000</pubDate>
				<category><![CDATA[Microsoft Fabric]]></category>
		<category><![CDATA[delete delta files]]></category>
		<category><![CDATA[fabric lakehouse]]></category>
		<guid isPermaLink="false">https://azureops.org/?p=8466</guid>

					<description><![CDATA[<p>This article describes how to delete delta files from fabric lakehouse using python code and also using manual steps.</p>
<p>The post <a href="https://azureops.org/articles/delete-delta-files-from-fabric/">How to Delete Stale Delta Files in Microsoft Fabric Lakehouse</a> appeared first on <a href="https://azureops.org">AzureOps</a>.</p>
]]></description>
										<content:encoded><![CDATA[
<p id="8f93" class=""><a href="https://www.microsoft.com/en-us/microsoft-fabric" target="_blank" rel="noreferrer noopener">Microsoft Fabric</a> is an end-to-end, unified analytics platform that integrates data engineering, data warehousing, data science, real-time analytics, and business intelligence. It streamlines data workflows across services like Azure, Power BI, and Synapse in a single SaaS offering.<br>When dropping a table in<a href="https://www.microsoft.com/en-us/microsoft-fabric" target="_blank" rel="noreferrer noopener"> </a>Microsoft Fabric, we sometimes notice that the Delta files have not been completely removed. This can cause issues when recreating the table, as the location may still contain old metadata or non-Delta files. To resolve this, we first list the files in the target folder location, identify any remaining Delta files, and then perform the necessary actions to delete them. Once the location is clean, we recreate the table to ensure a fresh and error-free setup. This article describes how to delete delta files from Fabric Lakehouse.</p>



<p class="">In the example below, we want to drop and recreate a table &#8216;lh_gold.t_fact_day_sales&#8217; in fabric lakehouse.</p>



<h3 class="wp-block-heading" id="6804">Error Message:</h3>



<p class="">The typical error message we receive:</p>



<blockquote class="wp-block-quote is-layout-flow wp-block-quote-is-layout-flow">
<p id="1a06" class="">Fabric getting this error while dropping and recreating table| AnalysisException: [DELTA_CREATE_TABLE_WITH_NON_EMPTY_LOCATION] Cannot create table (‘lh_gold.t_fact_day_sales&#8217;). The associated location (&#8216;abfss://7eaf3bc1-2d0c-43d9-bcbf-12b1195cb9a5@onelake.dfs.fabric.microsoft.com/cd923083-448c-43a9-bc86-94cfc95a7bc8/Tables/t_fact_day_sales&#8217;) is not empty and also not a Delta table.</p>
</blockquote>



<h3 class=" wp-block-heading">Why Microsoft Fabric Can&#8217;t Auto-Delete Old Delta Files Like Databricks</h3>



<p class="">Databricks has a built-in mechanism through its runtime to automatically manage files behind Delta Tables — especially when you <code>DROP TABLE</code>, <code>TRUNCATE</code>, or do a <code><a href="https://azureops.org/articles/databricks-vacuum-command/" target="_blank" rel="noreferrer noopener">VACUUM</a></code>. It deeply integrates with the storage layer (like DBFS, or direct Azure Data Lake) <strong>and</strong> uses <code>dbutils</code> and Delta Lake transaction logs (<code>_delta_log/</code>) to keep everything consistent.</p>



<p class="">However, <strong>Microsoft Fabric</strong> (as of 2024–2025):</p>



<ul class="wp-block-list">
<li class="">Uses a different storage abstraction: <strong>OneLake</strong>, not direct ADLS.</li>



<li class="">Runs on <strong>Spark pools</strong> that don&#8217;t fully expose low-level file system utilities like <code>dbutils.fs</code>.</li>



<li class="">Manages tables a little differently — especially when they&#8217;re <strong>shortcuts</strong> or <strong>external tables</strong> — and sometimes does <strong>not automatically delete</strong> orphaned files if a table is dropped.</li>



<li class="">Also, Fabric&#8217;s Spark runtime is <strong>hardened</strong> and <strong>sandboxed</strong> for multi-tenancy and governance, which limits direct file system operations unless explicitly triggered by the user (via <code>mssparkutils</code>, Fabric UI, or API).</li>
</ul>



<p class="">In short, <strong>Fabric prioritizes safety and governance over automatic cleanup</strong>, and doesn&#8217;t yet implement the same auto-vacuuming behaviors Databricks does.</p>



<h3 class="wp-block-heading" id="54c2">Follow the steps below to delete Delta files from Fabric workspace programmatically.</h3>



<p id="a0d9" class="">1. Check if the Location Contains Files</p>


<div class="wp-block-syntaxhighlighter-code "><pre class="brush: python; gutter: false; title: ; notranslate">
from pyspark.sql.functions import col
files = mssparkutils.fs.ls(“abfss://&lt;a href=&quot;mailto:7eaf3bc1-2d0c-43d9-bcbf-12b1195cb9a5@onelake.dfs.fabric.microsoft.com&quot; target=&quot;_blank&quot; rel=&quot;noreferrer noopener&quot;&gt;7eaf3bc1–2d0c-43d9-bcbf-12b1195cb9a5@onelake.dfs.fabric.microsoft.com&lt;/a&gt;/cd923083–448c-43a9-bc86–94cfc95a7bc8/Tables/t_fact_day_sales”)
display(files)
</pre></div>


<p id="43e5" class="">2. Delete Non-Delta Files (If Any)</p>


<div class="wp-block-syntaxhighlighter-code "><pre class="brush: python; gutter: false; title: ; notranslate">
mssparkutils.fs.rm(“abfss://&lt;a href=&quot;mailto:7eaf3bc1-2d0c-43d9-bcbf-12b1195cb9a5@onelake.dfs.fabric.microsoft.com&quot; rel=&quot;noreferrer noopener&quot; target=&quot;_blank&quot;&gt;7eaf3bc1–2d0c-43d9-bcbf-12b1195cb9a5@onelake.dfs.fabric.microsoft.com&lt;/a&gt;/cd923083–448c-43a9-bc86–94cfc95a7bc8/Tables/t_fact_day_sales”, recurse=True)
</pre></div>


<p id="4a5f" class="">3. Drop the Table Before Recreating</p>


<div class="wp-block-syntaxhighlighter-code "><pre class="brush: plain; gutter: false; title: ; notranslate">
DROP TABLE IF EXISTS lh_gold.t_fact_day_sales;
</pre></div>


<p class="">4. Create the Table Again Using Delta Format</p>


<div class="wp-block-syntaxhighlighter-code "><pre class="brush: sql; gutter: false; title: ; notranslate">
CREATE TABLE lh_gold.t_fact_day_sales
USING DELTA
LOCATION ‘abfss://7eaf3bc1–2d0c-43d9-bcbf-12b1195cb9a5@onelake.dfs.fabric.microsoft.com/cd923083–448c-43a9-bc86–94cfc95a7bc8/Tables/t_fact_day_sales’;
</pre></div>


<h2 class="wp-block-heading" id="9537">Alternative: Delete the Folder Manually</h2>



<p id="50d8" class="">If you are unable to delete files programmatically, try these options:</p>



<ul class=" wp-block-list">
<li class=""><strong>OneLake Explorer</strong>&nbsp;→ Navigate to&nbsp;<code>Tables/t_fact_day_sales</code>&nbsp;and delete the folder.</li>



<li class=""><strong>Azure Storage Explorer</strong>&nbsp;→ Connect to the Fabric OneLake storage and manually delete the folder.</li>
</ul>



<p id="05ff" class="">Once the folder is clean, retry the table creation.</p>



<p class="has-background" style="background-color:#bcefca"><strong>Pro tips:</strong><br>1. When using an external table, we can easily apply an alternative way to drop the folder. However, when working with a managed table, we have to use the fabric api as above.<br>2. If you want to automate deletion of old files from blob storage, follow this <a href="https://azureops.org/articles/automatically-delete-old-files-from-azure-storage-account/" target="_blank" rel="noreferrer noopener">article</a>.</p>



<h2 class="wp-block-heading">See more</h2>



<iframe width="700" height="394" src="https://www.youtube.com/embed/t2h6xNVFQkc" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" allowfullscreen></iframe>



<div class="wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex">
<div class="is-style-fill wp-block-button"><a class="wp-block-button__link has-white-color has-blush-light-purple-gradient-background has-text-color has-background has-link-color wp-element-button" href="https://azureops.org/product/ssis-catalog-migration-wizard-pro/" target="_blank" rel="noreferrer noopener">Download Now</a></div>
</div>
<p>The post <a href="https://azureops.org/articles/delete-delta-files-from-fabric/">How to Delete Stale Delta Files in Microsoft Fabric Lakehouse</a> appeared first on <a href="https://azureops.org">AzureOps</a>.</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">8466</post-id>	</item>
	</channel>
</rss>
