{"data":[{"active":true,"blog_title":"Fabric Spark Monitoring APIs (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/general-availability-announcement-fabric-spark-monitoring-apis","feature_description":"This feature provides an integrated, real-time dashboard for monitoring Spark application performance at both the driver and executor levels. Users can visualize CPU, memory, and core utilization across running and completed Spark applications--whether triggered through interactive notebooks or batch jobs. The dashboard aligns with the Fabric SaaS experience and enhances visibility into Spark vCore allocation and utilization.Users can inspect performance metrics at any moment in the application lifecycle, analyze utilization patterns, and access recommended actions to address bottlenecks. In addition to real-time insights, the experience includes summaries of active jobs and tasks, detailed Spark compute configurations, and the ability to drill into the Spark UI, application history, job-level details, or code-level snapshots.","feature_name":"Fabric Spark Real-Time Performance Monitoring for CPU, Memory, and vCores","last_modified":"2026-04-14","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-07-31","release_item_id":"9f72b035-86ba-f011-bbd3-6045bd00f9db","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Announcing the Fabric Apache Spark Diagnostic Emitter: Collect Logs and Metrics","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-the-fabric-apache-spark-diagnostic-emitter-collect-logs-and-metrics","feature_description":"This feature is intended to announce the General Availability of the Fabric Spark diagnostic emitter. The Spark emitter enables customers to send Spark logs and metrics to their preferred destinations, including Azure Log Analytics, Azure Event Hub, and Azure Blob Storage.","feature_name":"Fabric Spark Diagnostic Log Emitter: General Availability","last_modified":"2026-04-14","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-31","release_item_id":"2ff1693f-85ba-f011-bbd3-6045bd00f9db","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Simplifying Medallion Implementation with Materialized Lake Views in Fabric","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-materialized-lake-views-at-build-2025","feature_description":"Multi Lakehouse support in Lineage enables users to visualize and manage dependencies of Materialized Lake Views (MLVs) across multiple workspaces and lakehouses, providing a unified view that helps prevent data silos and improves transparency. It is designed to support scalable lineage tracking, advanced search, and focused navigation, making it easier for data teams to trace upstream and downstream dependencies.","feature_name":"Fabric Materialized Lake Views - Multi Workspace/Lakehouse support in Lineage","last_modified":"2026-04-09","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-05-29","release_item_id":"f152e5fd-1fbf-f011-bbd3-000d3a3740cc","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Simplifying Medallion Implementation with Materialized Lake Views in Fabric","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-materialized-lake-views-at-build-2025","feature_description":"Multiple schedule in FMLV allows users to independently schedule refreshes for individual Materialized Lake Views or chains within a Lakehouse, rather than applying a single schedule to the entire LakeHouse. This enables targeted refreshes, optimizes compute usage, and aligns data freshness with specific business SLAs for different reporting","feature_name":"Fabric Materialized Lake Views - Multiple Schedule Support","last_modified":"2026-04-09","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-16","release_item_id":"25c46393-1fbf-f011-bbd3-000d3a3740cc","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"Python Notebooks now integrate with Environments, enabling users to upload and use custom libraries and packages.","feature_name":"Environment - Support for Python Notebook","last_modified":"2026-02-12","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-04-24","release_item_id":"f5495e72-de01-f111-8406-6045bd00f798","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Fabric Notebooks: Resources Folder Support in Git","blog_url":"https://blog.fabric.microsoft.com/en-US/blog/fabric-notebooks-resources-folder-support-in-git","feature_description":"Modules and files stored in the Notebook Resource folder can now be committed to Git and published through Deployment Pipelines.","feature_name":"CI/CD: notebook resources in git and deployment pipeline","last_modified":"2026-02-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-31","release_item_id":"f4f6862a-e001-f111-8406-6045bd00f798","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Enhancing AI productivity in Fabric notebooks with Copilot updates","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/enhancing-ai-productivity-in-fabric-notebooks-with-copilot-updates","feature_description":"The new Notebook Copilot experience is Fabric-context aware, fast, and agentic--able to reason over your workspace and write code directly from natural-language prompts. It provides contextual assistance tailored to Data Engineers and Data Scientists, helping them move from intent to executable notebooks with less friction.","feature_name":"Agentic Copilot for Notebooks","last_modified":"2026-02-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-27","release_item_id":"5fa7544e-c4c3-f011-bbd3-00224808fcf0","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Fabric Data Agents + Microsoft Copilot Studio: A New Era of Multi-Agent Orchestration (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/fabric-data-agents-microsoft-copilot-studio-a-new-era-of-multi-agent-orchestration","feature_description":"The new Fabric Notebook agent mode, available in the GitHub Copilot panel in VS Code, enables users to leverage GitHub Chat with Fabric-aware context across Notebooks, Lakehouses, notebookutils, and more.","feature_name":"VSCode FabricNotebook Agent mode","last_modified":"2026-02-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-20","release_item_id":"743b7ba3-dc01-f111-8406-6045bd00f798","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"This new lightweight capability, available in the environment, provides an agile option to install libraries and packages using a quick mode, ideal for workloads that require frequent iteration. The quick mode can be switched to full mode later if needed.","feature_name":"Environment - Lightweight Library management","last_modified":"2026-02-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-06","release_item_id":"9c3c2e19-c5c3-f011-bbd3-00224808fcf0","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"Notebooks user will be able to configure and use predefined Cloud connections and read the data into Notebooks dataframe.","feature_name":"Notebooks integration with Data source management","last_modified":"2026-02-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-01-15","release_item_id":"aabe7b0e-5020-f011-998a-0022480939f0","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Microsoft JDBC Driver for Microsoft Fabric Data Engineering (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/microsoft-jdbc-driver-for-microsoft-fabric-data-engineering-preview","feature_description":"This feature provides the Spark JDBC driver as a downloadable component for use within client applications. It enables those applications to connect to Fabric or Synapse Spark and execute Spark jobs seamlessly.","feature_name":"Fabric Spark - JDBC Drivers - Public Preview","last_modified":"2026-02-03","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-02-27","release_item_id":"5c4ed978-98ba-f011-bbd3-00224808fcf0","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Supercharge your workloads: write-optimized default Spark configurations in Microsoft Fabric","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/supercharge-your-workloads-write-optimized-default-spark-configurations-in-microsoft-fabric","feature_description":"Performance by Default Experience based simple hints from users based on their workload requirementsPre-configured compute and environment settings tailored to specific data engineering workloads based on their requirements and price perf goals from workspace settings","feature_name":"Resource Profiles for Fabric Data Engineering","last_modified":"2026-01-13","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-02-28","release_item_id":"be21e5f9-7dba-f011-bbd2-0022480a2ecf","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"Supporting a new source for users to install libraries. Users can install the libraries from Azure Artifacr Feed in their Fabric Environments.","feature_name":"Installing libraries from Azure Artifact Feeds","last_modified":"2026-01-06","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-01-09","release_item_id":"9e8228c5-f994-ef11-8a6a-6045bd062aa2","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Fabric Runtime 2.0 (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/fabric-runtime-2-0-experimental-public-preview","feature_description":"This a new Fabric Runtime 2.0 release based on Spark 4.x and Delta Lake 4.x. Most importantly, it will have Scala 2.13 and will be based on Mariner 3.0 OS.","feature_name":"Fabric Runtime 2.0 - Experimental Public Preview","last_modified":"2026-01-05","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-01-30","release_item_id":"56c93a41-95ba-f011-bbd3-00224808fcf0","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Materialized Lake Views in Microsoft Fabric (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-US/blog/materialized-lake-views-in-microsoft-fabric-generally-available","feature_description":"[Optimal Refresh](https://learn.microsoft.com/en-us/fabric/data-engineering/materialized-lake-views/overview-materialized-lake-view) - refreshes only changed data (supporting filter, innerjoin and projections) instead of entire datasets, delivering faster and more efficient data updates.","feature_name":"Fabric Materialized Lake Views - Optimal Refresh","last_modified":"2025-12-10","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-12-31","release_item_id":"81643458-b721-f011-9989-000d3a34671f","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Announcing the preview of the REST API for Livy for Data Engineering.","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-the-public-preview-of-the-rest-api-for-livy-for-data-engineering","feature_description":"Apache Livy is an API that enables easy interaction with a Spark cluster over a REST interface. It enables easy submission of Spark jobs or snippets of Spark code, synchronous or asynchronous result retrieval, as well as Spark Context management, all via a simple REST interface or an RPC client library. Apache Livy API also simplifies the interaction between Spark and application servers, thus enabling the use of Spark for interactive web/mobile applications.","feature_name":"Livy API - General Availability","last_modified":"2025-12-07","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-06-30","release_item_id":"e3b1e6c9-c98c-ef11-ac21-00224804e9b4","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Microsoft Fabric extension for VS Code (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-the-general-availability-ga-of-microsoft-fabric-extension-for-vs-code","feature_description":"Core VSCode Extension for Fabric will provide common developer support for Fabric services.","feature_name":"VSCode Core Extension for Fabric","last_modified":"2025-12-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-15","release_item_id":"7603d03c-8603-ef11-a1fd-000d3a34b75c","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Fabric User Data Functions (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-fabric-user-data-functions-now-in-general-availability","feature_description":"User Data Functions will provide a powerful mechanism for implementing and re-using custom, specialized business logic into Fabric data science and data engineering workflows, increasing efficiency and flexibility.","feature_name":"User Data Functions in Fabric","last_modified":"2025-12-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-15","release_item_id":"3a31cb8c-8503-ef11-a1fd-000d3a34b75c","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Boost your development with Microsoft Fabric extensions for Visual Studio Code","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/boost-your-development-with-microsoft-fabric-extensions-for-visual-studio-code","feature_description":"The VSCode Satellite extensionn for User Data Functions will provide developer support (editing, building, debugging, publishing) for User Data Functions in Fabric.","feature_name":"VSCode Satellite Extension for User Data Functions in Fabric","last_modified":"2025-12-04","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-15","release_item_id":"21a906cd-8603-ef11-a1fd-000d3a34b75c","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Announcing the general availability of Microsoft Fabric API for GraphQL with exciting new features","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-the-general-availability-of-microsoft-fabric-api-for-graphql-with-exciting-new-features","feature_description":"API for GraphQL in Fabric provides a simple, SaaS experience for implementing data APIs for accessing data in Fabric from external applications.","feature_name":"API for GraphQL in Fabric","last_modified":"2025-12-02","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2024-11-25","release_item_id":"5104f09a-bf8c-ef11-ac21-002248098a98","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Fabric Runtime 2.0 (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-US/blog/fabric-runtime-2-0-preview","feature_description":"This a new Fabric Runtime 2.0 release based on Spark 4.x and Delta Lake 4.x. Most importantly, it will have Scala 2.13 and will be based on Mariner 3.0 OS.","feature_name":"Fabric Runtime 2.0 - Public Preview","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-04-30","release_item_id":"74116db5-95ba-f011-bbd3-00224808fcf0","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"This feature enables multiple runtime channels for customers. The default channel will remain the current standard runtime, while an EarlyAccess channel will provide the latest updates - such as library upgrades and security vulnerability fix..Using Spark settings in the environment, customers can test and validate these changes early, before they become part of the default runtime channel.","feature_name":"Release Channel - Public Preview","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-31","release_item_id":"399f07f8-96ba-f011-bbd3-00224808fcf0","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Custom SQL Pools for Fabric Data Warehouse (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-US/blog/custom-sql-pools-for-fabric-data-warehouse-preview","feature_description":"Customers can create custom compute pools for Spark with libraries and other items specific to their scenario and keep them warm like they can today with starter pools.","feature_name":"Custom Live Pools","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-03-31","release_item_id":"11fd2c23-e28c-ef11-ac21-00224804e9b4","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"Native Execution Engine available at no additional cost!","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/native-execution-engine-available-at-no-additional-cost","feature_description":"Enhance the Native Execution Engine in Microsoft Fabric Spark to support CSV ingestion natively, minimizing fallbacks to the Spark JVM and improving performance for data ingestion workflows.Unlock native engine speedups for foundational ingestion scenarios.Reduce cost and latency during ETL, especially for write-heavy delta loads for customers given majority of users  have CSV based file dependencies","feature_name":"CSV Support for Native Execution Engine","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-02-28","release_item_id":"bfd0bc17-7dba-f011-bbd2-0022480a2ecf","release_status":"Planned","release_type":"General availability"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"Visibility into Job Concurrency & QueueingWorkspace users and admins can see all active jobs and their states (running, queued, throttled)Diagnose job delays by identifying concurrency limits or queueing bottlenecksCapacity admins can now monitor job activity across all workspaces based on CU load.Understand overall load and capacity pressure","feature_name":"Job Queueing and Concurrency Monitoring","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2026-01-31","release_item_id":"1a98d2aa-7bba-f011-bbd2-0022480a2ecf","release_status":"Planned","release_type":"Public preview"},{"active":true,"blog_title":"ArcGIS GeoAnalytics for Microsoft Fabric Spark (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/arcgis-geoanalytics-for-microsoft-fabric-spark-generally-available","feature_description":"Microsoft and Esri have partnered to bring spatial analytics into Microsoft Fabric. This collaboration introduces a new library, ArcGIS GeoAnalytics for Microsoft Fabric, enabling an extensive set of spatial analytics right within Microsoft Fabric Spark notebooks and Spark job definitions (across both Data Engineering and Data Science experiences / workloads). This integrated product experience empowers Spark developers or data scientists to natively use Esri capabilities to run ArcGIS GeoAnalytics functions and tools within Fabric Spark for spatial transformation, enrichment, and pattern / trend analysis of data - even big data - across different use cases without any need for separate installation and configuration.","feature_name":"ArcGIS GeoAnalytics for Microsoft Fabric Spark - General Availability","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-11-03","release_item_id":"ab01c7d9-92ba-f011-bbd3-00224808fcf0","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Azure Synapse Runtime for Apache Spark 3.5 (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/general-availability-azure-synapse-runtime-for-apache-spark-3-5","feature_description":"Making available the latest Spark runtime in Azure Synapse Analytics in GA","feature_name":"Synapse Spark 3.5 Release - General Availability","last_modified":"2025-11-18","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-10-15","release_item_id":"5075a5ad-93ba-f011-bbd3-00224808fcf0","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Materialized Lake Views in Microsoft Fabric (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-US/blog/materialized-lake-views-in-microsoft-fabric-generally-available","feature_description":"**Materialized lake views** in Microsoft Fabric enables automatic orchestration of queries over a source table or another materialized view, providing up-to-date results efficiently. They improve query performance, reduce resource consumption and simplify overhead tasks involved in operationalizing medallion architecture like error handling, dependency management, data quality monitoring and visualization..","feature_name":"Fabric Materialized Lake Views - Public Preview","last_modified":"2025-11-12","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-05-19","release_item_id":"0e682167-f991-ef11-ac21-6045bd062aa2","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Spark Connector for SQL databases (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/spark-connector-for-sql-databases-preview","feature_description":"This feature extends the current Fabric Spark connector for DW to support reading and writing from Azure SQL DB / SQL Server as well.","feature_name":"Spark Connector - Read and Write from Azure SQL DB and SQL Server - Public Preview","last_modified":"2025-11-05","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-30","release_item_id":"ad21c5df-5521-f011-9989-000d3a34671f","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Azure Synapse Runtime for Apache Spark 3.5 (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/public-preview-azure-synapse-runtime-for-apache-spark-3-5","feature_description":"Making available the latest Spark runtime in Azure Synapse Analytics in public preview","feature_name":"Synapse Spark 3.5 Release - Public Preview","last_modified":"2025-11-05","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-06-02","release_item_id":"9a5b1514-5221-f011-9989-000d3a34671f","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Spark Connector for Fabric Data Warehouse (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/spark-connector-for-fabric-data-warehouse-dw-public-preview","feature_description":"The Spark connector for Microsoft Fabric Data Warehouse enables Spark developers and data scientists to access and work with data from a warehouse and the SQL analytics endpoint of a lakehouse. It offers a simplified Spark API, abstracts underlying complexity, and operates with just one line of code, while upholding security models like object-level security (OLS), row-level security (RLS), and column-level security (CLS).","feature_name":"Spark Connector for Fabric Data Warehouse - General Availability","last_modified":"2025-11-05","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-03-31","release_item_id":"a0e76d04-0b93-ef11-ac21-6045bd062aa2","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"ArcGIS GeoAnalytics for Microsoft Fabric Spark (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/arcgis-geoanalytics-for-microsoft-fabric-spark-generally-available","feature_description":"Microsoft and Esri have partnered to bring spatial analytics into Microsoft Fabric. This collaboration introduces a new library, ArcGIS GeoAnalytics for Microsoft Fabric, enabling an extensive set of spatial analytics right within Microsoft Fabric Spark notebooks and Spark job definitions (across both Data Engineering and Data Science experiences / workloads). This integrated product experience empowers Spark developers or data scientists to natively use Esri capabilities to run ArcGIS GeoAnalytics functions and tools within Fabric Spark for spatial transformation, enrichment, and pattern / trend analysis of data - even big data - across different use cases without any need for separate installation and configuration.","feature_name":"ArcGIS GeoAnalytics for Microsoft Fabric Spark - Public Preview","last_modified":"2025-11-05","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2024-11-30","release_item_id":"2e8680e3-0c93-ef11-ac21-6045bd062aa2","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Spark Connector for Fabric Data Warehouse (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/spark-connector-for-fabric-data-warehouse-dw-public-preview","feature_description":"Spark Connector for Fabric DW (Data Warehouse) empowers a Spark developer or a data scientist to access and work on data from Fabric Data Warehouse with a simplified Spark API, which literally works with just one line of code. It offers an ability to query the data, in parallel, from Fabric data warehouse so that it scales with increasing data volume and honors security model (OLS/RLS/CLS) defined at the data warehouse level while accessing the table or view. This first release will support reading data only and the support for writing data back will be coming soon.","feature_name":"Spark Connector for Fabric Data Warehouse - Public Preview","last_modified":"2025-11-05","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2024-05-31","release_item_id":"b0745ee1-b6f8-ee11-a1fe-000d3a340b2c","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"How Spark Supports OneLake Security with Row and Column Level Policies","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/how-spark-supports-onelake-security-with-row-and-column-level-security-policies","feature_description":"The feature allows users to implement security policies for data access within the Spark engine. Users may define Object, Row, or Column level security, ensuring that data is secured as defined by these policies when accessed through Fabric Spark and is aligned with the OneSecurity initiative being enabled across Microsoft Fabric.","feature_name":"RLS/CLS Support for Spark and Lakehouse","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-17","release_item_id":"0fbf16dd-ce8c-ef11-ac21-002248098a98","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"This feature allows users to view a Notebook snapshot while it is still running, which is essential for monitoring progress and troubleshooting performance issues. Users can see the original source code, input parameters, and cell outputs to better understand the Spark job, and they can track the Spark execution progress at the cell level.  Users can also review the output of completed cells to validate the accuracy of the Spark application and estimate the remaining work. Additionally, any errors or exceptions from already executed cells are displayed, helping users identify and address issues early.","feature_name":"Support for snapshots of in-progress Notebook jobs","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-08-31","release_item_id":"76338012-b2f8-ee11-a1fe-000d3a3419a8","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Organizing your tables with lakehouse schemas and more (Public Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/organizing-your-tables-with-lakehouse-schemas-and-more-public-preview","feature_description":"A multi-lakehouse feature that will allow user to work with multiple items in single consolidated view. Users will be able to seamlessly add and manage multiple lakehouses efficiently within a customizable view, streamlining data organization and access while working in the lakehouse explorer.","feature_name":"Multi-Lakehouse implementation in Lakehouse Explorer","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-07-31","release_item_id":"2218d20b-5321-f011-9989-000d3a34671f","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Bridging Fabric Lakehouses: Delta Change Data Feed for Seamless ETL","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/bridging-fabric-lakehouses-delta-change-data-feed-for-seamless-etl","feature_description":"Having proper defaults and aligning with the latest standards are of the utmost importance to Delta Lake standards in Microsoft Fabric. INT64 will be the new default encoding type for all timestamp values. This moves away from INT96 encodings, which the Apache Parquet deprecated years ago. The changes don't affect any reading capabilities, it's transparent and compatible by default, but ensures that all new parquet files in your Delta Lake table are written in a more efficient and future proof way.  We're also releasing a faster implementation of the OPTIMIZE command, making it skip already V-Ordered files.","feature_name":"Delta Lake improvements in Spark experiences","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-03-31","release_item_id":"6eaf2b7f-b7f8-ee11-a1fe-000d3a340b2c","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Private ADLS Gen2 access made easy with OneLake Shortcuts: a step-by-step guide","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/private-adls-gen2-access-made-easy-with-onelake-shortcuts-a-step-by-step-guide","feature_description":"To deliver a compelling application lifecycle management story, tracking object metadata in git and supporting deployment pipelines is imperative. In the Data Engineering modules, as workspaces are integrated to git.In this first iteration, OneLake Shortcuts will automatically be deployed across pipeline stages and workspaces. Shortcut connections can be remapped across stages using a new Microsoft Fabric item named variable library, assuring proper isolation and environment segmentation customers expect.","feature_name":"Lakehouse Shortcuts metadata on git and deployment pipelines","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-03-31","release_item_id":"0ebf2013-b7f8-ee11-a1fe-000d3a340b2c","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Public Preview of Native Execution Engine for Apache Spark on Fabric Data Engineering and Data Science","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/public-preview-of-native-execution-engine-for-apache-spark-on-fabric-data-engineering-and-data-science","feature_description":"The monitoring feature for the Native Execution Engine will allow users to view details related to the Native Execution Engine, including:* Spark SQL query execution details, such as the nodes running on the Native Engine or the normal JVMs.* A dedicated green color to highlight the stage or operator that runs under the Native Engine.* A summary of all key metrics for Spark SQL query executions, covering both native executions and normal Spark executions.","feature_name":"Monitoring for Native Execution Engine","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2024-12-31","release_item_id":"cbd7f1b7-9d9d-ef11-8a6a-002248098a98","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"The resource utilization analysis feature visualizes the allocation and utilization of executor cores, providing an intuitive way for users to quickly gain insights into resource allocation and utilization throughout the Spark application execution. Some highlights include:* A summary of executor core utilization efficiency is calculated.* Users can view details on the status of executor cores, including Running, Idled, Allocated, and Maximum instances.* The interactive graph allows users to understand executor, job, and task details for a given moment.","feature_name":"Resource Executor Core Utilization Analysis","last_modified":"2025-10-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2024-12-31","release_item_id":"0379ec90-a09d-ef11-8a6a-002248098a98","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Announcing Python Notebook in Preview","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/python-notebook-public-preview","feature_description":"Fabric notebooks support pure Python experience. This new solution is targeting BI developers and Data Scientists working with smaller datasets (up to a few GB) and using Pandas, and Python as their primary language. Through this new experience, they'll be able to benefit from native Python language and its native features and libraries out of the box, will be able to switch from a Python version to another (initially two versions will be supported) and finally will benefit with a better resource utilization by using a smaller 2VCore machine.","feature_name":"Python notebook","last_modified":"2025-10-20","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-15","release_item_id":"0fe8ec31-4c20-f011-998a-0022480939f0","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Autoscale Billing for Spark in Microsoft Fabric (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/now-generally-available-autoscale-billing-for-spark-in-microsoft-fabric","feature_description":"New billing methodology for Spark Workload that matches what is available in Synapse and Fabric.","feature_name":"Spark Autoscale Billing Option for Fabric Spark - General Availability","last_modified":"2025-08-28","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-09-30","release_item_id":"365e47c9-c88c-ef11-ac21-002248098a98","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"allow user to write t-sql code to query connected Data Warehouse","feature_name":"t-sql magic command inside Python notebook","last_modified":"2025-06-30","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-06-30","release_item_id":"43025100-7421-f011-9989-6045bd030c4d","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Notebook Live Versioning","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/notebook-live-versioning","feature_description":"With live versioning Fabric Notebook developers can track the history of changes made to their notebooks, compare different verions and restore previous versions if needed.Live versioning is now GA.","feature_name":"Notebook live versioning","last_modified":"2025-06-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-06-27","release_item_id":"a4ad1c7d-1322-f011-9989-6045bd096807","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Variable Library Support in Notebook (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/variable-library-support-in-notebook-now-generally-available","feature_description":"With Notebooks integration with variables libraries, users can defines certain variable and associate values to it. For example, Notebooks can be attached to a default Lakehouse in a Dev workspacebut might want to use a different lakehouse for a Test workspace. This is now possible with no code changes.","feature_name":"Notebooks integration with variable libraries","last_modified":"2025-06-27","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-06-27","release_item_id":"541e051a-1322-f011-998a-0022480939f0","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"T-SQL Notebook in Fabric (Preview)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/announcing-public-preview-of-t-sql-notebook-in-fabric","feature_description":"Fabric notebooks support T-SQL language to consume data against Data Warehouse. By adding a Data Warehouse or SQL analytics endpoint to a notebook, T-SQL developers can run queries directly on the connected endpoint. BI analysts can also perform cross-database queries to gather insights from multiple warehouses and SQL analytics endpoints. T-SQL Notebooks offer a great authoring alternative to the existing tools to SQL users and include Fabric native features, like, sharing, GIT integration and collaboration.","feature_name":"T-SQL notebook","last_modified":"2025-06-20","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-06-20","release_item_id":"6e2bdf98-4c20-f011-998a-0022480939f0","release_status":"Shipped","release_type":"General availability"},{"active":true,"blog_title":"Fabric Spark Monitoring APIs (Generally Available)","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/general-availability-announcement-fabric-spark-monitoring-apis","feature_description":"The Public Monitoring API feature for Fabric Spark aims to expose Spark monitoring APIs, allowing users to monitor Spark job progress, view execution tasks, and access logs programmatically. This feature is aligned with the public API standards, providing a seamless monitoring experience for Spark applications.","feature_name":"Public monitoring APIs","last_modified":"2025-03-31","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-03-31","release_item_id":"7bf646ea-b1f8-ee11-a1fe-000d3a341a60","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":null,"blog_url":null,"feature_description":"Supporting a new source for users to install libraries. Through creating a custom conda/PyPI channel, which is hosted on their storage account, users can install the libraries from their storage account in their Fabric Environments.","feature_name":"Installing libraries from ADLS Gen2 Storage account","last_modified":"2025-02-28","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-02-28","release_item_id":"a53c2ff6-f894-ef11-8a6a-6045bd062aa2","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Notebook Live Versioning","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/notebook-live-versioning","feature_description":"With live versioning Fabric Notebook developers can track the history of changes made to their notebooks, compare different verions and restore previous versions if needed.","feature_name":"Notebook live versioning","last_modified":"2025-01-10","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2025-01-10","release_item_id":"0dfbf36c-0993-ef11-ac21-002248098a98","release_status":"Shipped","release_type":"Public preview"},{"active":true,"blog_title":"Announcing Python Notebook in Preview","blog_url":"https://blog.fabric.microsoft.com/en-us/blog/python-notebook-public-preview","feature_description":"Fabric notebooks support pure Python experience. This new solution is targeting BI developers and Data Scientists working with smaller datasets (up to a few GB) and using Pandas, and Python as their primary language. Through this new experience, they'll be able to benefit from native Python language and its native features and libraries out of the box, will be able to switch from a Python version to another (initially two versions will be supported) and finally will benefit with a better resource utilization by using a smaller 2VCore machine.","feature_name":"Python notebook","last_modified":"2024-11-29","product_id":"a731518f-36ca-ee11-9079-000d3a341a60","product_name":"Data Engineering","release_date":"2024-11-29","release_item_id":"6db09e13-b8f8-ee11-a1fe-000d3a340b2c","release_status":"Shipped","release_type":"Public preview"}],"links":{"first":"/api/releases?product_name=Data+Engineering&page_size=50&page=1","last":"/api/releases?product_name=Data+Engineering&page_size=50&page=2","next":"/api/releases?product_name=Data+Engineering&page_size=50&page=2","prev":null,"self":"/api/releases?product_name=Data+Engineering&page_size=50&page=1"},"pagination":{"has_next":true,"has_prev":false,"next_page":2,"page":1,"page_size":50,"prev_page":null,"total_items":62,"total_pages":2}}