Cloud Data Driven

### Don't Repeat Yourself, how custom Python modules in Microsoft Fabric give you back hours every day

#### Description

Warning! This session may contain very DRY content!

Dont Repeat Yourself, or DRY, is a concept in software engineering that governs the way software is written by stating that you should never repeat yourself.

As a data engineer working with Microsoft Fabric, when you start building a data lakehouse you will be writing a lot of code to connect to source systems, copy and transform data, and orchestrate your ELT process.

Fabric allows you to write custom Python modules that can be called from within your notebooks, in order to streamline these processes.

Never again you'll have to write the same function twice again!

In this very practical session we will dive deep into:
1. Creating a very simple Python module using Visual Studio Code
2. Publishing our Python module to Microsoft Fabric
3. Calling functions in Python from Fabric notebooks

After this session you will go home never having to repeat yourself again, because you will be writing reusable Python modules for all your data engineering needs.

### Securing the Cloud with AI-Powered Contextual Key Generation

#### Description

In the rapidly evolving field of cloud security encryption of data plays a key role in maintaining confidentiality and integrity. This is particularly crucial in scenarios involving sensitive data where the importance of encryption in rest and transit is even greater. As cloud technologies advance, the risk of data breaches is also increasing due to sophisticated threats. In the domain of encryption, the process of generating and managing the encryption keys is crucial. Traditional methods of encryption key generation cannot adapt to the dynamically changing security needs of cloud environments. This limitation poses a risk of vulnerabilities. This talk discussed AI-based approach to generate encryption based on contextual data such as the time of the day, user location, and network security levels. This method not only ensures that each key is uniquely generated to meet the security demands of individual sessions but also significantly reduces the risks associated with key reuse and predictions. By integrating AI into the key generation process the aim is to provide a more robust and adaptive security solution that responds intelligently to varying threat environments and user contexts.

### Left-Shift Analytics: Mastering Real-Time Power BI Dashboards in Microsoft Fabric

#### Description

Revolutionize your approach to real-time data visualization in this cutting-edge session on creating high-performance Power BI dashboards with Microsoft Fabric's Real-Time Intelligence. Learn how to shift your analytics paradigm by pushing logic to the KQL database, optimizing performance, and leveraging advanced techniques for scalable, real-time reporting.

We'll explore:

1. The paradigm shift: Moving from traditional analytical reports to real-time, KQL-driven dashboards
2. Leveraging Direct Query mode for KQL databases in Fabric Real-Time Intelligence
3. Using Functions in KQL for efficient data retrieval at scale
4. Utilizing Dynamic M parameters to connect Power BI dashboards to parameterized KQL queries
5. Monitoring and optimization of KQL queries
6. Best practices for filter design, including how to really make the "Select All" option work
7. Finally, a demo of connecting Power BI to time series data in Fabric's Real-Time Intelligence

This session is ideal for Power BI developers, data engineers, and analytics professionals looking to push the boundaries of real-time reporting. You'll gain practical insights into creating blazing-fast dashboards that can handle large-scale, time-sensitive data, and learn how to effectively "shift left" your analytics for optimal performance in Microsoft Fabric.

Whether you're new to real-time analytics or looking to refine your skills, this session will equip you with the knowledge to create cutting-edge, performant dashboards that leverage the full power of Fabric's Real-Time Intelligence capabilities.

Revolutionizing Data Engineering & Analytics with Agentics AI by Jean Joseph

Description
Dive into the future of data management with our hands-on session featuring Agentics AI, powered by Microsoft Autogen, PHI-3 Mini and Azure OpenAI. This presentation showcases a groundbreaking dual-agent system designed to optimize your data workflow.

The first AI agent expertly manages the entire data engineering lifecycle—from generating SQL code and data ingestion to cleansing, transformation, and storage—ensuring a robust and efficient data pipeline. Meanwhile, the second AI agent harnesses advanced analytical techniques to extract insights, create compelling visualizations, and deliver actionable business intelligence.

Join us for practical demonstrations that illustrate how this innovative approach not only streamlines processes but also empowers data professionals to elevate their backend operations. Whether you’re looking to enhance your data strategy or explore cutting-edge AI solutions, this session is tailored for you!