End-to-End Analytics Platform

As part of my plan for Real Projects. I recently came across a few very interesting links for inspiration:

• Data Platform End-to-End – Microsoft Docs
• DataDevOps for the Modern Data Warehouse on Microsoft Azure – Lace Lofranco – YouTube
• Analytics end-to-end with Azure Synapse – Azure Example Scenarios | Microsoft Docs
• MLOps for Python models using Azure Machine Learning – Azure Reference Architectures | Microsoft Docs

Now I don’t have much experience in any of those areas. It got me thinking though. What if I used a mash up of those architectures, technologies, and processes to build and learn about an end-to-end analytics platform. Source to AI/API.

So that’s the plan. I am going to work on build a project that can try bring together those services in a single project. Along the way I am thinking about not only learning about the technologies but about the processes and methodologies that surround them such as DevOps/DataOps/MLOps.

As I get my hand dirty with learning these things the code can be found here: data-gauntlet 🐱‍👤