I invite all of you to peer-to-peer mastermind sessions about Azure Data Platform. Instead of only me sharing various insights about data platforms, we can learn from each other.
Sign up to get details
- My request is to keep the discussions vendor neutral
- Focus on pragmatic examples - we are engineers, data scientists, architects, managers.
- No slides. I expect a free-flowing discussion. Though it’s totally OK if you want just to listen in.
- No recording. I value your privacy and it’s all about learning from each other.
When: Thursday, May 13 (9:00 AM PT; 6:00 pm CET)
Duration: 60 mins
How do you define DataOps? What approaches do you use? Are there any brilliant tools available that simplify processes? Etc.
Sign up to get details
Data governance is a very broad subject, many layers of abstractions, interpretations, countless rabbit holes…
But on the other hand, the number of messages and requests to start with such topic only indicates the need of looking the devil in the eye ;)
Here are a few points I noted down for myself during the meeting:
- Data Governance is a very loaded term with a lot of baggage. Metadata management is a better concept to start with.
- Data Governance is like agile methodology in its early days. To achieve success, there has to be buy-in at the top of the organization, but also data practitioners’ commitment.
- Until people don’t see benefits of governance, it will be perceived as a burden that no one wants to do. Instead, focus on showcasing value proposition that you get with proper governance in place.
- Documenting measures & data is as important as the data itself.
- Even the best data catalog product is useless if users don’t contribute. Get your community excited about it. Make the processes of documenting data “sexy”. Enable crowdsourcing, award users for contributions with gamification.
- It’s better to build momentum, spark interest in data catalog and value of metadata before buying an expensive COTS offering. Wikipedia page with described data definitions and terms is a great place to start.
- Data engineers can’t be left alone to take care of all governance nuances. They need support and close collaboration from business, data stewards, data consumers.
- “Data Management at Scale” by Piethein Strengholt
- “Non-Invasive Data Governance” by Robert S. Seiner
- “Data Management Body of Knowledge” DAMA-DMBOK
The latest set of Azure Data Platform best practices - April 2021
A simple blog post evolved to 25+ page guide with 75+ different recommendations.