Practitioner Workshop – How to Deliver Continuous Enterprise Data

Your organization wants an enterprise data ecosystem that enables better-informed, data-driven decision-making. You also want to operationalize effective artificial intelligence (AI) to streamline your workflow, better serve customers, and improve the bottom line. To accomplish these goals, you need continuous enterprise data.

This two-day, interactive workshop teaches students how to build and evolve a continuous enterprise data pipeline. A continuous enterprise data pipeline delivers up-to-date, high-quality data from across the organization to the right data consumers on an as-needed, when-needed basis, while reflecting their changing needs in a timely manner.

Data teams are increasingly asked to do more, do it faster, and produce higher-quality results. In this workshop, we work through a disciplined hybrid approach that adopts ways of working (WoW) and ways of thinking (WoT) from agile, lean, and traditional sources. We apply Data Vault 2.1 strategies to ensure a scalable, auditable, and, most importantly, future-proof solution.  Students will work through the delivery lifecycle from beginning to end, starting with a hybrid agile approach and evolving it into a lean, continuous-delivery WoW.

What You Will Learn in How to Deliver Continuous Enterprise Data

    • Understand common challenges faced by enterprise data teams and practical strategies for overcoming them
    • Identify the roles of a continuous enterprise data team
    • Discover how to organize and lead a continuous enterprise data team
    • Identify how to support data-driven decision-making and artificial intelligence (AI) operationalization
    • Learn an effective way of working (WoW) for your team, combining agile, lean, and traditional strategies to do so
    • Learn how to take an optimal approach to initial requirements modelling, architectural modelling, and planning that fits your context
    • Discover how enterprise metadata – in particular taxonomy, ontology, and data lineage information – should be leveraged and evolved
    • Learn how to write question stories, a form of user story that is tailored for continuous enterprise data delivery
    • Explore DataOps practices and see how to apply them in practice
    • Discover how to successfully deliver the first release of your enterprise data solution
    • Learn how to adopt a continuous delivery approach for subsequent releases
    • Learn how lean, non-invasive governance strategies are required for continuous enterprise data teams to succeed

Logistics

    • Length: 2 days – 16 hours class time (exclusive of breaks)
    • Delivery strategy: On premises

Audience

This workshop is designed for data professionals who want to learn how to build a continuous enterprise data pipeline in their organization.

Prerequisites

    • An understanding of data and database fundamentals is required. Students are expected to be familiar with basic data terminology and techniques, including the ability to read a data model.
    • An understanding of Agile and Lean is very useful. We will review key concepts and ways of working (WoW), particularly those from Disciplined Agile (DA), that are applicable to DW teams. You may want to read the short book Choose Your WoW! 2/e to learn about the fundamentals of DA
    • Knowledge of DataVault2 (DV2) is very useful. In the workshop, we learn and apply key architecture and design heuristics from DV2.

Detailed Outline of How to Deliver Continuous Enterprise Data

Foundational Concepts

      • Definitions of key terms used throughout the workshop
      • Agile and lean ways of thinking (WoT) for data teams
      • Explore common challenges faced by data teams
      • The needs of human data consumers
      • The needs of AI data consumers

Roles on Continuous Enterprise Data Teams 

      • Primary and supporting roles
      • Responsibilities
      • How to build an effective team

Choosing the Right Lifecycle

      • Comparing traditional, Scrum, and Kanban-based approaches
      • Comparing project and continuous delivery approaches
      • The traditional and agile project lifecycles for enterprise data teams
      • The lean continuous delivery lifecycle for enterprise data teams

Initial Requirements for Enterprise Data

      • Question stories as thin slices of value
      • Agile data mapping/lineage
      • Working with your enterprise taxonomy and ontology
      • Initial agile data modelling
      • Identifying when you are “done” for now

Initial Architecture for a Continuous Enterprise Data Pipeline

      • Overview of the DataVault 2 architecture strategy
      • Legacy data source modelling
      • Clean data architecture
      • Initial cost and schedule guesstimation
      • Proving your architecture with a walking skeleton

How to Implement a Question Story 

      • The user-facing BI solution
      • Identifying acceptance criteria
      • Domain modelling to physical data modelling
      • Leveraging and evolving enterprise metadata
      • Clean database design
      • Writing acceptance tests

Working in Sprints: Overcoming the Challenges 

      • Common Scrum ceremonies
      • The workflow of a sprint for an enterprise data team
      • How to handle incoming data quality (DQ) problems
      • Look-ahead data analysis
      • Updating your guesstimates
      • Deployment planning

DataOps Practices for Data Engineering

      • Database refactoring to pay down data debt
      • Automated database testing
      • Continuous database integration
      • Continuous database deployment

Putting it All together: A Disciplined Sprint 

      • Making sprints work in practice
      • Parallel independent testing
      • Lean data governance

Deployment

      • Getting ready to deploy for the first time
      • (Almost) continuous database deployment
      • Deploying data infrastructure updates

Evolving Your Production DW

      • From project to product
      • Beyond agile: Lean continuous enterprise data delivery

Wrap Up

      • Where to go from here

Do You Want How to Deliver Continuous Enterprise Data Taught In Your Organization?

Great!  Please contact me and we’ll make this happen.

Related Offerings