A WORLD OF KNOWLEDGE. A NEW HORIZON.info@smart-horizon.eu
Digital Innovation and Transformation

Data Engineering Fundamentals: Pipelines and Data Platforms

Data engineering builds the pipelines and platforms that make data available for analytics and AI. This course explains data architecture, ingestion, ETL and ELT, data warehouses and lakehouses, data quality, orchestration, cloud data platforms and governance, with practical exercises.

5 days Classroom or live online English
Smart Horizon Certified - Global Leadership Consultants
Take the course details with you.

Download the full standard outline: why attend, methodology, objectives, audience, competencies, the daily outline and current plans.

Download course PDF
Why attend

From knowledge to real-world impact.

Analytics and AI initiatives depend on reliable data pipelines. This course gives analysts and IT professionals a practical understanding of how modern data platforms work.

Workplace challenges

Professional Problems This Course Is Designed to Solve

The programme explores practical approaches to the following challenges. Results depend on how the learning is applied in your organisation.

  • Difficulty translating subject knowledge into practical workplace decisions.
  • Inconsistent approaches to the activities covered in the course outline.
  • Lack of a structured plan for applying and reviewing new skills.
Course methodology

How you will learn.

The course combines concept sessions with guided labs, architecture design exercises and case studies.

Course objectives

What you'll take away.

By the end of this course, participants will be able to:

  • Explain modern data architecture concepts
  • Design data ingestion and integration pipelines
  • Understand ETL, ELT and data transformation
  • Compare data warehouses, data lakes and lakehouses
  • Implement data quality checks and orchestration
  • Apply governance and security to data platforms
Target audience

Who should attend.

This course is suitable for:

  • Data analysts moving into engineering
  • IT and database professionals
  • BI developers
  • Data project managers
  • Solution architects
Target competencies

Capabilities you will build.

Participants will develop competencies in:

  • Data architecture
  • Data pipelines
  • Data transformation
  • Data platforms
  • Data quality
  • Data governance
Course outline

Your learning journey.

A focused, practical outline with time to explore, apply and reflect.

Day 1Data Engineering Foundations

  1. 09:00–09:54Role of data engineering
  2. 09:54–10:48Data sources and types
  3. 10:48–11:00Batch and streaming
  4. 11:00–11:30Coffee break
  5. 11:30–12:12Batch and streaming (continued)
  6. 12:12–13:06Modern data stack
  7. 13:06–14:00Exercise: Data flow mapping

Day 2Ingestion and Integration

  1. 09:00–09:54APIs and connectors
  2. 09:54–10:48Change data capture
  3. 10:48–11:00File and database ingestion
  4. 11:00–11:30Coffee break
  5. 11:30–12:12File and database ingestion (continued)
  6. 12:12–13:06Integration patterns
  7. 13:06–14:00Lab: Building an ingestion pipeline

Day 3Transformation and Storage

  1. 09:00–09:54ETL versus ELT
  2. 09:54–10:48Data modelling for analytics
  3. 10:48–11:00Warehouses, lakes and lakehouses
  4. 11:00–11:30Coffee break
  5. 11:30–12:12Warehouses, lakes and lakehouses (continued)
  6. 12:12–13:06SQL transformations
  7. 13:06–14:00Lab: Transforming data

Day 4Quality and Orchestration

  1. 09:00–09:54Data quality testing
  2. 09:54–10:48Orchestration tools
  3. 10:48–11:00Monitoring and alerts
  4. 11:00–11:30Coffee break
  5. 11:30–12:12Monitoring and alerts (continued)
  6. 12:12–13:06Documentation
  7. 13:06–14:00Lab: Data quality checks

Day 5Platforms and Governance

  1. 09:00–09:54Cloud data platforms
  2. 09:54–10:48Security and access
  3. 10:48–11:00Cost management
  4. 11:00–11:30Coffee break
  5. 11:30–12:12Cost management (continued)
  6. 12:12–13:06Data governance
  7. 13:06–14:00Capstone: Data platform design

The timings provided are estimates and may vary depending on the number of participants and the discussions taking place during the sessions. They are indicative only and do not constitute a binding commitment.

Dates & venues

Find a session that works for you.

Confirmed dates accept registration requests. Tentative dates are enquiry only.

Istanbul 9 Nov - 13 Nov 2026
Confirmed dates
€2,650.-Register
Online Live virtual classroom 9 Nov - 13 Nov 2026
Confirmed dates
€1,250.-Register
Amsterdam 23 Nov - 27 Nov 2026
Confirmed dates
€2,540.-Register
Online Live virtual classroom 23 Nov - 27 Nov 2026
Confirmed dates
€1,250.-Register
Vienna 30 Nov - 4 Dec 2026
Confirmed dates
€2,940.-Register
Online Live virtual classroom 30 Nov - 4 Dec 2026
Confirmed dates
€1,250.-Register
Singapore 7 Dec - 11 Dec 2026
Confirmed dates
€2,820.-Register
Online Live virtual classroom 7 Dec - 11 Dec 2026
Confirmed dates
€1,250.-Register
London 14 Dec - 18 Dec 2026
Confirmed dates
€2,450.-Register
Online Live virtual classroom 14 Dec - 18 Dec 2026
Confirmed dates
€1,250.-Register
Dubai 11 Jan - 15 Jan 2027
Confirmed dates
€3,150.-Register
Online Live virtual classroom 11 Jan - 15 Jan 2027
Confirmed dates
€1,250.-Register
Frankfurt 25 Jan - 29 Jan 2027
Confirmed dates
€2,650.-Register
Online Live virtual classroom 25 Jan - 29 Jan 2027
Confirmed dates
€1,250.-Register
Kuala Lumpur 8 Feb - 12 Feb 2027
Confirmed dates
€1,450.-Register
Online Live virtual classroom 8 Feb - 12 Feb 2027
Confirmed dates
€1,250.-Register
Paris 22 Feb - 26 Feb 2027
Confirmed dates
€2,860.-Register
Online Live virtual classroom 22 Feb - 26 Feb 2027
Confirmed dates
€1,250.-Register
Cape Town 1 Mar - 5 Mar 2027
Confirmed dates
€1,890.-Register
Online Live virtual classroom 1 Mar - 5 Mar 2027
Confirmed dates
€1,250.-Register
Istanbul 8 Mar - 12 Mar 2027
Confirmed dates
€2,650.-Register
Online Live virtual classroom 8 Mar - 12 Mar 2027
Confirmed dates
€1,250.-Register
Amsterdam 22 Mar - 26 Mar 2027
Confirmed dates
€2,540.-Register
Online Live virtual classroom 22 Mar - 26 Mar 2027
Confirmed dates
€1,250.-Register
Singapore 12 Apr - 16 Apr 2027
Confirmed dates
€2,820.-Register
Online Live virtual classroom 12 Apr - 16 Apr 2027
Confirmed dates
€1,250.-Register
London 26 Apr - 30 Apr 2027
Confirmed dates
€2,450.-Register
Online Live virtual classroom 26 Apr - 30 Apr 2027
Confirmed dates
€1,250.-Register
Rome 3 May - 7 May 2027
Confirmed dates
€2,450.-Register
Online Live virtual classroom 3 May - 7 May 2027
Confirmed dates
€1,250.-Register
Dubai 10 May - 14 May 2027
Confirmed dates
€3,150.-Register
Online Live virtual classroom 10 May - 14 May 2027
Confirmed dates
€1,250.-Register
Frankfurt 24 May - 28 May 2027
Confirmed dates
€2,650.-Register
Online Live virtual classroom 24 May - 28 May 2027
Confirmed dates
€1,250.-Register
Kuala Lumpur 14 Jun - 18 Jun 2027
Confirmed dates
€1,450.-Register
Online Live virtual classroom 14 Jun - 18 Jun 2027
Confirmed dates
€1,250.-Register
Paris 21 Jun - 25 Jun 2027
Confirmed dates
€2,860.-Register
Online Live virtual classroom 21 Jun - 25 Jun 2027
Confirmed dates
€1,250.-Register
Rome 28 Jun - 2 Jul 2027
Confirmed dates
€2,450.-Register
Online Live virtual classroom 28 Jun - 2 Jul 2027
Confirmed dates
€1,250.-Register
Istanbul 12 Jul - 16 Jul 2027
Confirmed dates
€2,650.-Register
Online Live virtual classroom 12 Jul - 16 Jul 2027
Confirmed dates
€1,250.-Register
Amsterdam 26 Jul - 30 Jul 2027
Confirmed dates
€2,540.-Register
Online Live virtual classroom 26 Jul - 30 Jul 2027
Confirmed dates
€1,250.-Register
Singapore 9 Aug - 13 Aug 2027
Confirmed dates
€2,820.-Register
Online Live virtual classroom 9 Aug - 13 Aug 2027
Confirmed dates
€1,250.-Register
London 23 Aug - 27 Aug 2027
Confirmed dates
€2,450.-Register
Online Live virtual classroom 23 Aug - 27 Aug 2027
Confirmed dates
€1,250.-Register
Cape Town 30 Aug - 3 Sept 2027
Confirmed dates
€1,890.-Register
Online Live virtual classroom 30 Aug - 3 Sept 2027
Confirmed dates
€1,250.-Register
Dubai 13 Sept - 17 Sept 2027
Confirmed dates
€3,150.-Register
Online Live virtual classroom 13 Sept - 17 Sept 2027
Confirmed dates
€1,250.-Register
Frankfurt 20 Sept - 24 Sept 2027
Confirmed dates
€2,650.-Register
Online Live virtual classroom 20 Sept - 24 Sept 2027
Confirmed dates
€1,250.-Register
Kuala Lumpur 11 Oct - 15 Oct 2027
Confirmed dates
€1,450.-Register
Online Live virtual classroom 11 Oct - 15 Oct 2027
Confirmed dates
€1,250.-Register
Paris 25 Oct - 29 Oct 2027
Confirmed dates
€2,860.-Register
Online Live virtual classroom 25 Oct - 29 Oct 2027
Confirmed dates
€1,250.-Register
Barcelona 1 Nov - 5 Nov 2027
Confirmed dates
€2,840.-Register
Online Live virtual classroom 1 Nov - 5 Nov 2027
Confirmed dates
€1,250.-Register
Istanbul 8 Nov - 12 Nov 2027
Confirmed dates
€2,650.-Register
Online Live virtual classroom 8 Nov - 12 Nov 2027
Confirmed dates
€1,250.-Register
Amsterdam 22 Nov - 26 Nov 2027
Confirmed dates
€2,540.-Register
Online Live virtual classroom 22 Nov - 26 Nov 2027
Confirmed dates
€1,250.-Register
Singapore 6 Dec - 10 Dec 2027
Confirmed dates
€2,820.-Register
Online Live virtual classroom 6 Dec - 10 Dec 2027
Confirmed dates
€1,250.-Register
London 13 Dec - 17 Dec 2027
Confirmed dates
€2,450.-Register
Online Live virtual classroom 13 Dec - 17 Dec 2027
Confirmed dates
€1,250.-Register

Good to know

A few things to know.

How is the course delivered?

Our classroom programmes combine facilitated discussion, case studies, exercises and reflection. The precise format will be confirmed before enrolment.

Can you deliver this programme for our team?

Yes, you can enquire about a tailored programme. Share your goals, group size and preferred dates with our learning team.

Will I receive a certificate?

Participants who complete the programme receive a Smart Horizon certificate of attendance. Smart Horizon programmes are not externally accredited and do not award a professional qualification, licence or designation. Where a course title or outline refers to a professional certification (for example, AACE International's Certified Cost Professional), the programme supports learning and preparation only; the credential itself is awarded solely by the relevant professional body under its own application and examination requirements.

What should I confirm before booking travel?

Please confirm the session, exact venue, accessibility arrangements, fees and any visa requirements with the team before arranging travel. Tentative dates are not confirmed sessions.

Keep exploring

Your next horizon awaits.

All courses
Your next chapter starts here

Enquire about this course.

Send your selected programme and session to our learning team.

Your email app opens a draft. Nothing is sent until you send that email; no booking is created.