Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 21 hours
Course Outline
Enterprise Architecture and Pipeline Design
- Multi-layer ETL architectures
- Designing modular and reusable components
- Hybrid approaches across different systems
Advanced Performance Engineering
- Step-level optimization
- Parallelism and threading strategies
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Developing custom plugins
- Extending PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming integrations
- Working with big data platforms
- Advanced file and API processing
Data Governance, Security, and Compliance
- Securing transformations and credentials
- Data lineage and traceability
- Regulatory and compliance considerations
Enterprise Orchestration and Scheduling
- Managing large job networks
- Designing error recovery and failover mechanisms
- Environment-level orchestration
Repository, Version Control, and CI/CD
- Enterprise repository strategies
- Integrating PDI with Git
- Continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Promoting solutions across environments
- Utilizing operational tooling and dashboards
- Achieving end-to-end production readiness
Summary and Next Steps
Requirements
- A solid understanding of ETL pipelines and data modeling.
- Experience with intermediate-level PDI transformations.
- Strong SQL and scripting capabilities.
Audience
- Senior data engineers.
- ETL architects.
- Professionals managing complex data integration workloads.
Testimonials (1)
It's a hands-on session.
