Get in Touch
 Duration 21 hours

Course Outline

Introduction to OpenSearch Scaling Principles

  • Review of OpenSearch architecture and core components
  • Understanding scaling dimensions: vertical versus horizontal

Cluster Architecture and Design Patterns

  • Designing large-scale, multi-node clusters
  • Shard allocation, replication, and fault tolerance strategies
  • Cross-cluster search and replication approaches

Indexing and Data Management at Scale

  • Building efficient data ingestion pipelines
  • Managing hot, warm, and cold storage tiers
  • Index lifecycle management and rollover policies

Performance Optimisation and Benchmarking

  • Measuring and improving query latency and throughput
  • Configuring heap sizing, thread pools, and circuit breakers
  • Utilising Rally and Performance Analyzer for benchmarking

Monitoring, Observability, and Alerting

  • Monitoring metrics using OpenSearch Dashboards
  • Integration with Prometheus, Grafana, and CloudWatch
  • Developing automated alerts for critical thresholds

Security and Access Control at Scale

  • Implementing fine-grained, role-based access control
  • Managing certificates and encrypted communications
  • Auditing and compliance best practices

Scaling in the Cloud with AWS OpenSearch Service

  • Automating cluster scaling with AWS
  • Integrating IAM, VPC, and CloudFormation
  • Hybrid federation of on-premises and AWS OpenSearch clusters

Disaster Recovery, Backup, and Maintenance

  • Snapshot and restore strategies
  • Addressing node failures and cluster instability
  • Automated cluster maintenance and upgrade procedures

Summary and Next Steps

Requirements

  • A solid understanding of distributed database principles
  • Hands-on experience with Linux or cloud infrastructure administration
  • Familiarity with REST APIs and JSON data exchange

Target Audience

  • DevOps and Site Reliability Engineers
  • Data Engineers and Backend Developers
  • Cloud Architects overseeing large-scale search infrastructure

Number of participants


Price per participant

Testimonials (1)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories