Key skills
AWSAzureCloudDistributed SystemsDockerEC2ElasticSearchETLJenkinsKubernetesLogstashMicroservicesPythonTerraform.NETC#CGitHub ActionsEKSCloudFormationLambdaS3IAMCloudWatchKinesisAzure DevOpsElasticsearchGitHubPerformance OptimizationCI/CD
About this role
Role Overview
- Design, deploy, and manage OpenSearch clusters for high availability, scalability, and performance.
- Create and optimize index mappings, analyzers, tokenizers, relevance models, and search queries.
- Implement OpenSearch ingestion pipelines using Logstash, FluentBit, Beats, or custom ETL.
- Architect and manage cloud infrastructure using:
- Amazon OpenSearch Service
- EC2, S3, Lambda, IAM, CloudWatch, Kinesis, MSK
- Automate provisioning using Terraform/CloudFormation (nice to have).
- Implement secure access controls, VPC design, and encryption strategies.
- Build real-time streaming pipelines for logs, metrics, and application data.
- Develop backend services, APIs, and data pipelines in Python and .NET (C#).
- Write microservices that interface with OpenSearch queries and aggregations.
- Build automation tools for cluster maintenance, indexing, and monitoring.
- Integrate OpenSearch with enterprise applications using SDKs/REST APIs.
Requirements
- 6–8 years of hands-on experience with OpenSearch (or Elasticsearch).
- Strong knowledge of:
- Search indexing concepts
- Query DSL
- Aggregations
- Relevance tuning
- Solid experience with AWS cloud services.
- Strong programming skills in:
- Python
- .NET/C#
- Understanding of distributed systems and cluster architecture.
- Experience with CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins).
- Strong troubleshooting, analytical, and performance optimization skills.
- Knowledge of containers (Docker) and orchestration (Kubernetes/EKS) is a plus.
Tech Stack
- AWS
- Azure
- Cloud
- Distributed Systems
- Docker
- EC2
- ElasticSearch
- ETL
- Jenkins
- Kubernetes
- Logstash
- Microservices
- Python
- Terraform
- .NET