OpenSearch Engineer

Job Title: OpenSearch Engineer

Location: New York, NY

Position Overview

We are seeking a highly skilled OpenSearch Engineer with strong experience in AWS, .NET, and Python to design, build, optimize, and manage search and analytics solutions. The ideal candidate will have hands-on expertise with distributed systems, large-scale search infrastructures, and application development, while supporting enterprise-grade observability and indexing pipelines.

Key Responsibilities

• Design, deploy, and manage OpenSearch clusters for high availability, scalability, and performance.
• Create and optimize index mappings, analyzers, tokenizers, relevance models, and search queries.
• Implement OpenSearch ingestion pipelines using Logstash, FluentBit, Beats, or custom ETL.
• Architect and manage cloud infrastructure using:
• Amazon OpenSearch Service
• EC2, S3, Lambda, IAM, CloudWatch, Kinesis, MSK
• Automate provisioning using Terraform/CloudFormation (nice to have).
• Implement secure access controls, VPC design, and encryption strategies.
• Build real-time streaming pipelines for logs, metrics, and application data.
• Develop backend services, APIs, and data pipelines in Python and .NET (C#).
• Write microservices that interface with OpenSearch queries and aggregations.
• Build automation tools for cluster maintenance, indexing, and monitoring.
• Integrate OpenSearch with enterprise applications using SDKs/REST APIs.

Required Skills & Qualifications

• 6–8 years of hands-on experience with OpenSearch (or Elasticsearch).
• Strong knowledge of:
• Search indexing concepts
• Query DSL
• Aggregations
• Relevance tuning
• Solid experience with AWS cloud services.
• Strong programming skills in:
• Python
• .NET/C#
• Understanding of distributed systems and cluster architecture.
• Experience with CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins).
• Strong troubleshooting, analytical, and performance optimization skills.
• Knowledge of containers (Docker) and orchestration (Kubernetes/EKS) is a plus.