Technical Lead

Job Title :: Technical Lead

Location :: Fort Mill, SC || New York, NY || Austin, TX (3-4 days onsite)

Job Type :: Full time

About the Role

We’re looking for a hands-on Technical Lead who lives and breathes AWS data engineering and modern AI. You’ll architect, design, and deliver cutting‑edge data + AI solutions while guiding a sharp team of engineers. If Glue jobs, PySpark magic, serverless wizardry, Python scripts and AI/ML operationalization excite you—you’ll feel right at home.

What You’ll Own & Lead:

Architecture & Delivery

· Drive end‑to‑end architecture for ingestion, transformation, analytics, and AI‑powered data products.

· Set the standards, patterns, and roadmaps that shape our data future.

Hands-on Engineering

· Build high‑performance ETL/ELT pipelines using AWS Glue, Python, and PySpark.

· Craft serverless data services with Lambda, API Gateway & Step Functions.

· Tune Athena, optimize S3 layouts, and lead complex data migrations like a pro.

AI/ML Enablement

· Bring AI into real products: RAG pipelines, embeddings, inference endpoints, and more.

· Partner with Data Scientists & ML Engineers to operationalize models with MLOps best practices.

Quality, Security & Reliability

· Champion testing, data quality, observability, and lineage.

· Enforce security‑by‑design with IAM, KMS, VPC endpoints, masking, and tokenization.

Leadership & Collaboration

· Mentor engineers, lead sprints, and elevate the team’s technical bar.

· Work closely with Product, Security, and Architecture to turn ideas into reality.

What we are looking for

· 10+ years in data engineering/backend engineering, including 4+ years leading technical teams and driving architecture decisions.

· Deep, hands‑on expertise across AWS Data services & AI:

· AWS Glue (Jobs, Crawlers, PySpark), Lambda (Python), Athena, S3, Glue Data Catalog § Python for data engineering (PySpark) and service development

· ETL/ELT design patterns, orchestration (Step Functions / Airflow), and dimensional + Lakehouse modeling § Data migration strategies, validation frameworks, and rollback planning

· Data lake architecture: Parquet, partitioning, with familiarity in Iceberg

· IaC with Terraform / AWS CDK and CI/CD pipelines (CodePipeline, GitHub Actions, Azure DevOps)

· Hands‑on experience with modern AI technologies and emerging AI tooling

About US:

Incedo is a US-based consulting, data science and technology services firm with over 2,000 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.

Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities are also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.

We are an Equal Opportunity Employer:

We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Shubhi Srivastava

Talent Acquisition

Mobile (US): +1. 551 501 3536 | Email: [email protected] |

100 Campus Dr, Florham Park, New Jersey 07932, US