Data Engineer

About

Company provides cutting-edge trade surveillance technology that protects investors, enhances transparency, and ensures regulatory compliance across traditional financial assets and crypto markets.

The Role

Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.

As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.

Responsibilities

• Design and develop the data's team micro services - Java services running on K8S.
• Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
• Develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.
• Enrich financial data through third-party data integrations.
• Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.
• Plan and communicate integrations with other teams that consume the data and use it for insights creation.
• Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.

Required skills

• Education - BSc. in Computer Sciences from a top university, or equivalent.
• Java - Strong background as a software engineer with at least 2+ years experience with Java.
• DB - 8+ years in data engineering, and data pipeline development on high-volume production

environments.

• Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
• Experience in object-oriented development. Should have strong software engineering foundations.
• Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.
• Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.
• Experience with designing infrastructure to maintain high availability SLAs.
• Experience with monitoring and managing production environments.
• Strong communication skills.

Nice to have - Experience working in fintech or trading industries.