ETL Developer

Duration: 18 Months extension possible based on needs and performance

Job Title: ETL Developer

Location: New York NY 10271

9 AM to 5 PM Monday Friday

Job Summary:

Client seeks an experienced consultant that can:

• Extract geographic and non-geographic data from Oracle and SQL Server databases ensuring the integrity and quality of the data.
• Transform raw data into structured formats suitable for analysis reporting and system integration.
• Design and implement data pipelines for efficient handling of large datasets.
• Automate ETL integrations using SQL Server Integration Services (SSIS).
• Perform data analysis to drive key business objectives.
• Document ETL processes data models and API specifications for transparency and knowledge sharing.
• Develop test and maintain ETL workflows and scripts to automate data processing.
• Monitor ETL processes to ensure reliability scalability and performance.
• Perform data modeling and database design for application development and product implementation initiatives under the guidance of Database Administrator and Architect.
• Create reporting solutions using SQL Server Reporting Services (SSRS) by analyzing user needs and information availability.
• Troubleshoot and resolve data-related issues promptly.
• Create APIs to enable data access and integration with various applications and systems.
• Ensure APIs are secure performant and adhere to industry standards.
• Collaborate with developers and analysts to design API endpoints that meet business requirements.
• Work with GIS analysts developers and stakeholders to understand data requirements.
• Participate in requirements definition analysis and design.
• Work closely with business analysts subject matter experts and development teams in design development testing implementation and support of application projects.
• Facilitate creation migration and maintenance of database objects across development/ QA/ production environments.
• Follow best practices in data modeling including use of standard naming conventions processes and templates to ensure consistency of data models.
• Monitor and optimize database performance and capacity utilization to provide high availability and redundancy.
• Take ownership of database performance scalability and security.
• Define and implement data testing strategies with business stakeholders application development teams and QA groups.
• Participate in the software testing process including identification and resolution of defects.
• Contribute to and support roll-out strategies.
• Participate in and contribute to formal/informal technical reviews and presentations.
• Accurately estimate time required to complete development tasks.
• Demonstrate the ability to cooperate with a variety of people and achieve results.
• Mentor and guide development team members on database-related tasks.
• Provide technical support and knowledge transition to team members and end users as needed.
• Communicate effectively with team members stakeholders and project managers to gather requirements provide updates and manage expectations.
• Create and maintain technical documentation including system designs workflows and user guides.
• Ensure solutions comply with industry best practices standards and security protocols.
• Prepare documentation and conduct knowledge transition to support adoption across the organization and other city agencies.
• Stay current with industry trends and emerging technologies to propose innovative solutions and improve development processes.

REQUIRED QUALIFICATIONS SKILLS AND EXPERIENCE

• Bachelors degree in Computer Science Software Engineering Information Systems Geographic Information Systems (GIS) or a related field. Masters degree is a plus.
• Minimum of 4 years as ETL Developer Data Engineer or similar role with a focus on geographic data.
• Proficiency in T-SQL and PL/SQL with experience working with Microsoft SQL Server Oracle and PostgreSQL databases.
• Familiarity with SSRS SSAS SSIS and data warehousing concepts like ETL Dimensions Facts Cubes.
• Demonstrated knowledge of designing developing and integrating databases data warehouses and multidimensional databases in MS-SQL Server.
• Knowledge of data integration patterns database design and data modeling principles.
• Strong programming skills in Python C# or other relevant languages for ETL and API development.
• Experience with API frameworks (e.g. Flask FastAPI or Django REST Framework).
• Experience with geographic data formats (e.g. shapefiles GeoJSON) and geospatial tools (e.g. ArcGIS QGIS).
• Experience with cloud platforms (e.g. AWS Azure GCP) and related data services.
• Familiarity with ETL tools like Talend Apache Nifi or Informatica.
• Ability to write and optimize complex SQL queries stored procedures triggers and functions.
• Experience in code migration database change management and data management through the various stages of the development life cycle.
• Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub.
• Experience with version control and release management practices.
• Excellent problem-solving collaboration and communication skills.
• Experience with MS-SQL Server PostgreSQL Oracle and/or other geospatial databases.
• Ability to collaborate effectively within a team environment.
• Strong knowledge of software architecture principles design patterns and best practices.
• Familiarity with DevOps practices and tools for continuous integration and delivery.
• Familiarity with application lifecycle management (ALM) tools such as Azure DevOps and GitHub extensions.
• Experience with version control using Git and GitHub and release management practices.
• Excellent problem-solving skills and ability to work effectively in a collaborative team environment.
• Strong communication skills both written and verbal.
• ETL certifications on Microsoft SQL Server or Oracle will be a plus.
• Demonstrated experience working with technical and non-technical staff.