Data Engineer II

Data Engineer II

General Summary:

The Data Engineer II is involved in building and implementing data pipelines from source systems to the Enterprise Data Warehouse. Working closely with other Data Engineers, Architects, Data Analysts, and others to determine what data is needed for analysis and consumption. The Data Engineer II maintains data pipelines to scale analytics products from lab to production.

Principal Duties and Responsibilities:

• Creates and manages ETL pipelines using Azure Data Factory to extract, transform, and load data from various sources into the data warehouse.
• Maintains data transformation processes (ETL, SQL stored procedures, etc.) to support operational data flows.
• Collaborates with data engineers and data scientists to ensure data consistency, quality, and availability for analytical and reporting purposes.
• Participates in the evaluation, selection, and integration of new technologies and tools to enhance the database environment.
• Troubleshooting and resolving data warehouse related issues in a timely manner.
• Documenting database design, architecture, and processes for future reference.

Minimum Knowledge, Skills and Abilities Required

• Knowledge at a level normally acquired through the completion of a Bachelor's degree in Data Analytics, Information Management or Computer Science preferred, or equivalent experience.
• 2-4 years of experience in data engineering on a cloud-based platform required.
• Hands-on experience with ETL processes and tools, particularly Azure Data Factory required.
• Experience as a Database Developer, with a focus on Azure and SQL Server technologies preferred.
• Proficiency in writing and optimizing SQL queries, stored procedures, and functions preferred.
• Familiarity with data warehousing concepts and methodologies preferred.
• Knowledge of data modeling, normalization, and database design principles preferred.
• Strong communication and collaboration abilities within cross-functional teams.
• Experience working in an agile environment preferred.
• Demonstrates a commitment to diversity and inclusion. Promotes an environment of empathy and respect, ensures the inclusion of all team members, and will actively engage in D&I events and learning opportunities.
• Theoretical knowledge of Snowflake is a plus.

Working Conditions:

Requires daily interaction with PCs and data processing software for majority of duties. Must be able to quickly respond to problems that affect data processing availability, occasionally requiring work outside the Bank's normal business hours (i.e. weekends, evenings or early morning). Occasional travel for system meetings.

Notation: This position has been identified as "high risk" as outlined in the Bank's Background Check policy. Individuals occupying this position will be required to submit to a background check biennially. Such repeat background check(s) are considered a "condition of continued employment".