Data Engineer

Job Title: Data Engineer

Location: Montreal, QC (4x onsite a week)

Employment Type: Contract

Pay Rate: CAD$55 - $65/HR INC

Interview Type: Face 2 Face (Onsite Interview Only)

Job Description

As Senior Data Engineer you will be a member of the ADE Data development team with specific focus on developing data solutions for NonFinancial Risk Technology within Morgan Stanley In this role you will be primarily responsible for the design implementation and support of data workflows ETL pipelines using Spark, Scala, PySpark, Python APIs Libraries Views and Stored procedures in addition to performing data and process analysis and monitoring and tuning queries and data loads You will be working closely with data providers data scientists developers and data analytics teams to facilitate the implementation of client specific business requirements and requests

Key Responsibilities

* Design implement and maintain Spark, Scala, PySpark, Python components flows codebases in support of various requirements both from business and technical users

* Design implement and maintain RDBMS databases ensuring optimal performance scalability and data integrity

* Monitor and optimize data access and storage patterns for performance identifying and resolving bottlenecks and implementing performance tuning techniques

* Strong communication skills both verbal and written Capable of collaborating effectively across a variety of IT and Business groups across regions and roles and able to interact effectively with all levels

* Strong analytical skills including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions

* Write complex SQL queries to analyze data and create views for reporting purposes for downstream consumers

* Implement and enforce data security and access controls ensuring compliance with industry standards and regulations

* Self starter Proven ability to manage multiple concurrent projects with minimal supervision Can manage a complex ever changing priority list and resolve conflicts to competing priorities

* Strong problem solving skills Ability to identify where focus is needed and bring clarity to business objectives requirements and priorities

* Conduct database capacity planning forecasting future requirements and implementing necessary scaling strategies

* Troubleshoot and resolve complex database related issues collaborating closely with development and operations teams

* Use GIT and Jenkins CICD pipeline for Automated code deployment

* Experience with Agile development methodologies

Minimum Qualifications

* Bachelors degree in engineering technology or computer applications

* 12 years of experience in developing data components and pipelines using Spark, Scala, PySpark, Python and SQL

* Proficient in SQL query writing

* Solid understanding of relational databases Snowflake

* Familiarity with software development life cycle SDLC

* Excellent communication skills and ability to think independently

* Strong skills in presenting to stakeholders

Additional Qualifications Skills

* Knowledge and experience with Amazon Web Services AWS S3

Disclaimer: AI tools may assist in the recruitment process; however, all hiring decisions are made by the recruitment team based on a comprehensive evaluation of candidates.