Snowflake Cloud DWH Engineer
Capgemini
Date: 3 weeks ago
City: Montreal, QC
Contract type: Full time
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Team Overview
The Controls Engineering, Measurement and Analytics (CEMA) department is responsible for Cyber Risk and Control assessment, management, monitoring, and reporting capabilities across Technology, resulting in risk reduction and better oversight of the technology risk landscape of the firm. Our work is always client focused; our engineers are problem-solvers and innovators. We seek exceptional technologists to help deliver solutions on our user-facing applications, data stores, and reporting and metric platforms while being cloud-centric, leveraging multi-tier architectures and aligning with our DevOps and Agile strategies.
Role Summary
Storing data from different technology systems across the firm into a centralized data platform that empowers various reporting and analytics solutions for the Technology Risk functions. In this role you will be primarily responsible for contributing to the development of our Cloud Data Warehouse utilizing Snowflake and Python-based tooling. You will also be responsible for the design and development of our data warehouse utilizing Snowflake capabilities such as data sharing, time travel, Snow Park, workload optimization across analytic and AI use-cases, and the ingestion and storage of structured and unstructured data. You will also work on the integration of our Snowflake data warehouse with existing internal platforms for data quality, data cataloging, data discovery, incident logging, and metric generation. You will be working closely with data warehousing leaders, data analysts, ETL developers, infrastructure engineers, and data analytics teams to facilitate the implementation of this data platform and data pipeline framework.
Key Responsibilities
Capgemini is an Equal Opportunity Employer committed to diversity, equity, and inclusion in the workplace. We promote fairness, accessibility, inclusion, and respect through our Partnership Accreditation in Indigenous Relations (PAIR) Committee, which supports meaningful engagement with Indigenous communities across Canada. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment.
All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status, or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
Team Overview
The Controls Engineering, Measurement and Analytics (CEMA) department is responsible for Cyber Risk and Control assessment, management, monitoring, and reporting capabilities across Technology, resulting in risk reduction and better oversight of the technology risk landscape of the firm. Our work is always client focused; our engineers are problem-solvers and innovators. We seek exceptional technologists to help deliver solutions on our user-facing applications, data stores, and reporting and metric platforms while being cloud-centric, leveraging multi-tier architectures and aligning with our DevOps and Agile strategies.
Role Summary
Storing data from different technology systems across the firm into a centralized data platform that empowers various reporting and analytics solutions for the Technology Risk functions. In this role you will be primarily responsible for contributing to the development of our Cloud Data Warehouse utilizing Snowflake and Python-based tooling. You will also be responsible for the design and development of our data warehouse utilizing Snowflake capabilities such as data sharing, time travel, Snow Park, workload optimization across analytic and AI use-cases, and the ingestion and storage of structured and unstructured data. You will also work on the integration of our Snowflake data warehouse with existing internal platforms for data quality, data cataloging, data discovery, incident logging, and metric generation. You will be working closely with data warehousing leaders, data analysts, ETL developers, infrastructure engineers, and data analytics teams to facilitate the implementation of this data platform and data pipeline framework.
Key Responsibilities
- To design, develop, and manage our Snowflake data warehouse.
- To contribute towards the establishment of best practices for the optimal and efficient usage of Snowflake with tooling like Airflow, DBT and Spark.
- To assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling.
- To monitor the performance of queries and data loads and perform tuning as necessary.
- To provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related field required.
- At least 10 years of experience in data development and solutions in highly complex data environments with large data volumes.
- At least 7 years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
- At least 5 years of experience with developing data solutions on Snowflake.
- At least 3 years of data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
- At least 3 years of experience developing solutions in a hybrid data environment (on-Prem and Cloud)
- Hands on experience with Python must.
- Hands on experience with Airflow (or similar tools like Dagster) a must.
- Snowflake SnowPro Core a must
- Snowflake SnowPro Advanced Architect and Advanced Data Engineer a plus.
- Hands on experience with DBT a plus.
- Experience with performance tuning SQL queries, Spark job, and stored procedures.
- An understanding of E-R data models (conceptual, logical, and physical).
- Understanding of advanced data warehouse concepts (Factless Fact Tables, Temporal \ Bi-Temporal models, etc.) a plus.
Capgemini is an Equal Opportunity Employer committed to diversity, equity, and inclusion in the workplace. We promote fairness, accessibility, inclusion, and respect through our Partnership Accreditation in Indigenous Relations (PAIR) Committee, which supports meaningful engagement with Indigenous communities across Canada. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment.
All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status, or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resume