Senior Data Engineer - PySpark and Python at SAP

We help the world run better

At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

We are looking for a Senior Data Engineer to bridge the gap between data engineering and business analytics. This role requires building robust data pipelines, integrating disjointed data sources, and generating meaningful insights to drive key business and product decisions.

You will design and maintain data infrastructure, ensuring that clean, reliable, and structured data is readily available for decision-making. Additionally, you will build reports, dashboards, and assess. You will be working closely with the science, engineering and product teams to measure product success and improve performance.

This is a high-impact individual contributor role for someone who thrives in a fast-paced, data-driven environment, with a passion for both engineering and analytics.

Required Skills And Experience

• 5+ years of data engineering experince
• Highly experienced with data-driven decision making
• Proficient in analytics and data visualization, experienced with stakeholder communication
• Experience developing dashboards, reports, and data models to help teams track product performance and business health.
• Proficient in PySpark, SQL, Python
• Proficient in AWS tooling, including Glue, RedShift, Dynamo, Athena (SQL). Alternatively, experience with serverless data management in other cloud platform, e.g. Azure, Google Cloud
• Experienced with implementation, maintenance and conducting queries of distributed production-grade python applications, preferably on top of big data
  
  

Preferred Skills And Experience

• Experience with Databricks or Delta Lake
• Experience with vector database
• Experience with data privacy and its implementation in data pipelines
  
  

Tasks

In this job, you will work closely with the central data science team at SAP Concur and the Concur Spend product team to identify gaps in current data collection, initiate new data streams and build infrastructure to collect, join and explore data to deliver insights to influence product development directions and priorities. You will also work closely with machine learning scientists and build distributed production-grade data pipelines that support at-runtime usage of big data in AI-driven product features. Specifically, you will

• provide insights into customer behavior, feature adoption, and operational efficiency.
• define key success metrics and establish best practices for data-driven decision-making.
• partner with product managers, engineers, and leadership to identify business pain points, actionable insights, define and track KPIs.
• use data to drive feature prioritization, roadmap planning, and go-to-market strategies.
• build a distributed large-scale, production-grade data pipeline on big data in AWS
• maintain a robust and scalable data pipeline to ensure it meets needs from product, data privacy and compliance perspective
  
  

Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: [email protected].

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

SAP believes the value of pay transparency contributes towards an honest and supportive culture and is a significant step toward demonstrating SAP’s commitment to pay equity. SAP provides the annualized compensation range inclusive of base salary and variable incentive target for the career level applicable to the posted role. The targeted combined range for this position is 102400 - 214,300 (CAD) CAD. The actual amount to be offered to the successful candidate will be within that range, dependent upon the key aspects of each case which may include education, skills, experience, scope of the role, location, etc. as determined through the selection process. Any SAP variable incentive includes a targeted dollar amount, and any actual payout amount is dependent on company and personal performance. A summary of benefits and eligibility requirements can be found by clicking this link: www.SAPNorthAmericaBenefits.com.

Due to the nature of the role, which involves global interactions with SAP entities, as well as with employees and stakeholders in Canada, functional proficiency in English is required for positions based in the Quebec.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 441286 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: