Data Engineer, Sr.

About The Company

Maplesoft Group is a leading technology solutions provider committed to delivering innovative and reliable services to its clients. With a strong emphasis on fostering a diverse and inclusive workplace, Maplesoft Group values its employees as its most vital asset. The company prides itself on its distinct corporate culture that promotes attitude, ambition, skill, and aptitude. Dedicated to creating an equitable environment, Maplesoft Group actively encourages applications from all qualified individuals and is an equal opportunity employer. The organization strives to develop barrier-free recruitment and work environments that support diversity and inclusion, ensuring that every employee feels valued and empowered to contribute to the company's success.

About The Role

Maplesoft Group is seeking a highly skilled Senior Data Engineer to join our client's team. The successful candidate will play a crucial role in managing and enhancing data processing workflows. This position involves writing, testing, and debugging Python programs using PySpark, ensuring seamless integration with existing legacy systems such as SAS and SQL. The Senior Data Engineer will be responsible for translating and documenting legacy code, developing reliable data pipelines, and ensuring the accuracy and reproducibility of data processing tasks. The role requires a proactive individual with excellent problem-solving skills, attention to detail, and the ability to work collaboratively within a dynamic team environment. Deliverables include comprehensive documentation, functional Python programs, and detailed test plans and results maintained within Azure DevOps.

Qualifications

• Bachelor’s degree in Computer Science, Data Science, Software Engineering, or a related field
• Proven experience in Python programming, specifically with PySpark
• Strong understanding of data processing frameworks and big data technologies
• Experience in testing and debugging data pipelines
• Familiarity with legacy systems such as SAS and SQL
• Knowledge of Azure DevOps or similar project management tools
• Excellent documentation and communication skills
• Ability to translate complex legacy code into modern programming languages
• Attention to detail and strong analytical skills
• Ability to work independently and collaboratively in a team environment

Responsibilities

• Develop, run, and troubleshoot Python programs utilizing PySpark for data processing
• Test data pipelines to ensure consistency and reliability with existing SAS and Datastage programs
• Translate legacy SAS and SQL code into Python to modernize data workflows
• Document existing legacy programs and newly developed Python scripts for future reference and compliance
• Create and execute comprehensive test plans, recording results within Azure DevOps
• Collaborate with cross-functional teams to understand data requirements and deliver solutions
• Maintain high standards of data quality, security, and integrity throughout all processes
• Stay updated with industry best practices and emerging technologies related to data engineering

Benefits

• Competitive salary package
• Comprehensive health and dental insurance plans
• Opportunities for professional development and continuous learning
• Inclusive and diverse work environment
• Flexible work arrangements where applicable
• Supportive team culture focused on innovation and collaboration

Equal Opportunity

Maplesoft Group is an equal opportunity employer committed to fostering an inclusive environment. We welcome applications from all qualified individuals regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veterans’ status, Aboriginal peoples, or any other legally protected factors.