Senior AWS Data Engineer/Architect at Affinity

On behalf of our public sector client, Affinity is looking for a Senior AWS Data Engineer/Architect to help us establish a CI/CD deployment system and optimal patterns for monitoring, notifications, security, and data pipelines from a variety of source systems. The role demands strong cloud data engineering skills, expertise with AWS services, and a collaborative mindset to work with data warehouse, IT, and security teams.

Responsibilities:

• Collaborate with IT and the data Management team to design a CI/CD deployment system for the AWS data lake account

• Develop optimal patterns for monitoring, notifications, and security, including monitoring dashboards and alerting configurations

• Assist in developing data pipeline and orchestration design patterns from a variety of source systems using AWS tools such as Glue, Step Functions, and DMS

• Ensure security and data access best practices (IAM roles, encryption, Lake Formation)

Education and Experience

• Degree in computer science, computer engineering, system engineering, big data, statistics, or equivalent work experience

• Typically requires over 6 yearof s data engineering, applied data science, or software engineering experience

• Experience with large-scale data migrations or cloud modernization projects

Knowledge and Skills

• Capability to architect highly scalable distributed systems, using AWS tools.

• Demonstrated experience with agile or other rapid application development methods

• Familiarity with DevOps best practices

• Understands data pipeline technologies and tools and has experience building high-performance data systems.

• Extensive knowledge in SQL and scripting languages such as Python

• Expert knowledge of data modeling and understanding of different data structures and their benefits and limitations under particular use cases.

• Experience using AWS technologies, including S3, Redshift, AWS Glue, CloudFormation, CloudWatch

• Experience withthe integration of data from multiple data sources and multiple styles of APIs

• Experience working with SQL databases such as Oracle, SQL Server, MySQL, and Redshift

• Knowledge of various ETL techniques and frameworks

Competencies:

• Architecting secure and scalable systems

• Strong communication skills for cross-team collaboration

• Ability to mentor and guide other team members

Affinity Earn:

Know someone who’s great for this, or any of our open roles? Earn up to $4,000/year for each successful referral through Affinity Earn. You can also earn up to $50,000 for helping us find new clients. Learn about our referral program at https://affinity-group.ca/earn/ or browse our jobs & follow us at https://www.linkedin.com/company/affinity-staffing/jobs/

About Affinity:

Affinity Group is a technology and business consulting and services company. We believe in creating long term relationships between clients and consultants that foster a mutually beneficial partnership. Affinity is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment is decided on the basis of qualifications, merit and business need.

For more information on Affinity, please visit www.affinity-group.ca

Job Number: 12745