Overview
Located in Canada we're seeking a skilled AI/ML Engineer to develop robust data pipelines on our Google Cloud Data Platform. You'll design, optimize, and deploy solutions to support scientific discovery, using languages like Java, Scala, and Python. Collaborating closely with product managers, you'll ensure the continuous delivery of technology solutions, adhering to Agile and DevOps principles. Responsibilities include designing data pipelines, implementing ETL programs, and maintaining compliance with data governance policies. Your role will involve real-time and batch processing, enforcing data representation standards, and ensuring technical delivery meets security and regulatory standards. You'll work closely with Data Scientists, SREs, and Product Managers to deliver high-quality software and deploy machine learning models using Python and Jupyter notebook.
Responsibilities
Design data pipelines and implement ETL programs, maintaining compliance with data governance policies.
Work with real-time and batch processing, enforcing data representation standards and ensuring security/regulatory compliance.
Collaborate with Data Scientists, SREs, and Product Managers to deliver high-quality software and deploy machine learning models using Python and Jupyter notebooks.
Adhere to Agile and DevOps principles to ensure continuous delivery of technology solutions.
Skills and Requirements
Experience with data engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management (Git, Github actions, CI, testing, and operations).
Programming languages: Java, SQL, Python, Terraform.
Experience with Data Warehousing – Redshift (note: original text said "Red").
Experience with a public cloud – moving into GCP; currently operating in Azure.
Basic understanding of shell scripting.
Experience with Agile, DevOps & automation testing, build, deployment, CI/CD deployments.
AI/ML methodologies and distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, MySQL).
Experience working on real-time data and streaming applications.
Experience with visualization tools (SSRS, Excel, Power BI, Tableau, Google Looker, Azure Synapse).
Equal Opportunity and Accessibility
We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. If you need assistance and/or a reasonable accommodation during the application or recruiting process, please contact Human Resources. The EEOC Know Your Rights poster is available here.
#J-18808-Ljbffr