Senior Data Engineer

The Role

- As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines, ensuring high-quality data is available for decision-making across the business. - You’ll ollaborate closely with data architects, product teams, analysts, and data scientists to implement data solutions that power analytics and reporting. - The ideal candidate will have strong experience in data engineering, cloud platforms like DBT, Azure/AWS, data modeling, and ETL/ELT processes. - You’ll be part of a dynamic and innovative team, working on cutting-edge technologies to deliver impactful data products for our retail chain

Your responsibilities:

- ETL Pipeline Development: Develop, optimize, and maintain ETL pipelines to efficiently extract, transform, and load data from various sources, ensuring high data quality. - Monitor and troubleshoot production data pipelines, ensuring their performance and reliability. - Mentor junior engineers and lead technical discussions to drive best practices and innovation within the team. - Stay up to date with the latest trends and technologies in data engineering and recommend solutions to improve data processing capabilities. - Query Optimization & Data Transformation: Write and optimize SQL queries, ensuring data integrity, performance, and scalability, using best practices and techniques - Data vault Model implementation: Implement flexible Data vault model in Snowflake to support large-scale analytics and business intelligence. - Cross-Team Collaboration: Collaborate with Data Engineers, Product Managers, and Data Scientists to deliver solutions that support data-driven insights and innovation. - Stakeholder Engagement: Engage with business stakeholders to understand requirements and translate them into technical solutions that add value. - Data Quality & Governance: Implement and enforce data governance and quality processes, ensuring accurate and consistent data flows across all systems. - Cloud & Infrastructure Support: Work with cloud platforms such as AWS/Azure and DBT with Snowflake to build and maintain scalable data solutions. - Continuous Improvement: Proactively look for ways to improve data systems, processes, and tools, ensuring efficiency and scalability.

Essential skills/knowledge/experience:

- ETL/ELT & Data Pipelines: Solid understanding of ETL/ELT processes, along with hands-on experience building and maintaining data pipelines using DBT, Snowflake, Python, SQL, Terraform and Airflow - Experience in designing and implementing data products and solutions on cloud-based architectures. - Cloud Platforms: Experience working with cloud data warehouses and analytics platforms, such as Snowflake, and AWS/Azure - GitHub Skills and Experience: Proficiency in using GitHub for version control, code collaboration and managing data engineering projects - Data Governance and Compliance: Expertise in implementing data governance frameworks in Alation, including data quality management and compliance with industry regulations. - Effective Communication and Collaboration: Excellent communication skills for interacting with stakeholders, presenting technical concepts, and collaborating with cross-functional teams. - Collaboration & Communication: Strong interpersonal skills with the ability to work cross- functionally with stakeholders, engineers, and analysts. - SQL Proficiency: Expertise in writing complex SQL queries, query optimization, and database design for analytics. - Problem-Solving & Analytical Thinking: Ability to think critically and solve complex problems, translating business requirements into actionable insights.

Desirable skills/knowledge/experience:

- Knowledge of Data Visualization Tools: Experience with tools such as MicroStrategy / Power BI - Terraform: Experience with Terraform and Terragrunt for infrastructure as code - GenAI: Experience with Generative AI technologies

About the company