Senior Azure Data Engineer
SKILLS
FULL DESCRIPTION
Our client is looking for a highly experienced Senior Azure Data Engineer/Lead Engineer to contribute technically to delivering data improvements to an Azure enterprise data warehouse. The successful candidate will be responsible for translating business requirements into technical requirements and building data pipelines using Azure Synapse Analytics, Blob Storage, SQL DB, Apache Spark, and other Azure services as required.
About the Role
Designing enterprise data warehouse, working with Agile SDLC methodology
Building reusable code, libraries, and consumable frameworks for data sourcing, staging, transform, conforming, and extraction
Building, testing, and deploying production ETL/ELT data pipelines and associated software components
Building Power BI reports, publishing to Power BI workspaces & Apps & securing through AAD integration
Creating data structures optimized for storage and various query patterns for eg Parquet
Working with Azure platform services such as blob storage, event hubs, Azure monitoring services
Using Azure DevOps Services using Azure Git Repos, deployment artefacts and release packages for Test & production environment
Requirements
- Expert in Azure cloud services
- Highly experienced in designing enterprise data warehouse, working with Agile SDLC methodology
- Highly experienced as an ETL/ELT Developer using various ETL/ELT tools such as Azure Synapse Pipelines & Azure Data Factory, Apache Spark Pools using python scripts
- Highly experienced in Azure SQL databases & SQL Programming
- Skill in building end-end scalable data solution, from sourcing raw data, transforming data to producing analytics reports
- Experience in building secured Power BI reports, dashboard, paginated reports
- Experience in working in an Agile SDLC methodology
Required Skills:
- Azure Synapse, Azure Blob Storage, Apache Spark, hands-on SQL
- Expertise in building secured Power BI reports, dashboard, paginated reports
- Experience in Azure DevOps Services using Azure Git Repos, deployment artefacts, and release packages for Test & production environment.
Note: Visa Sponsorship available for this listing.