Data Engineer
SKILLS
FULL DESCRIPTION
Summary
Valcon UK are looking to recruit a self-motivated, highly logical and intellectually curious Data Engineer’s to join our expanding Data capability in the UK. As a growing business area, the ideal candidate will have the opportunity to help shape the technical and business land-scape, whilst delivering a variety of challenging projects
Key Responsibilities:
- Analyse and organise raw data
- Build data systems and pipelines
- Evaluate business needs and objectives
- Interpret trends and patterns
- Conduct complex data analysis and report on results
- Prepare data for prescriptive and predictive modelling
- Build algorithms and prototypes
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Identify opportunities for data acquisition
- Develop analytical tools and programs
- Collaborate with data scientists and architects on several projects
Core Requirements/Qualifications/Skills:
- Proven track record of success in Data Engineering teams
- Experience with relational and MPP databases (Snowflake, Redshift, Big Query etc).
- Experience with data modelling techniques (Kimball/Star, Datavault, etc).
- Experience with SQL and query design on large, complex datasets.
- Experience with cloud and big-data tools and frameworks like Databricks/Spark, Airflow, Snowflake, etc.
- Expertise designing and developing with distributed data processing platforms like Databricks/Spark.
- Experience using ELT/ETL tools such as DBT, FiveTran, etc.
- Understanding of Agile Delivery best practice
- Strong problem-solving and analytical abilities.
- Ability to present solutions and limitations to non-IT business experts
RESPONSIBILITIES:
- Analyse and organise raw data
- Build data systems and pipelines
- Evaluate business needs and objectives
- Interpret trends and patterns
- Conduct complex data analysis and report on results
- Prepare data for prescriptive and predictive modelling
- Build algorithms and prototypes
- Combine raw information from different sources
- Explore ways to enhance data quality and reliability
- Identify opportunities for data acquisition
- Develop analytical tools and programs
- Collaborate with data scientists and architects on several projects
Experience
- Proven track record of success in Data Engineering teams
- Experience with relational and MPP databases (Snowflake, Redshift, Big Query etc).
- Experience with data modelling techniques (Kimball/Star, Datavault, etc).
- Experience with SQL and query design on large, complex datasets.
- Experience with cloud and big-data tools and frameworks like Databricks/Spark, Airflow, Snowflake, etc.
- Expertise designing and developing with distributed data processing platforms like Databricks/Spark.
- Experience using ELT/ETL tools such as DBT, FiveTran, etc.
- Understanding of Agile Delivery best practice
- Strong problem-solving and analytical abilities.
- Ability to present solutions and limitations to non-IT business experts