QA Engineer
SKILLS
FULL DESCRIPTION
QA Engineer
[Employer hidden — sign up to reveal] - London (Hybrid) - Permanent / Full-time - Competitive salary
About the Role
You will own the quality assurance of [Employer hidden — sign up to reveal]'s client data platform deployments — the Databricks Lakehouse pipelines, gold-layer views, and analytics datasets that drive marketing, billing, credit and debt outcomes for our clients across financial services, retail, energy, telecoms & media, water, and the not-for-profit sector. Working closely with our Data Engineers, Platform Engineer, UAT teams, and client stakeholders, you will design and execute structured test programmes using SPHERE ([Employer hidden — sign up to reveal]'s internal QA platform), interpret results, triage failures, and provide confident assurance that the data leaving our platform is accurate, complete, and fit for purpose.
A typical day will see you working alongside AI agents for authoring tests, analysing results, and managing work items — treating AI-assisted tooling as a first-class part of your workflow rather than a novelty.
Responsibilities
- Author, run, and maintain test plans across all phases of client deployments — schema validation, referential integrity, row volume checks, data quality rules, and migration parity — using SPHERE's YAML-driven test framework
- Investigate test failures systematically: trace root causes through the Databricks Lakehouse stack (bronze → silver → gold), distinguish pipeline bugs from data issues, and produce clear, evidenced findings for the development team
- Manage QA work items in ClickUp throughout the delivery lifecycle — logging failures, tracking resolutions, promoting confirmed bugs, and closing issues when re-tests pass
- Collaborate with Data Engineers to agree expected behaviours, review data contracts, and validate fixes before they reach UAT or production
- Coordinate with UAT stakeholders to align acceptance criteria and share QA findings in a way that non-technical audiences can act on
- Provide client-facing QA assurance — joining delivery meetings to explain our testing approach, walk through results, and answer questions on QA methodology, coverage, and process
- Identify gaps and improvements in SPHERE — raise well-specified change requests and feature requests; contribute to the platform codebase where appetite and skill allow
- Keep QA coverage current as new views and data sources are onboarded — updating baselines, refreshing metadata, and extending test coverage without being asked
- Engage with AI agents for test authoring, investigation, result analysis, and documentation — working fluently in an AI-augmented engineering environment
What Success Looks Like
- Client datasets are validated end-to-end before delivery, with no material data quality escapes reaching UAT or production
- Test failures are investigated quickly, described clearly, and handed to developers with enough evidence that they can reproduce and fix without back-and-forth
- ClickUp boards reflect the current state of QA — no stale or phantom issues, and Dev Issues are closed promptly when tests go green
- Clients and internal stakeholders feel well-informed and reassured about QA rigour, without needing to ask twice
- SPHERE improves over time because gaps in the platform are named, specified, and tracked — not just worked around
- QA coverage expands naturally with each deployment increment rather than lagging behind
Competencies & Behaviours
Technical
- Strong SQL skills — comfortable writing and reading complex analytical queries (window functions, CTEs, aggregations) to interrogate data and verify correctness
- Hands-on experience with Databricks — running queries, navigating Unity Catalog, reading Spark job outputs and understanding what they mean for data quality
- Working knowledge of PySpark or Spark SQL — enough to read pipeline code, understand transformations, and trace where data issues originate
- Understanding of Lakehouse / medallion architecture (bronze-silver-gold) and how data flows and changes shape across layers
- Familiarity with YAML-based configuration and a willingness to author structured test definitions programmatically
- Comfortable with Git and basic engineering practices — branching, committing, reading diffs, and understanding what changed between pipeline versions
- Experience with or appetite for AI-assisted workflows — working with large language model agents as a genuine productivity tool, not just for curiosity
Experience
- 3–5+ years in a data quality, data testing, analytics engineering, or data engineering role with a strong quality focus
- Demonstrable experience investigating data issues in a complex, multi-source environment and communicating findings clearly
- Exposure to structured test frameworks, data observability tooling, or formal QA methodology in a data context
- Experience working directly with development teams in an agile or iterative delivery environment
- Client-facing or stakeholder-facing experience — comfortable presenting technical findings to non-technical audiences
Apply
Use the online application form to submit your details, including CV and answers to screening questions. [Employer hidden — sign up to reveal] is an equal opportunity employer.