Назад к вакансиям

Senior QA Data Engineer

130 000 – 150 000 $в год
Gradient AIУдалённоот 5 летflexible
PythonSQLCI/CDAirflowQA AutomationDBTDatabricksData QualitySoda

Описание

This is a fully remote position. Gradient AI is a leading provider of AI solutions for the Group Health and P&C insurance industries, improving loss ratios and profitability by predicting underwriting and claim risks with greater accuracy.

Responsibilities

  • Build and maintain an automated data quality suite that runs on data refreshes through Airflow, replacing manual, per-customer validation
  • Define checks as code (dbt tests, Soda, custom SQL) managed through version control and CI, including baseline checks so that new pipelines get coverage by default
  • Validate loads for completeness, sequencing, and schema before processing, and halt or quarantine failures
  • Reconcile data across Databricks layers and against downstream outputs such as pricing tools, at the portfolio, group, member, and claim level, using tolerance thresholds
  • Detect anomalies, edge cases, and unexpected changes in historical data between loads
  • Define severity levels and per-customer overrides and produce a data quality report for each customer that gates promotion to downstream consumers
  • Track quality metrics over time to retire flaky checks and close coverage gaps
  • Partner with engineers so that new pipelines ship with checks built in, and give engineers, stakeholders, and project managers timely feedback on quality issues and risk

Requirements

  • 5+ years of professional experience in quality assurance with a strong focus on backend automated testing
  • Hands-on experience building automated data tests with Soda, dbt, or similar frameworks
  • Strong SQL skills (Spark SQL a plus) and familiarity with Python
  • Experience with Airflow or similar orchestration tools, and with Databricks or a similar lakehouse environment (Delta Lake)
  • Familiarity with version control and CI/CD
  • Solid understanding of testing principles, including functional, integration, and regression testing, applied to data pipelines
  • Excellent analytical, debugging, and root-cause skills
  • Strong verbal and written communication skills, including clear defect reports and quality summaries for technical and non-technical audiences
  • Ability to work independently and coach others on testing best practices

Nice to have

  • Experience with health insurance or healthcare data
  • Experience with anomaly detection or data observability tools
  • Experience with front-end test automation tools such as Cypress or Playwright

We offer

  • A fun, team-oriented startup culture
  • Generous stock options
  • Unlimited vacation days
  • Flexible schedule that supports working from home
  • Full benefits package including medical, dental, vision, 401k, and more
  • Ample opportunities to learn and take on new responsibilities
  • Base salary annually: 130,000-150,000 USD
  • This role is also eligible for an annual performance bonus, equity grant, and a comprehensive benefits package

Tools we use

  • dbt
  • Soda
  • SQL (Spark SQL)
  • Python
  • Airflow
  • Databricks (Delta Lake)