REMOTE Sr. Data Quality Engineer; Python LA, San Fran​/Bay Area, SEA, or NYC

Descrição da Vaga

Requisitos

• A streaming client is in need of hiring a unique candidate who is a Data Quality Engineer who not only understands data and has the technical background, but also someone who has a quality engineering and testing mindset and is passionate about testing
• You must also know write queries as well as test your own scripts/queries
• You will also be required to attend team/scrum meetings and sprint stand ups and planning sessions
• In addition, this team is really looking for a candidate who is passionate about learning, is collaborative, and has excellent communication
• Validate ETL logic, business logic, and data quality in Snowflake, Databricks, and other data platforms before code changes are released to production
• 5-7 years of experience as a Sr
• Data Quality Engineer
• Strong experience validating data pipelines, ETL processes, and data warehouses in production environments
• Expert-level SQL skills and hands-on experience working with large datasets (terabytes or more), capable of identifying data anomalies through efficient queries
• Proficiency with Snowflake, Hive, Databricks, and other modern data platforms / big data processing
• Solid Python skills and experience with test automation for data pipelines
• Familiarity with tools like Airflow and Spark and understanding of CI/CD principles
• Strong collaboration and communication skills
• Ability to work effectively across cross-functional teams
• Passion for testing and data quality
• Must be able to automate the data validation process
• Understanding of business logic validations
• Experience working in a Scrum environment
• Takes initiative, can hit the ground running, works well with others and stakeholders
• Bachelor s Degree
• Nice to Have Skills & Experience
• Experience with BDD frameworks (e.g., Behave)
• Experience working in AWS or other cloud environments
• Familiarity with open-source data quality tools like Deequ, Great Expectations, or similar custom framework

Responsabilidades

• this role requires candidates to be located only in LA or Seattle (preferred), SF/Bay Area, or NYC - must be able to go on site 3-4 days/week*
• This role focuses on contributing to strategic data quality initiatives through day-to-day testing, automation, and collaboration
• You will be responsible for building strong SQL test cases to test data and use Python as well for testing
• This is a technical role where you will be responsible for helping build the automation process for data validation and testing, while working through a backlog of work
• You will be responsible for validating all streaming-related data from this client s multiple streaming platforms
• You will use automation while doing ETL validations (i.e
• the ETL is already built by a different team), so you will be responsible for validating the ETL and adhere to standards
• Partner with data engineers to identify potential failure points and proactively help catch issues early
• Ensure the quality of every release using rigorous, data-driven testing practices
• Develop automated and reusable tests to improve coverage, development velocity, and reduce regression risk
• Translate business and technical requirements into test scenarios to validate KPIs, metrics, and business rules
• Contribute to and enhance the existing test automation framework, with a focus on scalability and maintainability
• Collaborate closely with Data Analysts, Product Managers, and Engineering teams to ensure accuracy, completeness, and usability of the data

Benefícios