Engenheiro de dados

The focus of this role will be on partnering with business stakeholders to define data requirements, then building and owning end-to-end batch and streaming pipelines in a lakehouse environment. We are ideally looking for senior experts with at least 6 years of experience who can jump right in.

Role Highlights:

• Partner with non-technical business teams to define clear data contracts and metric requirements before any pipeline work begins.
• Build and maintain batch and streaming pipelines across Medallion layers (Bronze, Silver, Gold) using Databricks, PySpark, and dbt.
• Ingest data from multiple sources, including CDC, REST/GraphQL APIs, relational and NoSQL databases, and custom web scrapers.
• Tune pipeline performance, manage orchestration in Airflow (Astronomer), deploy through CI/CD, and take part in an on-call rotation.

Technical Vetting & Requirements:

• Strong SQL skills (mandatory), with Python highly desirable.
• Hands-on experience with Spark/PySpark, dbt, Airflow, Databricks, Postgres, MongoDB, and Kafka.
• Experience with dimensional data modeling (star/snowflake schemas).
• Daily use of AI tools (such as Claude Code, ChatGPT, or Cursor) for code generation, refactoring, and troubleshooting.
• Transferable experience is welcome, including Scala, Java, Kotlin, C#, Flink, Dagster, Prefect, Snowflake, BigQuery, Delta/Iceberg, MySQL, or DynamoDB.