B
Remoto LinkedIn

Data Engineer (Spark) - Remote Work | REF#295890

BairesDev São Paulo 25 candidaturas 11 dias atrás

Salário estimado

R$ 9k - 13k/mês

Pleno CLT
60%

Score de curadoria

Indicador interno 0 a 100: transparência salarial, stack, descrição útil e sinais de qualidade do anúncio. Não é match com o seu CV.

Descrição da vaga

Texto agregado para leitura rápida. Confira sempre a fonte original ao enviar a candidatura.

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

As a Data Engineer specializing in Spark, you will design and build large-scale data pipelines to process complex batch and streaming workloads. You will serve as a key link between raw data sources and analytical insights, ensuring the efficiency and scalability of our data infrastructure.

What You'll Do

  • Design and develop robust data pipelines using Python and PySpark to process large-scale datasets.
  • Optimize Spark jobs by deep-diving into internals to improve performance and manage costs.
  • Implement scalable storage solutions using Delta Lake or Iceberg for reliable data management.
  • Orchestrate complex data workflows using Airflow to ensure timely and accurate data delivery.
  • Build and maintain data processing infrastructure across cloud environments like AWS, Azure, or GCP.
  • Write and optimize complex SQL queries for data transformation and validation within the pipeline.

What We Are Looking For

  • 4+ years of experience in Data Engineering or Software Engineering.
  • Proven expertise in building large-scale batch and streaming pipelines using Apache Spark and Python.
  • Hands-on experience with Spark internals, PySpark, and Delta Lake or Apache Iceberg.
  • Proficiency in SQL and workflow orchestration using tools like Airflow.
  • Practical experience with cloud data platforms such as AWS, Azure, or GCP.
  • Advanced proficiency in English.

How we do make your work (and your life) easier:

  • 100% remote work (from anywhere).
  • Excellent compensation in USD or your local currency if preferred
  • Hardware and software setup for you to work from home.
  • Flexible hours: create your own schedule.
  • Paid parental leaves, vacations, and national holidays.
  • Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
  • Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!

Apply now!

Vagas relacionadas

Seleção por stack em comum com esta oportunidade

S
Remoto LinkedIn Hot
Match50%

BRA IT Analyst III

Santander São Paulo 25 candidaturas Hoje

Salário estimado

R$ 9k - 14k/mês

Pleno CLT

Country: Brazil# QUEM SOMOSA F1RST é o futuro e sua carreira está aqui! Nossa cultura é baseada em “Pessoas, Inovação e Resultados”.Fazemos parte do maior banco Internacional do Brasil, um dos maiores bancos do mundo. Promovendo serviços e experiências para os mais de 60 milhões de clientes de todo ...

Ver Detalhes
H
Remoto LinkedIn
Match65%

Desenvolvedor (a) de Software Full Stack (PHP, Python e JavaScript)

HealthBit | Consultoria em Gestão de Saúde Corporativa São Paulo 32 candidaturas Hoje

Salário estimado

R$ 15k - 23k/mês

Sênior CLT

Missão da função: Atuar com autonomia e proatividade no desenvolvimento de soluções de software robustas e escaláveis, do entendimento das necessidades do negócio à entrega de sistemas de alta qualidade. Ser referência técnica no time, promovendo boas práticas, melhoria contínua e entregas consisten...

Ver Detalhes
J
LinkedIn
Match35%

Pessoa Desenvolvedora .NET - Pleno

Jobgether Brazil 25 candidaturas Hoje

Salário estimado

R$ 7k - 10k/mês

Pleno CLT

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Pessoa Desenvolvedora .NET - Pleno based in Brazil.This role is part of a highly collaborative and fast-paced technology environment, focused on building scalable, high-p...

Ver Detalhes