Logo Solvd, Inc.

Senior Data Engineer (Python, Spark, Databricks)

Solvd, Inc.via Built In
RemotoGeorgia, UsSêniorCLT25 dias atrás

Salário Estimado

R$ 11.385,00 - R$ 17.078,00

0de 100

Excelente

Score da Vaga

Descrição da Vaga

Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence.


We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.


Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation.


Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.


We are looking for a Senior Data Engineer (Python, Spark, Databricks) to join our team.


Project description The project consists of building a scalable backend platform that runs data-driven analytical models in a controlled, automated, and auditable way.


The backend must orchestrate model execution, enforce data validation, manage metadata and artefacts, and ensure full traceability of every processing step.


The architecture is modular and cloud-oriented, with a strong focus on automation, versioning, and operational reliability.


What you'll do • Build, maintain, and optimize data ingestion pipelines using Python, pandas, Spark, and Databricks

Parse and transform complex Excel-based financial models into structured Delta Lake tables • Implement data processing workflows and calculation logic in Python
Develop and manage pipelines using Databricks Jobs, clusters, and SQL Warehouse • Improve performance, scalability, and reliability of existing data pipelines
Write clean, maintainable, and production-quality Python code • Use SQL for data validation, transformation, and pipeline integration What you bring
Senior-level engineer with 5–8+ years of experience • Strong Python skills, with proven experience building production data pipelines
Hands-on experience with pandas for data transformation and ingestion • Experience working with Spark (PySpark or Scala) and Databricks
Solid SQL skills and experience writing complex queries • Experience designing, implementing, and maintaining data processing pipelines
Experience working with medium to large datasets • Strong ownership and ability to work hands-on in a data platform environment
English fluency for daily communication with actuarial and engineering teams.

Nice to have • Experience optimizing Python or Spark workloads for performance and scalability

Experience working with Delta Lake • Experience ingesting and transforming large Excel-based datasets
Experience working with financial or structured modeling data Tech stack • Core: Python 3.x (pandas, numpy, pydantic, mlflow, databricks-sdk)
Data Layer: PostgreSQL, Azure Blob Storage, Parquet • Computation: Databricks Jobs / MLflow Projects
Integration: NestJS API • CI/CD & Infra: GitHub Actions, Terraform When you join Solvd, you'll…
Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation. • Be part of a global team with equal opportunities for collaboration across continents and cultures.
Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.

Ready to make an impact? If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds.


Apply today and let’s innovate together.

Vagas Semelhantes

RemotoSeattle, Washington, Us9 dias atrás

R$ 13k - 13k/mês

SêniorCLT

Role Overview Build the Future of Safe and Responsible AI Are you an experienced AI engineer advancing the frontiers of AI safety, LLM jailbreak detection and defense, and agentic AI, with publications and production deployments to show for it? Join us to translate pioneering research into robust, s...

Real Impact: Your research ships directly, securing our core features and AI infrastructure at scaleComprehensive healthcare, dental, and vision coverage401k plan
R

Engenheiro de Dados

RH ROOMRH Room
RemotoCuritiba, Paraná, Br14 dias atrás

R$ 13k - 19k/mês

SêniorCLT

2 vagas Sobre a empresa Scansource: Soluções de Tecnologia Somos referência no mercado de TI distribuindo tecnologia para o mundo, conectando empresas e pessoas com as melhores soluções. Tudo isso envolvendo uma equipe totalmente especializada e dedicada a você. Responsabilidades • Desenvolver, mant...

RemotoNew York, New York, Us17 dias atrás

R$ 8k - 9k/mês

SêniorCLT

Lead Backend Developer (Golang, Java or Python) About Brillio: Brillio is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. Brillio, reno...

RemotoUberlândia, Minas Gerais, BrHoje

R$ 11k - 16k/mês

SêniorCLT

Sobre a Cedro • SOBRE A CEDRO Nossa missão: desenvolver softwares de altíssima qualidade que escale o negócio do cliente Nossa visão: ser referência nacional em tecnologias de investimentos para o ecossistema financeiro Nossa finalidade: transformar o complexo em simples para melhorar a vida das pes...

Interessado nesta vaga?

Candidatar-se

Você será redirecionado para o site original

Informações

NívelSênior
ContratoCLT
LocalGeorgia, Us
RemotoSim
MoedaBRL
Publicada25 dias atrás
FonteBuilt In

Análise de Vaga com IA

Estimativa salarial, match de tecnologias e análise de requisitos feitos com Inteligência Artificial

Quer se preparar melhor? Pratique entrevistas com IA no Recrutadoria ou melhore suas habilidades no BitMentor

← Voltar às Vagas