Logo Solvd, Inc.

Senior Data Engineer (Python, Spark, Databricks)

Solvd, Inc.via Built In
RemotoGeorgia, UsSêniorCLT5 dias atrás

Salário Estimado

R$ 11.385,00 - R$ 17.078,00

0de 100

Excelente

Score da Vaga

Descrição da Vaga

Solvd Inc. is a rapidly growing AI-native consulting and technology services firm delivering enterprise transformation across cloud, data, software engineering, and artificial intelligence.


We work with industry-leading organizations to design, build, and operationalize technology solutions that drive measurable business outcomes.


Following the acquisition of Tooploox, a premier AI and product development company, Solvd now offers true end-to-end delivery—from strategic advisory and solution design to custom AI development and enterprise-scale implementation.


Our capability centers combine deep technical expertise, proven delivery methodologies, and sector-specific knowledge to address complex business challenges quickly and effectively.


We are looking for a Senior Data Engineer (Python, Spark, Databricks) to join our team.


Project description The project consists of building a scalable backend platform that runs data-driven analytical models in a controlled, automated, and auditable way.


The backend must orchestrate model execution, enforce data validation, manage metadata and artefacts, and ensure full traceability of every processing step.


The architecture is modular and cloud-oriented, with a strong focus on automation, versioning, and operational reliability.


What you'll do • Build, maintain, and optimize data ingestion pipelines using Python, pandas, Spark, and Databricks

Parse and transform complex Excel-based financial models into structured Delta Lake tables • Implement data processing workflows and calculation logic in Python
Develop and manage pipelines using Databricks Jobs, clusters, and SQL Warehouse • Improve performance, scalability, and reliability of existing data pipelines
Write clean, maintainable, and production-quality Python code • Use SQL for data validation, transformation, and pipeline integration What you bring
Senior-level engineer with 5–8+ years of experience • Strong Python skills, with proven experience building production data pipelines
Hands-on experience with pandas for data transformation and ingestion • Experience working with Spark (PySpark or Scala) and Databricks
Solid SQL skills and experience writing complex queries • Experience designing, implementing, and maintaining data processing pipelines
Experience working with medium to large datasets • Strong ownership and ability to work hands-on in a data platform environment
English fluency for daily communication with actuarial and engineering teams.

Nice to have • Experience optimizing Python or Spark workloads for performance and scalability

Experience working with Delta Lake • Experience ingesting and transforming large Excel-based datasets
Experience working with financial or structured modeling data Tech stack • Core: Python 3.x (pandas, numpy, pydantic, mlflow, databricks-sdk)
Data Layer: PostgreSQL, Azure Blob Storage, Parquet • Computation: Databricks Jobs / MLflow Projects
Integration: NestJS API • CI/CD & Infra: GitHub Actions, Terraform When you join Solvd, you'll…
Shape real-world AI-driven projects across key industries, working with clients from startup innovation to enterprise transformation. • Be part of a global team with equal opportunities for collaboration across continents and cultures.
Thrive in an inclusive environment that prioritizes continuous learning, innovation, and ethical AI standards.

Ready to make an impact? If you're excited to build things that matter, champion responsible AI, and grow with some of the industry’s sharpest minds.


Apply today and let’s innovate together.

Vagas Semelhantes

Logo Open Insurance

AI & LLM Developer — Senior

Open InsuranceIndeed
RemotoRemoto18 dias atrás

R$ 16k - 25k/mês

SêniorCLT

Location: Remote or Hybrid (if US Located) Employment Type: Contract — Full-Time Department: Engineering / Product Development Experience Level: Senior (5–8+ years) Reports To: Director of Engineering Role Overview We are seeking a highly skilled Senior AI & LLM Developer with deep, hands-on experie...

Competitive contract compensation commensurate with experiencePay: From $4,000.00 per month
RemotoBr23 dias atrás

R$ 7k - 11k/mês

PlenoCLT

This a Full Remote job, the offer is available from: Brazil JOB DESCRIPTION Nós somos a BHS! Com 30 anos de experiência no mercado, proporcionamos soluções modernas de TI. 🚀 Somos reconhecidos como a MELHOR empresa para se trabalhar em MG e no BRASIL pelo GPTW - Great Place to Work, e estamos class...

RemotoBellevue, Washington, Us2 dias atrás

R$ 12k - 19k/mês

SêniorCLT

the position Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second across 80M merchants, 15k Financial Institutions...

MedicalDentalVision
Logo Red Thread Innovations

Sr. Full Stack Engineer (3 Month Contract)

Red Thread InnovationsGlassdoor
RemotoBr10 dias atrás

R$ 12k - 18k/mês

SêniorCLT

Red Thread Innovations Red Thread Innovations (RTI) is a digital innovation firm with the sole mission of building meaningful digital products that delight consumers and transform businesses. Our vision is to be the global leader in digital product development, with the largest portfolio of successf...

Interessado nesta vaga?

Candidatar-se

Você será redirecionado para o site original

Informações

NívelSênior
ContratoCLT
LocalGeorgia, Us
RemotoSim
MoedaBRL
Publicada5 dias atrás
FonteBuilt In

Análise de Vaga com IA

Estimativa salarial, match de tecnologias e análise de requisitos feitos com Inteligência Artificial

Powered by CodeCortex
← Voltar às Vagas