Sr Data Engineering Specialist

3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description

Sr Data Engineering Specialist - 3M Brasil - Sumaré/SP

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a diversity of people, global locations, technologies and products, 3M is a place where you can collaborate with 93,000 other curious, creative 3Mers.

The Impact You’ll Make in this Role

3M is seeking a Senior Data Engineer to join Corporate Research Digital Platforms (CRDP) to design, build, and operate scalable data pipelines and data products within a modern cloud-based Lakehouse platform.

In this role, you will contribute to the development of data pipelines, data products, and AI-enabled workflows, supporting analytics, informatics, and emerging AI-driven use cases across research and business domains. You will work within a platform that integrates Databricks, DataHub, Temporal workflows, and AWS infrastructure, enabling reliable and scalable data and AI operations.

You will collaborate closely with Data Engineers, Platform Engineers, Backend/Temporal Engineers, and Governance teams to deliver high-quality, production-grade data solutions that are reliable, scalable, and aligned with platform standards.

In This Role, You Will Have The Opportunity To

Data Pipeline Development & Engineering

• Design, develop, and maintain scalable data pipelines to ingest, transform, and deliver structured and unstructured data.
• Build batch and streaming pipelines using modern cloud data platforms (Databricks preferred).
• Optimize pipelines for performance, scalability, and cost efficiency.
• Troubleshoot and resolve issues related to pipeline failures, latency, and data quality.
  
  
  

Lakehouse & Platform Integration

• Develop pipelines integrated with modern Lakehouse architectures, including Databricks and Delta Lake.
• Integrate pipelines with platform services such as metadata (DataHub), orchestration (Temporal), and cloud infrastructure (AWS).
• Support onboarding of new data sources and use cases into the platform through standardized ingestion and transformation patterns.
  
  
  

AI, GenAI & Agentic Data Workflows

• Support the development of data pipelines that enable AI and GenAI applications, including feature generation, document ingestion, and structured data extraction.
• Build data pipelines that feed LLM-based workflows, vector search systems, and downstream AI services.
• Collaborate with backend and workflow engineers to support agentic workflows, where data pipelines integrate with automated decision-making and multi-step orchestration systems.
• Enable data preparation for machine learning and AI use cases, including feature engineering and dataset generation.
• Support integration between data pipelines and AI orchestration frameworks (e.g., Temporal, event-driven workflows).
  
  
  

Data Modeling & Data Quality

• Develop and maintain logical and physical data models aligned with analytics and AI use cases.
• Implement data quality checks, validation rules, and monitoring processes.
• Ensure pipelines are aligned with data governance requirements, including metadata, lineage, and cataloging.
  
  
  

Collaboration with Platform & Governance Teams

• Work with Platform Engineers to deploy pipelines using CI/CD pipelines and infrastructure-as-code standards.
• Align with Governance teams to ensure data is properly cataloged, discoverable, and compliant with standards.
• Support integration of pipelines with metadata systems (DataHub) and cataloging frameworks.
  
  
  

Best Practices & Engineering Excellence

• Apply software engineering best practices to data engineering, including modular design, testing, and version control.
• Participate in code reviews and contribute to improving engineering standards.
• Promote reuse of patterns, frameworks, and pipeline components across teams.
  
  
  

Operational Support & Reliability

• Monitor production data pipelines and participate in troubleshooting operational issues.
• Collaborate with Platform Ops & Reliability teams to improve reliability and observability.
• Participate in root cause analysis (RCA) and continuous improvement efforts for platform stability.
  
  
  

Your Skills And Expertise

To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications:

• Bachelor’s degree or higher in Computer Science, Engineering, or related field.
• Senior experience in data engineering, data platforms, or related roles.
• Strong proficiency in SQL and Python (PySpark preferred).
• Hands-on experience building scalable data pipelines and data processing workflows.
• Experience working with distributed processing systems such as Apache Spark.
• Experience with modern cloud data platforms (Databricks strongly preferred).
• Experience working with cloud platforms such as AWS (S3, Glue, etc.).
• Understanding of data modeling, data transformation, and data warehousing concepts.
• Experience working in cross-functional engineering environments.
• Proficiency in English.
  
  
  

Additional qualifications that could help you succeed even further in this role include:

• Experience with Delta Lake, Unity Catalog, and Lakehouse architectures.
• Familiarity with metadata and catalog systems such as DataHub.
• Experience with workflow orchestration tools (Temporal, Airflow, Step Functions).
• Experience supporting AI/ML use cases, including feature engineering and dataset preparation.
• Familiarity with LLM-based applications, vector databases, or GenAI pipelines.
• Experience building pipelines for unstructured data (documents, text, images).
• Experience with streaming technologies (Kafka, Kinesis, Spark Streaming).
• Exposure to CI/CD pipelines and infrastructure-as-code concepts.
• Experience with APIs and event-driven architectures.
• Understanding of data governance principles including lineage, cataloging, and access control.
• Strong problem-solving and analytical skills.
  
  
  

Work location:

Work Location: This role follows an on-site working model, requiring the employee to work at least four days a week at the Sumaré site

Supporting Your Well-being 

3M offers many programs to help you live your best life – both physically and financially. To ensure competitive pay and benefits, 3M regularly benchmarks with other companies that are comparable in size and scope. 

Chat with Max

For assistance with searching through our current job openings or for more information about all things 3M, visit Max, our virtual recruiting assistant on 3M.com/careers. 

Learn more about 3M’s creative solutions to the world’s problems at www.3M.com or on Instagram, Facebook, and LinkedIn @3M.

A 3M é um empregador que oferece oportunidades iguais à todos. A 3M não discriminará nenhum candidato baseado em sua raça, cor, idade, religião, gênero, orientação sexual, identidade ou expressão de gênero, nacionalidade ou deficiência.

Safety is a core value at 3M. All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement.

Please note: your application may not be considered if you do not provide your education and work history, either by: 1) uploading a resume, or 2) entering the information into the application fields directly.

3M Global Terms of Use and Privacy Statement

Carefully read these Terms of Use before using this website. Your access to and use of this website and application for a job at 3M are conditioned on your acceptance and compliance with these terms.

Please click on the following links and select the country where you are applying for employment to review the applicable Terms of Use (link here) and Privacy Policy (link here). Before submitting your application, you will be asked to confirm your agreement with the terms.