Staff Data Platform Engineer

Irvine, California · Remotefull time

Apply on Employer Site

Remote

senior

$154k–$212k

H1B: no

rivianvw.tech Staff Data Platform Engineer at rivianvw.tech designs and scales data processing infrastructure with emphasis on multi-region Databricks orchestration. Manages infrastructure using Terraform and collaborates with cross-functional teams to deliver scalable data solutions.

Responsibilities

Infrastructure Management: Design, deploy, and maintain our data platform infrastructure using Terraform and other Infrastructure as Code (IaC) principles.
Databricks Platform Expertise: Manage and optimize our Databricks platform, ensuring it remains secure, performant, and cost-effective at a global scale.
System Design & Architecture: Lead the technical design of data systems, considering factors like scalability, reliability, and performance. You'll be expected to make informed decisions that align with our long-term architectural vision.
Stakeholder Collaboration: Communicate effectively with data producers, data consumers, and business leaders to gather requirements, provide technical guidance, and ensure the data platform meets their technical and legal needs.
Troubleshooting & Issue Resolution: Proactively identify and resolve issues that may arise with the Databricks platform.
Staying Ahead of the Curve: Stay up-to-date with the latest advancements in big data technologies, cloud computing, and DevOps practices.

Qualification

EducationExperienceDatabricks Platform ExpertiseTerraform and DevOps BackgroundProblem-Solving SkillsCommunication & CollaborationCloud ComputingPySpark ExpertiseAWS proficiency

Required

Education: Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
Experience: 3+ years of hands-on experience in a similar role, with a proven track record of building and maintaining large-scale data processing systems.
Databricks Platform Expertise: Solid understanding of the Databricks platform and core concepts such as Delta, Spark, Unity Catalog, data governance, and workspace administration.
Terraform and DevOps Background: History of using Terraform to manage large scale systems via Infrastructure as Code, and utilizing other technologies to build and maintain CI/CD pipelines.
Problem-Solving Skills: Exceptional analytical and problem-solving skills, with the ability to break down complex problems into manageable components.
Communication & Collaboration: Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams around the globe.
Cloud Computing: Experience working with cloud-based technologies (e.g., AWS, GCP, Azure)

Preferred

PySpark Expertise: Background designing scalable data pipelines using the Spark ecosystem (e.g., Spark SQL, Spark Streaming).
AWS proficiency: Familiarity with core services such as IAM permissions, VPC networking, EC2 compute, and S3 storage.

Benefits

Medical
Vision
Equity/RSU
Annual Bonus

Company

rivianvw.tech

View company page

Source: ashby

Active within the past hour

Remote-friendly

More roles at rivianvw.tech

Staff Functional Safety Engineer

Irvine, California · Remote

Sr. Security Platform Engineer

Irvine, California · Remote

Senior Advanced Development Engineer

Irvine, California · Remote

Sr. Electronics Design and Characterization Engineer (Zonal BMS)

Irvine, California · Remote