Skip to main content

Senior Software Engineer, Apple Data Platform

Posted yesterday

appleCupertino (CA)

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Overview: In this role you will advance Spark at Apple’s scale while accelerating Apache DataFusion Comet. You’ll design native operators and expressions, extend Comet’s Spark integration, and optimize IO, memory, and shuffle for large-scale workloads. You’ll work with open-source communities and cross-functional teams to ensure compatibility and performance. This is a hands-on, impact-first position focused on pushing the boundaries of distributed query engines. You will help shape high-performance data systems used by millions. Compensation / Benefits Medical and dental coverage Retirement benefits Employee stock programs Tuition reimbursement Relocation assistance Discounted products and free services
Responsibilities: Design and implement native operators/expressions using DataFusion and Arrow Extend Comet integration across Spark versions Accelerate Iceberg/Parquet reads and writes while preserving Spark compatibility Profile, benchmark, and optimize memory, shuffle, and I/O for reliability at scale Collaborate with open-source contributors and cross-team partners to upstream improvements Promote performance, correctness, and stability in production environments
Key requirements: 3+ years of professional software engineering experience Proven track record building distributed systems Contributor or committer to Apache Spark and/or Apache DataFusion/Comet BS in Computer Science or related field, or equivalent practical experience Collaborative mindset with cross-functional teams Strong communication and teamwork Problem-solving mindset and bias for action Deep knowledge of Apache Spark internals Experience with Apache Iceberg and Apache Parquet internals Proficiency with Apache Arrow and DataFusion

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this