Skip to main content

Senior Software Engineer, Data Ingestion

Posted 5 days ago

salesforceAtlanta (GA)

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Senior Software Engineer Slack is looking for a senior software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Lakehouse with both streaming and batch approaches. Currently, our infrastructure handles 180PB+ of storage, processes ~1T records a day, 400+ data pipelines and 1500+ Active Airflow DAGs. As Slack's data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies. As a Senior Engineer, you will play a key role in driving our streaming and lakehouse strategies while also building highly scalable services and tools to help our customers acquire large volumes of high quality data at scale and making customers' interactions with the ingested data pleasant and productive. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack! Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets Design and implement Slack's Lakehouse solutions and enable production use cases for customers Improve the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and tools. Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration).As one of the tech leads, comfortably collaborate with cross functional partners and lead technical initiatives independently end to end. Be a role model and a multiplier, coaching and mentoring other engineers across the team and the org. Write, review, or provide feedback on a technical design proposal from others. U.S. citizenship and willing to undergo a background check for GovSlack authorization. We can not provide visa sponsorship for this role.7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalentYou have hands on experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3 or equivalentYou are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalentYou are skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etc. You are familiar with AI-assisted software development and automation and have hands on experience of Claude Code/Codex or equivalentYou have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders You have high growth expectations for yourself and your team, and a willingness to push yourself and your team to achieve them This candidate must be a U.S. citizen (U.S. born or naturalized) who does not hold dual citizenship and agrees to complete a U.S. federal government Minimum Background Investigation (MBI) for a Moderate Public Trust position. Unleash Your Potential When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future — but to redefine what's possible — for yourself, for AI, and the world.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this