Senior Data Engineer (Data Platform)
Senior Data Engineer (Data Platform)
Posted today
SENIORITY
Lead
About the role
- Data Engineering Depth 8+ years of professional data engineering experience, including hands-on design and operation of production data pipelines and ownership of a data platform or lakehouse
- Hands-on production experience with an open table format (Apache Iceberg preferred; Delta or Hudi fine) and a distributed query engine (Trino, Presto, or Spark SQL), including partitioning, compaction, and schema evolution
- Demonstrated experience with streaming and batch data pipeline technologies (Kafka, NiFi, Debezium, Spark, or similar)
- Strong proficiency in Python and SQL, with experience integrating and validating data from multiple heterogeneous sources (relational and NoSQL databases, APIs, files, and streams)
- Strong data modeling skills for both analytical and operational workloads; experience designing entity models for complex real-world domains
- Production orchestration experience (Airflow, Dagster, Argo Workflows, or similar)
- Production experience writing services in Python and/or TypeScript, plus enough front-end skill (Vue, React, or similar) to ship a usable internal tool end to end
- Comfortable designing and documenting RESTful APIs that other teams build onContainers and Platform
- Strong Kubernetes and Docker experience: you've packaged, deployed, and operated stateful data services on Kubernetes and can debug networking, storage, and namespace issues
- Comfortable building on open-source tooling for self-hosted and air-gapped deployments
- Experience with AWS data services (e.g., S3, Glue, Aurora) or Azure equivalents and containerized environments (Kubernetes), delivered through DevSecOps/CI-CD pipelines
- Communication and Growth Mindset
- Demonstrated ability to work independently against well-defined tasking with minimal oversight, and to communicate effectively with both technical and non-technical stakeholders, including data providers and consumers
- Clear communicator across disciplines, whether writing an RFC, explaining a data model to an SME, or recording a weekly demo of recent work (a Gallatin tradition)
- Always seeking to learn and stay current with industry trends and tools
- Active SECRET or TOP SECRET clearance
- Data catalog, lineage, and governance experience (Iceberg REST catalogs, Nessie, Polaris, OpenLineage, DataHub, or similar)
- Data versioning and branching (Nessie, lakeFS) for sandboxed pipeline testing
- Apache NiFi or other low-code/no-code pipeline tools, including custom processors
- Entity resolution, semantic data fusion, knowledge graphs, or ontology modeling
- Shipping data workloads into air-gapped or classified environments
- Palantir Foundry or ontology experience
- Data infrastructure for AI: metadata and retrieval that make agents more accurate and explainable
- Operations research, optimization, or constraint-solver background
- Background in defense logistics, sustainment, or supply chain systems
- Contributions to open-source data projects
- Why Gallatin?
- Join a mission-driven, high-impact, and fast-moving startup where your work directly improves defense logistics readiness for the warfighters of the United States and allied forces.
- Work alongside a team of passionate engineers, designers, and industry experts.
- Competitive compensation incl. generous options grant, 100% employer-paid health insurance premiums, 401k, opportunities for rapid career growth, unlimited PTO, free lunches and snacks in the office.
- This position requires the ability to obtain and maintain relevant security clearances. The successful candidate must be able to work in a classified environment when necessary.
- If you're not excited about working hard, and solving the hard problems of building AI decision-support
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
