Senior Data Engineer
eevdTroy (NY)
About the role
Senior DATA ENGINEER at MOTOR INFORMATION SYSTEMSAbout MOTOR Information Systems (Hearst)MOTOR is the industry leader in automotive data and insights. We power the aftermarket ecosystem with some of the most comprehensive datasets in the world—and we're investing heavily in modernizing our data platform to support the next generation of products and AI-driven capabilities.
The Opportunity:
We're looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWSbased data platform. This is not a maintenance role—you'll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite. You'll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices, and designing solutions for scalability, reliability, performance, and cost efficiency. As a senior member of the team, you'll collaborate across engineering and product, provide technical guidance and mentorship, and help shape the evolution of our platform toward a more modern, scalable, and intelligent data architecture.
Required Experience:
- (Must Have)
- Expert Python & SQL Developer
- Strong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)
- Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)
- Strong Automation Experience
- Experience with Databricks (Delta Lake, Notebooks, SQL Analytics)
- Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)
- Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)
- Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)
- Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)
- Helpful Experience (Nice to Have)
- Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector Databases
- Experience with Automotive Data / Industry
- Experience with Agile / Scrum
Primary Responsibilities:
- Analyze large, and complex, data sets
- Design, develop and coordinate the generation of Data Pipelines
- Work collaboratively with team to plan and solve complex problems
- Design for, or optimize existing pipelines, for performance and cost
Why Join:
- MOTORWork on high-impact data products used across the automotive industry
- Real ownership and influence over platform direction
- Backed by Hearst—stable, but with room to innovate
- Collaborative team solving meaningful, complex problems
Additional Details:
Hybrid schedule: 3 days onsite in Troy, MINo visa sponsorship available at this timeEEO EMPLOYER
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.