Sr. ML Data Engineer (ETL) | TELECOMMUTE
kaavDenver (CO)
Sr. ML Data Engineer (ETL) | TELECOMMUTE
Posted 2 days ago
kaavDenver (CO)
SENIORITY
Senior
About the role
Senior Data Engineer With ML Feature Engineering Expertise 100% TELECOMMUTEWe seek a talented Senior Data Engineer with ML feature engineering expertise to join our Consumer ML team. This role involves designing and implementing advanced feature engineering and ETL pipelines to enable robust machine learning applications. The ideal candidate has hands-on experience with Databricks, a deep understanding of the medallion architecture, and a proven track record of supporting the end-to-end ML lifecycle. Experience with MLflow and an aptitude for creating data-driven insights are highly desirable.
Responsibilities:
- Feature Engineering Data Integration Develop and maintain feature engineering pipelines using Databricks to support ML models effectively
- Data Pipeline Development Integrate diverse data sources eg clickstreams user behaviour demographic data to create user behaviour features profiles for complex ML tasks
- Medallion Architecture Design and implement ETL, ELT pipelines aligned with the bronze silver and gold layers of the medallion architecture
- Model Support Build data pipelines to support ML model training calibration and deployment leveraging MLflow for experiment tracking and performance monitoring
- Query Optimization Low Latency Pipelines Design low latency production ready data pipelines to support real-time and batch model inferenceCICD Practices Apply CICD principles for seamless pipeline deployment
- Data Governance Ensure pipelines comply with security and regulatory standards particularly for handling PII and maintain metadata and master data across the data catalogue
- Collaboration Work closely with ml scientists ml engineers and other stakeholders to align data transformation with business objectives
Qualifications:
- 7 years in data engineering and at least 4 years focusing on ML feature engineering ETL pipeline development and data preparation for MLProven experience managing pipelines on Databricks using Apache Spark with a strong understanding of the medallion architecture
- Familiarity with ML lifecycle management with MLflow experience as a strong plus and advanced skills in Apache Spark PySpark for big data processing and analytics
- Proficient in Python for data manipulation and SQL for query optimization
- Experience building pipelines for real-time and batch model serving in production environments and knowledge of CICD practices for ETLELT pipeline development
- Expertise in metadata and master data management within technical data catalogues
- Understanding of data security and compliance especially with sensitive data like PIIMandatory Skills: Apache Spark, Databricks, Java, Python, Scala, SparkSQL
Required Skills:
Machine Learning Basic Qualification: Additional Skills: This is a high PRIORITY requisition.
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.