Senior Data Engineer
Senior Data Engineer
Posted 5 days ago
SENIORITY
Lead
About the role
- Develop Python-based ETL/ELT pipelines ingesting data from APIs, flat files, databases, and SaaS platforms
- Build and deploy containerized jobs using Azure Container Apps Jobs, including scheduling, scaling rules, secrets management (Key Vault), and Container Registry integration
- Maintain data movement between on-premises SQL Server and cloud targets
- Design idempotent, fault-tolerant pipeline patterns with robust logging, alerting, and retry logic
- Partner with analytics teams to deliver clean, well-documented data models for Power BI and similar BI tools
- Qualifications5–8 years of hands-on data engineering in production environments
- Proven track record delivering data platforms on Azure and/or AWSExperience migrating legacy on-premises infrastructure to cloud-native solutions
- Hands-on experience with Azure Container Apps Jobs or a comparable containerized job execution platform
- Python — production-grade pipelines, transformations, and automationSQL — advanced T-SQL and ANSI SQL; SQL Server, Azure SQL, Redshift, and Fabric query engines
- Microsoft Fabric — Warehouses, Lakehouses, Data Pipelines, OneLakeAzure — ADF, Azure SQL, ADLS, Key Vault, Container Apps Jobs, Container Registry
- Containerization — Docker image development, container registry management, Container Apps Jobs (scheduling, scaling, secret injection)AWS — S3 for data lake storage, Redshift for cloud warehousing
- Data Modeling — dimensional modeling, star/snowflake schema, ER modeling for OLTP and OLAPDevOps — Git, GitHub, PR workflows, CI/CD pipelines
- Visualization — Power BI, Tableau
- Microsoft Fabric in production (Fabric Warehouses, OneLake integration)dbt or similar transformation frameworks
- Power BI semantic model development, dataset optimization, DirectQuery/Import tradeoffs
- Agile/Scrum experience
- Cloud certifications: DP-203 (Azure Data Engineer), AWS Certified Data Analytics, or equivalent
- Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field — or equivalent professional experience
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
