Azure Data Engineer
techvilla solutionsAndrews Air Force Base (MD)
Azure Data Engineer
Posted 7 days ago
techvilla solutionsAndrews Air Force Base (MD)
SENIORITY
Lead
About the role
We are seeking an experienced Azure Data Engineer with strong expertise in Microsoft Azure, Azure Databricks, Microsoft Fabric, Python, PySpark, PL/SQL, and Power BI. The candidate will be responsible for building scalable data ingestion pipelines, transforming and standardizing data, ensuring data quality, and supporting analytics and reporting solutions across multiple data sources.
Key Responsibilities:
Design, develop, and maintain scalable data ingestion pipelines using Microsoft Azure and Azure Databricks.
Perform data transformation, cleansing, validation, and schema normalization using Python, PySpark, and SQL.Ingest and standardize internal and external partner data, ensuring accurate SKU, partner, and channel mapping.
Implement data quality checks, reconciliation processes, and validation rules across datasets.
Monitor data pipelines, troubleshoot failures, and perform exception handling and root cause analysis.
Manage data refresh schedules, pipeline orchestration, and operational monitoring workflows.
Support onboarding of new data feeds and integrations across enterprise systems.
Develop standardized data models to support analytics, reporting, and business intelligence requirements.
Work with Microsoft Fabric and Power BI to support data analytics and reporting solutions.
Utilize Azure Cosmos DB and related data services where applicable.
Implement data governance, security, compliance, data lineage, auditability, and traceability standards.
Support inventory data pipelines and deliver reliable, high-quality datasets for business reporting.
Collaborate with data analysts, business stakeholders, and cross-functional teams to understand data requirements.
Explore Microsoft Foundry capabilities to support AI-enabled data solutions where required.
Required Skills and Qualifications4–6 years of experience in data engineering, data integration, and data pipeline development.
Strong hands-on experience with Microsoft Azure data services.
Experience with Azure Databricks, PySpark, and Python for large-scale data processing.
Proficiency in SQL and PL/SQL for data transformation, querying, and validation.
Knowledge of Microsoft Fabric and its data engineering capabilities.
Experience with Microsoft Power BI for analytics and reporting integration.
Familiarity with Microsoft Power Platform and workflow automation.
Experience with Azure Cosmos DB or other NoSQL databases.
Familiarity with Microsoft Foundry and AI-enabled application development is desirable.
Strong understanding of ETL/ELT pipelines, data modeling, data quality, and data reconciliation.
Knowledge of data governance, security, compliance, and data lineage.
Strong analytical, troubleshooting, communication, and problem-solving skills.
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.