Skip to main content
David Careers

Senior Azure Databricks Engineer

Posted yesterday

airswiftArizona City (AZ)
Data Warehousing SpecialistsComputer Systems Design Services

SENIORITY

Senior

Apply (opens in a new tab)

About the role

Job Title: Data Engineer (Microsoft Fabric and Databricks)
Duration: 12 months (W2 Contract)
Schedule: 5/40 - Mon - Fri
Location: Reston, VA *Please note: We are only considering candidates who are U.S. Citizens or Green Card holders for this opportunity. This opportunity offers the chance to design, build, and support enterprise data platforms in a complex environment focused on analytics, AI initiatives, and project delivery. The role combines hands-on data engineering with platform administration across Microsoft Fabric, Databricks, Delta Lake, and OneLake. This position will play a key part in delivering scalable, secure, and reliable data solutions while supporting governance, performance optimisation, and operational excellence.
Required Education: Bachelor's degree in Computer Science, Engineering, Information Systems, Data Engineering, or a related discipline, or equivalent relevant experience
Required Experience:
  • 7-10 years of relevant experience in data engineering, data platforms, analytics, and cloud technologies
  • Minimum 3+ years of hands-on experience with Databricks and 2+ years working in Microsoft Fabric environments
  • Proven experience designing and supporting production-grade ETL/ELT and data integration solutions
  • Experience administering enterprise-scale Databricks and Microsoft Fabric platforms
  • Strong experience working with Azure data services and cloud-native architectures
  • Demonstrated experience in stakeholder engagement, solution ownership, and technical leadership
Required Skills:
  • Strong expertise in Databricks, Spark, Delta Lake, Microsoft Fabric, OneLake, Lakehouse, and Data Warehouse architectures
  • Advanced proficiency in Python, PySpark, SQL, and notebook-based development
  • Experience designing and implementing ETL/ELT, data ingestion, and data transformation pipelines for structured and unstructured data sources
  • Knowledge of batch processing, near real-time and streaming data ingestion from databases, APIs, files, cloud storage, and enterprise applications
  • Strong understanding of dimensional modelling, data warehousing, semantic data structures, and data marts
  • Experience implementing data quality frameworks, validation rules, reconciliation controls, and exception management processes
  • Ability to optimise Spark workloads, SQL queries, storage strategies, partitioning, and distributed data processing performance
  • Knowledge of Databricks workspace administration and Microsoft Fabric administration, including workspaces, capacities, Lakehouses, Data Warehouses, Dataflows, and Pipelines
  • Experience with Microsoft Entra ID, RBAC, access controls, service principals, identity integrations, secrets management, key vaults, and secure data access
  • Knowledge of platform monitoring, observability, troubleshooting, incident management, workload performance, and capacity planning
  • Experience with Git, Azure DevOps, CI/CD pipelines, release management, automated testing, and deployment standards
  • Understanding of metadata management, data lineage, cataloguing, governance processes, and compliance controls
  • Ability to communicate technical solutions, trade-offs, risks, dependencies, and delivery plans to technical and non-technical stakeholders
  • Ability to balance performance, scalability, reliability, security, and cost considerations in a fast-paced enterprise environment
Preferred Qualifications:
  • Experience mentoring engineers and supporting enterprise platform operations
  • Knowledge of Infrastructure as Code, automation frameworks, and deployment templates
  • Experience implementing enterprise data quality and reliability frameworks
  • Experience with Fabric capacity optimisation, Databricks cluster optimisation, workload management, and FinOps practices
  • Microsoft Certified: Fabric Analytics Engineer Associate
  • Microsoft Certified: Azure Data Engineer Associate
  • Databricks Certified Data Engineer Professional
  • Databricks Certified Data Engineer Associate
About Airswift: Airswift is an international workforce solutions provider within the energy, process and infrastructure industries. Airswift serves as a strategic partner to clients, offering a turnkey workforce solution to capture and deliver the top talent needed to complete successful projects by aligning with unique project needs. With over 1000 employees and 9,000 contractors operating in over 60 countries, Airswift's geographical reach and pool of talent available is unmatched in the industry.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this