Azure Data Lead

Posted 3 days ago

cynet systemsBrooklyn (NY)
Data Warehousing SpecialistsComputer Systems Design Services

SENIORITY

Lead

SALARY

$60.00hr

Apply

About the role

Job Overview: Pay Range: $60.00hr - $65.00hr Requirement/Must Have: Expertise in Python, OOP, and advanced Python design patterns. Proficiency in PySpark, Spark SQL, and SQL. Experience with Azure Databricks, Azure Data Factory, and ADLS Gen2. Knowledge of Apache Spark, Delta Lake, Data Lakehouse architecture, and distributed computing. Experience with MS SQL and Oracle PL/SQL. Proven experience as a senior data engineering leader with delivery of large-scale Databricks modernization programs. Responsibilities: Analyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution. Design, develop, and deploy enterprise-scale data pipelines on Azure Databricks. Build reusable PySpark frameworks and utility modules. Implement Delta Lake solutions using the Bronze Silver Gold architecture. Build robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics. Implement data quality, reconciliation, validation, and monitoring frameworks. Optimize Spark jobs including partitioning, bucketing, caching, broadcast joins, Adaptive Query Execution, and Delta optimization. Benchmark converted applications against original Python implementations. Nice to Have: Certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python. Skills: Python. PySpark. Databricks. ADF. Data Lake. Spark SQL. SQL. ADLS Gen2. Apache Spark. Delta Lake. MS SQL. Oracle PL/SQL. Qualification And Education: Strong verbal and written communication skills. Benefits: Our Benefits Include: Medical, Dental, and Vision Insurance 401(k) Retirement Plan Health Savings Account (HSA) Disability Insurance (Short-Term and Long-Term) Life and AD&D Insurance Paid Sick Leave (where required by applicable state or local law) Supplemental Insurance Plans Identity Theft Protection Pet Insurance Employee Wellness Programs Employee Assistance Program (EAP) Career Growth and Professional Development Opportunities Disclaimer: Benefits eligibility, accrual rates, and usage limits may vary based on employment status, length of service, and work location. Paid Sick Leave is provided in strict accordance with applicable state and municipal mandates. Cynet Systems Inc. reserves the right to modify, amend, or terminate any benefit plans at any time in accordance with applicable laws. About Cynet Systems Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading technology staffing and workforce solutions company serving Fortune 500 companies, government agencies, and enterprise organizations across the United States and Canada. We deliver agile, scalable talent solutions across IT, engineering, life sciences, clinical, and professional staffing, powered by a high-performing recruitment engine operating across North America and Asia. As a nationally and locally certified Minority Business Enterprise (MBE), Cynet Systems is committed to helping organizations build high-performing teams while empowering professionals to grow rewarding careers. Our organization is certified to ISO 9001, ISO 14001, ISO 27001, and SOC 2 Type II standards, reflecting our commitment to quality, security, operational excellence, and customer success.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this