Skip to main content
David Careers

Lead Data Engineer

Posted yesterday

zortech solutionsTarrytown (NY)
Data Warehousing SpecialistsComputer Systems Design Services

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Lead Data Engineer
Location: Tarrytown NY 10591 (Hybrid role – 3 days onsite 2 days WFH)
Duration: 6-12+ Months
Job Description:
  • Must have AWS, Apache Airflow, Pyspark, Redshift
  • Candidate should have 12+ years of experience in Data Engineering
  • Designing, creating, testing and maintaining the complete data management & processing systems. Working closely with the stakeholders & solution architect.
  • Ensuring architecture meets the business requirements.
  • Building highly scalable, robust & fault-tolerant systems. Taking care of the complete ETL process.
  • Knowledge of Hadoop ecosystem and different frameworks inside it – HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala and KafkaMust have knowledge and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift
  • Must have experience on SQL-based technologies (e.g. MySQL/ Oracle DB) and NoSQL technologies (e.g. Cassandra and MongoDB)
  • Should have Python/Scala/Java Programming skills
  • Discovering data acquisitions opportunities
  • Finding ways & methods to find value out of existing data.
  • Improving data quality, reliability & efficiency of the individual components & the complete system.
  • Creating a complete solution by integrating a variety of programming languages & tools together.
  • Creating data models to reduce system complexities and hence increase efficiency & reduce cost.
  • Introducing new data management tools & technologies into the existing system to make it more efficient.
  • Setting & achieving individual as well as the team goal.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this