Skip to main content
David Careers

Data Engineer

Posted 38 days ago

prolim globalNew Brunswick (NJ)
Data Warehousing SpecialistsComputer Systems Design Services

SENIORITY

Senior

Apply (opens in a new tab)

About the role

Job ID: z5G7h3l6a1kMvyS65NP3c90KoA8p0AXa1woVYBCQVOA=Job Code: JPC 9035775
Location: Peoria, IL, 61654, Plano, TX, 75094, Dallas, TX, 75342, San Jose, CA, 95117, Edison, NJ, 08906, United States
Experience: 5-10 years
Contact: Vighneshwar Gouda
Contact Email: vighneshwar.gouda@prolim.comWe are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in Python, SQL, Spark, ETL processes, and cloud technologies to support data-driven decision-making and advanced analytics.
Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. Build and optimize data processing solutions using Python, SQL, and Apache Spark (PySpark).Develop batch and real-time data ingestion pipelines. Work with structured and unstructured datasets from multiple data sources. Design and implement cloud-based data solutions using Azure, AWS, or GCP.Develop and maintain data models, data lakes, and enterprise data warehouses. Integrate data from APIs, databases, and streaming platforms. Optimize data pipeline performance and ensure data quality. Collaborate with Data Scientists, Business Analysts, and Software Engineers. Implement CI/CD pipelines and DevOps best practices for data engineering. Troubleshoot production issues and provide ongoing support. Ensure compliance with data governance, security, and privacy standards.
Required: Skills 5+ years of experience as a Data Engineer. Strong programming skills in Python. Excellent SQL skills. Hands-on experience with Apache Spark / PySpark. Experience with ETL/ELT development. Strong knowledge of Data Warehousing concepts. Experience with Hadoop ecosystem (Hive, HDFS).Experience with Databricks. Experience with Apache Kafka. Hands-on experience with Apache Airflow or similar workflow orchestration tools. Experience working on Linux/Unix environments. Knowledge of Git and CI/CD pipelines.
Cloud Skills:
  • Experience with one or more of the following: Microsoft Azure (ADF, ADLS, Synapse)
  • Amazon Web Services (AWS)
  • Google Cloud Platform (GCP)
Preferred Skills:
  • SnowflakeDelta LakeDockerKubernetesTerraformScala or JavaPower BI or TableauREST APIsAgile/Scrum methodology
  • Experience working with large-scale enterprise data platforms
  • Experience5-10 years
  • SkillsPYTHON, SQL, Apache Spark, PySpark, Hadoop, Hive, ETL, ELT, Data Pipeline Development, Apache Kafka, Databricks, Azure Data Factory (ADF), Azure Synapse, Snowflake, Azure, AWS, GCP, Delta Lake, DATA WAREHOUSING, Data Modeling, LINUX, UNIX, Airflow, REST APIs, Git, CI/CD

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this