Data Engineer
prolim globalEdison (NJ)
About the role
Overview:
As a Data Engineer, you will design, build, and optimize scalable data pipelines and cloud-based platforms to empower data-driven decision-making. You will work within cross-functional teams to translate data into actionable insights and robust data models. You’ll tackle batch and real-time ingestion, ensure data quality, and implement CI/CD for data workflows. This role offers the chance to shape enterprise data architecture on cloud platforms and collaborate with data scientists and engineers. You will be a key contributor to scalable analytics and governance across the data stack.
Responsibilities:
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows Build and optimize data processing with Python, SQL, and Apache Spark (PySpark) Develop batch and real-time data ingestion pipelines Handle structured and unstructured data from multiple sources Design and implement cloud-based data solutions (Azure, AWS, GCP) Develop and maintain data models, data lakes, and data warehouses Integrate data from APIs, databases, and streaming platforms Optimize pipeline performance and ensure data quality Collaborate with Data Scientists, Business Analysts, and Software Engineers Implement CI/CD pipelines and DevOps practices for data engineering Troubleshoot production issues and provide ongoing support Ensure compliance with data governance, security, and privacy standards
Key requirements:
5+ years of Data Engineer experience Strong Python programming Excellent SQL skills Hands-on Apache Spark / PySpark ETL/ELT development experience Knowledge of Data Warehousing concepts Hadoop ecosystem experience (Hive, HDFS) Databricks experience Apache Kafka experience Airflow or similar workflow orchestration tool Linux/Unix environment experience Git and CI/CD familiarity Cloud experience with Azure, AWS or GCP collaboration with cross-functional teams problem-solving mindset effective communication Python SQL Apache Spark / PySpark
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.