Senior PySpark Developer / Engineer
Senior PySpark Developer / Engineer
Posted 45 days ago
SENIORITY
Senior
About the role
- Must-Have Technical Skills: PySpark, SQL and UNIXPySpark Expertise-Strong hands-on experience with PySpark architecture understanding
- Clear understanding of how PySpark jobs execute in the background
- Ability to read, write, analyze, and enhance PySpark scripts and configurationsSQL Proficiency: Strong SQL skills
- Experience working with SQL as part of data processing and PySpark job execution
- Unix Shell Scripting: Should have good understanding of Unix shell scripting.
- Ability to understand backend Unix scripts supporting PySpark workflows
- Experience in reading, analyzing, writing, and modifying shell scripts for PySpark integrationETL Knowledge: Hands-on experience with ETL processes using any programming language or framework
- Ability to understand and work with complementary ETL workflows alongside PySparkJob Scheduling & Automation
- Experience with at least one enterprise scheduling/automation tool such as: Autosys/ Control‐M/ Airflow/ or similar tools used in production environments
- Nice-to-Have Skills
- Experience working with finance domain applications
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
