Java Spark Backend Developer
Java Spark Backend Developer
Posted 6 days ago
SENIORITY
Senior
About the role
- Architect and build a high-performance, metadata-driven aggregation platform using Apache Spark.
- Design and implement novel algorithms to reduce the computational complexity of high-dimensional risk aggregations.
- Design and build a rich semantic layer over the aggregated data, creating a business-friendly data model that can power both traditional BI and next-generation AI-driven queries.
- Solve deep computer science challenges within Spark, choosing the right underlying mechanisms, designing optimal data partitioning strategies, and minimizing network shuffling to ensure extreme performance.
- Build a self-service platform that empowers quants and risk managers to define new aggregations without writing new code.
- Pioneer innovative ways of making data available to users by building high-performance APIs for UIs, and providing curated datasets for Python Notebooks that enable deep forensic analysis and calculation replication.
- Load the final, aggregated risk metrics into high-performance OLAP stores (Apache Pinot, Apache Druid) to serve the analytics and UI layers.
- You will receive the following benefits:
- Medical Insurance - Four medical plans to choose from for you and your family
- Dental & Orthodontia Benefits
- Vision Benefits
- Health Savings Account (HSA)
- Health and Dependent Care Flexible Spending Accounts
- Voluntary Life Insurance, Long-Term & Short-Term Disability Insurance
- Hospital Indemnity Insurance 401(k) including match with pre and post-tax options
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
