Senior Data Engineer
ltmTampa (FL)
About the role
Job Title: Sr. DATA EngineerWork Location : Tampa FL
Job Description:
Seeking a Senior professional with 3 to 5 years of experience in Python Scala and Spark SQL to design and optimize scalable big data processing solutions within the Databricks Spark SQL Scala Python Java ecosystemDevelop and maintain scalable data processing pipelines using Apache Spark with Python and Scala Utilize Spark SQL to analyze large datasets and extract meaningful insights supporting data driven decision making Collaborate with cross functional teams to integrate big data solutions into existing systems Optimize Spark jobs for performance and efficiency in distributed computing environments Ensure data quality and consistency across various data sources Stay updated with the latest advancements in Spark Scala Python and related big data technologies to continuously improve processing capabilities Roles and Responsibilities Design develop and deploy complex data processing workflows leveraging Apache Spark Scala Python and SparkSQL Write efficient reusable and maintainable code for Spark applications Troubleshoot and resolve performance bottlenecks in Spark jobs and data pipelines Collaborate with data engineers' data scientists and stakeholders to translate business requirements into technical solutions Conduct code reviews and provide mentorship to junior team members on best practices and coding standards Participate in architectural discussions and contribute to the evolution of big data platforms Monitor and maintain the health availability and reliability of Spark clusters and data services Karat Interview mandate
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.