AWS Databricks Data Engineer Lead
kaavBel Air (MD)
AWS Databricks Data Engineer Lead
Posted yesterday
kaavBel Air (MD)
SENIORITY
Lead
About the role
Data Engineer LeadData Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise. As a Data Engineer you will play a key role in growing and transforming analytics landscape. Looking for Data Engineer lead having experience on building ingestion solutions to integrate 3rd party data using databricks. Strong python skillsAWS Cloud infrastructure knowledge commonly used AWS Glue S3 IAM Airflow Experience with building data pipelines using Databricks on AWSKnowledge and hands-on Snowflake Experience in Agile methodologies and Atlassian tools like JIRAExpertise in using version control tools like Git Bitbucket Experience on CICD using Kubernetes GIT and Monitoring and ing tools Experience on data migration from OnPrem databases to AWS Cloud on S3Acts as a single point of contact for databricks projects for customer Provides innovative and cost-effective solution using AWS databricks python Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit As a leader in the Cloud Engineering you will be responsible for the overseeing development Learn adapt quickly to new Technologies as per the business need Develop a team of Operations Excellence building tools and capabilities that the Development teams leverage to maintain high levels of performance scalability security and availability Understand where to obtain information needed to make the appropriate decisions Demonstrate ability to break down a problem to manageable pieces and implement effective timely solutions Identify the problem versus the symptoms Develop solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit The Candidate must have 35 yrs of experience in Databricks AWS PythonHands on experience on AWS Cloud platform especially S3 Glue Lamda Experience on spark scripting Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform Relevant experience with ETL methods and with retrieving data from dimensional data models and data warehouses Strong experience with relational databases and data access methods especially SQLKnowledge of Amazon AWS architecture and design Bachelors degree or equivalent training with data tools techniques and manipulation Four years of data engineering or equivalent experience Databricks-SparkSQL-Scala/Python/JavaData Analysis Data Engineer
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.