Databricks Architect -- KATDC5738914
compunnelEdison (NJ)
About the role
Design develop and maintain data ingestion pipelines using Databricks and Lakeflow ConnectIntegrate data from various structured and unstructured sources into Delta Lake and other data storage systemsImplement realtime and batch ingestion workflows to support analytics and reporting needsOptimize data ingestion performance ensuring scalability reliability and cost efficiencyCollaborate with data architects analysts and business stakeholders to define data requirements and ingestion strategiesEnsure data quality lineage and governance compliance across the ingestion processStay up to date with emerging Databricks Lakehouse and data integration technologies and best practicesRequired QualificationsBachelors or Masters degree in Computer Science Information Systems Data Engineering or a related field 4 years of experience in data engineering or ETL developmentHandson experience with Databricks SQL PySpark Delta LakeProficiency with Lakeflow Connect for building and managing data ingestion workflowsStrong understanding of data integration patterns data modeling and data lakehouse architecturesExperience with cloud platforms Azure AWS or GCP and associated data servicesKnowledge of CICD version control Git and infrastructure as code practicesFamiliarity with data governance security and compliance standardsPreferred SkillsExperience with streaming technologies Kafka Event Hubs etcKnowledge of REST APIs and connectorbased ingestionExposure to machine learning data pipelines in DatabricksStrong problemsolving communication and collaboration skills
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
More like this