Data Engineer (Digital Wallet)

Posted today

zortech solutionsScottsdale (AZ)

Data Warehousing SpecialistsComputer Systems Design Services

SENIORITY

Senior

About the role

Data Engineer (Digital Wallet)Location: Scottsdale AZ (hybrid) Duration: FTE & C2CJob Description: Must have: Skillset: Java, Scala, S3, Glue, Python, AWS.6-8 years of IT experience focusing on enterprise data architecture and management.Experience in Conceptual/Logical/Physical Data Modeling & expertise in Relational and Dimensional Data ModelingExperience with Databricks & on Prem, Structured Streaming, Delta Lake concepts, and Delta Live Tables requiredExperience with Spark Scala and Java programmingData Lake concepts such as time travel and schema evolution and optimizationStructured Streaming and Delta Live Tables with Databricks as a bonusExperience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation/supportAdvanced level understanding of streaming data pipelines and how they differ from batch systemsFormalize concepts of how to handle late data, defining windows, and data freshnessAdvanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etcUnderstanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermarks, etc. Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonusFamiliarity with concepts such as late data, defining windows, and how window definitions impact data freshnessAdvanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)Indexing and partitioning strategy experienceDebug, troubleshoot, design, and implement solutions to complex technical issuesExperience with large-scale, high-performance enterprise big data application deployment and solutionArchitecture experience in AWS environment a bonusFamiliarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonusExperience with Gitlabs and CloudWatch and ability to write and maintain Gitlabs for supporting CI/CD pipelinesExperience working with AWS Lambdas for configuration and optimization and experience with S3Familiarity with Schema Registry, and message formats such as Avro, ORC, etc.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.