Data Engineer (BigQuery, DataProc, DataFlow) | Hybrid - Dallas, TX
samprasoftDallas (TX)
Data Engineer (BigQuery, DataProc, DataFlow) | Hybrid - Dallas, TX
Posted today
samprasoftDallas (TX)
SENIORITY
Lead
About the role
Job Title Advanced Data Engineer
Job Description:
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. Extensive Experience on BigQuery, DataProc and DataFlow platforms on Google Cloud platform. Having experience on Azure Databricks is an added advantage (not mandatory). Experience on Cluster capacity configurations and cloud optimization to meet application demand. Programming experience on Python, Shell scripting, PySpark and other data programming language. Programming experience on Apache Beam Java SDK for building effective heavy data pipelines and deploying them in GCP DataFlow. CICD process to deploy these pipelines in GCP. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with Data Visualization Dashboard, Metrics and etc. Build processes supporting data transformation, data structures, metadata, dependency and workload management. A successful history of manipulating, processing and extracting value from large disconnected datasets. Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores. Familiar with Deployment tool like Docker and building CI/CD pipelines. Experience supporting and working with cross-functional teams in a dynamic environment. 8+ years' experience in software development, Data engineering, and Bachelor's degree in computer science, Statistics, Informatics, Information Systems or another quantitative field. Postgraduate/master's degree is preferred. Experience in Machine Learning and Data Modeling is a plus.
Top Skills Needed/Required:
Extensive Experience on BigQuery, DataProc and DataFlow platforms on Google Cloud platform. Having experience on Azure Databricks is an added advantage (not mandatory). Programming experience on Python, Shell scripting, PySpark and other data programming language. Programming experience on Apache Beam Java SDK for building effective heavy data pipelines and deploying them in GCP DataFlow. CICD process to deploy these pipelines in GCP.What Makes a Resource Profile Stand OutPrevious experience tenure with prior clients Good hands-on experience on prior assignments
Day-to-Day Responsibilities:
- Handling business requirements and delivering them on Agile methodology.
- Contribution to the Project
- Handling business requirements and delivering them on Agile methodology
- Office Requirement1 or 2 days per week Please note that resources who will be working in Bentonville, AR, Reston, VA or some Texas locations must have a VendorSAFE background check completed.
- Opportunity to Extend or Convert to FTEYes Along with the required skills, it would be great if we can have profiles that are currently working somewhere or have just recently finished their assignment. We are also looking for candidates with at least 7-8 years or experience or more in Big Data.
Required Skills:
Data Analysis, Data Warehouse Additional Skills: Data Engineer This is a high PRIORITY requisition.
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.