Senior Data Engineer

Job ID: 26-34069

Pay Range: $68/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities: Data Engineering & Pipeline Development: Design, develop, and maintain scalable data pipelines to ingest, process, transform, and integrate structured and unstructured data from multiple enterprise sources using Python, SQL, ETL/ELT frameworks, and data integration technologies. Build reliable data processing workflows to support AI, analytics, automation, and enterprise applications. Data Architecture & AI-Ready Data Preparation: Develop and maintain data models, storage architectures, and data transformation frameworks to organize and prepare enterprise data for AI/GenAI consumption. Work with operational documentation, network configurations, technical standards, policies, logs, telemetry, and runbooks to create structured, searchable, and reusable knowledge assets. Support RAG, embeddings, vector databases, semantic search, and context retrieval use cases. Data Governance & Metadata Management: Implement data governance standards and frameworks covering data quality, metadata management, data lineage, data ownership, stewardship, data classification, retention, and lifecycle management. Establish standards for data definitions, documentation, traceability, and accessibility to ensure enterprise data is accurate, consistent, secure, and suitable for downstream AI applications. Data Quality, Validation & Monitoring: Develop automated data quality checks, validation rules, data profiling, monitoring frameworks, and preventative/detective controls to ensure data accuracy, completeness, consistency, and freshness. Identify upstream data issues, perform root cause analysis, implement remediation strategies, and continuously optimize data pipelines and transformation processes. Cross-Functional Collaboration & Continuous Improvement: Collaborate with engineering, architecture, product, network operations, and governance teams to understand business and technical requirements and translate operational knowledge into reliable data assets. Establish reusable data engineering patterns, documentation standards, and best practices while monitoring data health, pipeline performance, governance compliance, and overall readiness of data for AI-driven solutions. Key Requirements and Technology Experience: Key Skills: Spark, Python, Data Modelling, Data Quality Financial services 5+ Years of Spark 5+ years of total Data Engineer experience 3+ years of Data Modelling experience Our client is a leading Financial Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration. Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.