Senior Data Engineer (GenAI / AWS)

Senior Data EngineerOur client is seeking a Senior Data Engineer with 6-10 years of experience to design and build advanced data pipelines and AI-powered document processing solutions on AWS. This role focuses on developing end-to-end workflows that integrate generative AI, vector databases, and RAG architectures to support intelligent agent systems. Responsibilities & QualificationsDesign and develop scalable data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend for extracting and processing structured and unstructured dataBuild automated document-processing workflows with document chunking, embeddings, vector indexing, and semantic search capabilitiesDevelop and maintain vector databases and knowledge bases to support RAG (Retrieval-Augmented Generation) systems and integrate them with AI agents for contextual information retrievalBuild and deploy AI agents using Claude Agent SDK and Amazon Bedrock AgentCore RuntimeCreate and maintain CI/CD pipelines using GitHub Actions to automate builds, testing, and deploymentsOptimize data pipelines for scalability, reliability, security, and performance across production environmentsImplement infrastructure-as-code solutions using Terraform and AWS CDK for repeatable, maintainable deploymentsRequirements 6-10 years of professional experience as a Data Engineer or similar roleStrong proficiency in Python, SQL, and TypeScriptHands-on experience with AWS services: Lambda, S3, Step Functions, Glue, IAM, and BedrockDemonstrated expertise with vector databases (Pinecone, pgvector, OpenSearch) and embedding technologiesExperience building RAG systems, knowledge bases, and semantic search solutionsProficiency with AI/ML frameworks and libraries: LangChain, LlamaIndex, and Claude Agent SDKExperience with Document AI, OCR technologies (Textract), and NLP services (Comprehend) Familiarity with infrastructure-as-code tools (Terraform, AWS CDK) and CI/CD automation (GitHub Actions)