Skip to main content

About the role

Job Title: Generative AI (GenAI) Architect
Location: NYC, NY (Hybrid)
Experience: 10+ Years in Software Engineering, Data & AI with 3+ Years in Generative AI, LLMs, and Enterprise AI Solutions
Job Summary: We are seeking an experienced Generative AI Architect to lead the design, development, and deployment of enterprise-scale AI solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and AI-powered automation. The ideal candidate will drive AI strategy, define architecture standards, and collaborate with business stakeholders, engineering teams, and leadership to deliver scalable, secure, and responsible AI solutions. Key ResponsibilitiesAI Architecture & Strategy Define and implement enterprise GenAI architecture and roadmap. Design scalable AI solutions using OpenAI, Azure OpenAI, Anthropic Claude, Gemini, and open-source LLMs. Evaluate emerging AI technologies and recommend adoption strategies. Establish AI governance, security, compliance, and responsible AI frameworks. Solution Design & Development Architect and implement: RAG (Retrieval-Augmented Generation) solutionsAI Agents and Multi-Agent Systems Conversational AI and Chatbots Knowledge Management Solutions Document Intelligence Platforms Design vector database architectures using Pinecone, Weaviate, ChromaDB, Qdrant, or Azure AI Search. Develop prompt engineering and prompt management strategies. Define scalable LLM orchestration patterns using LangChain, LlamaIndex, Semantic Kernel, AutoGen, CrewAI, or LangGraph. Cloud & Infrastructure Architect cloud-native AI solutions on: Microsoft AzureAWSGoogle Cloud Platform Design MLOps/LLMOps pipelines for deployment, monitoring, and optimization. Establish model observability, monitoring, and performance tracking frameworks. Optimize AI workloads for scalability, reliability, and cost efficiency.
Security & Compliance: Develop secure AI architectures aligned with enterprise security standards. Implement data privacy controls, PII protection, model governance, and audit mechanisms. Ensure compliance with regulatory frameworks such as GDPR, HIPAA, SOC2, and Responsible AI principles.
Stakeholder Management: Partner with business leaders to identify GenAI opportunities. Translate business requirements into scalable technical solutions. Lead architecture reviews, design sessions, and technical governance meetings. Mentor AI engineers, architects, and development teams.
Required Qualifications:
  • EducationBachelor's or Master's degree in Computer Science, Artificial Intelligence, Data Science, or related field.
  • Experience 10+ years of software engineering, solution architecture, or data engineering experience.3+ years in AI/ML architecture and GenAI solution design.
  • Hands-on experience building enterprise-grade GenAI solutions.
  • Technical Skills
  • Generative AI & LLMsOpenAI GPT-4/4oAzure OpenAI Service
  • Anthropic ClaudeGoogle GeminiLlama, Mistral, FalconAI Frameworks
  • LangChainLlamaIndexSemantic KernelLangGraphCrewAIAutoGenRAG & Search Technologies
  • Azure AI Search
  • ElasticsearchPineconeChromaDBWeaviateQdrantProgrammingPythonJavaC#REST APIsMicroservices Architecture
  • Cloud Platforms
  • Microsoft Azure (Preferred)AWSGCPDevOps & MLOpsDockerKubernetesTerraformGitHub Actions
  • Azure DevOpsMLflowPreferred Qualifications
  • Microsoft Azure AI Engineer Associate (AI-102)
  • Azure Solutions Architect Expert (AZ-305)AWS Machine Learning Specialty
  • Google Professional Machine Learning EngineerTOGAF Certification
  • Experience with Agentic AI and Autonomous Workflow Systems
Desired Skills:
  • Enterprise ArchitectureAI Governance
  • Responsible AIDesign Thinking
  • Stakeholder Management
  • Team Leadership
  • Strategic Planning
  • Solution Consulting
  • Key Deliverables
  • Enterprise GenAI Architecture BlueprintAI Governance FrameworkRAG and Agentic AI SolutionsLLM Platform StrategyAI Security & Compliance Standards
  • Production-Ready AI Applications

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this