Skip to main content

AI Data Engineer

Posted 6 days ago

sgaRockville (MN)

SENIORITY

Lead

Apply (opens in a new tab)

About the role

Job Description: Job DescriptionSoftware Guidance & Assistance, Inc., (SGA), is searching for an Data Scientistfor a contract assignment with one of our premier Regulatory clients. Must sit in one of these office locations: Rockville MD or Tysons VA. The Data Scientist (Conversational AI Analytics) develops analytics and derives insights from conversational data generated by AI-powered platforms. This role is responsible for designing clustering pipelines, building facet extraction workflows, and producing actionable intelligence on how users interact with chat systems. The Data Scientist works closely with engineers and stakeholders to surface usage patterns, identify emerging topics, and inform product decisions through data.
Responsibilities: Conversation Analytics & Insight Generation Design and implement analytics pipelines that extract meaningful patterns from large-scale chat conversation dataDevelop facet extraction approaches using LLMs to categorize conversations by request type, task performed, and topic discussedBuild dashboards and reporting artifacts that communicate usage trends, emerging topics, and user behavior to stakeholdersIdentify and quantify shifts in conversation patterns over time to inform product roadmap and content strategyTranslate analytical findings into actionable recommendations for platform improvement Clustering & Unsupervised Learning Architect and optimize hierarchical clustering pipelines using density-based algorithms (e.g., HDBSCAN) to group conversations by semantic similarityGenerate and manage text embeddings at scale using embedding models for downstream clustering and similarity tasksDesign multi-level clustering strategies that produce both granular groupings and higher-order category taxonomiesEvaluate cluster quality using persistence metrics, silhouette analysis, and domain-informed validationExperiment with clustering parameters, distance metrics, and dimensionality reduction techniques to improve grouping coherence Data Engineering & Pipeline Development Build and maintain data pipelines using Python for ingesting, transforming, and analyzing conversation datasetsDevelop automated workflows using cloud-native orchestration and compute services to run analytics at scale on scheduled cadencesWork with object storage, search engines, and relational databases to store and query analytical outputsImplement caching, batching, and incremental processing strategies to handle large embedding and clustering workloads efficientlyMaintain reproducible analysis environments and version analytical artifacts (models, cluster outputs, embeddings) LLM-Assisted Analysis Design and refine LLM prompts for facet extraction, cluster labeling, and conversation summarizationEvaluate LLM output quality for analytical tasks and iterate on prompt strategies to improve accuracyLeverage model infrastructure for embedding generation and LLM inferenceExplore emerging techniques in LLM-driven data analysis, topic modeling, and automated insight generation Quality & Testing Develop evaluation frameworks to measure clustering quality, facet extraction accuracy, and analytical pipeline correctnessBuild automated regression tests to detect drift in clustering outputs or degradation in categorization qualityValidate analytical results against known baselines and domain expertiseDocument methodologies, assumptions, and limitations of analytical approaches Security & Compliance Assist with adherence to technology policies and comply with all security controlsImplement secure coding practices, particularly in handling personally identifiable information (PII) and sensitive dataParticipate in threat modeling and security discussions for API and infrastructure componentsUnderstand and apply organizational security standards and best practices SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/. SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy.

Before you apply

Applying takes about a minute. These four things decide how fast it moves after that.

Your profile is current

It's what we read first. Occupations, seniority and locations matter more than a long history.

Two examples you can talk through

Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.

A number in mind

What you're on now and what would make you move. We negotiate better when we know both.

Your notice period

Employers plan around it, and it's the question that stalls offers most often.

Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.

More like this