ETL Developer - TS/SCI with Polygraph Jobs
$200,000 per year
Apply (opens in a new tab)ETL Developer - TS/SCI with Polygraph Jobs
Posted today
SENIORITY
Senior
SALARY
$200,000 per year
About the role
- Design, develop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform
- Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues
- Obtain an understanding of existing NiFi flows with minimal support from others
- Develop new NiFi flows that adopt best practices of existing NiFi flows
- Take feedback on NiFi flows and develop requested changes
- Take direction and communicate status via a ticketing system
- Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions
- Interface with a development cycle using a local development environment of containerized infrastructure and version control via Git and NiFi Registry
- Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints
- Take feedback from analysts on nuances to support application data layers
- Programmatically manipulate and transform data from multiple sources
- Query and analyze large datasets using SQLRetrieve and process data from external systems via APIsSupport data quality, integrity, and performance optimization efforts
- Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements
- Develop Python in support of data science related efforts or ETL prototypes
- Creativity to experiment and recommend best practice coding improvements
- Drive to adopt and recommend AI into development processes
- Ability to design and develop custom NiFi processors using Java
- Experience with AWS cloud services for data ingestion and processing
- Strong experience with PostgreSQL for data management
- Hands-on experience with Apache Airflow
- Hands-on experience with Apache NiFiHands-on experience with NiFi registry and GitHands-on experience with Git and repository actions and pull requests
- Hands-on experience in Python for data manipulation and API interfacing
- Experience working with geospatial data and related tool
- Understanding of basic data science concepts and tools
Before you apply
Applying takes about a minute. These four things decide how fast it moves after that.
Your profile is current
It's what we read first. Occupations, seniority and locations matter more than a long history.
Two examples you can talk through
Not a portfolio — just two pieces of work where you can explain the decisions and what you'd change.
A number in mind
What you're on now and what would make you move. We negotiate better when we know both.
Your notice period
Employers plan around it, and it's the question that stalls offers most often.
Once you apply, someone reads it and calls you before anything reaches the employer — usually within two working days.
