Data Engineer SME
Fort Bragg, North Carolina, United States of America
Full Time
5 days ago
Key skills
JavaScriptTypeScriptPythonGolangSQLNoSQLAIMLData WarehousingReactTailwindTailwind CSSSassSCSSHTML5CSS3ViteWebpackFastAPIGinEchoWebSocketsJestCypressTesting LibraryAWSAzureGCPPostgreSQLMySQLMongoDBRESTfulnpmyarnpnpmGitGitLabVersion ControlPerformance OptimizationAgileCI/CDCommunicationCollaboration
About this role
At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.
Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.
Requisition #: 1472Job Title: Data Engineer (SME)Location: Fort Bragg, NC (Hybrid Remote)Clearance Level: TS/SCI
SUMMARY
Agile Defense is seeking a Data Engineer to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources. This is not a Data Science, Big Data, ML-Ops, or AI-related role. Instead, this position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders.
JOB DUTIES AND RESPONSIBILITIES
· Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.· Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.· Collaborate with software development teams to optimize application-generated data for streamlined aggregation.· Ensure data integrity, security, and compliance with industry regulations and company policies.· Optimize query performance and improve data access patterns to support analytical and operational use cases.· Work with business stakeholders to define data requirements and improve data accessibility for decision-making.· Design and build APIs to support data ingestion, retrieval, and integration with external systems.· Develop and maintain event-driven architectures, utilizing event storage for real-time data processing
Education, Background, and Years of Experience
· Bachelor’s degree in Computer Science, Software Engineering, or a related technical field, or equivalent professional experience.· Minimum of eight (8) years of relevant professional experience.· Experience developing data pipelines, integration solutions, and data aggregation services in complex environments.· Must possess an active TS/SCI security clearance.· Due to U.S. Government contract requirements, only U.S. citizens are eligible for this position.
SKILLS & QUALIFICATIONS Required Skills
· 3+ years of experience in front-end development with a focus on React.· Strong proficiency in JavaScript (ES6+), TypeScript, HTML5, and CSS3.· Knowledge of modern CSS frameworks (Tailwind CSS, Styled Components, or SASS/SCSS).· Experience with build tools and package managers (Webpack, Vite, pnpm, Yarn, npm).· Familiarity with RESTful APIs, Eventstores, and WebSockets for data fetching.· Experience with testing frameworks (Jest, React Testing Library, Cypress) is a plus.· Knowledge of performance optimization techniques and best practices for front-end development.· Experience with CI/CD pipelines and version control (Git, GitLab, etc.).· Strong problem-solving skills and the ability to work independently or collaboratively.· Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).· Strong programming skills in Golang, Python, and JavaScript/TypeScript.· Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.· Familiarity with building APIs, data integration tools, and best practices for data aggregation.· Understanding of API-based data aggregation and event-driven architectures.· Experience working with streaming and batch data processing frameworks is a plus.· Ability to work independently and collaboratively within a team.
Preferred Skills
· Building microservice APIs in Golang/Python (e.g., Gin, Echo, FastAPI, etc.).· Designing, maintaining, and updating database schemas and configurations (SQL/NoSQL/EventStoreDB).· Aggregating user-created and imported classified data into versioned datasets.· Designing data provenance, lineage, retention, and management solutions.Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.
What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.
We also believe in supporting our employees by offering a competitive and comprehensive benefits package. To explore the benefits we offer, please visit our website under the Careers section.
Happy - Be Infectious.Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.
Helpful - Be Supportive.Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
Honest - Be Trustworthy.Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
Humble - Be Grounded.Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
Hungry - Be Eager.Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
Hustle - Be Driven.Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities
Our vision is to bring adaptive innovation to support our nation's most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility—leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests.
Requisition #: 1472Job Title: Data Engineer (SME)Location: Fort Bragg, NC (Hybrid Remote)Clearance Level: TS/SCI
SUMMARY
Agile Defense is seeking a Data Engineer to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources. This is not a Data Science, Big Data, ML-Ops, or AI-related role. Instead, this position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders.
JOB DUTIES AND RESPONSIBILITIES
· Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.· Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.· Collaborate with software development teams to optimize application-generated data for streamlined aggregation.· Ensure data integrity, security, and compliance with industry regulations and company policies.· Optimize query performance and improve data access patterns to support analytical and operational use cases.· Work with business stakeholders to define data requirements and improve data accessibility for decision-making.· Design and build APIs to support data ingestion, retrieval, and integration with external systems.· Develop and maintain event-driven architectures, utilizing event storage for real-time data processing
Education, Background, and Years of Experience
· Bachelor’s degree in Computer Science, Software Engineering, or a related technical field, or equivalent professional experience.· Minimum of eight (8) years of relevant professional experience.· Experience developing data pipelines, integration solutions, and data aggregation services in complex environments.· Must possess an active TS/SCI security clearance.· Due to U.S. Government contract requirements, only U.S. citizens are eligible for this position.
SKILLS & QUALIFICATIONS Required Skills
· 3+ years of experience in front-end development with a focus on React.· Strong proficiency in JavaScript (ES6+), TypeScript, HTML5, and CSS3.· Knowledge of modern CSS frameworks (Tailwind CSS, Styled Components, or SASS/SCSS).· Experience with build tools and package managers (Webpack, Vite, pnpm, Yarn, npm).· Familiarity with RESTful APIs, Eventstores, and WebSockets for data fetching.· Experience with testing frameworks (Jest, React Testing Library, Cypress) is a plus.· Knowledge of performance optimization techniques and best practices for front-end development.· Experience with CI/CD pipelines and version control (Git, GitLab, etc.).· Strong problem-solving skills and the ability to work independently or collaboratively.· Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).· Strong programming skills in Golang, Python, and JavaScript/TypeScript.· Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.· Familiarity with building APIs, data integration tools, and best practices for data aggregation.· Understanding of API-based data aggregation and event-driven architectures.· Experience working with streaming and batch data processing frameworks is a plus.· Ability to work independently and collaboratively within a team.
Preferred Skills
· Building microservice APIs in Golang/Python (e.g., Gin, Echo, FastAPI, etc.).· Designing, maintaining, and updating database schemas and configurations (SQL/NoSQL/EventStoreDB).· Aggregating user-created and imported classified data into versioned datasets.· Designing data provenance, lineage, retention, and management solutions.Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.
What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It's how we show up every day. It's who we are.
We also believe in supporting our employees by offering a competitive and comprehensive benefits package. To explore the benefits we offer, please visit our website under the Careers section.
Happy - Be Infectious.Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.
Helpful - Be Supportive.Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
Honest - Be Trustworthy.Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
Humble - Be Grounded.Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
Hungry - Be Eager.Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
Hustle - Be Driven.Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.
Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities