Sr. Data Engineer

***THIS IS FOR A PROPOSAL***

Knowledge Management, Inc. (KMI) has the leadership and experience to deliver innovative technology, logistics and management solutions to meet real mission requirements. KMI is a Minority Business Enterprise (MBE) and Small Disadvantage Business (SDB) that specializes in Logistics, Warehouse Services, Distance Learning/Training, Enterprise Solutions, Financial Management Support, Program Management, Intelligence Analysis & Threat Assessment, and Data Analytics/Operations Research. Since 1998, our solutions and services have helped our clients improve performance, drive cost and operational effectives, and map technology needs for tomorrow's requirements.

Job Requisition: Sr. Data Engineer

Location: Washington, DC (remote with availability required between 6:00 a.m. and 6:00 p.m. EST, Monday through Friday)

Clearance: clearable for a Public Trust

Contract: 5+ years

Salary Range: Please provide your salary requirement

The Senior Data Engineer designs, builds, and maintains the data architecture and pipelines that support SBA OIG's Technology Solutions Division (TSD) in its loan fraud detection and investigative mission. The role works within SBA's Microsoft Azure cloud environment to migrate, transform, and structure data assets so that TSD's Data Analytics team can perform agile inquiries and systematic machine learning in support of audits and investigations.

Duties and Responsibilities

The Senior Data Engineer will perform the following duties in direct support of SBA OIG's data architecture and pipeline needs.

Provide highly skilled and authoritative expertise on data engineering methods and best practices, including code-first development approaches and modern pipeline design patterns.

Design, implement, and maintain an efficient, secure, stable, and flexible data architecture, with all assets managed via source control.

Design, implement, and maintain ELT/ETL pipelines for processing source data in Azure Synapse and Azure Machine Learning.

Review, maintain, and improve existing architecture and pipelines, including periodic audits addressing bottlenecks, deprecated dependencies, and architecture drift.

Establish quality controls for pipeline maintenance, and introduce error handling, logging mechanisms, and validation checks.

Incorporate source control for all pipelines and data analytics codebases to enable iterative code development while maintaining data architecture stability.

Optimize the ingestion, processing, and storage of a wide variety of datasets and data types, including modern columnar formats such as Parquet.

Develop self-service capabilities for SBA OIG analysts to query and export data for investigations and audits.

Coordinate with the Senior Data Scientists to ensure the architecture supports machine learning algorithms and data pipelines in Azure Machine Learning.

Develop standard operating protocols governing the authoring, development, validation, publishing, execution, and monitoring of all data pipelines and assets in the Azure environment.

Provide detailed documentation of the data architecture, including data dictionaries, entity-relationship diagrams, and pipeline process maps.

Maintain and expand the environment with additional datasets and services upon request, following a defined intake and testing process prior to production deployment.

Stay current with emerging AI tools relevant to data engineering and contribute to exploratory efforts evaluating automation and large language model-assisted capabilities.

Minimum Qualifications

Five (5) years of hands-on experience maintaining SQL databases and conducting advanced operations in SQL and T-SQL.

Five (5) years of hands-on experience designing, implementing, and maintaining ELT/ETL processes in cloud-based data analytics environments.

Three (3) years of hands-on experience working in Azure Synapse and Azure Machine Learning within the modern data stack; DP-203 or an equivalent certification is preferred.

Three (3) years of hands-on experience manipulating data in Python, with required proficiency in Pandas; PySpark or Polars experience is preferred, along with experience developing reusable, modular code.

Preferred: implementing pipelines and infrastructure using code-first approaches, including Python SDK, CLI, REST APIs, or infrastructure-as-code tooling.

Preferred: implementing source control and CI/CD workflows.

Preferred: demonstrated familiarity with AI coding assistants and large language model integration patterns.

Education

A Bachelor's degree in data engineering, computer science, data science, machine learning, mathematics, or a related field satisfies the education standard set forth in PWS Section 5.2.1.

In the absence of a bachelor's degree, five (5) years of applied work experience in data engineering, computer science, data science, machine learning, mathematics, or a related field will satisfy this requirement.

Required Certifications

Microsoft Certified: Azure Data Engineer Associate, or an equivalent Azure data engineering certification, is preferred consistent with the Azure Synapse and Azure Machine Learning experience.

Certifications supporting source control, CI/CD, or infrastructure-as-code practices are preferred but not required.

Benefits: All full-time employees are eligible to participate in our benefits programs:

• Health, dental, and vision insurance
• 401(k) retirement plan
• Paid time off (PTO) and holidays
• Group Term Life and Accidental Death and Dismemberment Insurance
• Voluntary Term Life Insurance
• Short and Long-term disability insurance

Equal Employment Opportunity Statement. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

E-Verify Statement. Knowledge Management, Inc. participates in E-Verify and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S. If E-Verify cannot confirm that you are authorized to work, KMI is required to give you written instructions and an opportunity to contact Department of Homeland Security (DHS) or Social Security Administration (SSA) so you can begin to resolve the issue before the employer can take any action against you, including terminating your employment. Employers can only use E-Verify once you have accepted a job offer and completed the Form I-9.

Pay Transparency Non-Discrimination Provision. Knowledge Management, Inc. will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR 60-1.35(c)

Disability Statement. If you have a disability and need reasonable accommodation or assistance at any point in the application or onboarding process, please email us at .