Key skills
PythonPysparkDatabricksCI/CD pipelinesGitlabDatabase designCloud architectureAnalytical skillsKnowledge sharingAnalyticsAWSAzureRESTfulGitLabVersion ControlERPSAPCI/CDCommunication
About this role
SMX is seeking a skilled Junior Data Engineer to join their team in support of Enterprise Data Analytics Platform efforts for a Federal customer. The role focuses on analyzing current data and system interfaces, building and maintaining data pipelines, and developing CI/CD pipelines.
Responsibilities:
- Design new solutions using Databricks (Python, Pyspark) to deliver capabilities meeting business functional requirements
- Design modifications to existing data model solutions as needed
- Promote code into production using Gitlab
- Define test cases and verify test results to ensure solutions are functioning as designed
- Build data models and reports using datasets from ERPs and legacy systems
Requirements:
- U.S. citizenship and an active DoD Secret security clearance are required
- Bachelor's degree in Computer Science or related field
- 2 years of related work experience
- Strong analytical, problem-solving, and decision-making skills
- Hands on development experience (dependent on level)
- Proficiency in Python and Pyspark
- Familiarity with Databricks, developing data pipelines and workflow automation
- Familiarity with Dev/Ops and CI/CD pipelines using Gitlab
- Familiarity with database design and architecture; relational and non-relational
- Ability to work cross-functionally, and participate in discussions
- Knowledge of cloud architecture: commercial cloud vendors (AWS/Azure)
- Competence with software engineering tools and processes (estimation, issue tracking, version control, debugging, etc.)
- Proven ability to work independently on assigned tasks without any supervision
- Proven experience in knowledge sharing (i.e., code reviews, solid documentation)
- Driven, self-directed personality
- Strong sense of mission and commitment to making a difference
- Experience implementing RESTful APIs
- Python ninja
- Exceptional communication skills and the ability to foster positive outcomes from diverse interests of people and teams
- Experience working with the DoD
- Experience working with GFEBS or other SAP ERP system