Data Engineer
United States
Full Time
2 hours ago
No H1B
Key skills
Data pipeline developmentETL processesBig data analysisAgile principlesPythonSQLPostgreSQLCI/CD pipelinesRSASGitAPI developmentTableauPowerBIShell scriptingShellETLAnalyticsBusiness IntelligenceVersion ControlAgileScrumCI/CDCollaboration
About this role
CGS Federal is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform. The role involves developing data pipelines, collaborating in an Agile/Scrum team, and ensuring the performance and reliability of data extraction and processing.
Responsibilities:
- Complete development efforts across data pipeline to store, manage, store, and provision to data consumers
- Being an active and collaborating member of an Agile/Scrum team and following all Agile/Scrum best practices
- Write code to ensure the performance and reliability of data extraction and processing
- Support continuous process automation for data ingest
- Achieve technical excellence by advocating for and adhering to lean-agile engineering principles and practices such as API-first design, simple design, continuous integration, version control, and automated testing
- Work with program management and engineers to implement and document complex and evolving requirements
- Help cultivate an environment that promotes customer service excellence, innovation, collaboration, and teamwork
- Collaborate with others as part of a cross-functional team that includes user experience researchers and designers, product managers, engineers, and other functional specialists
Requirements:
- Must be a US Citizen
- Must be able to obtain a Public Trust Clearance
- 7+ years of IT experience including experience in design, management, and solutioning of large, complex data sets and models
- Experience with developing data pipelines from many sources from structured and unstructured data sets in a variety of formats
- Proficiency in developing ETL processes, and performing test and validation steps
- Proficiency to manipulate data (Python, R, SQL, SAS)
- Strong knowledge of big data analysis and storage tools and technologies
- Strong understanding of the agile principles and ability to apply them
- Strong understanding of the CI/CD pipelines and ability to apply them
- Experience with relational database, such as, PostgreSQL
- Work comfortably in version control systems, such as, Git Repositories
- Experience creating and consuming APIs
- Experience with DHS and knowledge of DHS standards a plus
- Candidates will be given special consideration for extensive experience with Python
- Ability to develop visualizations utilizing Tableau or PowerBI
- Experience in developing Shell scripts on Linux
- Demonstrated experience translating business and technical requirements into comprehensive data strategies and analytic solutions
- Demonstrated ability to communicate across all levels of the organization and communicate technical terms to non-technical audiences