Sr Data Engineer

Deltek is a recognized global standard for project-based businesses that delivers software and information solutions to help organizations achieve their purpose. The Sr Data Engineer will design and implement robust data architectures for enterprise platforms, build scalable data pipelines, and collaborate with data science and analytics teams to deliver advanced data solutions while ensuring compliance and governance requirements are met.

Responsibilities:

• Design and implement data architecture for enterprise data platforms (data lakes, warehouses, lakehouse architectures)
• Build scalable data pipelines using modern ETL/ELT frameworks (e.g., Airflow, DBT); ensure data quality, reliability, and performance
• Implement Change Data Capture (CDC) and real-time streaming solutions using technologies such as Kafka and Spark Streaming
• Optimize data infrastructure for performance and cost, including partitioning, compression, and caching strategies
• Establish data governance practices: data lineage, quality monitoring, schema management, and access controls
• Lead technical initiatives for data platform modernization; evaluate and adopt new technologies and tools
• Mentor junior data engineers, conduct code reviews, and establish best practices
• Collaborate with data science and analytics teams to deliver data solutions for advanced analytics
• Support compliance requirements for data security, privacy, and regulatory needs (e.g., GDPR, SOC2)

Requirements:

• 5+ years of data engineering experience building large-scale data platforms on cloud infrastructure
• Extensive experience with cloud data platforms: AWS (Redshift, Glue, EMR, S3), Azure (Synapse, Data Factory, ADLS), or GCP (BigQuery, Dataflow, GCS)
• Expertise in SQL; proficiency in Python or Scala; experience with Spark for distributed data processing
• Hands-on experience with data pipeline orchestration tools (Airflow, DBT, Luigi, or similar)
• Experience with streaming platforms (Kafka, Kinesis, Pub/Sub) and event-driven architectures
• Deep knowledge of relational databases (PostgreSQL, Oracle, SQL Server) and NoSQL databases (MongoDB, Cassandra, DynamoDB)
• Strong skills in dimensional modeling, data normalization, and schema design
• Experience with Infrastructure as Code tools (Terraform, CloudFormation, or similar)
• Bachelor's degree in Computer Science, Engineering, or related field
• This position requires US Citizenship
• Master's degree in Computer Science, Engineering, or related field
• Experience with data compliance requirements (FedRAMP, ITAR, HIPAA)
• Experience with lakehouse platforms (Databricks, Delta Lake)
• Experience with CDC tools (GoldenGate, Debezium)
• Oracle Cloud experience