Key skills
PythonSQLData pipelinesDistributed data processingData warehousingCI/CD practicesDebugging skillsPerformance optimizationBig data toolsStreaming systemsCloud platformsData lakesML data pipelinesData governanceJavaMachine LearningMLETLELTData WarehousingData LakeAnalyticsSparkKafkaHadoopAWSAzureGCPKinesisVersion ControlPerformance OptimizationCI/CD
About this role
Objectways is seeking a Data Engineer to design, build, and optimize scalable data pipelines and distributed data systems. The role involves transforming raw data into reliable datasets that support analytics, machine learning, and operational systems.
Responsibilities:
- Design and implement scalable ETL/ELT pipelines
- Build reliable batch and real-time data processing workflows
- Develop data ingestion systems from multiple sources (APIs, streaming, files, databases)
- Ensure data quality, validation, and monitoring
- Optimize data storage, query performance, and cost efficiency
- Design data models and schemas for analytical and operational use cases
- Maintain data warehouse and/or data lake environments
- Collaborate with backend, ML, and analytics teams
Requirements:
- Strong proficiency in Python and/or Java
- Solid SQL skills and experience with relational databases
- Experience building production-grade data pipelines
- Understanding of distributed data processing concepts
- Experience with data warehousing and data modeling
- Familiarity with version control and CI/CD practices
- Strong debugging and performance optimization skills
- Experience with big data tools (Spark, Hadoop, etc.)
- Experience with streaming systems (Kafka, Kinesis, etc.)
- Experience with cloud platforms (AWS / GCP / Azure)
- Experience with data lakes and modern warehouse platforms
- Exposure to ML data pipelines or feature engineering workflows
- Knowledge of data governance and data quality frameworks