Key skills
Data engineeringData pipeline developmentSQLPythonScalaETLELTOrchestration frameworksAWSAzureGCPData warehousesLakehouse architecturesSparkKafkaData modelingData governanceData optimizationAIData EngineeringAnalyticsBI
About this role
BeGig is a tech freelancing platform that connects skilled technology professionals with companies seeking specialized expertise. As a Data Engineer, you will work on freelance projects to build scalable data infrastructure and pipelines that enable analytics and AI-driven decision-making.
Responsibilities:
- Design and build data pipelines and data processing systems
- Develop ETL/ELT workflows for ingesting, transforming, and loading data
- Build and maintain scalable data architectures and storage solutions
- Integrate data from APIs, databases, cloud platforms, and external sources
- Optimize data performance, reliability, and pipeline efficiency
- Implement data quality checks, governance, and monitoring processes
- Manage structured and unstructured datasets across environments
- Support analytics, BI, and AI teams with reliable data access
- Document data models, workflows, and engineering standards
Requirements:
- Strong experience in data engineering and data pipeline development
- Proficiency in SQL and programming languages such as Python or Scala
- Experience with ETL/ELT tools and orchestration frameworks
- Familiarity with cloud platforms (AWS, Azure, GCP) and modern data stacks
- Experience with data warehouses and lakehouse architectures
- Knowledge of big data technologies such as Spark, Kafka, or similar tools
- Understanding of data modeling, governance, and optimization techniques
- Strong analytical and troubleshooting skills
- A self-driven freelancer who can independently deliver scalable data solutions