CloudIngestRemote
Data Engineer with Gen AI
United States of America
Full Time
2 hours ago
$55 USD
H1B Sponsor Likely
Key skills
Data EngineeringDatabricksPySparkSQLSQL Performance TuningApache IcebergData WarehousingData ModelingLarge-scale Data ProcessingCloud-based Data PlatformsEnterprise AnalyticsAI-assisted Development ToolsGitHub CopilotAIAnalyticsGitHub
About this role
CloudIngest is seeking a Data Engineer with Gen AI expertise. The role involves developing data pipelines, optimizing SQL performance, and working with cloud-based data platforms.
Responsibilities:
- Strong hands-on experience with Databricks
- Experience developing data pipelines using PySpark
- Strong SQL development and performance tuning skills
- Experience with Apache Iceberg
- Knowledge of data warehousing concepts and data modeling
- Experience working with large-scale data processing environments
- Work with cloud-based data platforms and enterprise analytics environments
- Utilize AI-assisted development tools such as GitHub Copilot to improve coding efficiency and solution delivery
Requirements:
- 7+ years of Data Engineering experience
- Strong hands-on experience with Databricks
- Experience developing data pipelines using PySpark
- Strong SQL development and performance tuning skills
- Experience with Apache Iceberg
- Knowledge of data warehousing concepts and data modeling
- Experience working with large-scale data processing environments
- Work with cloud-based data platforms and enterprise analytics environments
- Utilize AI-assisted development tools such as GitHub Copilot to improve coding efficiency and solution delivery