CrowdStrike is a global leader in cybersecurity, dedicated to stopping breaches and redefining modern security with an AI-native platform. As a Senior Data Engineer, you will design and build reusable data integration components and frameworks to support Operational Data Store and Enterprise Data Lake Platforms, ensuring data accuracy and consistency across various sources.
Responsibilities:
- Design, develop, and maintain scalable, automated, framework driven and efficient data pipelines using scripting languages like Python, Airflow, Dbt and Cloud databases such as Snowflake, RedShift, etc
- Implement data integration solutions for various data sources like SFDC, Product Telemetry, NetSuite and other systems, ensuring data accuracy, consistency, and completeness
- Work closely with DevOps and data scientists to support their data platform automation needs
Requirements:
- 12+ years' experience in design and development of data pipeline automation extracting data from Cloud API based sources
- Experience developing complex automation frameworks, queries, data modeling, and extract, transform, and load (ETL) processes in SQL, Python, DBT, Apache Airflow or similar technical languages
- Deep Experience in scripting languages such as Python and Cloud database experience such as Snowflake, Redshift, etc. to facilitate rapid ingestion and dissemination of key data
- Proficient in transforming structured and unstructured data
- Experience working on CI/CD processes such as Jenkins, Gitlab CI/CD etc., and source control tools such as GitHub, etc
- Experience identifying and solving issues concerning data management to improve data quality, and clean, prepare and optimize data for ingestion and consumption
- Proven experience integrating and managing business data from enterprise applications to drive analytics and insights
- Bachelor's Degree in Computer Science, Information Technology, Computer Engineering, or related IT discipline; or equivalent experience