Key skills
AirflowAmazon RedshiftApacheAWSAzureBigQueryCassandraCloudDynamoDBEC2ETLGoogle Cloud PlatformHadoopHBaseJavaKafkaMongoDBNoSQLPythonScalaSparkSQLAIData EngineeringBIBusiness IntelligenceSnowflakeRedshiftApache SparkApache AirflowdbtGCPGoogle CloudLambdaS3CloudWatchGlueVersion ControlSalesforceJira
About this role
Role Overview
- Analyzing large amounts of business data
- Solving real world problems
- Developing metrics and business cases that will enable Business Insights
- Leveraging data from platforms such as Jira, Portal, Salesforce
- Working with Product Managers, Software Engineers and Business Intelligence Engineers to automate and scale the analysis
- Owning large datasets and implementing new data pipelines
- Designing, implementing, and supporting an analytical data infrastructure
- Designing, building, and maintaining efficient and scalable data pipelines and ETL processes
- Optimizing data storage and retrieval methods
- Managing AWS resources including EC2, S3, Glue, Lambda, etc.
- Collaborating with Data Scientists and Business Intelligence Engineers to recognize and help adopt best practices
- Maintaining internal reporting platforms/tools
- Interacting with internal users to establish and clarify requirements
- Collaborating with Engineering partners to help shape and implement the development of BI infrastructure
- Writing advanced SQL queries and Python code to develop solutions
- Collaborating across teams to align AI initiatives with organizational goals.
Requirements
- Bachelor's degree in Computer Science, Information Technology, or a related field
- 3-5 years of experience in data engineering or a related role, with demonstrated success in delivering data solutions
- AWS Glue, Lambda, S3, EC2, CloudWatch, Cloud Trail
- Dbt, Snowflake, SQL, Python, Qlik
- Proficient in SQL, with the ability to write complex queries, perform query optimization, and conduct performance tuning
- Experience with NoSQL databases, such as MongoDB, Cassandra, or DynamoDB, and an understanding of their appropriate use cases
- Strong programming skills in Python, Java, or Scala, with experience in data processing frameworks (e.g., Apache Spark, Hadoop)
- Experience with cloud platforms (AWS, Azure, GCP) and data services, such as AWS Redshift, Azure Synapse, or Google BigQuery
- Knowledge of big data technologies, including Hadoop, Spark, Kafka, and HBase, with experience in distributed data processing
- Familiarity with data orchestration tools, such as Apache Airflow for scheduling and managing data workflows
- Experience with data versioning and testing tools, such as DVC (Data Version Control) and dbt (data build tool)
- Understanding of data security practices, including encryption, access controls, and data masking.
Tech Stack
- Airflow
- Amazon Redshift
- Apache
- AWS
- Azure
- BigQuery
- Cassandra
- Cloud
- DynamoDB
- EC2
- ETL
- Google Cloud Platform
- Hadoop
- HBase
- Java
- Kafka
- MongoDB
- NoSQL
- Python
- Scala
- Spark
- SQL
Benefits
- Robust health insurance plans, including Medical, Dental, and Vision coverage
- 401(k) Retirement Plan with $1 for $1 Company Match up to 5%
- Paid Parental Leave
- Associate Assistance Plan
- Education Assistance Program
- Up to $30,000 in Adoption Assistance
- Up to three weeks of vacation annually
- Generous Holiday, Sick Leave, and Personal Day policies
- New Hire Referral Bonus Program
- Significant Home Purchase Discounts
- Everyone’s Included Day