Key skills
AirflowAWSETLPandasPostgresPythonSQLELTAnalyticsSnowflakedbtFastAPIServerlessEKSLambdaGitCI/CDPrototyping
About this role
Role Overview
- Design, implement, and maintain end-to-end data pipelines (ELT/ETL) with a focus on reliability, reprocessing, and cost-efficiency.
- Orchestrate jobs and routines using Airflow (AWS) and serverless functions (AWS Lambda); support deployments on EKS when needed.
- Model data in Snowflake (bronze/silver/gold layers) and develop transformations in dbt (macros, tests, docs).
- Build integrations and services in Python using FastAPI to expose/consume data and automate processes.
- Ingest, normalize, and version market data, with emphasis on historical data and distribution (batch; minimal streaming).
- Write high-performance SQL (tuning, partitioning/clustering in Snowflake, and in Postgres).
- Use Pandas for ad-hoc data handling, validations, and prototyping transformations.
- Ensure quality (dbt tests, data checks), observability (logs/metrics/alerts), security (access controls, masking), and documentation.
- Collaborate with business, analytics, and product teams to define SLAs, data contracts, and governance standards.
Requirements
- Strong experience with SQL (query optimization, relational and analytical modeling).
- Hands-on experience with Snowflake (warehousing, roles, tasks, performance, cost management) and dbt (models, tests, sources, exposures).
- Experience building data pipelines in Airflow (DAGs, sensors, retries, SLAs) and AWS Lambda.
- Knowledge of Postgres (ingestion, basic replication/CDC or maintenance, routines).
- Experience with Python for data (Pandas) and API development with FastAPI.
- Practice in batch-oriented ELT/ETL, versioning with Git, and CI/CD (secure deployment of pipelines/dbt models).
- Understanding of data security and governance (access control, lineage, documentation, sensitive data).
- Technical English for reading documentation.
Tech Stack
- Airflow
- AWS
- ETL
- Pandas
- Postgres
- Python
- SQL
Benefits
- Health and dental insurance;
- Meal and food allowance;
- Childcare assistance;
- Extended parental leave;
- Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) / TotalPass;
- Profit-sharing (PLR);
- Life insurance;
- Continuous learning platform (CI&T University);
- Discount club;
- Free online platform dedicated to physical and mental health and well-being;
- Pregnancy and responsible parenting course;
- Partnerships with online course platforms;
- Language learning platform;
- And many others