Key skills
AWSETLPandasPostgresPythonReactTypeScriptRArtificial IntelligenceFastAPIS3PostgreSQLCaching
About this role
Role Overview
- Evolve the ETL pipeline focusing on performance (filtering, joins, deduplication, aggregation).
- Optimize reading/writing of large files (CSV, Parquet, gzip).
- Design and operate persistence in PostgreSQL (schema, indexes, queries).
- Implement caching, server-side pagination and sorting for large datasets.
- Ensure stability and scalability of processing.
Requirements
- Backend architecture and stack in Python (FastAPI) with an ETL pipeline and data reconciliation.
- Processing of large volumes with Polars/pandas/DuckDB.
- Persistence and metadata in PostgreSQL (jobs, manifests, history, parameters).
- File and results storage on AWS S3.
- Experience with Artificial Intelligence.
- Frontend in React + TypeScript with data grids, filters, and server-side pagination.
- Experience tuning ETL and handling large-scale data processing.
- Modeling and optimization in PostgreSQL (indexes, EXPLAIN, VACUUM/ANALYZE).
- Familiarity with job-oriented architecture patterns and queues.
Tech Stack
- AWS
- ETL
- Pandas
- Postgres
- Python
- React
- TypeScript
Benefits
- Meal allowance (Flash)
- R$ 900.00 monthly;
- Bradesco Health and Dental plan;
- Specialization program (up to 30% of your postgraduate tuition for the first 12 monthly payments; available after 12 months of employment);
- Language allowance;
- Clude Saúde (medical consultation platform);
- Birthday day off + gift;
- TotalPass;
- Udemy platform;
- Paid referral (for each hired referral we reward the employee with R$1,000.00);
- Merits platform (Domvs' exclusive platform to give and receive merits. Accumulated merits can be exchanged for vouchers such as iFood, Outback...).