Develop standardized practices for delivering new products and capabilities using Big Data & cloud technologies, including data acquisition, transformation, analysis, Modelling, Governance & Data management skills
Interact with senior client technology leaders, understand their business goals, create, propose solution, estimate effort, build architectures, develop and deliver technology solutions
Define and develop client specific best practices around data management within a cloud environment
Recommend design alternatives for data ingestion, processing and provisioning layers
Design and develop data ingestion programs to process large data sets in Batch mode using ADB, ADF, PySpark, Python, Snypase
Develop data ingestion programs to ingest real-time data from LIVE sources using Apache Kafka, Spark Streaming and related technologies
Have managed team and have experience in end to end delivery
Have experience of building technical capability and teams to deliver
Requirements
Minimum 7 years hands-on experience in one or more of the above areas
Minimum 10 years industry experience
Strong understanding & familiarity with all Cloud Ecosystem components
Strong understanding of underlying Cloud Architectural concepts and distributed computing paradigms
Experience in the development of large scale data processing.
Hands-on programming experience in ADB, ADF, Synapse, Python, PySpark, SQL
Hands-on expertise in cloud services like AWS, and/or Microsoft Azure eco system
Solid understanding of ETL methodologies in a multi-tiered stack with Data Modelling & Data Governance
Experience with BI, and data analytics databases
Experience in converting business problems/challenges to technical solutions considering security, performance, scalability etc.
Experience in Enterprise grade solution implementations.
Experience in performance benchmarking enterprise applications
Strong stakeholder, client, team, process & delivery management skills
Design and propose Azure-based data and AI solutions that align with customer objectives and solve business challenges.
Develop and present demonstrations, prototypes, and PoCs to showcase the value and capabilities of the proposed solutions.
Tech Stack
Apache
AWS
Azure
Cloud
ETL
Kafka
PySpark
Python
Spark
SQL
Benefits
Support, coaching and feedback from some of the most engaging colleagues around
Opportunities to develop new skills and progress your career
The freedom and flexibility to handle your role in a way that’s right for you