Key skills
AirflowAWSAzureDockerETLJavaScriptJenkinsKubernetesLinuxMicroservicesNode.jsNumpyPandasPostgresPythonSparkSQLAIMachine LearningNLPLLMNumPyKubeflowELTTDDBDDAzure DevOpsPostgreSQLREST APIGitGitHubBitbucketAgileScrumCI/CDCommunication
About this role
Role Overview
- Contributing to business applications and POCs using Python and big data technologies (e.g., Spark).
- Development of Data Analysis, Data Processing engines using Python
- Development of REST API using Python
- Develop and maintain ETL/ELT workflows for batch and real-time data ingestion
- Development & Deployment of applications on AWS/Azure
- Ability to do POCs on new tech stack and to integrate the same in the applications on functional level
- Ability to understand the business requirements, system architecture and process guidelines
- Ability to code for multiple projects at a time
- Ability to code for complex requirements under tight timelines
- Ability to work with cross functional / domain teams
- Ability to handle end to end projects on individual basis
- Ability to work in a fast-paced and agile development environment
- Solve complex analytic challenges using analytic algorithms and AI
- Build and deploy predictive and prescriptive models using statistical modeling, machine learning, and optimization
- Create structured prompts for LLMs to perform tasks like summarization or classification.
- Develop routines to parse and integrate LLM outputs into downstream systems.
- Prepare and execute test plans and scripts for data pipelines.
Requirements
- Qualification: B.E or Post graduate in –Computer Science, Electronics & Instrumentation.
- Exp 2 to 4 Yrs. with minimum 2 yrs. In python & SQL development (Mandatory)
- Minimum 1 year of experience working with python > 3.x
- Minimum 1 year of implementing and delivering projects using CI/CD tools such as git, Jenkins, docker, Kubernetes, Kubeflow Pipelines, Airflow, Spark etc.
- Minimum of 1-year experience in building microservices and web API
- Hands on experience using numpy and pandas
- Experience working with PostgreSQL database will be added advantage.
- Experience working with Node JS and Node-Red will be added advantage.
- Devops experience and mindset is a big plus.
- Some experience using Google-OR tools would be an added advantage
- Exposure to building ETL pipelines and data integration; machine learning and NLP would be an added advantage.
- Good communication skill
- Must be flexible, independent and self-motivated.
- Team player and learning ability.
- Result orientation and focus on details.
- Strong analytical and problem-solving skills.
- Practical understanding of Object-Oriented Design Principles and Design Patterns
- Experience in secure product development lifecycle practices
- Proficiency in Visual Studio Code or Visual Studio with strong debugging skills such as watch, threads, modules, memory view, disassembly view etc.
- Experience working with Azure DevOps
- Software Development best practices like using GIT, collaborative platforms like Github or bitbucket
- Experience working in an Agile/Scrum development process
- Behavior Driven (BDD) or Test-Driven Development (TDD)
- Experience building apps and solutions in Windows and Linux.
- Experience working with data science teams and contributions to projects would be a huge plus.
Tech Stack
- Airflow
- AWS
- Azure
- Docker
- ETL
- JavaScript
- Jenkins
- Kubernetes
- Linux
- Microservices
- Node.js
- Numpy
- Pandas
- Postgres
- Python
- Spark
- SQL
Benefits
- Flexible work timings.
- Professional development opportunities.