NumpyPandasPythonPyTorchScikit-LearnAIMachine LearningMLDeep LearningNLPLLMLarge Language ModelsRAGscikit-learnNumPy
About this role
Role Overview
Conduct experiments with LLMs and evaluate different architectures and techniques (SFT, RLHF, Adapters, etc.) to improve conversational AI quality;
Develop and maintain robust evaluation frameworks to assess model performance, accuracy, and user satisfaction using offline and online metrics;
Optimize models for inference, improving speed, efficiency, and scalability for production environments;
Fine-tune and adapt large language models using approaches such as LoRA, QLoRA, prompt/prefix tuning, and instruction tuning;
Collaborate closely with Data Scientists, Software Engineers, and Product Managers to integrate AI solutions into the product pipeline;
Participate in improving deployment and inference stack, including evaluation of serving frameworks such as vLLM and SGLang.
Requirements
Strong hands-on experience with LLM fine-tuning and adaptation techniques such as SFT, LoRA, QLoRA and etc.
Practical experience in training and improving NLP / LLM models, not only integrating third-party APIs or building RAG pipelines;
Deep understanding of Machine Learning, Deep Learning, and classical NLP concepts;
Experience with transformer-based architectures and modern NLP/LLM model development workflows;
Understanding of model evaluation methodologies, offline/online metrics, and experimentation frameworks;
Experience with inference optimization, quantization, and deployment/serving frameworks such as vLLM, SGLang, or similar;
Strong Python skills and practical experience with ML frameworks such as PyTorch, Transformers, NumPy, Pandas, Scikit-learn;
Good understanding of software engineering best practices and production-oriented development mindset;
English level B2+.
Tech Stack
Numpy
Pandas
Python
PyTorch
Scikit-Learn
Benefits
REMOTE OPPORTUNITY to work full-time;
Vacation 28 calendar days per year;
7 wellness days per year (time off) that can be used to deal with household issues, to lie down and recover without taking sick leave;
Bonuses up to $5000 for recommending successful applicants for positions in the company;
50% payment for professional training, international conferences, and meetings;
Corporate discount for English lessons;
Health benefits. According to the paychecks, if you are not eligible for corporate medical insurance, the company will compensate you with up to $ 1,000 gross per year per employee. This can be spent on self-purchase of health insurance or on doctor’s fees for yourself and close relatives (spouse, children);
Workplace organization. The company provides all employees with an equipped workplace and all the necessary equipment (table, armchair, wifi, etc.) in our offices or co-working locations. In the other locations, the company provides reimbursement of workplace costs up to $ 1000 gross once every 3 years, according to the paychecks. This money can be spent on the rent of the co-working room, on equipping the working place at home (desk, chair, Internet, etc.) during those 3 years;
Internal gamified gratitude system: receive bonuses from colleagues and exchange them for our merchandise, team building activities, massage certificates, etc.