Senior/Engineer - Data Analytics Engineering

1w1 week ago

Sandisk

Batu Kawan, MY · Full-time · MYR 42,000 – MYR 66,000

About this role

Sandisk understands how people and businesses consume data and relentlessly innovates to deliver solutions that enable today’s needs and tomorrow’s next big ideas. With groundbreaking innovations in Flash and advanced memory technologies, our solutions power the digital world. Sandisk meets people and businesses at the intersection of aspirations and the moment.

As Senior/Engineer in Data Analytics Engineering, assist in designing and developing NLP pipelines for entity recognition, summarization, sentiment analysis, and question answering. Preprocess text data for training LLMs and experiment with frameworks like Hugging Face Transformers, OpenAI API, and LangChain. Support fine-tuning models using LoRA, PEFT, or full training on domain-specific datasets.

Sandisk has two facilities recognized by the World Economic Forum as Global Lighthouse Network for 4IR innovations and Sustainability Lighthouses. We balance powerhouse manufacturing with an industry-leading portfolio recognized for innovation, performance, and quality. Our global reach ensures supply chain access to Flash memory.

Develop prompt engineering strategies and implement RAG techniques for context optimization. Document experiments and present findings to the team. Thrive in an inclusive environment embracing diversity for optimal outcomes.

Requirements

Bachelor's or Master’s degree in computer science/Engineering, data science or related field
Experience in programming language (Python, R) and database (SQL) to perform data mining and analysis
Knowledge of statistical techniques in data science (regression, properties of distribution)
Knowledge in machine learning techniques (neural network, machine learning)
Strong analytic skills and problem-solving skills

Responsibilities

Assist in the design and development of NLP pipelines for tasks like entity recognition, summarization, sentiment analysis, and question answering
Preprocess and clean text data for training and evaluation of LLMs
Experiment with state-of-the-art LLM frameworks (e.g., Hugging Face Transformers, OpenAI API, LangChain) to solve real-world text processing problems
Support fine-tuning of pre-trained models on domain-specific datasets using techniques like LoRA, PEFT, or full model training
Develop and maintain prompt engineering strategies for improving model performance
Research and implement techniques for RAG (Retrieval-Augmented Generation) and context optimization
Document experiments and present findings to the team

Benefits

Thrives on the power and potential of diversity
Committed to an inclusive environment where every individual can thrive through belonging, respect, and contribution
Opportunities to applicants with disabilities with accommodations in hiring process