PyData Global 2024

Sheetal Borar

Sheetal is a Senior Applied Scientist at Etsy and has six years of experience in data science and machine learning, with a career that spans Asia and Europe and active engagement with the global data science community. She worked at Amazon as an Applied Scientist in London, focusing on personalization, and as a Machine Learning Engineer at JP Morgan Chase in Hong Kong. She holds a master’s degree in Data Science and AI from a dual degree program in the Netherlands and Finland, during which she published papers at top-tier conferences. Currently, she leads a paper reading group in the Northeast, facilitating discussions with fellow data professionals.

Sheetal is deeply passionate about fostering and growing women-focused communities in tech. As a WiDS (Women in Data Science) ambassador, she actively supports initiatives that empower women in the field. Her dedication to community impact was recognized with the Social Impact Award in Germany.

The speaker's profile picture

Sessions

12-04
13:30
90min
Build Your Own Transformer (90 minutes)
Shefali Shrivastava, Chuxin Liu, Sheetal Borar

Colab Notebook Link: https://colab.research.google.com/drive/1faxDHE3LdAwH7MORdnJei87Q0WF1BhS0?usp=sharing
Make a copy to your local drive to start working on this notebook.

Ever wondered how groundbreaking language models like ChatGPT and Llama were built? The answer lies in transformer, a powerful neural network architecture. In this workshop, we'll dive deep into the inner workings of transformers, with specific focus on self-attention mechanism. We will guide you through the process of building one from scratch. Whether you're a beginner or an experienced practitioner, this workshop is designed to cater to all levels of expertise.

LLM Track
LLM Track