top of page
קאבר אליפסה (1)_edited.png

Expanding your horizon,

one shot at a time

In each shot we'll dive into a different data science challenge, demonstrating tools, concepts and methodologies.

So what's a shot? It's a single video shot that starts with an empty Jupyter Notebook, and finishes with a working solution.

Join the learning!

newsletter
new shot

Shot #

16

Speculative Decoding Made Easy With Only One Model

You already know that Speculative Decoding reduces LLM inference time, don't you? (If you don't, watch shot #14 to learn how Speculative Decoding works!) The magic behind Speculative Decoding lies in leveraging a smaller draft model. But what if you don't have a smaller model on hand? In this shot you'll learn how to achieve a 10% speedup via Speculative Decoding, by simulating a smaller model using the layers of the big model! This shot was filmed in front of a live audience 👥👥, as part of the One Shot Learning’s 2nd Anniversary Fest 🎉 (https://www.oneshotlearning.io/anniversary-fest-2024). The audience was thrilled with this festive event (just as we were). Want to know about future events? Join our Telegram community! https://t.me/one_shot_learning

Past Live Events

The Hosts

Yoel Zeldes

Algorithm Developer

  • LinkedIn
Roei Shor Photography-134.jpg

Over 14 years of experience as a software engineer and algorithm developer in various domains, including NLP, recommender systems, vision, and cybersecurity.

I am passionate about good quality code, interesting ideas and sophisticated algorithms. I love encountering elegant equations while trying to solve real-life problems.

Shuki Cohen

Data Scientist

  • LinkedIn
Roei Shor Photography-146.jpg

Seasoned Data Scientist with an emphasis on NLP, classical ML, visualization and experimentation.

 

Driven by great passion for the field, I am inspired by unintuitive insights and inferences made by smart algorithms. In my talks, I try to convey my typical spirit and enthusiasm while delivering crisp takeaways.

You can contact us at
oneshotlearningchannel@gmail.com

bottom of page