Empirical Analysis of LSTM Performance

Robin Chauhan, Pathway Intelligence
Oct 16, 2019
Vancouver BC Canada

This work explores how performance of Recurring Neural Networks scale with various parameters, to build intuition and understanding of the Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) layers.

 

OpenAI GPT and Friends

Robin Chauhan , Pathway Intelligence
May 15, 2019
Simon Fraser University VentureLabs in Harbourfront Center, Vancouver BC Canada

A brief but detailed talk on the most recent Natural Language Processing (NLP) models based on unsupervised pre-training, primarily GPT, BERT, and GPT-2. A mix of material from papers, secondary sources, and my own experience with running and customizing GPT-2.

 

Traditional Machine Learning vs Deep Learning

Robin Chauhan , Pathway Intelligence
Nov 3, 2017
Simon Fraser University VentureLabs in Harbourfront Center, Vancouver BC Canada

I presented my analysis of a Kaggle competition held in 2017, for predicting Instacart e-commerce reorders. This competition was of particular interest for a few reasons. Two of the top submissions provided a perfect case study in comparing traditional ML, using hand-designed features, with deep learning, which involved ensembles of models tasked with predicting different aspects of the result (including somewhat exotic models).