OpenAI GPT and Friends

Robin Chauhan , Pathway Intelligence
May 15, 2019
Simon Fraser University VentureLabs in Harbourfront Center, Vancouver BC Canada

A brief but detailed talk on the most recent Natural Language Processing (NLP) models based on unsupervised pre-training, primarily GPT, BERT, and GPT-2. A mix of material from papers, secondary sources, and my own experience with running and customizing GPT-2.

 

Traditional Machine Learning vs Deep Learning

Robin Chauhan , Pathway Intelligence
Nov 3, 2017
Simon Fraser University VentureLabs in Harbourfront Center, Vancouver BC Canada

I presented my analysis of a Kaggle competition held in 2017, for predicting Instacart e-commerce reorders. This competition was of particular interest for a few reasons. Two of the top submissions provided a perfect case study in comparing traditional ML, using hand-designed features, with deep learning, which involved ensembles of models tasked with predicting different aspects of the result (including somewhat exotic models).