• Paper Summary #6 - Language Models are Unsupervised Multitask Learners

  The GPT2 model which aimed to perform complex NLP tasks while relying only on a language model trained in a completely unsupervised fashion.

  19 min read   ·   May 23, 2021

  2021   ·   llm   transformer   paper-summaries   ·   LLMs

  

• Paper Summary #5 - XLNet: Generalized Autoregressive Pretraining for Language Understanding

  XLNet tries to overcome the limitations of BERT by having a autoregressive component while also capturing the bidirectional context.

  28 min read   ·   May 16, 2021

  2021   ·   llm   transformer   paper-summaries   ·   LLMs   NLP

  

• Paper Summary #4 - BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  The ground breaking paper that introduced the famous BERT model. This started the inflow of a large number of BERT-based language understanding models.

  23 min read   ·   May 09, 2021

  2021   ·   llm   transformer   paper-summaries   ·   LLMs   NLP

  

• Paper Summary #3 - Improving Language Understanding by Generative Pre-Training

  The first paper in the GPT set of models. This is OpenAI's GPT-1.

  21 min read   ·   May 02, 2021

  2021   ·   llm   transformer   paper-summaries   ·   LLMs   NLP

  

• Paper Summary #2 - Deep contextualized word representations (ELMo)

  The second post in the paper notes series. This time we take a look at ELMo.

  19 min read   ·   April 25, 2021

  2021   ·   representation learning   lstm   language model   paper-summaries   ·   NLP

  

• Paper Summary #1 - Attention Is All You Need

  The first of the paper summary series. This is where I briefly summarise the important papers that I read for my job or just for fun :P

  14 min read   ·   April 18, 2021

  2021   ·   attention   language model   paper-summaries   ·   NLP

  

• Deep Learning in the Browser - Exploring TF.js, WebDNN and ONNX.js

  A quick tutorial to set up a small scale deployment for your ML or DL model

  15 min read   ·   January 25, 2021

  2021   ·   model-deployment   machine learning   web   ·   MLOps

  

• Quick tutorial to deploy your ML models using FastAPI and Docker

  Just a quick tutorial to set up a small scale deployment for your ML or DL model

  9 min read   ·   January 25, 2021

  2021   ·   model-deployment   machine learning   web   ·   MLOps

  

• Androids Encryption (Crypto) - Pwn2Win CTF 2020

  My writeup for Androids Encryption challenge in the Pwn2Win CTF 2020

  11 min read   ·   June 01, 2020

  2020   ·   cryptography   ctf   writeups   ·   Information Security

  

• MalwareTech's VM1 Reversing Challenge

  My writeup for the VM1 reversing challenge posted by MalwareTech on his website.

  18 min read   ·   January 04, 2020

  2020   ·   reverse engineering   writeups   ·   Information Security