Paper Summary #12 - Image Recaptioning in DALL-E 3
Technical Paper: Improving Image Generation with Better Captions
OpenAI’s Sora is built upon the image captioning model which was …
Paper Summary #11 - Sora
Technical Paper: Sora - Creating video from text
Blog: Video generation models as world simulators
These are just short notes / …
Paper Summary #10 - Gemini 1.5 Pro
Technical Paper: Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Blog: Our next-generation model: …
Solving Substitution Ciphers using Markov Chain Monte Carlo (MCMC)
I was reading about Markov Chain Monte Carlo (MCMC) recently and discovered a very famous application of using them to decrypt …
Paper Summary #9 - Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
Paper: Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
Link: https://arxiv.org/abs/2305.14342 …
Paper Summary #8 - FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Paper: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Link: https://arxiv.org/abs/2205.14135
Authors: Tri …
Academic Log | October-December 2022
A collection of academic papers/blogs/talks/projects that I read/watched/explored during the month. I also include any small (or large) …
Academic Log | August/September 2022
A collection of academic papers/blogs/talks/projects that I read/watched/explored during the month. I also include any small (or large) …
Paper Summary #7 - Efficient Transformers: A Survey
Paper: Efficient Transformers: A Survey
Link: https://arxiv.org/abs/2009.06732
Authors: Yi Tay, Mostafa Dehghani, Dara Bahri, Donald …
Academic Log | June/July 2022
A collection of academic papers/blogs/talks/projects that I read/watched/explored during the month. I also include any small (or large) …
