AI Weekly Update - January 31st, 2022
Thank you so much for watching, please subscribe for more Deep Learning and Ai videos! Please check out SeMI Technologies on YouTube as well, where I am hosting a podcast on Deep Learning for Search!
Paper Links:
Text and Code Embeddings by Contrastive Pre-Training: https://cdn.openai.com/papers/Text_an...
Introducing Text and Code Embeddings in the OpenAI API (Blog Post): https://openai.com/blog/introducing-t...
Nils Reimers - OpenAI GPT-3 Text Embeddings - Really a new state-of-the-art in dense text embeddings? / openai-gpt-3-text-embeddings-really-a-new-...
Training language models to follow instructions with human feedback: https://cdn.openai.com/papers/Trainin...
Reasoning Like Program Executors: https://arxiv.org/pdf/2201.11473.pdf
Synchromesh: Reliable Code Generation from Pre-Trained Language Models: https://arxiv.org/pdf/2201.11227.pdf
Artefact Retrieval: Overview of NLP Models with Knowledge Base Access: https://arxiv.org/pdf/2201.09651.pdf
GreaseLM: Graph Reasoning Enhanced Language Models for Question Answering: https://arxiv.org/pdf/2201.08860.pdf
Relational Memory Augmented Language Models: https://arxiv.org/pdf/2201.09680.pdf
CodeRetriever: Unimodal and Bimodal Contrastive Learning for Code Search: https://arxiv.org/pdf/2201.10866.pdf
Out-of-Domain Semantics to the Rescue! Zero-Shot Hybrid Retrieval Models: https://arxiv.org/pdf/2201.10582.pdf
Natural Language Descriptions of Deep Visual Features: https://arxiv.org/pdf/2201.11114.pdf
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers: https://arxiv.org/pdf/2102.00529.pdf
Environment Generation for Zero-Shot Compositional Reinforcement Learning: https://arxiv.org/pdf/2201.08896.pdf
AI in health and medicine: https://www.nature.com/articles/s4159...
Chapters
0:00 Introduction
1:28 Text and Code Embeddings by Contrastive Pre-Training
10:20 Training LMs to Follow Instructions
12:34 Reasoning Like Program Executors
14:36 Synchromesh
17:38 Artefact Retrieval
19:38 GreaseLM
21:58 Relational Memory Augmented Language Models
23:45 CodeRetriever
24:48 Out-of-Domain Semantics to the Rescue!
27:36 Natural Language Descriptions of Deep Visual Features (MILAN)
30:05 Decoupling the Role of Data, Attentino, and Losses in Multimodal Transformers
32:10 Environment Generation for Zero-Shot Compositional Reinforcement Learning
34:52 AI in Health and Medicine