Home
Videos uploaded by user “Graham Neubig”
CMU Neural Nets for NLP 2017 (1): Class Introduction & Why Neural Nets?
 
01:11:44
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Introduction to Neural Networks * Example Tasks and Their Difficulties * What Neural Nets can Do To Help Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-01-intro.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/01-intro Next Video: (2) Neural Language Models: https://www.youtube.com/watch?v=tNC9tpGqQb0 See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 11100 Graham Neubig
CMU Neural Nets for NLP 2017 (23): Debugging Neural Nets for NLP
 
01:13:47
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Diagnosing your Problem * Debugging Training Time Problems * Debugging Decoding Time Problems * Combatting Overfitting * Dealing with Loss/Eval Disconnect Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-23-debugging.pdf Previous Video: https://youtu.be/rOiXjukeHSw Next Video: https://youtu.be/4AQbrT-GD2k See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 558 Graham Neubig
CMU Neural Nets for NLP 2017 (17): Adversarial Learning
 
55:40
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * (Generative) Adversarial Networks * Where to use the Adversary?: Features vs. Outputs * GANs on Discrete Outputs * Adversaries on Features Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-17-adversarial.pdf Previous Video: https://youtu.be/F1hZfoh-wX4 Next Video: https://youtu.be/EKvkrv4K0qo See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1300 Graham Neubig
CMU Neural Nets for NLP 2017 (9): Attention
 
01:03:18
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Attention * What do We Attend To? * Improvements to Attention * Specialized Attention Varieties * A Case Study: "Attention is All You Need" Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-09-attention.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/09-attention Previous Video: https://youtu.be/6DSg-AA-Ur0 Next Video: https://youtu.be/e5sPNlgbZAE See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 5647 Graham Neubig
CMU Neural Nets for NLP 2017 (5): Convolutional Networks for Text
 
01:11:02
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Bag of Words, Bag of n-grams, and Convolution * Applications of Convolution: Context Windows and Sentence Modeling * Stacked and Dilated Convolutions * Structured Convolution * Convolutional Models of Sentence Pairs * Visualization for CNNs Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-05-cnn.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/05-cnn Previous Video: https://youtu.be/9ERZsx__rBM Next Video: https://youtu.be/TVp_75uJkPw See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 5038 Graham Neubig
CMU Neural Nets for NLP 2017 (6): Recurrent Neural Networks
 
01:01:17
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Recurrent Networks * Vanishing Gradient and LSTMs * Strengths and Weaknesses of Recurrence in Sentence Modeling * Pre-training for RNNs Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-06-rnn.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/06-rnn Previous Video: https://youtu.be/vnzKAhs7nds Next Video: https://youtu.be/7j20MC6J_QU See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1910 Graham Neubig
CMU Neural Nets for NLP 2017 (3): Models of Words
 
01:09:03
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Describing a word by the company that it keeps * Counting and predicting * Skip-grams and CBOW * Evaluating/Visualizing Word Vectors * Advanced Methods for Word Vectors Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-03-wordemb.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/03-wordemb Previous Video: https://youtu.be/tNC9tpGqQb0 Next Video: https://youtu.be/9ERZsx__rBM See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 2431 Graham Neubig
CMU Neural Nets for NLP 2019 (1): Intro/Why Neural Nets for NLP
 
01:09:00
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Spring 2019) covers: * Introduction to Neural Networks * Example Tasks and Their Difficulties * What Neural Nets can Do To Help Site: http://phontron.com/class/nn4nlp2019/schedule/class-introduction.html Sample Code: https://github.com/neubig/nn4nlp-code/tree/master/01-intro
Views: 409 Graham Neubig
CMU Neural Nets for NLP 2017 (15): Latent Variable Models
 
01:13:00
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Generative vs. Discriminative, Deterministic vs. Random Variables * Variational Autoencoders * Handling Discrete Latent Variables * Examples of Variational Autoencoders in NLP Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-15-latent.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/15-vae Previous Video: https://youtu.be/7gS8pwRwHMc Next Video: https://youtu.be/F1hZfoh-wX4 See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1474 Graham Neubig
CMU Neural Nets for NLP 2017 (16): Reinforcement Learning
 
01:09:16
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * What is Reinforcement Learning? * Policy Gradient and REINFORCE * Stabilizing Reinforcement Learning * Value-based Reinforcement Learning Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-16-rl.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/16-rl Previous Video: https://youtu.be/QKr8Ar86xSQ Next Video: https://youtu.be/twjlGZzUM68 See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1619 Graham Neubig
CMU Neural Nets for NLP 2017 (12): Transition-based Dependency Parsing
 
01:00:13
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * What is Transition-based Parsing? * Shift-reduce Parsing w/ Feed-forward Nets * Stack LSTM * A Simple Alternative: Linearized Trees Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-12-transitionparsing.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/12-transitionparsing Previous Video: https://youtu.be/e5sPNlgbZAE Next Video: https://youtu.be/gRtEW6Q5XJE See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1519 Graham Neubig
CMU Neural Nets for NLP 2017 (2): A Simple (?) Exercise: Predicting the Next Word in a Sentence
 
01:17:15
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Describing a word by the company that it keeps * Counting and predicting * Skip-grams and CBOW * Evaluating/Visualizing Word Vectors * Advanced Methods for Word Vectors Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-03-wordemb.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/03-wordemb Previous: https://www.youtube.com/watch?v=Sss2EA4hhBQ Next: https://www.youtube.com/watch?v=xCAtxcc0KIE See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 3742 Graham Neubig
CMU Neural Nets for NLP 2017 (10): Structured Prediction
 
01:20:01
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Teacher Forcing and Exposure Bias * Local vs. Global, Label Bias * The Structured Perceptron * Structured Max-margin Objectives Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-10-structure.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/10-structured Previous Video: https://youtu.be/MhTMgFvoaD8 Next Video: https://youtu.be/p8K35mE66Ic See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1490 Graham Neubig
CMU Neural Nets for NLP 2017 (7): Using/Evaluating Sentence Representations
 
01:05:12
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Sentence Similarity * Textual Entailment * Paraphrase Identification * Retrieval Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-07-sentrep.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/07-sentrep Previous Video: https://youtu.be/TVp_75uJkPw Next Video: https://youtu.be/6DSg-AA-Ur0 See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1378 Graham Neubig
CMU Neural Nets for NLP 2017 (4): Why is word2vec so fast? Efficiency Tricks.
 
54:40
This lecture (by Taylor Berg-Kirkpatrick) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Softmax Approximations: Negative Sampling, Hierarchical Softmax * Parallel Training * Tips for Training on GPUs (this time slides are not in the video, so please reference the slides below while watching). Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-04-efficiency.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/04-efficiency Previous Video: https://youtu.be/xCAtxcc0KIE Next Video: https://youtu.be/vnzKAhs7nds See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1648 Graham Neubig
CMU Neural Nets for NLP 2017 (21): Learning From/For Knowledge Bases
 
01:09:40
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Relation Extraction w/ Neural Nets * Learning Embeddings from Knowledge Bases Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-21-kb.pdf Previous Video: https://youtu.be/P58GOj91nnA Next Video: https://youtu.be/rOiXjukeHSw See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 775 Graham Neubig
研究室勧誘対話システム
 
01:18
奈良先端科学技術大学院大学(NAIST)の知能コミュニケーション研究室で開発されている、研究室勧誘対話システムです。
Views: 392 Graham Neubig
自動ソーシャルスキルトレーナ
 
01:06
奈良先端科学技術大学院大学(NAIST)の知能コミュニケーション研究室で開発されている、話の苦手を克服するコミュニケーション支援システムです。
Views: 940 Graham Neubig
CMU Neural Nets for NLP 2017 (25): Multilingual and Multitask Learning
 
52:17
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Multitask Learning * Domain Adaptation * Multilingual Learning Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-25-multitask.pdf Previous Video: https://youtu.be/4AQbrT-GD2k See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 401 Graham Neubig
CMU Neural Nets for NLP 2017 (8): Conditioned Generation
 
01:01:46
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Encoder-Decoder Models * Conditional Generation and Search * Ensembling * Evaluation * Types of Data to Condition On Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-08-condlm.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/08-condlm Previous Video: https://youtu.be/7j20MC6J_QU Next Video: https://youtu.be/MhTMgFvoaD8 See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1038 Graham Neubig
CMU Neural Nets for NLP 2017 (13): Parsing With Dynamic Programs
 
01:00:11
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * What is Graph-based Parsing? * Minimum Spanning Tree Parsing * Structured Training and Other Improvements * Dynamic Programming Methods for Phrase Structure Parsing * Reranking Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-13-dpparsing.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/13-dpparsing Previous Video: https://youtu.be/7rp2c7JVymE Next Video: https://youtu.be/7gS8pwRwHMc See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 695 Graham Neubig
CMU Neural Nets for NLP 2017 (22): Machine Reading w/ Neural Nets
 
57:07
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Machine Reading * Attention-based Machine Reading Models * Multi-hop Reasoning Models Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-22-machinereading.pdf Previous Video: https://youtu.be/yq5YuZ_QCxU Next Video: https://youtu.be/oMB24_ao05A See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 462 Graham Neubig
個人性制御デモ
 
02:58
奈良先端科学技術大学院大学(NAIST)の知能コミュニケーション研究室で開発されている個人性制御システムのデモです。
Views: 97 Graham Neubig
CMU Neural Nets for NLP 2017 (18): Unsupervised Learning of Structure
 
55:05
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Learning Features vs. Learning Structure * Unsupervised Learning Methods * Design Decisions for Unsupervised Models * Examples of Unsupervised Learning Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-18-unsup.pdf Previous Video: https://youtu.be/twjlGZzUM68 Next Video: https://youtu.be/cWDt6GTOpLE See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 625 Graham Neubig
CMU Neural Nets for NLP 2017 (20): Models of Dialog
 
01:06:51
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Chat-based Dialog * Task-based Dialog Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-20-dialog.pdf Previous Video: https://youtu.be/cWDt6GTOpLE Next Video: https://youtu.be/yq5YuZ_QCxU See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 533 Graham Neubig
CMU Neural Nets for NLP 2017 (19): Document Level Models
 
01:04:50
This lecture (by Zhengzhong Liu) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Models of Coreference * Discourse Parsing * Document Level Prediction Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-19-document.pdf Previous Video: https://youtu.be/EKvkrv4K0qo Next Video: https://youtu.be/P58GOj91nnA See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 576 Graham Neubig
CMU Neural Nets for NLP 2017 (14): Neural Semantic Parsing
 
01:00:09
This lecture (by Graham Neubig) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * What is Graph-based Parsing? * Minimum Spanning Tree Parsing * Structured Training and Other Improvements * Dynamic Programming Methods for Phrase Structure Parsing * Reranking Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-14-semparsing.pdf Code Examples: https://github.com/neubig/nn4nlp2017-code/tree/master/14-semparsing Previous Video: https://youtu.be/gRtEW6Q5XJE Next Video: https://youtu.be/QKr8Ar86xSQ See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 1047 Graham Neubig
CMU Neural Nets for NLP 2017 (24): Advanced Search Algorithms
 
01:02:29
This lecture (by Daniel Clothiaux) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Beam Search * A*-type Search Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-24-search.pdf Previous Video: https://youtu.be/oMB24_ao05A Next Video: https://youtu.be/XnwB6jlHeR0 See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 356 Graham Neubig
A Method for Speech Translation considering Emphasis
 
00:38
This is a demonstration of the method for speech translation considering emphasis described in the paper: "A Method for Translation of Paralinguistic Information" Takatomo Kano, Sakriani Sakti, Shinnosuke Takamichi, Graham Neubig, Tomoki Toda, Satoshi Nakamura IWSLT 2012.
Views: 216 Graham Neubig
CMU Neural Nets for NLP 2017 (11): Structured Prediction w/ Local Dependence
 
01:08:55
This lecture (by Xuezhe Ma) for CMU CS 11-747, Neural Networks for NLP (Fall 2017) covers: * Why Local Independence Assumptions? * Conditional Random Fields * Considering Reward in Training Sorry, there was a mishap with recording the slides, but you can find them below: Slides: http://phontron.com/class/nn4nlp2017/assets/slides/nn4nlp-11-crf.pdf Previous Video: https://youtu.be/e5sPNlgbZAE Next Video: https://youtu.be/7rp2c7JVymE See more details of the class here: http://phontron.com/class/nn4nlp2017/
Views: 715 Graham Neubig