Current events (2009)
From LS2
(Redirected from Current events)
Note: everything is subject to change; please check back frequently to see current reading lists, etc.
| Dates | Topic | Readings | Lecture slides | Reminders |
| Tu 8-25 | Philosophy: the empirical way of thinking about language | Pereira, 2000; Abney, 1996; blog post on the science/engineering question - comments are especially interesting | ||
| Th 8-27 | Evaluation, experimentation, and hypothesis testing | LS2 book draft: experimentation appendix | ||
| Tu 9-1 | Numerical optimization | LS2 book draft: optimization appendix | ||
| Th 9-3 | Weighted dynamic programming | Goodman, 1999; McAllester, 2002; Eisner, Goldlust, and Smith, 2005; if you're in love, Shieber, Schabes, and Pereira, 1995 (warning: these papers focus to some extent on parsing algorithms, which won't be covered in this lecture much) | ||
| Tu 9-8 | assignment 1 out | |||
| Th 9-10 |
Stochastic models of sequences: Markov models, hidden Markov models, and related algorithms | Manning and Schütze, 1999 (ch. 9); Smith, 2004 | ||
| Tu 9-15 | some notes related to forward/backward probabilities | assignment 1 due | ||
| Th 9-17 | Log-linear/exponential/maximum entropy models | Log-linear model article draft sent to you by email (sections 1, 2, and 3). | assignment 2 out; due: short summary of proposed literature review topic and hyperlinks to 6-8 papers you think are appropriate. Submit via your User page on the wiki, and link to that page from Noah's user page. | |
| Tu 9-22 | GHC celebration (no class) | |||
| Th 9-24 | Training log-linear models, maximum entropy | Three tutorials: Adam Berger's tutorial; Smith, 2004, and Ratnaparkhi, 1997. Chen and Rosenfeld 1999; Rosenfeld, Chen, and Zhu, 2000; Della Pietra, Della Pietra, and Lafferty, 1995 | ||
| Tu 9-29 | Conditional random fields (structured log-linear models) | Lafferty, McCallum, and Pereira, 2001 | assignment 2 due | |
| Th 10-1 | Approximate training of structured log-linear models | Sutton and McCallum, 2007, Smith, Vail, and Lafferty, 2007 | ||
| Tu 10-6 | Stochastic and weighted context-free grammars, statistical parsing with CFGs | Johnson, 1998 | Assignment 3 out. | |
| Th 10-8 | Charniak, 1997; Charniak, 2000; Collins, 2003; Klein and Manning, 2003; Finkel, Kleeman, and Manning, 2008; Ratnaparkhi, 1997 | |||
| Tu 10-13 | This week: literature review progress meetings with instructor. | |||
| Th 10-15 | Other discriminative methods for structured data: perceptron, boosting, maximizing the margin, online methods | Collins, 2002; Altun, Johnson, and Hofmann, 2003; Taskar and Klein's ACL 2005 tutorial, Taskar, Klein, Collins, Koller, and Manning, 2004; Ratliff, Bagnell, and Zinkevich, 2006 | ||
| Tu 10-20 | assignment 3 due | |||
| Th 10-22 | Dependency parsing (guest lecture - Dipanjan Das) | McDonald, Pereira, Ribarov, and Hajic, 2005; Smith and Smith, 2007; Martins, Smith, and Xing, 2009 | assignment 4 out | |
| Tu 10-27 | EM, word clustering, and word alignment | Brown et al., 1992; Brown et al., 1993 | ||
| Th 10-29 | EM for NL models, contrastive estimation | Merialdo, 1994; Pereira and Schabes, 1992; Klein and Manning, 2002; Smith and Eisner, 2005 | ||
| Tu 11-3 | ||||
| Th 11-5 | Bayesian NL models | Blei, Ng, and Jordan, 2003; Teh et al., 2004 ; Liang and Klein's ACL 2007 tutorial | Literature review draft due. | |
| Tu 11-10 | Assignment 4 due. | |||
| Th 11-12 | Approximate inference for NL models | Goldwater and Griffiths, 2007; Johnson, 2007; Beal, 2003 (ch. 3); MacKay, 1997 | ||
| Tu 11-17 | Combining labeled and unlabeled data: Yarowsky algorithms, bootstrapping, self-training, co-training | Yarowsky, 1995; Blum and Mitchell, 1998; Nigam and Ghani, 2000; Abney, 2004, Smith and Eisner, 2007, Mann and McCallum, 2007, McClosky et al., 2006; see also Jerry Zhu's semisupervised learning survey | ||
| Th 11-19 | ||||
| Tu 11-24 | Weighted finite-state machines and transducers | Mohri's list of references on algorithms; Eisner, 2002; Stolcke and Omohundro 1993, Kartunnen, 2001 . Tools: Xerox's FS group; AT&T FSM libraries; RWTH FSA toolkit; OpenFST | Literature review due; assignment 5 out | |
| Th 11-26 | Thanksgiving break (no class) | |||
| Tu 12-1 | Oral presentations | |||
| Th 12-3 | Oral presentations | assignment 5 due | ||
| TBA | Final exam (room TBA) |
