mirror of https://github.com/percyliang/sempre
c95d17fb6c
|
||
|---|---|---|
| .. | ||
| README.md | ||
| basketball.grammar | ||
| blocks.grammar | ||
| calendar-canonical.examples | ||
| calendar.grammar | ||
| calendar.turk.examples | ||
| general.grammar | ||
| geo880-unittest.examples | ||
| geo880.grammar | ||
| housing-unittest.examples | ||
| housing.grammar | ||
| null.examples | ||
| publications.grammar | ||
| recipes.grammar | ||
| restaurants-unittest.examples | ||
| restaurants.grammar | ||
| socialnetwork-unittest.examples | ||
| socialnetwork.grammar | ||
| templates.grammar | ||
| unittest.db | ||
| unittest.grammar | ||
README.md
Files for Building a Semantic Parser Overnight
Generating canonical utterances
To generate all the canonical utterances, run:
./pull-dependencies freebase overnight
ant corenlp freebase overnight
./run @mode=genovernight-wrapper
To generate each individual domain:
./run @mode=genovernight @gen=1 @domain=<domain>
Training
After generating the paraphrases via AMT and setting up the appropriate example files, we train a model.
Run the following to train with all the features:
./run @mode=overnight @domain=<domain>
To run with a subset of the features for ablation studies:
Baseline:
./run @mode=overnight @domain=<domain> -OvernightFeatureComputer.featureDomains match skip-bigram root lf simpleworld
No Lexical features:
./run @mode=overnight @domain=<domain> -OvernightFeatureComputer.featureDomains match ppdb skip-bigram root lf simpleworld
No PPDB features:
./run @mode=overnight @domain=<domain> -OvernightFeatureComputer.featureDomains match skip-bigram root lf alignment lexical root_lexical simpleworld
Full system:
./run @mode=overnight @domain=<domain> -OvernightFeatureComputer.featureDomains match ppdb skip-bigram root alignment lexical root_lexical lf simpleworld
Generating alignment files for a new domain
See the instructions here (work in progress).