Notes of Reading MUSE Project

Classifier and Features

• AbstractClassifier
  • String classify(Parse, SmartFeatureGenerator)
  • getPositiveClassProb(Parse, SmartFeatureGenerator, String posClassLabel)
  • evaluate: recognize timexes from Statement and evaluate the results. The results is a list of Parse.
  • detect: detect if a parse corresponds to a timex.
• SmartFeatureGenerator
  • float[] transformFeatures(String[], String[]) string to float, the second array of string is used to store the substring before last "=" of string in the first array, which is the featureValues. float value will be parsed from the substring after the last "=".
  • String[] getFeatures(Parse phrase, Statement context)
    • getWordBasedFeatures get the most probable temporal token in phrase, add its lemma, word, POS. Special attention is made to cadinal numbers (CD). POS list of phrase, phrase pattern. etc.
      • getCharacterPattern: "Word 32" => "Xxxx_99", compact form is "Xx_9". Symbol replaced "./­"
      • getTokenList: get list of String, numbers are converted into patterns.
      • getAllTokens: concatenate strings by whitespace.
      • getSimpleEnding: end characters.
      • getGoldLabel: get MlLabel of token
      • getToken: get next token in parse.
    • getParseBasedFeatures

• event
  • EventDetector String classify(Token, FeatureGenerator) It gets features by feature generator using the token and token context. transform the features to float array and new strings by feature generator. Uses model to eval the new strings and float numbers to get a list of results and then find the best one.
  • FeatureGenerator extends SmartFeatureGeneator Provides many functions, but keep the transform function the same as the parent class. add word, POS, CPOS, end2, end3,
    • hypernyms
    • synonyms
    • derivations

• AnnotatedElement extends Statement implements Comparable
  • NamedNodeMap attributes// dom name (String) to nodes
  • Node annotatingNode // dom xml node
  • String id; String fileName; int startIndex // index of the first token in the sentence
  • HashMap<String, String> // two maps from attribute name to value and vise versa.
  • ArrayList<String> // annotationLines, annotationAttributeLines
  • ArrayList<Integer> tokenNums
• Event extends AnnotatedElement
• Timex extends AnnotatedElement
  • Type: date, duration, time, set
  • Role: creation_time, modification_time, etc.
  • Value: duration, weekdate, season, etc.
  • String[] features
  • Calendar// define seasons, quarters, etc, parse a time and get the corresponding equivalent time expressions like date -> day in week -> season.
• TLink
  • type
  • ids of entities and link
• Parse
  • Parse: parent, head
  • List<Parse>: parts
  • Span, String: type, List<Token> tokens.
• Statement extends Question
  • Question implements Serializable, Cloneable
    • String //string representation, etc., List<Token>, Parse //the syntatic parse, List<String> chunks
    • ArrayList<ArrayList<SemanticLabel>>
    • String normlizedQuestion, originalQuestion.
    • ArrayList<AnnotatedElement> annotatedEvent, recognizedEvent, annotated timex, recognized timex, annotatedSignals
    • ArrayList<ArrayList<Token>> ngrams
    • String sourceFile, dct.
    • ArrayList<String> timex, ArrayList<Parse> candidates;
• Token implements Serializable
  • index in sentence, String annotationLine?, pos, int (start, end), String convertedString, some boolean for syntactic states, Span, String chunkTag. Statement //sentence. String[] features.
    • HashMap<Integer, ArrayList<RuleResults>> ?. integer means level
    • HashMap<Sematic,String> different labels in different context?
    • HashMap<Enum, ArrayList<Object>> map of TimeML label -> BIO labels? In Question, they only treate the first element and planned to make warm if there are more than one label. twist design. The second(why second?) Object is converted into a NamedNodeMap.
    • ArrayList<Container<String, Double>> contextSynonyms. Synonyms and probabilities
    • ArrayList<Container<String, Double>> contextIndependentSynonyms
    • Parse parentParse ?
  • Span int (start, end), String merge?
  • SemanticLabel String role; String chunk; ArrayList<Token> tokens;
• malt.Node

• CorpusReader, read/get files under directory
• ml.Outcomes; confusion matrix?
• ml.dependency.features.CPOSTag; return concise POS of the head token
• ml.dependency.features.Form; get token from Token/AnnotatedElement(Quasi head token, which is the last token)
• ml.dependency.features.Lemma; Lemma of token returned by Form
• ml.dependency.features.POSTag; POS of token returned by Form
• ml.dependency.malt.MaltDataWriter;
• nlp.adapters.OpenNLPFactory; OpenNLP processors
• nlp.adapters.WebNLPFactoryLoader; wrapper for web.
• timex.model.Calendar; time convertor
• tlink.EventStemFrequency; load frequency from file
• util.Const;
• util.EditDistance;
• util.WebConst;
• util.WordNet;

• recognition.Classifier; GISModel… List<Parse> = AbstractClassifier.simpleEvaluate(Question, classifier, outcomes, false, SmartFeatureGenerator)
  • AbstractClassifier.simpleDetect *to do, very long function*
• tlinks.fables.FablesFeatureGenerator; generate features for tlinks
• tlinks.fables.parse.MaltFeatureGenerator; ???
• tlinks.fables.parse.MaltParser; invoke malt parser (dependency parser)