Three Pieces of Evidence that the NLA Reconstructor Does Not Read Semantics or Syntax
TL;DRThe autoreconstructor (AR) in a natural language autoencoder (NLA) is the entire argument for the validity of the method, and at present is poorly understood.The AR does not condition strongly on English grammar or semantics.
LessWrong10 min read