DiffusER: Discrete Diffusion via Edit-based Reconstruction
DiffusER rivals autoregressive models on several tasks spanning machine translation, summarization, and style transfer.
DiffusER is a strong generative model in general, rivaling autoregressive models on several tasks spanning machine translation, summarization, and style transfer. It can also perform other varieties of generation that standard autoregressive models are not well-suited for.
Lila: A Unified Benchmark for Mathematical Reasoning
Proposes Lila, a unified mathematical reasoning benchmark consisting of 23 diverse tasks along four dimensions.
Lila offers a unified benchmark for evaluating and improving AI systems in mathematical reasoning consisting of 23 diverse tasks along four dimensions
Preventing Verbatim Memorization in Language Models Gives a False Sense of Privacy
Argues that verbatim memorization definitions are too restrictive and fail to capture more subtle forms of memorization.
Defining memorization is a difficult and crucial open question for neural language models.