Autumn Toney-Wails, PhD

• Postdoc Researcher at UNU-MERIT, Maastricht University

---

• Contact: autumn.toney@georgetown.edu
• PhD Computer Science | Georgetown University
• MS Data Science | George Washington University
• BA Mathematics | University of Florida

---

Academic Publications

• Comparing the Humanness of Machine-Generated and Human-Authored Text
• Autumn Toney-Wails, Leticia Bode, Tiago Ventura, Ethan Wilcox, and Lisa Singh
• ACM Computing Surveys 2026
• ⭐ Newly accepted! ⭐

• How Clued up are LLMs? Evaluating Multi-Step Deductive Reasoning in a Text-Based Game Environment
• Rebecca Ansell and Autumn Toney-Wails
• Workshop on Logical Reasoning of Large Language Models @ ICLR 2026
• ⭐ Newly accepted! ⭐

• Certain but not Probable? Differentiating Certainty from Probability in LLM Token Outputs for Probabilistic Scenarios
• Autumn Toney-Wails and Ryan Wails
• UncertaiNLP @ EMNLP 2025

• Expertly Informed, Generatively Summarized: A Hybrid RAG Approach to Informed Consent Summarization with Auxiliary Expert Knowledge
• Autumn Toney-Wails, Ryan Wails, and Caleb Smith
• KnowledgeNLP @ NAACL 2025

• AI on AI: Exploring the Utility of GPT as an Expert Annotator of AI Publications
• Autumn Toney-Wails, Christian Schoeberl, and James Dunham
• International Conference on Scientometrics and Informetrics 2025

• Are You Sure About That: Eliciting Natural Language Confidence Indicators from Chatbots
• Autumn Toney-Wails and Lisa Singh
• International Conference on Human-Agent Interaction 2024

• What Kind of Sourcery is This? Evaluating GPT-4’s Performance on Linking Scientific Fact to Citations
• Autumn Toney-Wails
• Workshop on Customizable NLP: Progress and Challenges in Customizing NLP for a Domain, Application, Group, or Individual 2024

• Let Me Generate That for You: Generative Data Augmentation for Misinformation Detection in Low-Resource Environments
• Autumn Toney-Wails and Lisa Singh
• International Conference on Data Science and Advanced Analytics 2024

• Climate change and artificial intelligence: assessing the global research landscape
• Joanna I. Lewis, Autumn Toney-Wails, and Xinglan Shi
• Discover Artificial Intelligence 2024

• Trust Issues: Discrepancies in Trustworthy AI Keywords Use in Policy and Research
• Autumn Toney-Wails, Kathleen Curlee, and Emelia Probasco
• ACM FAccT 2024

• Impacts of Social Media Sentiments on Retractions of Scholarly Literature
• Autumn Toney-Wails and Sara Abdulla
• International Conference on Science, Technology and Innovation Indicators 2023

• Investigating Scientific Misinformation Using Different Modes of Learning
• Autumn Toney-Wails, Kornraphop Kawintiranon, Lisa Singh, Paul-Emmanuel Courtines, Alexander Lin, and Haofei Zhang
• The AAAI-23 Workshop on Scientific Document Understanding

• A Large-Scale, Automated Study of Language Surrounding Artificial Intelligence
• Autumn Toney-Wails
• The AAAI-23 Workshop on Scientific Document Understanding

• Multi-label Classification of Scientific Research Documents Across Domains and Languages
• Autumn Toney-Wails and James Dunham
• Scholarly Document Processing Workshop @ COLING 2022

• ValNorm Quantifies Semantics to Reveal Consistent Valence Biases Across Languages and Over Centuries
• Autumn Toney-Wails and Aylin Caliskan
• EMNLP 2021

• AI Research Funding Portfolios and Extreme Growth
• Ilya Rahkovsky, Autumn Toney-Wails, Kevin W. Boyack, Richard Klavans, and Dewey A. Murdick
• Frontiers in Research Metrics and Analytics 2021

• Automatically Characterizing Targeted Information Operations Through Biases Present in Discourse on Twitter
• Autumn Toney-Wails, Akshat Pandey, Wei Guo, David Broniatowski, and Aylin Caliskan
• ICSC 2021

A complete list of my publications can be found on my Georgetown CSET page and Google Scholar.