Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
Posts
Conference on Natural Language Learning 2024
Published:
Keynote Speaker Lorna Quandt
Integrating AI Driven sign language technologies in education recognition generation and interaction. ~300 sign languages in the world, many understudied. Iconic signs are related to the concept that they represent like a plant growing out of the ground. But there are still significant differences across languages.
AI Institute for Societal Decision Making Meeting
Published:
These are the notes that I took during the AI Institute for Societal Decision Making Meeting in September 2024.
CyLab Conference Notes
Published:
These are the notes that I made during the CyLab 2024 conference held at Carnegie Mellon University that I attended in September.
Dynamic Decision Making Lab Yearly Review
Published:
The Dynamic Decision Making Laboratory has issued it’s yearly review for 2024 which summarizes the work from the lab that occured during the past year. It is available online here. I have copied below my own section of the yearly review, and encourage people interested in my work to check out the annual summary. This will also be of interest to those who would like to get an idea of the work that goes into running a relatively large research lab in decision sciences.
Multi-University Research Initiative
Published:
This blog post contains my unedited notes that I took while attending the Multi-University Research Initiative Program Review this year. This was an interesting meeting where I presented my work in cognitive models applied onto large languge model to improve their usefullness in educational settings, specifically for phishing email education.
Individualized Measures of Similarity
Published:
This post is a continuation of a previous post on measures of similarity in cognitive models. This post is inspired by the recent preprint that I released called ‘Leveraging a Cognitive Model to Measure Subjective Similarity of Human and GPT-4 Written Content’.
Measures of Similarity
Published:
This post is inspired by the recent preprint that I released called ‘Leveraging a Cognitive Model to Measure Subjective Similarity of Human and GPT-4 Written Content’.
Descisions From Description and Experience
Published:
One of the interesting lines of recearch that I have recently become more involved with is the distinction between making decisions based on description and making them based on experience.
The Future of Cyber Deception
Published:
These are my personal notes taken while attending the Workshop on the Future of Cyber Deception Presented by the Army Research Office held at Carnegie Mellon University.
AAAI Symposium on Generative Models in Cognitive Architectures
Published:
These are my notes I took while attending the AAAI Symposium on Generative Models in Cognitive Architectures in Washington D.C. I had a great experience at this conference discussing the use cases of generative AI models in cognitive modeling.
Applying LLMs in Cognitive Models
Published:
Two submissions our lab has been working on were recently accepted to the AAAI 2023 Fall Symposium Series on the Integration of Cognitive Architectures and Generative Models.
IEEE S&P 2023
Published:
The following are my notes that I took during the IEEE European Symposium on Security and Privacy. It was a great experience and I tired to attend every lecture and find the papers that were discussed during them.
Security and Human Behaviour 2023
Published:
The following are my notes taken during the SHB workshop. I have included the names of presenters but it should be noted that these are my own general thoughs and reactions while attending these presentations.
Learning to Learn
Published:
One interesting development in my research interests is the unexpected focus on ‘learning to learn’ that many of my recent papers and projects have been focused on.
Job Security
Published:
I recently completed the last meeting with a small group of mentees from my alma mater UBC that was put together to give undergraduate students at different points in their career some insight into life after undergrad.
Sentience and World Representations in LLMs
Published:
In my last blog post I discussed a few of the presentations given at NeurIPS 2022 that I found particularly interesting.
Narrowing The Gap With LLMs
Published:
This will be my third blog post in a row (see the first, and second) on the topic of large language models.
NeurIPS 2022
Published:
This past year I attended the Conference on Neural Information Processing Systems for the first time to present a poster alongside a paper that was accepted at the workshop on Information Theoretic Principles in Cognitive Systems.
PhD Defense
Published:
It has been a while since I made a blog post, mostly becase I have been working hard on my PhD Dissertation and practicing for my defense, which you can watch a practice run through of at this link.
What’s in a Representation?
Published:
As I begin the final stages of my PhD thesis, I was recently surprised by one topic that jumped out as being more relevant than I had originally thought of when I began work on the project.
Visual Sciences Society Conference 2022
Published:
Earlier this year I attented the Visual Science Society 2022 conference where I gave a talk titled “A Beta-Variational Auto-Encoder Model of Human Visual Representation Formation in Utility-Based Learning”. The entire abstract I submitted is copied at the bottom of this blog post if you would like to read it.
Beyond Reward
Published:
In a previous post I mentioned an interesting paper that made the claim that much of human intelligence could be viewed under the lense of reward maximization, you can see that blog post here..
Rl Web Security
Published:
Since my partner is a web security expert, I often end up having long discussions about internet security, even though my personal knowledge and research is in a very different area.
Wordl with Reinforcement Learning
Published:
This post will discuss briefly the possiblity of constucting a reinforcement learning algorithm to play the game Wordle.
Is Reward Enough
Published:
In this post I provide a review and opinion on the paper “Reward Is Enough” by D Silver, S Singh, D Precup, and RS Sutton.
New Year 2022
Published:
Rather than look back at previous research I have done, as the previous posts on this blog have done, this post will look forward to my hopes for 2022 and new research ideas I am interested in. Firstly, the major plans for this year include completing the website hosting my thesis project, submitting a paper based on my work in Theory of Mind for reinforcement learning, and completing my PhD Thesis.
Masters Thesis 2020
Published:
This post is another retrospective, but instead of a conference or journal paper it takes a look at my masters thesis, titled “Modelling Learning and Decision Making Under Information Processing Constraints”. This blog post will go through the begninning stages of the project and how it ultimately narrowed down the focus of the thesis and project into what it eventually became.
AAAI 2021
Published:
This is the second post in a series of retrospectives on previous work I have done that shaped my PhD and are related to my future research goals. If you would like to read the paper you can find it on my Researchgate.
Predicting Human Choice
Published:
This is the first post in a series of retrospectives looking back at papers and conferences I have attended. Now that I am entering my final year of my PhD, I will be begining this as a chronicle of projects, papers and conferences that influenced my time during my PhD.
cv
portfolio
publications
Deep RL with information constrained policies: Generalization in continuous control
Published in arXiv preprint arXiv:2010.04646, 2020
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, Tim Klinger, Miao Liu, Matthew Riemer, Gerald Tesauro, "Deep RL with information constrained policies: Generalization in continuous control." arXiv preprint arXiv:2010.04646, 2020.
Modelling Human Information Processing Limitations in Learning Tasks with Reinforcement Learning
Published in In the proceedings of Proceedings of the 18th International Conference on Cognitive Modelling, 2020
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, "Modelling Human Information Processing Limitations in Learning Tasks with Reinforcement Learning." In the proceedings of Proceedings of the 18th International Conference on Cognitive Modelling, 2020.
Modelling Learning and Decision Making Under Information Processing Constraints
Published in Rensselaer Polytechnic Institute, 2020
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, "Modelling Learning and Decision Making Under Information Processing Constraints." Rensselaer Polytechnic Institute, 2020.
Capacity-Limited Decentralized Actor-Critic for Multi-Agent Games
Published in In the proceedings of IEEE Conference on Games, 2021
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, Tim Klinger, Miao Liu, Matthew Riemer, Gerald Tesauro, "Capacity-Limited Decentralized Actor-Critic for Multi-Agent Games." In the proceedings of IEEE Conference on Games, 2021.
Consolidation via Policy Information Regularization in Deep RL for Multi-Agent Games
Published in In the proceedings of AAAI Reinforcement Learning in Games Workshop, 2021
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Tim Klinger, Miao Liu, Matthew Riemer, Gerald Tesauro, Chris Sims, "Consolidation via Policy Information Regularization in Deep RL for Multi-Agent Games." In the proceedings of AAAI Reinforcement Learning in Games Workshop, 2021.
Modeling Capacity-Limited Decision Making Using a Variational Autoencoder
Published in In the proceedings of Proceedings of the Annual Meeting of the Cognitive Science Society, 2021
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Tim Klinger, Miao Liu, Gerald Tesauro, Matthew Riemer, Chris Sims, "Modeling Capacity-Limited Decision Making Using a Variational Autoencoder." In the proceedings of Proceedings of the Annual Meeting of the Cognitive Science Society, 2021.
Modelling Visual Decision Making Using a Variational Autoencoder
Published in In the proceedings of Proceedings of the 19th International Conference on Cognitive Modelling, 2021
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, "Modelling Visual Decision Making Using a Variational Autoencoder." In the proceedings of Proceedings of the 19th International Conference on Cognitive Modelling, 2021.
RL Generalization in a Theory of Mind Game Through a Sleep Metaphor (Student Abstract)
Published in In the proceedings of AAAI Student Abstract Workshop, 2021
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Tim Klinger, Miao Liu, Gerald Tesauro, Matthew Riemer, Chris Sims, "RL Generalization in a Theory of Mind Game Through a Sleep Metaphor (Student Abstract)." In the proceedings of AAAI Student Abstract Workshop, 2021.
A Beta-Variational Auto-Encoder Model of Human Visual Representation Formation in Utility-Based Learning
Published in Journal of Vision, 2022
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, "A Beta-Variational Auto-Encoder Model of Human Visual Representation Formation in Utility-Based Learning." Journal of Vision, 2022.
Learning in Factored Domains with Information-Constrained Visual Representations
Published in In the proceedings of NeurIPS 2022 Workshop on Information-Theoretic Principles in Cognitive Systems, 2022
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, Tim Klinger, Matthew Riemer, Miao Liu, Gerald Tesauro, "Learning in Factored Domains with Information-Constrained Visual Representations." In the proceedings of NeurIPS 2022 Workshop on Information-Theoretic Principles in Cognitive Systems, 2022.
Modeling Human Reinforcement Learning with Disentangled Visual Representations
Published in In the proceedings of Reinforcement Learning and Decision Making, 2022
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Tim Klinger, Chris Sims, "Modeling Human Reinforcement Learning with Disentangled Visual Representations." In the proceedings of Reinforcement Learning and Decision Making, 2022.
Resource-Rational Cognitive Modelling: An Information-Theoretic Approach
Published in Rensselaer Polytechnic Institute, 2022
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, "Resource-Rational Cognitive Modelling: An Information-Theoretic Approach." Rensselaer Polytechnic Institute, 2022.
Accounting for Transfer of Learning in Human Behavior Models
Published in In the proceedings of Human Computation and Crowdsourcing, 2023
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Du Yinuo, Fang Fei, Gonzalez Cleotilde, "Accounting for Transfer of Learning in Human Behavior Models." In the proceedings of Human Computation and Crowdsourcing, 2023.
Generative Environment-Representation Instance-Based Learning: A Cognitive Model
Published in In the proceedings of AAAI Symposium on Integration of Cognitive Architectures and Generative Models, 2023
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Du Yinuo, Fang Fei, Gonzalez. Cleotilde, "Generative Environment-Representation Instance-Based Learning: A Cognitive Model." In the proceedings of AAAI Symposium on Integration of Cognitive Architectures and Generative Models, 2023.
Learning to Defend by Attacking (and Vice-Versa): Transfer Learning in Cyber-Security Games
Published in In the proceedings of IEEE European Symposium on Security and Privacy Workshop Series, 2023
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Gonzalez. Cleotilde, "Learning to Defend by Attacking (and Vice-Versa): Transfer Learning in Cyber-Security Games." In the proceedings of IEEE European Symposium on Security and Privacy Workshop Series, 2023.
A Cyber-War Between Bots: Cognitive Attackers are More Challenging for Defenders than Strategic Attackers
Published in under review. ACM Transactions on Social Computing, 2024
Use Google Scholar for full citation
Recommended citation: Yinuo Du, Baptiste Prebot, Tyler Malloy, Gonzalez. Cleotilde, "A Cyber-War Between Bots: Cognitive Attackers are More Challenging for Defenders than Strategic Attackers." under review. ACM Transactions on Social Computing, 2024.
Applying Generative Artificial Intelligence to Cognitive Models of Decision Making
Published in Frontiers in Psychology, 2024
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Cleotilde Gonzalez, "Applying Generative Artificial Intelligence to Cognitive Models of Decision Making." Frontiers in Psychology, 2024.
Efficient Visual Representations in Learning and Decision Making
Published in in press. Psychological Review, 2024
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Chris Sims, "Efficient Visual Representations in Learning and Decision Making." in press. Psychological Review, 2024.
Experimental Evaluation of Cognitive Agents for Collaboration in Human-Autonomy Cyber Defense Teams
Published in in preperation. Computers and Human Behavior, 2024
Use Google Scholar for full citation
Recommended citation: Yinuo Du, Baptiste Prebot, Tyler Malloy, Fei Fang, Gonzalez. Cleotilde, "Experimental Evaluation of Cognitive Agents for Collaboration in Human-Autonomy Cyber Defense Teams." in preperation. Computers and Human Behavior, 2024.
Training to Identify Phishing Emails Generated by Humans and LLMs
Published in in preperation. Computers and Human Behavior, 2024
Use Google Scholar for full citation
Recommended citation: Tyler Malloy, Ferriera Maria, Fang Fei, Gonzalez. Cleotilde, "Training to Identify Phishing Emails Generated by Humans and LLMs." in preperation. Computers and Human Behavior, 2024.
talks
Modelling Human Information Processing Limitations in Learning Tasks with Reinforcement Learning
Published:
This a presentation given online to the International Conference on Cognitive Modeling (ICCM) 2020.
Modelling visual decision making using a variational autoencoder
Published:
This a presentation given online to the International Conference on Cognitive Modeling (ICCM) 2021.
PhD Thesis Proposal
Published:
This is my PhD thesis proposal video.
A B-VAE Model of Human Visual Learning
Published:
This talk was presented to the Vision Sciences Society in June of 2022.
Resource Rational Cognitive Modelling: An Information Theoretic Approach
Published:
This talk is a practice run through of my PhD dissertation talk.
Cognitive Modeling of Decision Making in Cybersecurity
Published:
This talk was presented to the cognitive security institute in January of 2024.
teaching
88-308 Spring 2024
, , 2024
Human and Machine Decisions from Experience
88-308 Spring 2025
, , 2025