Following our @dagstuhl.de seminar on Continual Learning in the Foundation Model Era, we are now sharing a roadmap!
In summary, we view modular memory design as the missing piece to combine the capabilities of In-Weight & In-Context Learning for adaptation at scale:
arxiv.org/abs/2603.01761
The 5th edition of the Conference on Lifelong Learning Agents is going to Romania in 2026 & I'm happy to serve as program chair
We've just put the CfP online ⬇️ & we're particularly excited to broaden the scope to all facets of adaptation of ML models.
Please check out these exciting additions!
Wonder how LLMs learn over long time horizons & how hate-checks deal with time?
Look at our new work "Chronoberg": an open-source dataset spanning 250 years of books with analysis of shifts in meaning & continual learning of LLMs:
arxiv.org/pdf/2509.22360
huggingface.co/datasets/spa...
🎉"Aligning generalization between humans and machines" (w/ 25 incredible authors) is out now in #Nature Machine Intelligence: www.nature.com/articles/s42...
In short, we identified interdisciplinary commonalities & differences with respect to notions of, methods for, & evaluation of generalization
Feeling really inspired after @collasconf.bsky.social: wonderful keynotes, exceptionally talented early-career spotlights & interactions that mattered!
And of course our own oral presentation as well :)
Very excited to be the next program chair & ensure its success for CoLLAs in Romania next year!
Just arrived in Philadelphia for @collasconf.bsky.social
Very excited about a fantastic program!
I’ll be around all week, but feel free to drop me a message or catch me directly at the debate on Monday morning, after our oral presentation on Tuesday, or in any of the poster sessions
🎉 Announcing the winners of the #CoLLAs2025 Early-Career Spotlight Program!
These rising stars are pushing the boundaries of lifelong & continual learning, adaptation, and embodied AI.
👇 A thread introducing their work & talks.
#AI #MachineLearning #ContinualLearning #LifelongLearning
🧠 Don't miss the tutorials at #CoLLAs2025!
We’re excited to host two deep dives into the theory and practice of lifelong learning:
📍Information-Theoretic Measures for Multi-Expert FM Adaptation
📍Mathematics of Continual Learning
Details below 👇
I'm not at #ICML2025 myself, but @florianbusch.bsky.social & Roshni are presenting our spotlight poster on continual confounding + our respective ConCon dataset on Thursday 17 Jul 4:30 pm - 7 pm PDT in East Exhibition Hall A-B: E-3309 icml.cc/virtual/2025...
Please talk to them! :)
Details below ⬇️
🏳️🌈 Queer in AI is thrilled to announce another season of our affinity workshop at #NeurIPS2025! We announce a Call for Contributions to the workshop, with visa-friendly submissions due by 📅 July 31, 2025 (AOE), all other submissions due by 📅 August 14, 2025. #QueerInAI #CallForPapers
Photo of the Town Hall meeting at last week's conference. The audience watches as Su Lin Blodgett announces the location of next year's conference. Su Lin Blodgett and Zeerak Talat will be General Chairs, and Michael Madaio will be PC Chair.
We're happy to officially announce the location of #FAccT2026!
Next year's conference will be held in Montreal, Canada 🇨🇦
Su Lin Blodgett and Zeerak Talat will be General Chairs, and Michael Madaio will be PC Chair 🎉
(thanks to MindView for the photo!)
dear computer vision people,
labelling someone* an "activist" is not the disparage you think it is
(*there is no claim in our paper that's not supported by empirical evidence so our work adheres to science by any standard. still...)
📢 Present your published work at #CoLLAs2025!
Submit recent papers (JMLR, TMLR, NeurIPS, etc.) on lifelong/continual learning, LLMs, online learning & more.
🗓 Deadline: July 5
🔗 lifelong-ml.cc/Conferences/...
#AI #MachineLearning #LifelongLearning #ContinualLearning
We are hiring a tenure-track prof in the computer science department at University of Bremen for the field of Computer Engineering with a focus on Distributed Systems
Applications are still open until June 18th, so come join a fantastic set of colleagues!
www.uni-bremen.de/en/universit...
Are you based in Greece? 🇬🇷 Do you want to attend #FAccT2025 and have your entire registration fee waived?
Volunteer for just 4 hours at the conference!
Apply by June 3, 2025, at 11:59 pm anywhere on Earth: facctconference.org/2025/cfv2
We (+ @pranav-nlp.bsky.social) had tremendous fun presenting our cake-AI analogy to a really engaging audience. Thanks for the greatly thoughtful discussions 🙏
We are facing numerous socio-technical challenges in AI, but with talented fresh minds & increased awareness, there may be a bright future
Martin presenting the intro slide of the talk
I am at the data story workshop hosted by @martinmundt.bsky.social where we talk about AI as cake! We redefine Yann LeCun's famous analogy beyond just learning types. From ingredients to selling - we break down how AI really works and who gets left out.
"Reasonable AI" got selected as a cluster of excellence www.tu-darmstadt.de/universitaet...
Overwhelmingly happy to be part of RAI & continue working with the smart minds at TU Darmstadt & hessian.AI, while also seeing my new home at Uni Bremen achieve a historic success in the excellence strategy!
You may know batch-norm, but did you know it is a lightweight catalyst for open world learning?
In "BOWL: A Deceptively Simple Open World Learner" we leverage BN stats to enable OoD detection & rapid active + continual learning!
arxiv.org/abs/2402.04814
🚀 now accepted @collasconf.bsky.social
Exciting news!!! This just got into @icmlconf.bsky.social as a position paper!!! 🎉 More updates to come as we work on the camera-ready version!!!
Horizontal, vertical, hybrid data partitioning: heterogeneity is tough to handle in federated learning!
🔥In “Scaling Probabilistic Circuits via Data Partitioning" - accepted at #UAI25 - we unify the different settings through aggregation of learned client distributions: arxiv.org/abs/2503.08141
We have 2 variants of the dataset: 1. Confounders only ever appear disjointly
2. Confounders can reappear later in other “tasks”
We did observe that in disjoint scenarios, solutions like “blue + large + metallic” (concatenation of confounders) happen.
Did you have something like this in mind?
Join us this Thursday 8 May for:
U n l e a r n i n g
~ in continual scenarios ~
together with:
Zhenyi Wang, Sijia Liu, and Kairan Zhao
6 PM CET / 9 AM PT / 12 PM ET
Hope to see you there!!!
Registration here: stanford.zoom.us/meeting/regi...
We believe ConCon is crucial for future continual learning studies. Why?
In the presence of confounders, we show that models succeed when training on all data, but sequential training on accumulated tasks fails without further action!
This questions the common CL "upper-bound" with infinite memory
🔥Our work “Where is the Truth? The Risk of Getting Confounded in a Continual World" was accepted with a spotlight poster at ICML!
arxiv.org/abs/2402.06434
-> we introduce continual confounding + the ConCon dataset, where confounders over time render continual knowledge accumulation insufficient ⬇️
Join us for a delicious Data Story by @martinmundt.bsky.social on the AI-cake analogy, hosted @dfki.bsky.social in Bremen!
👉 Info and registration: www.bremen-research.de/data-train/c...
👓 Read more about the research in Martin's thread below
🍰 Of course, there will be cake 😋
We are hosting a 3-hour interactive session on our Cake-AI analogy work (arxiv.org/abs/2502.03038) on May 27th @dfki.bsky.social Bremen.
If you are around, please consider signing up to learn & discuss how the process of baking helps us understand design & socio-technical tensions of AI systems!⬇️
🚀We’ve created a spotlight program for early Postdoc/starting faculty/industry equivalent researchers to highlight their contributions & vision in a 30 minute spotlight talk at CoLLAs!
It’s a unique opportunity & recognition!
Applications are open until May 26 AOE: lifelong-ml.cc/Conferences/...
Gaming the system? …
No paper in my ICML batch with negative ratings has posted rebuttals, in both tracks!
I spend lots of time reviewing & give detailed comments.
I see people complain about review quality constantly, but with such author behavior, what exactly do we expect?
Still ~8 days to apply for a postdoc position in multimodal foundation models at the University of Edinburgh! (@edinburgh-uni.bsky.social) -- Fully funded position until 2029 by the Generative AI Hub (@genaihub.bsky.social) to work with outstanding research teams! neuralnoise.com/2025/multimo...
