DoRA and Mixture-of-Depths
We are going to have an hour of pizza and networking, followed by our monthly event to discuss interesting ML papers and other ML lightning talks. Note the change to the times on the agenda. Papers to be discussed at 1pm PDT:
DoRA: Weight-Decomposed Low-Rank Adaptation (https://arxiv.org/abs/2402.09353)
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models (https://arxiv.org/abs/2404.02258)
Please message Ted if you have a paper or other topic you can share in a future lightning talk.
Please make sure to read the instructions for joining the event below.
Agenda:
12:00 - 1:00 pm -- Networking and pizza (in person only)
1:00 - 2:00 pm -- Presentations and discussions (both in person & zoom)
Time permitting -- Additional Q&A
Links to notes/slides and videos of prior meetups are available on the SDML GitHub repo https://github.com/SanDiegoMachineLea...
Location:
For in-person, join us at Filippi's Pizzo Grotto Scripps Ranch.
Please Note: There are two steps required to join the online meetup:
You must go to our Slack community and ask for the password for the meeting. Link to join is below.
You must have a Zoom login in order to join the event. A free Zoom account will work. If you get an error message joining the Zoom, please login to your account on the Zoom website then try again.
Use this Zoom link: https://us06web.zoom.us/j/82891977558
Community:
Join our slack channel for questions and discussion about what's new in ML:
https://join.slack.com/t/sdmachinelea...