Pages

▼
Sunday, December 22, 2024

ModernBERT: Smarter, Better, Faster and with Longer context

›
🎄 Just in time for the magical week 🎅: LightOn and Answer.AI just made available a new model called ModernBERT . ModernBERT is available...
Thursday, August 17, 2023

Large Language Models and Transformers (Videos, Simons Institute for the Theory of Computing)

›
As some of you may know, LightOn has built a few Large Language Models, and we are now making them usable to Enterprise customers. In the m...
Friday, December 31, 2021

2021, the year AI ate HPC … and more

›
Back in 2011, Marc Andreesen announced that Software was eating the world while everyone was trying to make sense of the realities of the c...
Tuesday, December 21, 2021

LightOn Photonic coprocessor integrated into European AI Supercomputer

›
**  Nuit Blanche is now on Twitter: @NuitBlog  ** This is history of computing in the making stuff! Four years ago to the day, LightOn ’s f...
Friday, May 21, 2021

The Akronomicon: an Extreme-Scale Leaderboard

›
**  Nuit Blanche is now on Twitter: @NuitBlog  ** As larger models seem to be providing more context and more ability for zero-shot learnin...
Wednesday, April 28, 2021

Virtual Workshop: Conceptual Understanding of Deep Learning (May 17th 9am-4pm PST)

›
**  Nuit Blanche is now on Twitter: @NuitBlog  ** Just got an email from Rina Panigrahy Hi Igor, I am an algorithms researcher at Google ( ...
Tuesday, April 27, 2021

Randomized Algorithms for Scientific Computing (RASC)

›
**  Nuit Blanche is now on Twitter: @NuitBlog  ** At LightOn , we build photonic hardware that performs random projections and it is nice t...
Tuesday, April 06, 2021

The $1,000 GPT-3

›
**  Nuit Blanche is now on Twitter: @NuitBlog  ** Progress usually comes from a steady technology bootstrap…until it doesn’t. Take for inst...
Wednesday, March 24, 2021

Computing with Light: How LightOn intends to unlock Transformative AI

›
I gave a talk at #mathia2021 conference on March 9th, 2021 where I drew a parallel between the scaling laws that enabled industrialization ...
Monday, March 08, 2021

Unveiling LightOn Appliance

›
Today is a big day at LightOn as we unveil a hardware product, the Appliance, the world's first commercially available photonic co-proc...