#pre-training
#pre-training

[ follow ]

OpenAI co-founder Andrej Karpathy joins Anthropic's pre-training team | TechCrunch

Andrej Karpathy joined Anthropic to lead R&D focused on using Claude to accelerate pre-training research for frontier LLMs.

fromArs Technica

7 months ago

Researchers show that training on "junk data" can lead to LLM "brain rot"

On the surface, it seems obvious that training an LLM with "high quality" data will lead to better performance than feeding it any old "low quality" junk you can find. Now, a group of researchers is attempting to quantify just how much this kind of low quality data can cause an LLM to experience effects akin to human "brain rot."

Artificial intelligence

fromTechCrunch

8 months ago

'Selling coffee beans to Starbucks' - how the AI boom could leave AI's biggest companies behind | TechCrunch

Foundation models are increasingly commoditized; fine-tuning, post-training methods, and user-facing interfaces now drive competitive advantage in many AI businesses.

Artificial intelligence

fromHackernoon

10 months ago

Tuning the Pixels, Not the Soul: How Filter Atoms Remake ConvNets | HackerNoon

Pre-training models on large datasets enhances their performance through fine-tuning for specific tasks.

[ Load more ]

#pre-training#pre-training

OpenAI co-founder Andrej Karpathy joins Anthropic's pre-training team | TechCrunch

Researchers show that training on "junk data" can lead to LLM "brain rot"

'Selling coffee beans to Starbucks' - how the AI boom could leave AI's biggest companies behind | TechCrunch

Tuning the Pixels, Not the Soul: How Filter Atoms Remake ConvNets | HackerNoon

#pre-training
#pre-training