Lemmy.ca
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
☆ Yσɠƚԋσʂ ☆@lemmy.ml to Machine Learning@lemmy.mlEnglish · 22 days ago

The Bitter Lesson is coming for Tokenization

lucalp.dev

external-link
message-square
0
link
fedilink
  • cross-posted to:
  • [email protected]
  • [email protected]
  • [email protected]
3
external-link

The Bitter Lesson is coming for Tokenization

lucalp.dev

☆ Yσɠƚԋσʂ ☆@lemmy.ml to Machine Learning@lemmy.mlEnglish · 22 days ago
message-square
0
link
fedilink
  • cross-posted to:
  • [email protected]
  • [email protected]
  • [email protected]
Highlights the desire to replace tokenization with a general method that better leverages compute and data. We'll see tokenization's fragility and review the Byte Latent Transformer arch.
alert-triangle
You must log in or # to comment.

Machine Learning@lemmy.ml

machinelearning@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: [email protected]
Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 1 user / day
  • 4 users / week
  • 12 users / month
  • 67 users / 6 months
  • 24 local subscribers
  • 2.01K subscribers
  • 198 Posts
  • 152 Comments
  • Modlog
  • mods:
  • osipov@lemmy.ml
  • BE: 0.19.12
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org