I rate this as a composite functional endpoint. I wonder whether a group needs to collaborate on the Pelican-Riding-a-Bike Benchmark? You game?
🏗️ Building on HF
Dylan A Mordaunt
edithatogo
AI & ML interests
None yet
Recent Activity
repliedto sergiopaniego's post about 4 hours ago
Simon Willison (@simonw) has asked every new model to draw a pelican riding a bicycle for some time now
you look at the drawing and you know. but there is no number, so nothing can train against it, no?
I turned this idea into an rl env in OpenEnv. now, you can eval any model against it, and train against it with TRL
read the details!🤓
https://huggingface.co/blog/sergiopaniego/pelican-env-openenv reacted to sergiopaniego's post with 🔥 about 4 hours ago
Simon Willison (@simonw) has asked every new model to draw a pelican riding a bicycle for some time now
you look at the drawing and you know. but there is no number, so nothing can train against it, no?
I turned this idea into an rl env in OpenEnv. now, you can eval any model against it, and train against it with TRL
read the details!🤓
https://huggingface.co/blog/sergiopaniego/pelican-env-openenv updated a dataset about 19 hours ago
edithatogo/archive-govt-nz-treasury-csvOrganizations
replied to sergiopaniego's post about 4 hours ago
reacted to sergiopaniego's post with 🔥 about 4 hours ago
Post
2019
Simon Willison (@simonw ) has asked every new model to draw a pelican riding a bicycle for some time now
you look at the drawing and you know. but there is no number, so nothing can train against it, no?
I turned this idea into an rl env in OpenEnv. now, you can eval any model against it, and train against it with TRL
read the details!🤓
https://huggingface.co/blog/sergiopaniego/pelican-env-openenv
you look at the drawing and you know. but there is no number, so nothing can train against it, no?
I turned this idea into an rl env in OpenEnv. now, you can eval any model against it, and train against it with TRL
read the details!🤓
https://huggingface.co/blog/sergiopaniego/pelican-env-openenv
- 2 replies
updated a
dataset about 19 hours ago
published a
dataset about 19 hours ago
updated a
dataset about 19 hours ago
published a
dataset about 19 hours ago
updated a
dataset about 20 hours ago
published a
dataset about 20 hours ago
updated a
dataset about 21 hours ago
updated 3
collections 3 days ago