I low-key wish there were a separate AI leaderboard. It would be really interesting to see how fast bots can actually solve a problem as soon as it goes up, and it'd be nice to compare that to last year.
this post was submitted on 14 Nov 2023
25 points (100.0% liked)
Advent Of Code
770 readers
15 users here now
An unofficial home for the advent of code community on programming.dev!
Advent of Code is an annual Advent calendar of small programming puzzles for a variety of skill sets and skill levels that can be solved in any programming language you like.
AoC 2023
Solution Threads
| M | T | W | T | F | S | S |
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | ||||
| 4 | 5 | 6 | 7 | 8 | 9 | 10 |
| 11 | 12 | 13 | 14 | 15 | 16 | 17 |
| 18 | 19 | 20 | 21 | 22 | 23 | 24 |
| 25 |
Rules/Guidelines
- Follow the programming.dev instance rules
- Keep all content related to advent of code in some way
- If what youre posting relates to a day, put in brackets the year and then day number in front of the post title (e.g. [2023 Day 10])
- When an event is running, keep solutions in the solution megathread to avoid the community getting spammed with posts
Relevant Communities
Relevant Links
Credits
Icon base by Lorc under CC BY 3.0 with modifications to add a gradient
console.log('Hello World')
founded 1 year ago
MODERATORS
Honestly, I'd be very surprised if AI could even solve those problems.
The only AI I've heard of that might eventually be able to actually solve problems is OpenAI's Project Q, and that one isn't public yet. The publicly available AI tools can just repeat things they have already seen online (with a rather large chance of repeating it wrong due to their lossy nature). So, unless the riddles exist somewhere online in a reasonably similar form, I'd expect the chatbots to fail at solving them.
(They can, however, help a human developer solve them quicker than the developer could without AI assistence.)
Whoever makes the Advent of Code problems should test all them on GPT4 / other LLMs and try to make it so the AI can't solve them.
That class of problems is small, and shrinking, and would block out any newer programmers from entering.
Is it though? Has someone tried with some of the past problems?
I hope AoC is niche enough that the community won't use AI before leaderboards are filled.
Would be interesting to compare this year's times with the years before and see if there is a trend.