this post was submitted on 12 Nov 2023
12 points (83.3% liked)
Furry Chat
682 readers
1 users here now
Yiffit chat! Talk about anything you want here.
Mention @chat@yiffit.net from your favorite Fediverse / Mastodon client to post here directly, or post directly via any Lemmy instance.
Community Icon (CC-BY-NC-SA) Tom Fischbach
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Currently in my last year of a CS degree. As a hobby I've been focusing on programming procedural generation stuff for games and recently I've been getting more into working with electronics hoping to one day make an automated sorting system for my Lego collection.
Sounds like your hobby could turn into something more. Electronics can have some really unintuitive debug issues. Your idea for a lego sorter reminds me of parts Shane's (Stuff Made Here) puzzle robot. https://www.youtube.com/watch?v=Gu_1S77XkiM
Yeah, I'm still new to all of it. My plan of action is to make a machine that tumbles bricks onto a conveyor and takes pictures of them before cycling them back through. This is to collect a dataset for training a machine vision model. If that doesn't work out I'll just have to make it sort the bricks by color as that's easy enough to do.
The hardest part I've encountered so far is trying to learn how to control lots of stepper motors, how to power everything, and of course learning the 3d modelling process so I can mix both Lego and non Lego in the machine's construction.
I haven't done any modelling myself, but if I ever start, I'll probably try openscad. Lego are fairly uniform, so I would wonder if more traditional machine vision techniques would work.
For machine vision, I was thinking of using multiple cameras and then just stitching the images together and using that as the input. That way it gets images of the bricks from multiple angles, which when combined with bright lighting from LED strips should make it easier to identify.
I have basically no experience with any machine vision, I've done some edge/color detection once, but my intuition says that sounds like a plan. Because you have a pretty unique feature for each brick, its number of studs and size of cavity on the bottom, you might not need as full a picture of each brick as you might think. That's pure speculation though. Have fun with the project.