In a similar vein I want a puzzle solver where you take a photo of the box and the piece and the app highlights where the piece probably goes in the picture
That might be doable. One of my fellow students designed a jigsaw puzzle solver that worked by looking at the shape of the piece, rather than a picture. However, I have worked in this kind of area and if you can guarantee little rotation, working out the translational offset isn't too bad. I'll give this some thought.
http://ideasfrommydreams.blogspot.com/2009/04/iphone-apps.ht...