Crazy black magic video on using Augmented Reality / CV to find PCB Components!

[snoop911]

Any thoughts on how one would actually implement something like this?  
https://www.youtube.com/watch?v=AfVQ4N-u0sk


In terms of software, it seems it's a mixture of
-- Unity ,
-- a Computer Vision library (OpenCV, TCP-Com, Sighthound, Cogniac, etc) ,
-- and a AR Library (ARkit , Vuforia, ARCore, etc)

Having to put a QR image on the PCB isn't great.. but the application is super cool and cheaper than commercial Automatic Optical Inspection solutions (arav , Cluso, ProntoAOI, etc)