I improved project for hummingbird to be able to use camera input. I used also immitation learning (when you record your actions and teach NN to act closely as recorded). And even using it last iteration learned for 8 days! (Mac M1).
If you have any questions or know how to make it better, write me please www.linkedin.com/in/vshirokun
...

Project is here: drive.google.com/file/d/1O_vkL4-LBKStT1a9kRwXIlaLyA67QlSH/view