Use YOLOv5 tensorflow.js models to speed up annotation

Submitted by RandomForests92 t3_xus40c in deeplearning

Hi everyone! I'm Piotr and for several years I have been developing a small open-source project for labeling photos - makesense.ai. I added a new feature this weekend. You can use [YOLOv5](https://github.com/ultralytics/yolov5) models to automatically annotate photos. You can choose one of the models pre-trained on the COCO dataset, but most importantly you can load your own custom models. Just drag and drop the tensorflow.js model to the editor and you are good to go. Everything runs in the browser - no backend, so it is completely free. Let me know what you think! I'm super excited about that project.

By the way, I have created an NPM package, which can also make it easier for you to deploy YOLOv5 in the browser. https://github.com/SkalskiP/yolov5js

17

Comments

You must log in or register to comment.

encord_team t1_ir50jb5 wrote

Hi u/RandomForests92 - Exciting project! The onboarding experience is smooth and the UI makes it easy to get started on a simple annotation project.

I would consider adding hotkeys for the different label types/label operations and the option to do object detection and classification in one view.

2

RandomForests92 OP t1_ir52dsl wrote

Hi u/encord_team 👋! Thank you. I am building it as a side project since 2019. And watching it grow gives me tons of pleasure.

We have some hotkeys mechanism, but it was really purely designed - certainly wasn't my best engineering achievement. I will have to rebuild it in the future.

Detection and classification at the same time? What would be the real-life scenario when you would need both?

2

encord_team t1_ir55n46 wrote

I can imagine! Any other side projects that you're working on?

Hotkeys are not a major thing, just a nice productivity enhancer when annotating many images with a more extensive ontology.

Soz, should have been more clear - not to perform both tasks in one frame. More from a UI perspective in the editor, you could add the option to change between them or show both at the same time.

2

RandomForests92 OP t1_ir5jaag wrote

I really understand the need for hotkeys. I simply underestimated the complexity. Doing that right turned out to be quite complicated.

makesense.ia is certainly the largest one. I just recently started https://github.com/SkalskiP/yolov5js with the aim to make it much easier for frontend developers without computer vision background to use object detection in their projects. Apart from that, I have https://github.com/SkalskiP/ILearnDeepLearning.py which is a repository containing examples related to my blog posts on Medium https://medium.com/@piotr.skalski92.

2

DDDqp t1_iqzo5n3 wrote

That's great, but is it possible to have yolov7? The 5th is lacking in comparison. At least in my case the v7 gave better results.

1

RandomForests92 OP t1_iqzq70m wrote

Hi u/DDDqp! YOLOv7 is for sure on my list. Problem is that, as it is right now YOLOv7 does not offer export to tensorflow.js. I actually created the issue by asking if they plan to add that export: https://github.com/WongKinYiu/yolov7/issues/885 No response yet. But I think it is more than possible. I can even work on that export for them. If they would have exported to tfjs, than I most certainly can work on the NPM package.

2