Making SAM 2 run 2x faster

[mvoodarla]

I was pretty amazed with SAM 2 when it came out given all the work I do with video. My company works a ton with it and we decided to take a crack at optimizing it, and we made it run 2x faster than the original pipeline!

Unlike LLMs, video models are notorious for incredibly inefficient file reading, storage, and writing which makes them much slower than they need to be.

We wrote a bit about our work here and thought we'd share with the community:

https://www.sievedata.com/blog/meta-segment-anything-2-sam2-introduction

[jhj0517]

I just quickly looked into this, does this need API key and call API using network instead of using local model?

[mvoodarla]

Yep unfortunately this currently requires an API key as some of the speedups we made are more system / compute level as well (not just code-level).