Try uv for package management (245ms project installation)

[vwxyzjn]

Still playing with it.

Installation takes 245ms vs the typical 2-5 mins with pip. It also has many other additional benefits. For example, it locks the entire dependency tree, so there is always a reproducible build, so things like #246 would not happen unless we specifically decided to bump dependency.

With the current requirements.txt there is no dependency locking, so the dependencies may be different in just a couple of days. E.g.., the dependency difference in the image below comes from

• https://wandb.ai/ai2-llm/open_instruct_internal/runs/z0l53ziz
• https://wandb.ai/ai2-llm/open_instruct_internal/runs/gtkk202t

Some speed tests:

uv sync with caches: takes 235ms to install the whole open instruct project and then 10ms to install flash attention

Screen.Recording.2024-08-22.at.10.09.16.AM.mov

uv sync without caches: takes ~90 seconds (mostly download time; if done in the server, it should much much faster due to parallel download) to install the whole open instruct project and then 10 seconds to install flash attention

Screen.Recording.2024-08-22.at.10.06.23.AM.mov

** requirements.txt caches: takes about 2 mins

https://youtu.be/BLYBx5gCWqA

** requirements.txt without caches: takes about 4 mins

https://youtu.be/z0VdT29wb6E