Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Andrew branch #15003

Closed
wants to merge 54 commits into from
Closed

Andrew branch #15003

wants to merge 54 commits into from

Conversation

Ataing1
Copy link

@Ataing1 Ataing1 commented Feb 22, 2024

No description provided.

@AmeyaGawde326
auto refresh models
8ad3585
@AmeyaGawde326
auto refresh models
a5ba468
@AmeyaGawde326
auto refresh models for image2image api
881a1ae
@AmeyaGawde326
add auto refresh if model is not present
65b26e4
@AmeyaGawde326
changed the get checkpoint function
e635a73
@AmeyaGawde326
syntax fix for range
81718c3
@AmeyaGawde326
change validate function
0050a35
@AmeyaGawde326
remove replace
1d20a47
@AmeyaGawde326
use title instead of model_name
6cf8d84
@AmeyaGawde326
add local storage cache for model weights
0fbe9b9
@AmeyaGawde326
set default path as runpod and fix utf file names
1bce211
@AmeyaGawde326
refactor code
0614efd
@AmeyaGawde326
refactor code and fix tests
957519d
@AmeyaGawde326
Merge branch 'model_refresh' of https://github.com/lookfirst-io/stabl…
97eff3e 
…e-diffusion-webui into model_cache_test
@AmeyaGawde326
remove extra logs
a8d4fe4
@AmeyaGawde326
remove extra log in loading
a2ee513
@AmeyaGawde326
Merge branch 'model_cache_test' of syr_web_ui
1cf4cec
@AmeyaGawde326
changed runpod volume
84c2d74
@AmeyaGawde326
set cmd args to default
0894635
@AmeyaGawde326
add an if check for override settings
83c87b8
@AmeyaGawde326
fix txt2img test
3c30161
@AmeyaGawde326
Merge branch 'model_refresh' of https://github.com/lookfirst-io/stabl…
1c5cc6c 
…e-diffusion-webui into model_cache_test
@AmeyaGawde326
test with local storage
a770735
@AmeyaGawde326
Merge branch 'model_cache_test' of syr_web into model_cache
fa43b20
@AmeyaGawde326
linter test
6e06d5c
@AmeyaGawde326
lru cache test
5129fef
@AmeyaGawde326
state dict lru cache
1e07454
@AmeyaGawde326
add cache management
ef6b256
@AmeyaGawde326
enviorment variable change
4aa80f8
@AmeyaGawde326
change cache size to 30 gb
16dca3c
AmeyaGawde326 and others added 24 commits February 16, 2024 01:00
@AmeyaGawde326
add api cmd arg
e3ac4ce
@AmeyaGawde326
change storage using enviorment variable
b5c7da3
@AmeyaGawde326
pop item entry from cache when deleted
e975c8c
@AmeyaGawde326
local storage cache management
c29394f
@AmeyaGawde326
add ram cache above local cache
47bc3a1
@AmeyaGawde326
fix conflict
2537e44
@AmeyaGawde326
add small changes, better logs, fixed small errors and fail safes
bb6d8c8
@AmeyaGawde326
add third layer of cache from runpod volume
4a6eafc
@AmeyaGawde326
add a queue lock to check if that mixes the memory issue
2a7906d
@AmeyaGawde326
Refactor code and small fixes
73959ed
@AmeyaGawde326
Refactor and Bug fixes Andrew MVP
15a8695
@AmeyaGawde326
small comments changes and formatting
0fc4e48
@AmeyaGawde326
fix 0 capacity lru cache
f2f867b
@AmeyaGawde326
fix syntax error
8a2cad3
@AmeyaGawde326
fix comment
7368af6
@AmeyaGawde326
unpack tuple to evict model from ram
446908a 
udd better logs for loading and writing files
re-add get func in lru cache
use lru cache to check ram
@AmeyaGawde326
refactor code
f4afdb8
@AmeyaGawde326
remove runpod cache layer
6f3a78f
@AmeyaGawde326
fix the cache path
3e4c3d4
@AmeyaGawde326
fix function args
9dac044
@AmeyaGawde326
fix local storage cache out of sync
2649fd1
@AmeyaGawde326
refactor code
c32c4bc
@AmeyaGawde326
check ram availability
d1f803b
@Ataing1
test
d146b6d
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@AUTOMATIC1111 AUTOMATIC1111 Awaiting requested review from AUTOMATIC1111 AUTOMATIC1111 is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Ataing1 @missionfloyd @AmeyaGawde326