-
Notifications
You must be signed in to change notification settings - Fork 193
Pull requests: openvinotoolkit/openvino.genai
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[WWB] add more models
category: GHA
CI based on Github actions
category: llm_bench
Label for tool/llm_bench folder
category: WWB
PR changes WWB
#1446
opened Dec 27, 2024 by
ilya-lavrenov
•
Draft
[Testing] SDPA vs PA: debug prints
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: sampling
Sampling / Decoding algorithms
do_not_merge
do_not_review
no-match-files
StaticLLMPipeline: Support multinomial sampling
category: LLM
LLM pipeline (stateful, static)
category: sampling
Sampling / Decoding algorithms
#1431
opened Dec 24, 2024 by
TolyaTalamanov
Loading…
Pl bench
category: cmake / build
Cmake scripts
category: continuous batching
Continuous batching
category: GenAI C++ API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: sampling
Sampling / Decoding algorithms
category: speculative decoding
Speculative decoding
no-match-files
Use get_max_new_tokens() insted of max_new_tokens field when stopping…
category: sampling
Sampling / Decoding algorithms
#1417
opened Dec 20, 2024 by
michalkulakowski
Loading…
[Samples] merge LLM samples to "text_generation" folder
category: cmake / build
Cmake scripts
category: GHA
CI based on Github actions
category: samples
GenAI samples
#1411
opened Dec 19, 2024 by
olpipi
Loading…
add performance statistics for image generation
category: GenAI C++ API
Changes in GenAI C++ public headers
category: Python API
Python API for GenAI
category: samples
GenAI samples
category: text to image
Text 2 image pipeline
#1405
opened Dec 18, 2024 by
xufang-lisa
•
Draft
Add performance statistics for speculative decoding
category: continuous batching
Continuous batching
category: samples
GenAI samples
category: speculative decoding
Speculative decoding
#1403
opened Dec 18, 2024 by
xufang-lisa
•
Draft
Cross referencing blogs in genai samples readme
category: samples
GenAI samples
#1399
opened Dec 17, 2024 by
DimaPastushenkov
Loading…
Removed WAs for OpenVINO: pass properties as is
category: continuous batching
Continuous batching
category: GHA
CI based on Github actions
category: LLM
LLM pipeline (stateful, static)
category: Python API
Python API for GenAI
category: speculative decoding
Speculative decoding
category: text to image
Text 2 image pipeline
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
category: whisper
Whisper pipeline
no-match-files
[GHA] Samples tests
category: cmake / build
Cmake scripts
category: GHA
CI based on Github actions
no-match-files
[CB]Support 4-bit cache
category: continuous batching
Continuous batching
do_not_merge
no-match-files
#1366
opened Dec 12, 2024 by
zhangYiIntel
•
Draft
[WIP] LoRA for FLUX
category: GenAI C++ API
Changes in GenAI C++ public headers
category: text to image
Text 2 image pipeline
Drop check of 'import openvino'
category: cmake / build
Cmake scripts
category: Python API
Python API for GenAI
#1299
opened Dec 4, 2024 by
ilya-lavrenov
•
Draft
Add slice before matmut transformation for CB scenario
category: continuous batching
Continuous batching
category: LLM
LLM pipeline (stateful, static)
category: sampling
Sampling / Decoding algorithms
category: speculative decoding
Speculative decoding
no-match-files
[VLM] Image resize model
category: GHA
CI based on Github actions
category: tokenizers
Tokenizer class or submodule update
category: visual language
Visual language pipeline
Parallel sampling with threadpool
category: continuous batching
Continuous batching
category: sampling
Sampling / Decoding algorithms
no-match-files
Parallel sampling with ov::threading
category: cmake / build
Cmake scripts
category: continuous batching
Continuous batching
category: sampling
Sampling / Decoding algorithms
no-match-files
Add LongBench validation
category: continuous batching
Continuous batching
no-match-files
#1220
opened Nov 18, 2024 by
l-bat
Loading…
Added chat template to CLI.
category: WWB
PR changes WWB
#1208
opened Nov 13, 2024 by
andreyanufr
•
Draft
Previous Next
ProTip!
Follow long discussions with comments:>50.