Code

concurrency without model cloning#573

Code

Open

dtrawins wants to merge 17 commits intohuggingface:mainhuggingface/optimum-intel:mainfrom dtrawins:no-clone-concurrencydtrawins/optimum-intel:no-clone-concurrencyCopy head branch name to clipboard

+271-39

Commits

Commits on Feb 27, 2024

• initial test version

  dtrawins

  committed
  a2379a9

Commits on Feb 28, 2024

• more tests and code cleanup

  dtrawins

  committed
  6798a66

Commits on Feb 29, 2024

• Merge remote-tracking branch 'origin/main' into no-clone-concurrency

  dtrawins

  committed
  02a129a

• fix python3.8 execution

  dtrawins

  committed
  be1a32d

Commits on Mar 6, 2024

• test fixes for latest transformers and review fixes

  dtrawins

  committed
  fe71151

Commits on Mar 18, 2024

• review updates

  dtrawins

  committed
  6667661

Commits on Mar 20, 2024

• merge with main

  dtrawins

  committed
  4bb1370

Commits on Mar 28, 2024

• style fixes

  dtrawins

  committed
  ae47a4e

• Merge remote-tracking branch 'origin/main' into no-clone-concurrency

  dtrawins

  committed
  9fdd833

Commits on Apr 18, 2024

• concurrency without overriding past_key_values with infer context

  dtrawins

  committed
  bd106a7

Commits on Apr 19, 2024

• fix passing beam_idx content for stateless models

  dtrawins

  committed
  93e40ee

Commits on Apr 22, 2024

• merge from main

  dtrawins

  committed
  bb40376

• cleanup and style

  dtrawins

  committed
  e5b6075

• style

  dtrawins

  committed
  f7653b2

• merge from main

  dtrawins

  committed
  8de1511

• change dict to Dict from typing

  dtrawins

  committed
  0ecaa0f

• fix type declaration

  dtrawins

  committed
  aec45a9