Code

Add attentive layer to Jepa#927

Code

Merged

cbalioglu merged 40 commits intomainfacebookresearch/fairseq2:mainfrom tuan/add_attentive_layer_to_jepafacebookresearch/fairseq2:tuan/add_attentive_layer_to_jepaCopy head branch name to clipboardDec 27, 2024

+482-2

Commits

Commits on Dec 19, 2024

• add init function to the builders

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  7fca3ca

• add builder skeleton for the AttentivePooler

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  7623e1b

• refactor init_module function

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  7b959fe

• refactor init_module function

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  cef6687

• update cross attention layer

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  c7a9021

• update cross attn layer

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  ab93be9

• Cosmetic updates

  cbalioglu

  committed
  f745bea

• add forward() function

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  60ec4c1

• Can's comments

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  854b68e

• fix git rebase

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  328f8ca

• fix git rebase

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  f57108d

• lint

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  2d27bab

• lint

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  8d7dfaf

• rebase

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  4b69946

• flake8

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  e86afaa

• remove commits remnant

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  2a76edd

• black

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  250f1ee

• black

  

  tuantran user

  committed
  f4aaf33

Commits on Dec 20, 2024

• add builder func

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  e4d9a0a

• revert remnant codes

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  b8cfd50

• revert remnant codes

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  a6987ab

• revert remnant codes

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  837cc6c

• lint

  

  Tuan Tran

  committed
  25eb3f0

• lint

  

  Tuan Tran

  committed
  be3b6e2

Commits on Dec 22, 2024

• rebase

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  8f90974

• nit import clean

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  2f685e8

• nit rename layers

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  919b305

• update factory

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  c771767

• lint

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  a43f683

Commits on Dec 24, 2024

• fix typo

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  b76bbe5

Commits on Dec 26, 2024

• allow unstricted model loading

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  88b2d95

• Feedback commit

  

  cbalioglu

  authored and

  Tuan Tran

  committed
  57987da

• update cross_attn build func

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  4690e6b

• lint

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  a345c4c

• update AttentivePooler param names

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  f96344b

• decouple #938

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  75472ab

• lint

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  8993698

• lint

  

  Tuan Tran

  committed
  4394a0a

• lint

  

  Tuan Tran

  authored and

  Tuan Tran

  committed
  05c979f

• lint

  

  Tuan Tran

  committed
  fc3b5c9