🐋Via Docker

També s’han preparat alguns models que requereixen poca capacitat de còmput en fer l’inferència com a “dockers” auto-continguts als quals es pot accedir mitjançant una RestFUL API.

• RestFUL API i interfície web per servir models de síntesi de la parla

  • Accés al Docker: https://hub.docker.com/r/projecteaina/tts-api

  • Accés a GitHub: https://github.com/projecte-aina/tts-api

• RestFUL API per servir models de traducció automàtica

  • Accés al Docker: https://hub.docker.com/r/projecteaina/mt-api

  • Accés a GitHub: https://github.com/projecte-aina/mt-api

Si teniu interès en que posem a disposició altres models en format "Docker", feu-nos arribar la petició a través del formulari de contacte.

Requisits mínims/recomanats per als models disponibles

Model

BSC-LT/salamandra-7b-instruct

Type

Text Generation

MINIMUM GPU vRAM MEMORY

24 GB

RECOMMENDED HARDWARE

Minimum/Suggested:

NVIDIA A10G 24GB NVIDIA L4 24GB Next level: NVIDIA T4 60GB (4 GPUs) NVIDIA A10G 96GB (4 GPUs) NVIDIA A100 NVIDIA H100

Works on CPU?

No

Model

BSC-LT/salamandra-7b

Type

Text Generation

MINIMUM GPU vRAM MEMORY

24 GB

RECOMMENDED HARDWARE

Minimum/Suggested:

NVIDIA A10G 24GB NVIDIA L4 24GB Next level: NVIDIA T4 60GB (4 GPUs) NVIDIA A10G 96GB (4 GPUs) NVIDIA A100 NVIDIA H100

Works on CPU?

No

Model

BSC-LT/salamandra-2b-instruct

Type

Text Generation

MINIMUM GPU vRAM MEMORY

-

RECOMMENDED HARDWARE

Minimum: CPU with 4 cores and 8GB of RAM Suggested: NVIDIA T4 16GB Next level: NVIDIA A10G 24GB NVIDIA L4 24GB NVIDIA T4 60GB (4 GPUs) NVIDIA A10G 96GB (4 GPUs) NVIDIA A100 NVIDIA H100

Works on CPU?

Yes, but response times increase considerably.

Model

BSC-LT/salamandra-2b

Type

Text Generation

MINIMUM GPU vRAM MEMORY

-

RECOMMENDED HARDWARE

Minimum: CPU with 4 cores and 8GB of RAM Suggested: NVIDIA T4 16GB Next level: NVIDIA A10G 24GB NVIDIA L4 24GB NVIDIA T4 60GB (4 GPUs) NVIDIA A10G 96GB (4 GPUs) NVIDIA A100 NVIDIA H100

Works on CPU?

Yes, but response times increase considerably.

Model

projecte-aina/whisper-large-v3-ca-3catparla

Type

Speech Recognition

MINIMUM GPU vRAM MEMORY

16GB

RECOMMENDED HARDWARE

Minimum/Suggested: NVIDIA T4 16GB NVIDIA L4 24GB NVIDIA A10G 24GB Next level: NVIDIA T4 60GB (4 GPUs) NVIDIA A10G 96GB (4 GPUs) NVIDIA A100 NVIDIA H100

Works on CPU?

No

Model

projecte-aina/matxa-tts-cat-multiaccent

Type

Text to Speech

MINIMUM GPU vRAM MEMORY

-

RECOMMENDED HARDWARE

Minimum: CPU with 4 cores and 8GB of RAM NVIDIA GTX1060 (minimum tested by us, lower may work) Suggested: NVIDIA T4 16GB Next level: NVIDIA A10G 24GB NVIDIA L4 24GB NVIDIA T4 60GB (4 GPUs) NVIDIA A10G 96GB (4 GPUs) NVIDIA A100 NVIDIA H100

Works on CPU?

Yes