[Hosting] - How to deploy SYSTRAN Whisper ASR (beta) offline mode

Introduction

This article describes how to deploy a SYSTRAN Whisper ASR (beta) offline mode

Description

1) Required Packages

The following RPM packages are required (Dropbox):

2) Installation 

Transfer the two RPM files to the target server, then install them with: 

rpm -ivh systran-whisper-asr-1.0.1.rpm systran-whisper-asr-data-1.0.1.rpm 

3) Configure

Edit the configuration file /opt/systran/whisper-asr/etc/whisper_asr.cfg and set the following keys :

mongodb_host=server1, server2, server3
mongodb_user=systranAdmin
mongodb_password=XXXXXXXXX
mongodb_auth_source=admin

If applicable to your environment (TLS-secured MongoDB):

mongodb_tls=true
mongodb_tls_ca_file=/etc/ssl/cs-team-systran-ca.pem

Update CPU limits according to your environment. For instance when >= 32 cores:

cat >> /opt/systran/whisper-asr/etc/whisper_asr.cfg <<EOF
# Number of model workers to run multiple transcriptions in parallel. (default: 4)
MODEL_WORKERS=2
# Number of computation threads used by each model worker. (default: 4)
MODEL_THREADS=8
EOF

If 16 cores, reduce MODEL_WORKERS to 1

4) Start and check service

systemctl restart systran-whisper-asr
systemctl status systran-whisper-asr

If needed, logs can be obtain using

journalctl -fu systran-whisper-asr 

5) Configure SES-console

Most probable settings:

Restart services to apply:

systemctl restart systran-ses-console
systemctl restart systran-ses-file-translation-consumer

6) Upgarde

The current package does not support a direct in-place upgrade. To upgrade in the future: 

1. Back up /opt/systran/whisper-asr/etc/whisper_asr.cfg
2. Remove the existing Whisper packages 
3. Install the updated Whisper package version