> ## Documentation Index
> Fetch the complete documentation index at: https://smallestai-ff1e543d.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Performance

> Latency, accuracy, and throughput benchmarks for Pulse STT

## Latency Metrics

### Time-to-First-Transcript (TTFT)

Our Pulse STT model provides State of the art TTFT latency of \~**64ms**, which is one of the least in the world.

<Accordion title="TTFT Comparison Analysis">
  TTFT (Time to First Transcript) measures the latency between when a user stops speaking and when the model returns the complete transcript. Lower TTFT means faster response times and better user experience in real-time applications.

  <table style={{ borderCollapse: 'separate', borderSpacing: 0, width: '100%', borderRadius: '8px', overflow: 'hidden' }}>
    <thead>
      <tr style={{ backgroundColor: 'rgba(255, 255, 255, 0.08)' }}>
        <th style={{ padding: '12px 16px', textAlign: 'left', fontWeight: '800', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderTopLeftRadius: '8px' }}>Model</th>
        <th style={{ padding: '12px 16px', textAlign: 'left', fontWeight: '800', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderTopRightRadius: '8px' }}>Latency (ms)</th>
      </tr>
    </thead>

    <tbody>
      <tr>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Smallest Pulse STT</td>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>64</td>
      </tr>

      <tr>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Deepgram Nova 2</td>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>76</td>
      </tr>

      <tr>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Deepgram Nova 3</td>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>71</td>
      </tr>

      <tr>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderBottomLeftRadius: '8px' }}>Assembly AI Universal</td>
        <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderBottomRightRadius: '8px' }}>698</td>
      </tr>
    </tbody>
  </table>
</Accordion>

## Accuracy Metrics

### Word Error Rate (WER)

All models were evaluated on the FLEURS dataset, a standardised multilingual speech benchmark ensuring fair cross-model comparison.

<table style={{ borderCollapse: 'separate', borderSpacing: 0, width: '100%', borderRadius: '8px', overflow: 'hidden' }}>
  <thead>
    <tr style={{ backgroundColor: 'rgba(255, 255, 255, 0.08)' }}>
      <th style={{ padding: '12px 16px', textAlign: 'left', fontWeight: '800', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderTopLeftRadius: '8px' }}>Language</th>
      <th style={{ padding: '12px 16px', textAlign: 'left', fontWeight: '800', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderTopRightRadius: '8px' }}>WER</th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>English</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>5.1%</td>
    </tr>

    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Italian</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>4.2%</td>
    </tr>

    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Spanish</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>5.4%</td>
    </tr>

    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderBottomLeftRadius: '8px' }}>Hindi</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderBottomRightRadius: '8px' }}>11.4%</td>
    </tr>
  </tbody>
</table>

## Throughput

### Requests Per Second

<table style={{ borderCollapse: 'separate', borderSpacing: 0, width: '100%', borderRadius: '8px', overflow: 'hidden' }}>
  <thead>
    <tr style={{ backgroundColor: 'rgba(255, 255, 255, 0.08)' }}>
      <th style={{ padding: '12px 16px', textAlign: 'left', fontWeight: '800', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderTopLeftRadius: '8px' }}>Audio Length</th>
      <th style={{ padding: '12px 16px', textAlign: 'left', fontWeight: '800', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderTopRightRadius: '8px' }}>HTTP POST</th>
    </tr>
  </thead>

  <tbody>
    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Short (\< 5s)</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>50-100</td>
    </tr>

    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>Medium (5-30s)</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)' }}>20-50</td>
    </tr>

    <tr>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderBottomLeftRadius: '8px' }}>Long (30s+)</td>
      <td style={{ padding: '12px 16px', border: '0.5px solid rgba(209, 213, 219, 0.2)', borderBottomRightRadius: '8px' }}>10-20</td>
    </tr>
  </tbody>
</table>

*Throughput varies based on audio length, format, and server load*

## Performance by Audio Format

### Linear16 (PCM)

* **Latency**: Lowest (\~64ms)
* **Accuracy**: Highest
* **Bandwidth**: Highest
* **Best for**: High-quality applications

### Opus

* **Latency**: Low (\~70-80ms)
* **Accuracy**: High
* **Bandwidth**: Low
* **Best for**: Browser/mobile applications

### FLAC

* **Latency**: Medium (\~80-90ms)
* **Accuracy**: Highest
* **Bandwidth**: Medium
* **Best for**: Archival/quality-critical use cases

### μ-law

* **Latency**: Low (\~65-75ms)
* **Accuracy**: Good
* **Bandwidth**: Lowest
* **Best for**: Telephony applications

## Performance by Language

### High-Performance Languages

* **Italian**: 4.2% WER, \~64ms latency
* **English**: 5.1% WER, \~64ms latency
* **Spanish**: 5.4% WER, \~64ms latency
* **Portuguese**: 7.1% WER, \~64ms latency
* **German**: 8.5% WER, \~64ms latency
* **French**: 9.2% WER, \~64ms latency

### Regional Variations

* **Indian Languages**: 10-15% WER, \~90-100ms latency
* **Eastern European**: 9-12% WER, \~85-95ms latency

## Feature Impact on Performance

### Diarization

* **Latency Impact**: +10-20ms
* **Accuracy Impact**: Minimal
* **Use When**: Multiple speakers present

### Word Timestamps

* **Latency Impact**: +5-10ms
* **Accuracy Impact**: None
* **Use When**: Timing information needed

### Emotion Detection

* **Latency Impact**: +15-25ms
* **Accuracy Impact**: None
* **Use When**: Emotion analysis required

## Optimization Tips

* Use 16kHz sample rate for optimal balance
* Choose linear16 format for lowest latency
* Enable only needed features to reduce latency
* Batch process when latency isn't critical

## Next Steps

* [Metrics Overview](/v4.0.0/content/speech-to-text/benchmarks/metrics-overview).
* [Evaluation Walkthrough](/v4.0.0/content/speech-to-text/benchmarks/evaluation-walkthrough).
* [Best Practices](/v4.0.0/content/speech-to-text/pre-recorded/best-practices).
