🗣️ Speech Discriminative Tasks
                
    
    
    
     📊 1st Probing Head
  
    
      | Models/Tasks | #Q | ASR-En | ASR-multiling | ER | IC | KS | SI | SV | 
    
      | WER ↓ | WER ↓ | 
    
      | Clean | Other | Welsh | Basque | ACC ↑ | ACC ↑ | ACC ↑ | ACC ↑ | EER ↓ | 
  
  
    
      | Continuous | -- | 2.26 | 5.09 | 41.77 | 14.32 | 63.10 | 86.10 | 99.00 | 99.70 | 2.10 | 
    
      | Enc-SMA-24 | 2 | 39.16 | 63.44 | 90.90 | 51.00 | 45.50 | 42.90 | 77.73 | 89.81 | 18.33 | 
    
      | 8 | 16.83 | 38.98 | 84.53 | 45.36 | 44.73 | 40.03 | 74.30 | 94.26 | 13.54 | 
    
      | 32 | 50.84 | 66.04 | 97.39 | 58.21 | 42.96 | 33.66 | 69.10 | 91.12 | 10.12 | 
    
      | DAC-SMA-24 | 2 | 24.57 | 50.60 | 95.21 | 68.93 | 45.20 | 29.83 | 67.27 | 97.88 | 21.80 | 
    
      | 8 | 16.29 | 39.57 | 97.20 | 62.45 | 44.73 | 23.97 | 65.27 | 87.33 | 15.86 | 
    
      | 32 | 98.40 | 98.42 | 98.96 | 73.57 | 43.20 | 44.60 | 68.67 | 87.69 | 17.12 | 
    
        | ST-S-16 | 2 | 14.92 | 34.19 | 71.36 | 42.17 | 54.86 | 56.80 | 94.11 | 73.16 | 24.23 | 
      
        | 8 | 12.69 | 30.99 | 68.36 | 35.35 | 55.00 | 53.83 | 94.11 | 96.78 | 10.45 | 
  
      
      
        | Mimi-S-24 | 8 | 13.96 | 31.53 | 91.59 | 59.18 | 51.13 | 53.83 | 92.18 | 79.50 | 18.68 | 
      
        | 32 | 13.52 | 30.77 | 96.89 | 58.15 | 46.76 | 50.73 | 91.31 | 63.93 | 23.91 | 
  
      
      
        | DWavL-S-16 | 2 | 6.00 | 14.38 | 58.98 | 22.02 | 61.53 | 76.33 | 96.82 | 76.57 | 22.41 | 
      
        | 6 | 4.32 | 10.73 | 48.94 | 19.66 | 63.20 | 78.73 | 95.89 | 92.31 | 13.47 | 
  
      
      
        | DHuBERT-S-16 | 2 | 5.89 | 14.71 | 53.51 | 22.16 | 55.97 | 67.00 | 82.90 | 86.39 | 23.15 | 
      
        | 6 | 4.37 | 10.92 | 54.74 | 20.83 | 63.00 | 71.20 | 88.10 | 66.53 | 22.64 | 
  
      
      
        | DWav2Vec2-S-16 | 2 | 4.47 | 32.87 | 61.85 | 28.68 | 56.43 | 67.90 | 93.45 | 76.86 | 24.49 | 
      
        | 6 | 6.57 | 15.94 | 54.35 | 23.19 | 60.63 | 71.10 | 96.24 | 89.76 | 14.41 | 
  
      
      
        | SQ-SMA-16 | 4 | 11.63 | 30.91 | 94.80 | 94.24 | 41.30 | 58.13 | 92.74 | 97.38 | 9.69 | 
  
      
      
        | WT-SMA-24-2 | 1 | 28.69 | 52.90 | 97.41 | 75.82 | 43.43 | 15.25 | 59.13 | 85.90 | 19.38 | 
    
  
    
    📊 2nd Probing Head
    
      
        
          | Models/Tasks | #Q | ASR-En | ASR-multiling | ER | IC | KS | SI | SV | 
        
          | WER ↓ | WER ↓ | 
        
          | Clean | Other | Welsh | Basque | ACC ↑ | ACC ↑ | ACC ↑ | ACC ↑ | EER ↓ | 
      
      
        
        
          | Enc-SMA-24 | 2 | 39.16 | 63.44 | 90.90 | 51.00 | 45.50 | 42.90 | 77.73 | 89.81 | 18.33 | 
        
          | 8 | 16.83 | 38.98 | 84.53 | 45.36 | 44.73 | 40.03 | 74.30 | 94.26 | 13.54 | 
        
          | 32 | 50.84 | 66.04 | 97.39 | 58.21 | 42.96 | 33.66 | 69.10 | 91.12 | 10.12 | 
    
        
        
          | DAC-SMA-24 | 2 | 24.57 | 50.60 | 95.21 | 68.93 | 45.20 | 29.83 | 67.27 | 97.88 | 21.80 | 
        
          | 8 | 16.29 | 39.57 | 97.20 | 62.45 | 44.73 | 23.97 | 65.27 | 87.33 | 15.86 | 
        
          | 32 | 98.40 | 98.42 | 98.96 | 73.57 | 43.20 | 44.60 | 68.67 | 87.69 | 17.12 | 
    
        
        
          | ST-S-16 | 2 | 14.92 | 34.19 | 71.36 | 42.17 | 54.86 | 56.80 | 94.11 | 73.16 | 24.23 | 
        
          | 8 | 12.69 | 30.99 | 68.36 | 35.35 | 55.00 | 53.83 | 94.11 | 96.78 | 10.45 | 
    
        
        
          | Mimi-S-24 | 8 | 13.96 | 31.53 | 91.59 | 59.18 | 51.13 | 53.83 | 92.18 | 79.50 | 18.68 | 
        
          | 32 | 13.52 | 30.77 | 96.89 | 58.15 | 46.76 | 50.73 | 91.31 | 63.93 | 23.91 | 
    
        
        
          | DWavL-S-16 | 2 | 6.00 | 14.38 | 58.98 | 22.02 | 61.53 | 76.33 | 96.82 | 76.57 | 22.41 | 
        
          | 6 | 4.32 | 10.73 | 48.94 | 19.66 | 63.20 | 78.73 | 95.89 | 92.31 | 13.47 | 
    
        
        
          | DHuBERT-S-16 | 2 | 5.89 | 14.71 | 53.51 | 22.16 | 55.97 | 67.00 | 82.90 | 86.39 | 23.15 | 
        
          | 6 | 4.37 | 10.92 | 54.74 | 20.83 | 63.00 | 71.20 | 88.10 | 66.53 | 22.64 | 
    
        
        
          | DWav2Vec2-S-16 | 2 | 4.47 | 32.87 | 61.85 | 28.68 | 56.43 | 67.90 | 93.45 | 76.86 | 24.49 | 
        
          | 6 | 6.57 | 15.94 | 54.35 | 23.19 | 60.63 | 71.10 | 96.24 | 89.76 | 14.41 | 
    
        
        
          | SQ-SMA-16 | 4 | 11.63 | 30.91 | 94.80 | 94.24 | 41.30 | 58.13 | 92.74 | 97.38 | 9.69 | 
    
        
        
          | WT-SMA-24-2 | 1 | 28.69 | 52.90 | 97.41 | 75.82 | 43.43 | 15.25 | 59.13 | 85.90 | 19.38 |