🗣️ Speech Discriminative Tasks

📊 1st Probing Head

Models/Tasks	#Q	ASR-En		ASR-multiling		ER	IC	KS	SI	SV
		WER ↓		WER ↓		ER	IC	KS	SI	SV
		Clean	Other	Welsh	Basque	ACC ↑	ACC ↑	ACC ↑	ACC ↑	EER ↓
Continuous	--	2.26	5.09	41.77	14.32	63.10	86.10	99.00	99.70	2.10
Enc-SMA-24	2	39.16	63.44	90.90	51.00	45.50	42.90	77.73	89.81	18.33
	8	16.83	38.98	84.53	45.36	44.73	40.03	74.30	94.26	13.54
	32	50.84	66.04	97.39	58.21	42.96	33.66	69.10	91.12	10.12
DAC-SMA-24	2	24.57	50.60	95.21	68.93	45.20	29.83	67.27	97.88	21.80
	8	16.29	39.57	97.20	62.45	44.73	23.97	65.27	87.33	15.86
	32	98.40	98.42	98.96	73.57	43.20	44.60	68.67	87.69	17.12
ST-S-16	2	14.92	34.19	71.36	42.17	54.86	56.80	94.11	73.16	24.23
ST-S-16	8	12.69	30.99	68.36	35.35	55.00	53.83	94.11	96.78	10.45
Mimi-S-24	8	13.96	31.53	91.59	59.18	51.13	53.83	92.18	79.50	18.68
Mimi-S-24	32	13.52	30.77	96.89	58.15	46.76	50.73	91.31	63.93	23.91
DWavL-S-16	2	6.00	14.38	58.98	22.02	61.53	76.33	96.82	76.57	22.41
DWavL-S-16	6	4.32	10.73	48.94	19.66	63.20	78.73	95.89	92.31	13.47
DHuBERT-S-16	2	5.89	14.71	53.51	22.16	55.97	67.00	82.90	86.39	23.15
DHuBERT-S-16	6	4.37	10.92	54.74	20.83	63.00	71.20	88.10	66.53	22.64
DWav2Vec2-S-16	2	4.47	32.87	61.85	28.68	56.43	67.90	93.45	76.86	24.49
DWav2Vec2-S-16	6	6.57	15.94	54.35	23.19	60.63	71.10	96.24	89.76	14.41
SQ-SMA-16	4	11.63	30.91	94.80	94.24	41.30	58.13	92.74	97.38	9.69
WT-SMA-24-2	1	28.69	52.90	97.41	75.82	43.43	15.25	59.13	85.90	19.38

Models/Tasks	#Q	ASR-En		ASR-multiling		ER	IC	KS	SI	SV
		WER ↓		WER ↓		ER	IC	KS	SI	SV
		Clean	Other	Welsh	Basque	ACC ↑	ACC ↑	ACC ↑	ACC ↑	EER ↓
Enc-SMA-24	2	39.16	63.44	90.90	51.00	45.50	42.90	77.73	89.81	18.33
	8	16.83	38.98	84.53	45.36	44.73	40.03	74.30	94.26	13.54
	32	50.84	66.04	97.39	58.21	42.96	33.66	69.10	91.12	10.12
DAC-SMA-24	2	24.57	50.60	95.21	68.93	45.20	29.83	67.27	97.88	21.80
	8	16.29	39.57	97.20	62.45	44.73	23.97	65.27	87.33	15.86
	32	98.40	98.42	98.96	73.57	43.20	44.60	68.67	87.69	17.12
ST-S-16	2	14.92	34.19	71.36	42.17	54.86	56.80	94.11	73.16	24.23
ST-S-16	8	12.69	30.99	68.36	35.35	55.00	53.83	94.11	96.78	10.45
Mimi-S-24	8	13.96	31.53	91.59	59.18	51.13	53.83	92.18	79.50	18.68
Mimi-S-24	32	13.52	30.77	96.89	58.15	46.76	50.73	91.31	63.93	23.91
DWavL-S-16	2	6.00	14.38	58.98	22.02	61.53	76.33	96.82	76.57	22.41
DWavL-S-16	6	4.32	10.73	48.94	19.66	63.20	78.73	95.89	92.31	13.47
DHuBERT-S-16	2	5.89	14.71	53.51	22.16	55.97	67.00	82.90	86.39	23.15
DHuBERT-S-16	6	4.37	10.92	54.74	20.83	63.00	71.20	88.10	66.53	22.64
DWav2Vec2-S-16	2	4.47	32.87	61.85	28.68	56.43	67.90	93.45	76.86	24.49
DWav2Vec2-S-16	6	6.57	15.94	54.35	23.19	60.63	71.10	96.24	89.76	14.41
SQ-SMA-16	4	11.63	30.91	94.80	94.24	41.30	58.13	92.74	97.38	9.69
WT-SMA-24-2	1	28.69	52.90	97.41	75.82	43.43	15.25	59.13	85.90	19.38