Host: The Japanese Society for Artificial Intelligence
Name : The 38th Annual Conference of the Japanese Society for Artificial Intelligence
Number : 38
Location : [in Japanese]
Date : May 28, 2024 - May 31, 2024
In our earlier study, we introduced a multimodal neural network designed to assess online interviews and appraise candidates' performance. However, the previous study focused solely on a subset of evaluation criteria named question items that assess distinct sections within the interview process. In this study, our evaluation criteria are extended to observation items that encompass the entire interview process rather than targeting specific sections. Because some samples lack audio modality, we use prompt learning to discern between the samples with completed modalities and those without audio modality. Furthermore, we apply the re-sampling method and margin ranking loss to improve the model robustness on imbalanced distribution. For the experimental results, the prompt learning and class-imbalanced learning methods improved the prediction accuracy, and the proposed model finally achieves an average accuracy of 67.41% in binary classification for the extended eight criteria, providing a more holistic assessment of candidate performance.