This paper presents a data-driven online identification method for battery thermal dynamics in battery thermal management systems. An offline-identified lumped thermal model is used as a nominal battery thermal model, but its accuracy can deteriorate when operating conditions, ambient temperature, and load conditions vary. To improve model accuracy, a concurrent learning-based approach is introduced to learn the unmodeled thermal dynamics online while keeping the estimation errors bounded. The learning rules utilize the informative stored data together with current measurements, thereby improving parameter convergence without requiring continuous persistent excitation. Simulation studies in the MATLAB/Simulink 2025a EV environment show that the proposed method improves long-horizon temperature prediction and reduces rollout RMSE by up to 32.3% compared with the offline model.