The actor was worried after hearing